2023-10-06T04:24:29.460 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T04:24:29.461 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280/orig.config.yaml 2023-10-06T04:24:29.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:24:29.590 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} email: yweinste@redhat.com first_in_suite: false job_id: '7412280' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi124.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEAVo48XyyqF8WwhIz1EAN5JDzAT7TEbLY2hV1KnF9lHlHfXSpFsGEapl53q0wLw8jLEsJiEnpAsyZfCuQPoQ5s= smithi158.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN0jY6eeKfnzMjCEO7OuloWVye6yPMWpc20GCQTKM8t6nbYP+PPIKt7THWED9cMoULky5wcnzIUcYy1evP1vkMo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_dump_tree teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T04:24:29.590 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T04:24:29.591 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T04:24:29.591 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T04:24:29.593 INFO:teuthology.task.internal:Checking packages... 2023-10-06T04:24:29.621 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T04:24:29.622 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T04:24:29.622 INFO:teuthology.packaging:ref: None 2023-10-06T04:24:29.622 INFO:teuthology.packaging:tag: None 2023-10-06T04:24:29.622 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:24:29.622 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:24:29.622 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:24:29.763 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274.g68e53a4a 2023-10-06T04:24:29.763 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T04:24:29.771 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T04:24:29.771 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T04:24:29.779 INFO:teuthology.task.internal:Saving configuration 2023-10-06T04:24:29.796 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T04:24:29.803 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:24:29.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:18:51.549170', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEAVo48XyyqF8WwhIz1EAN5JDzAT7TEbLY2hV1KnF9lHlHfXSpFsGEapl53q0wLw8jLEsJiEnpAsyZfCuQPoQ5s='} 2023-10-06T04:24:29.850 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:18:51.547670', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN0jY6eeKfnzMjCEO7OuloWVye6yPMWpc20GCQTKM8t6nbYP+PPIKt7THWED9cMoULky5wcnzIUcYy1evP1vkMo='} 2023-10-06T04:24:29.851 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T04:24:29.857 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T04:24:29.857 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T04:24:29.857 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T04:24:30.002 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f73f25dfb80>, signals=[15]) 2023-10-06T04:24:30.003 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T04:24:30.013 INFO:teuthology.task.internal:Opening connections... 2023-10-06T04:24:30.013 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:24:30.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:24:30.081 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:24:30.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:24:30.150 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T04:24:30.155 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-10-06T04:24:30.178 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-10-06T04:24:30.178 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-06T04:24:30.238 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-10-06T04:24:30.239 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8" 2023-10-06T04:24:30.239 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-10-06T04:24:30.239 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-10-06T04:24:30.239 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8" 2023-10-06T04:24:30.239 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:24:30.239 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-06T04:24:30.239 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-06T04:24:30.239 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-06T04:24:30.239 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-10-06T04:24:30.239 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:24:30.240 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:24:30.240 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T04:24:30.240 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-06T04:24:30.273 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-10-06T04:24:30.295 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-10-06T04:24:30.295 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-10-06T04:24:30.355 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-10-06T04:24:30.355 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:24:30.356 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T04:24:30.357 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-10-06T04:24:30.389 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T04:24:30.403 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T04:24:30.410 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T04:24:30.410 DEBUG:teuthology.orchestra.run.smithi124:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:24:30.412 DEBUG:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:24:30.432 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T04:24:30.440 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T04:24:30.440 DEBUG:teuthology.orchestra.run.smithi124:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:24:30.473 DEBUG:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:24:30.499 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T04:24:30.559 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T04:24:30.575 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T04:24:30.576 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-06T04:24:30.576 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-06T04:24:30.576 DEBUG:teuthology.orchestra.run.smithi124:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:24:30.577 DEBUG:teuthology.orchestra.run.smithi158:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:24:30.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:24:30.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-06T04:24:30.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:24:30.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-06T04:24:30.832 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:24:30.832 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T04:24:30.833 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-10-06T04:24:30.841 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:24:30.841 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T04:24:30.841 DEBUG:teuthology.orchestra.run.smithi124:> uname -r 2023-10-06T04:24:30.852 INFO:teuthology.orchestra.run.smithi158.stdout:4.18.0-489.el8.x86_64 2023-10-06T04:24:30.852 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:24:30.853 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T04:24:30.853 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum upgrade -y linux-firmware 2023-10-06T04:24:30.862 INFO:teuthology.orchestra.run.smithi124.stdout:4.18.0-489.el8.x86_64 2023-10-06T04:24:30.862 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:24:30.862 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T04:24:30.863 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum upgrade -y linux-firmware 2023-10-06T04:24:34.742 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - AppStream 28 MB/s | 33 MB 00:01 2023-10-06T04:24:35.148 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - AppStream 20 MB/s | 33 MB 00:01 2023-10-06T04:24:45.501 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - BaseOS 10 MB/s | 48 MB 00:04 2023-10-06T04:24:52.650 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras 114 kB/s | 18 kB 00:00 2023-10-06T04:24:53.176 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 6.9 kB 00:00 2023-10-06T04:24:53.482 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-06T04:24:54.713 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-06T04:24:58.588 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 554 kB/s | 24 kB 00:00 2023-10-06T04:25:01.497 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - BaseOS 2.3 MB/s | 48 MB 00:20 2023-10-06T04:25:02.339 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-06T04:25:02.339 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-06T04:25:02.339 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repo Size 2023-10-06T04:25:02.339 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-06T04:25:02.339 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrading: 2023-10-06T04:25:02.339 INFO:teuthology.orchestra.run.smithi158.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-10-06T04:25:02.339 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:25:02.340 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-06T04:25:02.340 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-06T04:25:02.340 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrade 1 Package 2023-10-06T04:25:02.340 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:25:02.340 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 286 M 2023-10-06T04:25:02.340 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-06T04:25:08.747 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - Extras 57 kB/s | 18 kB 00:00 2023-10-06T04:25:09.323 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-10-06T04:25:09.608 INFO:teuthology.orchestra.run.smithi124.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-06T04:25:10.736 INFO:teuthology.orchestra.run.smithi124.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-10-06T04:25:14.559 INFO:teuthology.orchestra.run.smithi124.stdout:lab-extras 601 kB/s | 24 kB 00:00 2023-10-06T04:25:18.330 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-10-06T04:25:18.331 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-10-06T04:25:18.331 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repo Size 2023-10-06T04:25:18.331 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-10-06T04:25:18.331 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrading: 2023-10-06T04:25:18.331 INFO:teuthology.orchestra.run.smithi124.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-10-06T04:25:18.331 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:25:18.331 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-10-06T04:25:18.331 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-10-06T04:25:18.331 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrade 1 Package 2023-10-06T04:25:18.332 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:25:18.332 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 286 M 2023-10-06T04:25:18.332 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-10-06T04:25:39.601 INFO:teuthology.orchestra.run.smithi124.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 13 MB/s | 286 MB 00:21 2023-10-06T04:25:39.601 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:25:39.601 INFO:teuthology.orchestra.run.smithi124.stdout:Total 13 MB/s | 286 MB 00:21 2023-10-06T04:25:40.211 INFO:teuthology.orchestra.run.smithi158.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 9.4 MB/s | 286 MB 00:30 2023-10-06T04:25:40.211 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:25:40.211 INFO:teuthology.orchestra.run.smithi158.stdout:Total 7.6 MB/s | 286 MB 00:37 2023-10-06T04:25:41.308 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-10-06T04:25:41.389 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-10-06T04:25:41.389 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-10-06T04:25:41.909 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-06T04:25:41.990 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-06T04:25:41.990 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-06T04:25:43.182 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-10-06T04:25:43.214 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-10-06T04:25:43.760 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-06T04:25:43.793 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-06T04:26:02.136 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-10-06T04:26:02.484 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-06T04:26:02.629 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-06T04:26:02.729 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-06T04:26:02.948 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-06T04:26:02.948 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-06T04:26:02.965 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-06T04:26:03.220 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-06T04:26:03.451 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-06T04:26:03.451 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-06T04:26:03.703 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-06T04:26:03.703 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:26:03.704 INFO:teuthology.orchestra.run.smithi124.stdout:Upgraded: 2023-10-06T04:26:03.704 INFO:teuthology.orchestra.run.smithi124.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-10-06T04:26:03.704 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:26:03.704 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-10-06T04:26:03.877 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-06T04:26:03.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:26:04.100 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T04:26:04.100 DEBUG:teuthology.orchestra.run.smithi124:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T04:26:04.103 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi124.front.sepia.ceph.com to complete... 2023-10-06T04:26:04.212 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-06T04:26:04.212 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:26:04.212 INFO:teuthology.orchestra.run.smithi158.stdout:Upgraded: 2023-10-06T04:26:04.212 INFO:teuthology.orchestra.run.smithi158.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-10-06T04:26:04.212 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:26:04.212 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-06T04:26:04.442 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-06T04:26:04.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:26:04.679 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T04:26:04.679 DEBUG:teuthology.orchestra.run.smithi158:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T04:26:04.681 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi158.front.sepia.ceph.com to complete... 2023-10-06T04:26:24.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06 04:26:24 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T04:26:24.075 INFO:teuthology.orchestra.run.smithi124.stderr:FINISHED --2023-10-06 04:26:24-- 2023-10-06T04:26:24.075 INFO:teuthology.orchestra.run.smithi124.stderr:Total wall clock time: 20s 2023-10-06T04:26:24.075 INFO:teuthology.orchestra.run.smithi124.stderr:Downloaded: 1 files, 363M in 20s (18.5 MB/s) 2023-10-06T04:26:24.076 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-06T04:26:24.076 DEBUG:teuthology.orchestra.run.smithi124:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T04:26:25.752 INFO:teuthology.orchestra.run.smithi124.stdout:Verifying... ######################################## 2023-10-06T04:26:25.796 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing... ######################################## 2023-10-06T04:26:25.905 INFO:teuthology.orchestra.run.smithi124.stdout:Updating / installing... 2023-10-06T04:26:48.873 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06 04:26:48 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T04:26:48.873 INFO:teuthology.orchestra.run.smithi158.stderr:FINISHED --2023-10-06 04:26:48-- 2023-10-06T04:26:48.873 INFO:teuthology.orchestra.run.smithi158.stderr:Total wall clock time: 44s 2023-10-06T04:26:48.873 INFO:teuthology.orchestra.run.smithi158.stderr:Downloaded: 1 files, 363M in 44s (8.32 MB/s) 2023-10-06T04:26:48.874 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-06T04:26:48.875 DEBUG:teuthology.orchestra.run.smithi158:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T04:26:50.542 INFO:teuthology.orchestra.run.smithi158.stdout:Verifying... ######################################## 2023-10-06T04:26:50.584 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing... ######################################## 2023-10-06T04:26:50.695 INFO:teuthology.orchestra.run.smithi158.stdout:Updating / installing... 2023-10-06T04:27:03.843 INFO:teuthology.orchestra.run.smithi124.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T04:27:28.652 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T04:27:30.306 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi124.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T04:27:30.307 DEBUG:teuthology.orchestra.run.smithi124:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T04:27:30.339 INFO:teuthology.orchestra.run.smithi124.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:30.339 INFO:teuthology.orchestra.run.smithi124.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:30.339 INFO:teuthology.orchestra.run.smithi124.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:30.339 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:30.339 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T04:27:30.339 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T04:27:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T04:27:30.341 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T04:27:30.342 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T04:27:30.343 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T04:27:30.343 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T04:27:30.343 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T04:27:30.343 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T04:27:30.343 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T04:27:30.343 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T04:27:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T04:27:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T04:27:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T04:27:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T04:27:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T04:27:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T04:27:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T04:27:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T04:27:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T04:27:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T04:27:30.346 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T04:27:30.346 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T04:27:30.346 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T04:27:30.346 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T04:27:30.365 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T04:27:30.365 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T04:27:30.366 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T04:27:30.367 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T04:27:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T04:27:30.369 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T04:27:30.370 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T04:27:30.371 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T04:27:30.372 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T04:27:30.373 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T04:27:30.374 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T04:27:30.375 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T04:27:30.375 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T04:27:30.375 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T04:27:30.375 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T04:27:30.375 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T04:27:30.375 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T04:27:30.375 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T04:27:30.375 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T04:27:30.375 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T04:27:30.375 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T04:27:30.376 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T04:27:30.377 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T04:27:30.378 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T04:27:30.378 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T04:27:30.378 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T04:27:30.378 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T04:27:30.378 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T04:27:30.378 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T04:27:30.378 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T04:27:30.378 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T04:27:30.378 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T04:27:30.379 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T04:27:30.380 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T04:27:30.381 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T04:27:30.382 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T04:27:30.383 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T04:27:30.384 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T04:27:30.385 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T04:27:30.386 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T04:27:30.387 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T04:27:30.388 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T04:27:30.389 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T04:27:30.390 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T04:27:30.391 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T04:27:30.392 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T04:27:30.393 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T04:27:30.394 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T04:27:30.395 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T04:27:30.396 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T04:27:30.397 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T04:27:30.398 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T04:27:30.399 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T04:27:30.400 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T04:27:30.401 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T04:27:30.402 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T04:27:30.403 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T04:27:30.404 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T04:27:30.405 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T04:27:30.406 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T04:27:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T04:27:30.408 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T04:27:30.409 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T04:27:30.410 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T04:27:30.411 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T04:27:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T04:27:30.413 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T04:27:30.414 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T04:27:30.415 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T04:27:30.416 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T04:27:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T04:27:30.418 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T04:27:30.419 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T04:27:30.420 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T04:27:30.421 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T04:27:30.422 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T04:27:30.423 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T04:27:30.424 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T04:27:30.425 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T04:27:30.426 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T04:27:30.427 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T04:27:30.428 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T04:27:30.429 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T04:27:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T04:27:30.431 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T04:27:30.432 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T04:27:30.433 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T04:27:30.434 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T04:27:30.435 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T04:27:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T04:27:30.437 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T04:27:30.438 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T04:27:30.439 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T04:27:30.440 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T04:27:30.441 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T04:27:30.442 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T04:27:30.443 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T04:27:30.444 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T04:27:30.444 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T04:27:30.444 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T04:27:30.444 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T04:27:30.444 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T04:27:30.444 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T04:27:30.444 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T04:27:30.444 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T04:27:30.444 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T04:27:30.444 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T04:27:30.445 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T04:27:30.446 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T04:27:30.447 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T04:27:30.448 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T04:27:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T04:27:30.450 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T04:27:30.451 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T04:27:30.452 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T04:27:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T04:27:30.454 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T04:27:30.455 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T04:27:30.456 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T04:27:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T04:27:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T04:27:30.459 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T04:27:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T04:27:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T04:27:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T04:27:30.463 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T04:27:30.464 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T04:27:30.466 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T04:27:30.467 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T04:27:30.468 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T04:27:30.469 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T04:27:30.470 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T04:27:30.471 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T04:27:30.472 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T04:27:30.473 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T04:27:30.474 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T04:27:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T04:27:30.476 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T04:27:30.477 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T04:27:30.478 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T04:27:30.478 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T04:27:30.478 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T04:27:30.478 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T04:27:30.478 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T04:27:30.478 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T04:27:30.478 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T04:27:30.478 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T04:27:30.478 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T04:27:30.478 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T04:27:30.479 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T04:27:30.480 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T04:27:30.481 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T04:27:30.482 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T04:27:30.483 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T04:27:30.484 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T04:27:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T04:27:30.486 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T04:27:30.487 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T04:27:30.488 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T04:27:30.488 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T04:27:30.488 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T04:27:30.488 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T04:27:30.488 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T04:27:30.488 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T04:27:30.488 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T04:27:30.488 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T04:27:30.488 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T04:27:30.489 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T04:27:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T04:27:30.493 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T04:27:30.493 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T04:27:30.493 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T04:27:30.493 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T04:27:30.493 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T04:27:30.493 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T04:27:30.493 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T04:27:30.493 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T04:27:30.493 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T04:27:30.493 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T04:27:30.494 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T04:27:30.494 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T04:27:30.494 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T04:27:30.494 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T04:27:30.494 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T04:27:30.494 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T04:27:30.494 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T04:27:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T04:27:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T04:27:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T04:27:30.499 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T04:27:30.500 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T04:27:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T04:27:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T04:27:30.503 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T04:27:30.504 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T04:27:30.505 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T04:27:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T04:27:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T04:27:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T04:27:30.509 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T04:27:30.510 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T04:27:30.511 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T04:27:30.512 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T04:27:30.513 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T04:27:30.513 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T04:27:30.513 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T04:27:30.513 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T04:27:30.513 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T04:27:30.513 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T04:27:30.513 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T04:27:30.513 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T04:27:30.513 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T04:27:30.515 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T04:27:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T04:27:30.517 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T04:27:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T04:27:30.519 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T04:27:30.519 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T04:27:30.519 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T04:27:30.519 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T04:27:30.519 INFO:teuthology.orchestra.run.smithi124.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T04:27:30.519 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:30.520 DEBUG:teuthology.orchestra.run.smithi124:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T04:27:30.585 INFO:teuthology.orchestra.run.smithi124.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T04:27:30.585 INFO:teuthology.orchestra.run.smithi124.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T04:27:30.585 INFO:teuthology.orchestra.run.smithi124.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:27:30.585 INFO:teuthology.orchestra.run.smithi124.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:27:30.585 INFO:teuthology.orchestra.run.smithi124.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:fi 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:fi 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T04:27:30.586 INFO:teuthology.orchestra.run.smithi124.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:30.587 INFO:teuthology.orchestra.run.smithi124.stdout:fi 2023-10-06T04:27:30.587 DEBUG:teuthology.orchestra.run.smithi124:> sudo rpm -qi grub2-tools 2023-10-06T04:27:30.668 INFO:teuthology.orchestra.run.smithi124.stdout:Name : grub2-tools 2023-10-06T04:27:30.668 INFO:teuthology.orchestra.run.smithi124.stdout:Epoch : 1 2023-10-06T04:27:30.668 INFO:teuthology.orchestra.run.smithi124.stdout:Version : 2.02 2023-10-06T04:27:30.668 INFO:teuthology.orchestra.run.smithi124.stdout:Release : 129.el8 2023-10-06T04:27:30.668 INFO:teuthology.orchestra.run.smithi124.stdout:Architecture: x86_64 2023-10-06T04:27:30.668 INFO:teuthology.orchestra.run.smithi124.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Group : System Environment/Base 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Size : 9265586 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:License : GPLv3+ 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Relocations : (not relocatable) 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Packager : CentOS BuildSystem 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Vendor : CentOS 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Summary : Support tools for GRUB. 2023-10-06T04:27:30.669 INFO:teuthology.orchestra.run.smithi124.stdout:Description : 2023-10-06T04:27:30.670 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:27:30.670 INFO:teuthology.orchestra.run.smithi124.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:27:30.670 INFO:teuthology.orchestra.run.smithi124.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:27:30.670 INFO:teuthology.orchestra.run.smithi124.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:27:30.670 INFO:teuthology.orchestra.run.smithi124.stdout:hardware devices. 2023-10-06T04:27:30.670 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:27:30.670 INFO:teuthology.orchestra.run.smithi124.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:27:30.671 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:27:30.671 INFO:teuthology.task.kernel:Updating grub on smithi124 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:30.671 DEBUG:teuthology.orchestra.run.smithi124:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:27:33.243 INFO:teuthology.orchestra.run.smithi124.stderr:Generating grub configuration file ... 2023-10-06T04:27:35.800 INFO:teuthology.orchestra.run.smithi124.stderr:done 2023-10-06T04:27:35.802 DEBUG:teuthology.orchestra.run.smithi124:> mktemp 2023-10-06T04:27:35.834 INFO:teuthology.orchestra.run.smithi124.stdout:/tmp/tmp.JP1nTg6w0A 2023-10-06T04:27:35.835 DEBUG:teuthology.orchestra.run.smithi124:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JP1nTg6w0A 2023-10-06T04:27:35.909 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0666 /tmp/tmp.JP1nTg6w0A 2023-10-06T04:27:36.060 DEBUG:teuthology.orchestra.remote:smithi124:/tmp/tmp.JP1nTg6w0A is 6KB 2023-10-06T04:27:36.108 DEBUG:teuthology.orchestra.run.smithi124:> rm -fr /tmp/tmp.JP1nTg6w0A 2023-10-06T04:27:36.126 DEBUG:teuthology.orchestra.run.smithi124:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:27:36.192 INFO:teuthology.orchestra.run.smithi124.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-06T04:27:36.192 INFO:teuthology.orchestra.run.smithi124.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-06T04:27:36.192 INFO:teuthology.orchestra.run.smithi124.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-06T04:27:36.192 INFO:teuthology.orchestra.run.smithi124.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T04:27:36.193 DEBUG:teuthology.orchestra.run.smithi124:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:36.370 DEBUG:teuthology.orchestra.run.smithi124:> sudo shutdown -r now 2023-10-06T04:27:51.907 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi158.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T04:27:51.907 DEBUG:teuthology.orchestra.run.smithi158:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T04:27:51.934 INFO:teuthology.orchestra.run.smithi158.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T04:27:51.935 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T04:27:51.936 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T04:27:51.937 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T04:27:51.937 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T04:27:51.937 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T04:27:51.937 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T04:27:51.937 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T04:27:51.937 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T04:27:51.937 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T04:27:51.937 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T04:27:51.937 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T04:27:51.958 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T04:27:51.958 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T04:27:51.958 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T04:27:51.958 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T04:27:51.959 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T04:27:51.959 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T04:27:51.959 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T04:27:51.959 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T04:27:51.959 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T04:27:51.959 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T04:27:51.959 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T04:27:51.959 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T04:27:51.959 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T04:27:51.959 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T04:27:51.960 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T04:27:51.961 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T04:27:51.961 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T04:27:51.961 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T04:27:51.961 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T04:27:51.961 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T04:27:51.961 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T04:27:51.961 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T04:27:51.961 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T04:27:51.961 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T04:27:51.961 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T04:27:51.962 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T04:27:51.962 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T04:27:51.962 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T04:27:51.962 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T04:27:51.962 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T04:27:51.962 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T04:27:51.962 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T04:27:51.962 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T04:27:51.962 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T04:27:51.962 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T04:27:51.963 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T04:27:51.964 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T04:27:51.965 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T04:27:51.966 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T04:27:51.967 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T04:27:51.967 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T04:27:51.967 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T04:27:51.967 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T04:27:51.967 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T04:27:51.967 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T04:27:51.967 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T04:27:51.967 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T04:27:51.967 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T04:27:51.967 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T04:27:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T04:27:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T04:27:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T04:27:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T04:27:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T04:27:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T04:27:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T04:27:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T04:27:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T04:27:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T04:27:51.969 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T04:27:51.970 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T04:27:51.970 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T04:27:51.970 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T04:27:51.970 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T04:27:51.970 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T04:27:51.970 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T04:27:51.970 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T04:27:51.970 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T04:27:51.970 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T04:27:51.970 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T04:27:51.971 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T04:27:51.972 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T04:27:51.973 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T04:27:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T04:27:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T04:27:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T04:27:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T04:27:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T04:27:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T04:27:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T04:27:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T04:27:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T04:27:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T04:27:51.975 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T04:27:51.975 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T04:27:51.975 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T04:27:51.975 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T04:27:51.975 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T04:27:51.975 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T04:27:51.975 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T04:27:51.975 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T04:27:51.975 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T04:27:51.975 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T04:27:51.976 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T04:27:51.977 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T04:27:51.978 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T04:27:51.979 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T04:27:51.979 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T04:27:51.979 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T04:27:51.979 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T04:27:51.979 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T04:27:51.979 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T04:27:51.979 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T04:27:51.979 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T04:27:51.979 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T04:27:51.979 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T04:27:51.980 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T04:27:51.981 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T04:27:51.982 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T04:27:51.983 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T04:27:51.984 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T04:27:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T04:27:51.986 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T04:27:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T04:27:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T04:27:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T04:27:51.990 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T04:27:51.991 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T04:27:51.992 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T04:27:51.993 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T04:27:51.994 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T04:27:51.995 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T04:27:51.995 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T04:27:51.995 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T04:27:51.995 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T04:27:51.995 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T04:27:51.995 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T04:27:51.995 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T04:27:51.995 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T04:27:51.995 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T04:27:51.996 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T04:27:51.997 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T04:27:51.998 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T04:27:51.999 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T04:27:52.000 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T04:27:52.001 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T04:27:52.002 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T04:27:52.003 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T04:27:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T04:27:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T04:27:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T04:27:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T04:27:52.008 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T04:27:52.009 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T04:27:52.010 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T04:27:52.011 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T04:27:52.012 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T04:27:52.013 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T04:27:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T04:27:52.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T04:27:52.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T04:27:52.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T04:27:52.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T04:27:52.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T04:27:52.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T04:27:52.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T04:27:52.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T04:27:52.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T04:27:52.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T04:27:52.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T04:27:52.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T04:27:52.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T04:27:52.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T04:27:52.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T04:27:52.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T04:27:52.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T04:27:52.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T04:27:52.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T04:27:52.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T04:27:52.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T04:27:52.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T04:27:52.026 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T04:27:52.026 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T04:27:52.026 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T04:27:52.026 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T04:27:52.026 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T04:27:52.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T04:27:52.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T04:27:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T04:27:52.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T04:27:52.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T04:27:52.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T04:27:52.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T04:27:52.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T04:27:52.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T04:27:52.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T04:27:52.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T04:27:52.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T04:27:52.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T04:27:52.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T04:27:52.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T04:27:52.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T04:27:52.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T04:27:52.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T04:27:52.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T04:27:52.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T04:27:52.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T04:27:52.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T04:27:52.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T04:27:52.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T04:27:52.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T04:27:52.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T04:27:52.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T04:27:52.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T04:27:52.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T04:27:52.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T04:27:52.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T04:27:52.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T04:27:52.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T04:27:52.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T04:27:52.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T04:27:52.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T04:27:52.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T04:27:52.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T04:27:52.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T04:27:52.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T04:27:52.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T04:27:52.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T04:27:52.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T04:27:52.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T04:27:52.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T04:27:52.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T04:27:52.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T04:27:52.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T04:27:52.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T04:27:52.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T04:27:52.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T04:27:52.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T04:27:52.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T04:27:52.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T04:27:52.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T04:27:52.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T04:27:52.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T04:27:52.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T04:27:52.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T04:27:52.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T04:27:52.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T04:27:52.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T04:27:52.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T04:27:52.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T04:27:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T04:27:52.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T04:27:52.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T04:27:52.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T04:27:52.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T04:27:52.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T04:27:52.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T04:27:52.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T04:27:52.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T04:27:52.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T04:27:52.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T04:27:52.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T04:27:52.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T04:27:52.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T04:27:52.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T04:27:52.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T04:27:52.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T04:27:52.071 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T04:27:52.072 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T04:27:52.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T04:27:52.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T04:27:52.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T04:27:52.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T04:27:52.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T04:27:52.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T04:27:52.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T04:27:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T04:27:52.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T04:27:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T04:27:52.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T04:27:52.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T04:27:52.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T04:27:52.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T04:27:52.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T04:27:52.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T04:27:52.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T04:27:52.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T04:27:52.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T04:27:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T04:27:52.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T04:27:52.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T04:27:52.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T04:27:52.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T04:27:52.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T04:27:52.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T04:27:52.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T04:27:52.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T04:27:52.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T04:27:52.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T04:27:52.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T04:27:52.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T04:27:52.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T04:27:52.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T04:27:52.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T04:27:52.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T04:27:52.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T04:27:52.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T04:27:52.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T04:27:52.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T04:27:52.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T04:27:52.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T04:27:52.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T04:27:52.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T04:27:52.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T04:27:52.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T04:27:52.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T04:27:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T04:27:52.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T04:27:52.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T04:27:52.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T04:27:52.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T04:27:52.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T04:27:52.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T04:27:52.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T04:27:52.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T04:27:52.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T04:27:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T04:27:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T04:27:52.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T04:27:52.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T04:27:52.131 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:52.131 DEBUG:teuthology.orchestra.run.smithi158:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T04:27:52.157 INFO:teuthology.orchestra.run.smithi158.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T04:27:52.157 INFO:teuthology.orchestra.run.smithi158.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T04:27:52.157 INFO:teuthology.orchestra.run.smithi158.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:27:52.157 INFO:teuthology.orchestra.run.smithi158.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:27:52.157 INFO:teuthology.orchestra.run.smithi158.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:52.157 INFO:teuthology.orchestra.run.smithi158.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:27:52.157 INFO:teuthology.orchestra.run.smithi158.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:fi 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:fi 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:52.158 INFO:teuthology.orchestra.run.smithi158.stdout:fi 2023-10-06T04:27:52.159 DEBUG:teuthology.orchestra.run.smithi158:> sudo rpm -qi grub2-tools 2023-10-06T04:27:52.232 INFO:teuthology.orchestra.run.smithi158.stdout:Name : grub2-tools 2023-10-06T04:27:52.232 INFO:teuthology.orchestra.run.smithi158.stdout:Epoch : 1 2023-10-06T04:27:52.232 INFO:teuthology.orchestra.run.smithi158.stdout:Version : 2.02 2023-10-06T04:27:52.232 INFO:teuthology.orchestra.run.smithi158.stdout:Release : 129.el8 2023-10-06T04:27:52.232 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: x86_64 2023-10-06T04:27:52.232 INFO:teuthology.orchestra.run.smithi158.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-06T04:27:52.233 INFO:teuthology.orchestra.run.smithi158.stdout:Group : System Environment/Base 2023-10-06T04:27:52.233 INFO:teuthology.orchestra.run.smithi158.stdout:Size : 9265586 2023-10-06T04:27:52.233 INFO:teuthology.orchestra.run.smithi158.stdout:License : GPLv3+ 2023-10-06T04:27:52.233 INFO:teuthology.orchestra.run.smithi158.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-06T04:27:52.233 INFO:teuthology.orchestra.run.smithi158.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-06T04:27:52.233 INFO:teuthology.orchestra.run.smithi158.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-06T04:27:52.233 INFO:teuthology.orchestra.run.smithi158.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-06T04:27:52.234 INFO:teuthology.orchestra.run.smithi158.stdout:Relocations : (not relocatable) 2023-10-06T04:27:52.234 INFO:teuthology.orchestra.run.smithi158.stdout:Packager : CentOS BuildSystem 2023-10-06T04:27:52.234 INFO:teuthology.orchestra.run.smithi158.stdout:Vendor : CentOS 2023-10-06T04:27:52.234 INFO:teuthology.orchestra.run.smithi158.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:27:52.234 INFO:teuthology.orchestra.run.smithi158.stdout:Summary : Support tools for GRUB. 2023-10-06T04:27:52.234 INFO:teuthology.orchestra.run.smithi158.stdout:Description : 2023-10-06T04:27:52.235 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:27:52.235 INFO:teuthology.orchestra.run.smithi158.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:27:52.235 INFO:teuthology.orchestra.run.smithi158.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:27:52.235 INFO:teuthology.orchestra.run.smithi158.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:27:52.235 INFO:teuthology.orchestra.run.smithi158.stdout:hardware devices. 2023-10-06T04:27:52.236 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:27:52.236 INFO:teuthology.orchestra.run.smithi158.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:27:52.237 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:27:52.237 INFO:teuthology.task.kernel:Updating grub on smithi158 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:52.238 DEBUG:teuthology.orchestra.run.smithi158:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:27:56.924 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2023-10-06T04:27:58.846 INFO:teuthology.orchestra.run.smithi158.stderr:done 2023-10-06T04:27:58.849 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-10-06T04:27:58.872 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.wZV0hte84k 2023-10-06T04:27:58.872 DEBUG:teuthology.orchestra.run.smithi158:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wZV0hte84k 2023-10-06T04:27:58.947 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.wZV0hte84k 2023-10-06T04:27:59.089 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.wZV0hte84k is 6KB 2023-10-06T04:27:59.137 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.wZV0hte84k 2023-10-06T04:27:59.154 DEBUG:teuthology.orchestra.run.smithi158:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:27:59.223 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-06T04:27:59.223 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-06T04:27:59.223 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-06T04:27:59.223 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T04:27:59.224 DEBUG:teuthology.orchestra.run.smithi158:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:27:59.386 DEBUG:teuthology.orchestra.run.smithi158:> sudo shutdown -r now 2023-10-06T04:28:06.378 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T04:28:06.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T04:28:06.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:24.826 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-06T04:28:29.390 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T04:28:29.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T04:28:29.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:33.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T04:28:33.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:37.022 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-06T04:28:47.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-06T04:28:49.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T04:28:49.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:56.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T04:28:56.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:59.930 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-06T04:29:07.578 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-06T04:29:11.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T04:29:11.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:29:15.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-06T04:29:22.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T04:29:22.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:29:22.916 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-06T04:29:23.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T04:29:23.302 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T04:29:23.302 DEBUG:teuthology.orchestra.run.smithi124:> uname -r 2023-10-06T04:29:23.349 INFO:teuthology.orchestra.run.smithi124.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T04:29:23.349 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:29:23.350 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:29:23.350 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-06T04:29:24.351 DEBUG:teuthology.parallel:result is None 2023-10-06T04:29:30.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T04:29:30.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:29:48.538 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-06T04:30:06.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T04:30:06.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:30:06.843 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-06T04:30:07.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T04:30:07.268 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T04:30:07.269 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-10-06T04:30:07.313 INFO:teuthology.orchestra.run.smithi158.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T04:30:07.314 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:30:07.314 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:30:07.314 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-06T04:30:08.315 DEBUG:teuthology.parallel:result is None 2023-10-06T04:30:08.315 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T04:30:08.325 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T04:30:08.325 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:30:08.330 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:30:08.380 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T04:30:08.392 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T04:30:08.406 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T04:30:08.406 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:30:08.411 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:30:08.495 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T04:30:08.504 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T04:30:08.504 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:30:08.508 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:30:08.638 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:30:08.671 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:30:08.677 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:30:08.714 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:30:08.717 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T04:30:08.726 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T04:30:08.727 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:30:08.731 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:30:08.801 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T04:30:08.811 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T04:30:08.811 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:30:08.815 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:30:08.860 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:30:08.971 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:30:09.059 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:30:09.131 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:30:09.199 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:30:09.199 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:30:09.268 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:30:09.342 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:30:09.412 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:30:09.487 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:30:09.556 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:30:09.557 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:30:09.627 DEBUG:teuthology.orchestra.run.smithi124:> sudo service rsyslog restart 2023-10-06T04:30:09.631 DEBUG:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2023-10-06T04:30:09.751 INFO:teuthology.orchestra.run.smithi124.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:30:09.781 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:30:10.196 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T04:30:10.205 INFO:teuthology.task.internal:Starting timer... 2023-10-06T04:30:10.205 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T04:30:10.218 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T04:30:10.227 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T04:30:10.228 DEBUG:teuthology.orchestra.run.smithi124:> sudo service auditd rotate 2023-10-06T04:30:10.370 INFO:teuthology.orchestra.run.smithi124.stdout:Rotating logs: 2023-10-06T04:30:10.373 DEBUG:teuthology.orchestra.run.smithi158:> sudo service auditd rotate 2023-10-06T04:30:10.509 INFO:teuthology.orchestra.run.smithi158.stdout:Rotating logs: 2023-10-06T04:30:10.512 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T04:30:10.512 DEBUG:teuthology.orchestra.run.smithi124:> /usr/sbin/getenforce 2023-10-06T04:30:10.562 INFO:teuthology.orchestra.run.smithi124.stdout:Permissive 2023-10-06T04:30:10.563 DEBUG:teuthology.orchestra.run.smithi158:> /usr/sbin/getenforce 2023-10-06T04:30:10.613 INFO:teuthology.orchestra.run.smithi158.stdout:Permissive 2023-10-06T04:30:10.614 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi124.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi158.front.sepia.ceph.com': 'permissive'} 2023-10-06T04:30:10.614 DEBUG:teuthology.orchestra.run.smithi124:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:30:10.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:30:10.684 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:30:10.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:30:10.754 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T04:30:10.754 DEBUG:teuthology.orchestra.run.smithi124:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:30:10.822 DEBUG:teuthology.orchestra.run.smithi158:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:30:10.894 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T04:30:10.903 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T04:30:10.903 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T04:30:10.919 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T04:30:10.920 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi124.front.sepia.ceph.com,smithi158.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T04:40:36.439 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi124.front.sepia.ceph.com'), Remote(name='ubuntu@smithi158.front.sepia.ceph.com')] 2023-10-06T04:40:36.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T04:40:36.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:40:36.526 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-06T04:40:36.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T04:40:36.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T04:40:36.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:40:36.728 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-06T04:40:36.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T04:40:36.841 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T04:40:36.853 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T04:40:36.853 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:40:36.853 DEBUG:teuthology.orchestra.run.smithi124:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:40:36.859 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:40:36.859 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:40:36.931 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:40:36.934 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:40:36.965 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:40:36.968 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:40:37.056 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: ntpd: command not found 2023-10-06T04:40:37.061 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: ntpd: command not found 2023-10-06T04:40:37.084 INFO:teuthology.orchestra.run.smithi158.stdout:506 Cannot talk to daemon 2023-10-06T04:40:37.088 INFO:teuthology.orchestra.run.smithi124.stdout:506 Cannot talk to daemon 2023-10-06T04:40:37.118 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:40:37.121 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:40:37.151 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:40:37.153 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:40:37.240 INFO:teuthology.orchestra.run.smithi124.stderr:bash: ntpq: command not found 2023-10-06T04:40:37.243 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi124.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi124.stdout:=============================================================================== 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:37.250 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:40:37.250 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-10-06T04:40:37.251 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:37.251 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:37.251 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:37.251 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:37.252 INFO:teuthology.run_tasks:Running task install... 2023-10-06T04:40:37.260 DEBUG:teuthology.task.install:project ceph 2023-10-06T04:40:37.260 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T04:40:37.260 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T04:40:37.260 INFO:teuthology.task.install:Using flavor: default 2023-10-06T04:40:37.266 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T04:40:37.266 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T04:40:37.267 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T04:40:37.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:40:37.270 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T04:40:37.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:40:37.422 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T04:40:37.422 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T04:40:37.494 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T04:40:37.494 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T04:40:37.591 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:40:37.591 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:40:37.591 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:40:37.660 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:40:37.661 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:40:37.661 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:40:37.662 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:40:37.663 DEBUG:teuthology.orchestra.run.smithi158:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:40:37.733 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:40:37.733 DEBUG:teuthology.orchestra.run.smithi124:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:40:37.773 DEBUG:teuthology.orchestra.run.smithi158:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:40:37.844 DEBUG:teuthology.orchestra.run.smithi124:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:40:37.869 DEBUG:teuthology.orchestra.run.smithi158:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:40:37.939 DEBUG:teuthology.orchestra.run.smithi124:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:40:37.939 INFO:teuthology.orchestra.run.smithi158.stdout:check_obsoletes = 1 2023-10-06T04:40:37.941 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum clean all 2023-10-06T04:40:38.007 INFO:teuthology.orchestra.run.smithi124.stdout:check_obsoletes = 1 2023-10-06T04:40:38.010 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum clean all 2023-10-06T04:40:38.289 INFO:teuthology.orchestra.run.smithi158.stdout:76 files removed 2023-10-06T04:40:38.324 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:40:38.361 INFO:teuthology.orchestra.run.smithi124.stdout:76 files removed 2023-10-06T04:40:38.400 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:40:39.189 INFO:teuthology.orchestra.run.smithi158.stdout:ceph packages for x86_64 244 kB/s | 78 kB 00:00 2023-10-06T04:40:39.326 INFO:teuthology.orchestra.run.smithi124.stdout:ceph packages for x86_64 204 kB/s | 78 kB 00:00 2023-10-06T04:40:39.523 INFO:teuthology.orchestra.run.smithi158.stdout:ceph noarch packages 31 kB/s | 9.2 kB 00:00 2023-10-06T04:40:39.659 INFO:teuthology.orchestra.run.smithi124.stdout:ceph noarch packages 31 kB/s | 9.2 kB 00:00 2023-10-06T04:40:39.866 INFO:teuthology.orchestra.run.smithi158.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2023-10-06T04:40:40.018 INFO:teuthology.orchestra.run.smithi124.stdout:ceph source packages 4.3 kB/s | 1.4 kB 00:00 2023-10-06T04:40:41.108 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - AppStream 27 MB/s | 33 MB 00:01 2023-10-06T04:40:42.851 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - AppStream 12 MB/s | 33 MB 00:02 2023-10-06T04:41:05.932 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - BaseOS 2.7 MB/s | 48 MB 00:17 2023-10-06T04:41:12.717 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - BaseOS 2.0 MB/s | 48 MB 00:23 2023-10-06T04:41:13.764 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras 99 kB/s | 18 kB 00:00 2023-10-06T04:41:14.190 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 6.9 kB 00:00 2023-10-06T04:41:15.366 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - PowerTools 6.3 MB/s | 6.5 MB 00:01 2023-10-06T04:41:16.993 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-06T04:41:18.421 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-10-06T04:41:20.300 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - Extras 56 kB/s | 18 kB 00:00 2023-10-06T04:41:20.709 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - Extras common packages 30 kB/s | 6.9 kB 00:00 2023-10-06T04:41:21.760 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - PowerTools 7.2 MB/s | 6.5 MB 00:00 2023-10-06T04:41:23.094 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 407 kB/s | 24 kB 00:00 2023-10-06T04:41:23.320 INFO:teuthology.orchestra.run.smithi124.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-06T04:41:24.339 INFO:teuthology.orchestra.run.smithi124.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-10-06T04:41:27.458 INFO:teuthology.orchestra.run.smithi158.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:41:27.459 INFO:teuthology.orchestra.run.smithi158.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:41:27.472 INFO:teuthology.orchestra.run.smithi158.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-06T04:41:27.472 INFO:teuthology.orchestra.run.smithi158.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-06T04:41:27.473 INFO:teuthology.orchestra.run.smithi158.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-06T04:41:27.474 INFO:teuthology.orchestra.run.smithi158.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-06T04:41:27.475 INFO:teuthology.orchestra.run.smithi158.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:41:27.477 INFO:teuthology.orchestra.run.smithi158.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:41:27.480 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T04:41:27.481 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T04:41:27.703 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-06T04:41:27.716 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-10-06T04:41:27.717 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-06T04:41:27.717 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-10-06T04:41:27.717 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-06T04:41:27.717 INFO:teuthology.orchestra.run.smithi158.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-06T04:41:27.717 INFO:teuthology.orchestra.run.smithi158.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T04:41:27.717 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T04:41:27.717 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T04:41:27.717 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T04:41:27.718 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T04:41:27.718 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T04:41:27.718 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T04:41:27.718 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T04:41:27.718 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T04:41:27.718 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:41:27.718 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T04:41:27.718 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T04:41:27.718 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T04:41:27.718 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-06T04:41:27.719 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T04:41:27.720 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T04:41:27.720 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T04:41:27.720 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T04:41:27.720 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T04:41:27.720 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:41:27.720 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T04:41:27.721 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-10-06T04:41:27.721 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrading: 2023-10-06T04:41:27.721 INFO:teuthology.orchestra.run.smithi158.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-06T04:41:27.721 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-06T04:41:27.721 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-06T04:41:27.721 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-06T04:41:27.721 INFO:teuthology.orchestra.run.smithi158.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-06T04:41:27.722 INFO:teuthology.orchestra.run.smithi158.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-06T04:41:27.722 INFO:teuthology.orchestra.run.smithi158.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-06T04:41:27.722 INFO:teuthology.orchestra.run.smithi158.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-06T04:41:27.722 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T04:41:27.722 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:41:27.723 INFO:teuthology.orchestra.run.smithi158.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-06T04:41:27.723 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-06T04:41:27.723 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-06T04:41:27.723 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-06T04:41:27.723 INFO:teuthology.orchestra.run.smithi158.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-10-06T04:41:27.723 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-10-06T04:41:27.723 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-06T04:41:27.724 INFO:teuthology.orchestra.run.smithi158.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-10-06T04:41:27.724 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T04:41:27.724 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T04:41:27.724 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T04:41:27.724 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T04:41:27.724 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T04:41:27.724 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:41:27.724 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T04:41:27.725 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T04:41:27.725 INFO:teuthology.orchestra.run.smithi158.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-06T04:41:27.725 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:41:27.725 INFO:teuthology.orchestra.run.smithi158.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-06T04:41:27.725 INFO:teuthology.orchestra.run.smithi158.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-06T04:41:27.725 INFO:teuthology.orchestra.run.smithi158.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-06T04:41:27.725 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T04:41:27.725 INFO:teuthology.orchestra.run.smithi158.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-06T04:41:27.726 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-06T04:41:27.726 INFO:teuthology.orchestra.run.smithi158.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:41:27.726 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-06T04:41:27.726 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-06T04:41:27.726 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T04:41:27.726 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-06T04:41:27.726 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T04:41:27.727 INFO:teuthology.orchestra.run.smithi158.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-06T04:41:27.727 INFO:teuthology.orchestra.run.smithi158.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-06T04:41:27.727 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:41:27.727 INFO:teuthology.orchestra.run.smithi158.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-06T04:41:27.727 INFO:teuthology.orchestra.run.smithi158.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-06T04:41:27.727 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-06T04:41:27.727 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T04:41:27.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-06T04:41:27.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:41:27.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:41:27.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-06T04:41:27.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-06T04:41:27.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:41:27.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:41:27.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-06T04:41:27.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-06T04:41:27.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-06T04:41:27.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:41:27.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:41:27.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-06T04:41:27.732 INFO:teuthology.orchestra.run.smithi158.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-06T04:41:27.733 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:41:27.733 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-06T04:41:27.733 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-10-06T04:41:27.733 INFO:teuthology.orchestra.run.smithi158.stdout:Install 123 Packages 2023-10-06T04:41:27.733 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrade 16 Packages 2023-10-06T04:41:27.733 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:41:27.734 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 209 M 2023-10-06T04:41:27.734 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-06T04:41:28.037 INFO:teuthology.orchestra.run.smithi158.stdout:(1/139): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-10-06T04:41:28.370 INFO:teuthology.orchestra.run.smithi158.stdout:(2/139): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 2.6 MB/s | 877 kB 00:00 2023-10-06T04:41:28.437 INFO:teuthology.orchestra.run.smithi158.stdout:(3/139): ceph-immutable-object-cache-17.2.6-127 2.4 MB/s | 162 kB 00:00 2023-10-06T04:41:28.846 INFO:teuthology.orchestra.run.smithi158.stdout:(4/139): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 5.6 MB/s | 2.3 MB 00:00 2023-10-06T04:41:28.896 INFO:teuthology.orchestra.run.smithi124.stdout:lab-extras 387 kB/s | 24 kB 00:00 2023-10-06T04:41:28.963 INFO:teuthology.orchestra.run.smithi158.stdout:(5/139): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 4.7 MB/s | 5.2 MB 00:01 2023-10-06T04:41:29.155 INFO:teuthology.orchestra.run.smithi158.stdout:(6/139): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 5.1 MB/s | 1.6 MB 00:00 2023-10-06T04:41:29.480 INFO:teuthology.orchestra.run.smithi158.stdout:(7/139): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 7.6 MB/s | 3.9 MB 00:00 2023-10-06T04:41:30.764 INFO:teuthology.orchestra.run.smithi158.stdout:(8/139): ceph-common-17.2.6-1274.g68e53a4a.el8. 8.1 MB/s | 23 MB 00:02 2023-10-06T04:41:30.847 INFO:teuthology.orchestra.run.smithi158.stdout:(9/139): ceph-selinux-17.2.6-1274.g68e53a4a.el8 293 kB/s | 24 kB 00:00 2023-10-06T04:41:31.348 INFO:teuthology.orchestra.run.smithi158.stdout:(10/139): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 7.6 MB/s | 17 MB 00:02 2023-10-06T04:41:31.566 INFO:teuthology.orchestra.run.smithi158.stdout:(11/139): ceph-radosgw-17.2.6-1274.g68e53a4a.el 8.1 MB/s | 17 MB 00:02 2023-10-06T04:41:31.589 INFO:teuthology.orchestra.run.smithi158.stdout:(12/139): cephfs-mirror-17.2.6-1274.g68e53a4a.e 1.0 MB/s | 255 kB 00:00 2023-10-06T04:41:31.623 INFO:teuthology.orchestra.run.smithi158.stdout:(13/139): libcephfs-devel-17.2.6-1274.g68e53a4a 425 kB/s | 25 kB 00:00 2023-10-06T04:41:31.699 INFO:teuthology.orchestra.run.smithi158.stdout:(14/139): libcephsqlite-17.2.6-1274.g68e53a4a.e 2.3 MB/s | 175 kB 00:00 2023-10-06T04:41:31.732 INFO:teuthology.orchestra.run.smithi158.stdout:(15/139): libcephfs2-17.2.6-1274.g68e53a4a.el8. 5.5 MB/s | 797 kB 00:00 2023-10-06T04:41:31.774 INFO:teuthology.orchestra.run.smithi158.stdout:(16/139): librados-devel-17.2.6-1274.g68e53a4a. 1.7 MB/s | 130 kB 00:00 2023-10-06T04:41:31.816 INFO:teuthology.orchestra.run.smithi158.stdout:(17/139): libradosstriper1-17.2.6-1274.g68e53a4 5.9 MB/s | 506 kB 00:00 2023-10-06T04:41:31.891 INFO:teuthology.orchestra.run.smithi158.stdout:(18/139): python3-ceph-argparse-17.2.6-1274.g68 593 kB/s | 45 kB 00:00 2023-10-06T04:41:31.975 INFO:teuthology.orchestra.run.smithi158.stdout:(19/139): python3-ceph-common-17.2.6-1274.g68e5 1.4 MB/s | 115 kB 00:00 2023-10-06T04:41:32.067 INFO:teuthology.orchestra.run.smithi158.stdout:(20/139): python3-cephfs-17.2.6-1274.g68e53a4a. 2.0 MB/s | 190 kB 00:00 2023-10-06T04:41:32.167 INFO:teuthology.orchestra.run.smithi158.stdout:(21/139): python3-rados-17.2.6-1274.g68e53a4a.e 3.6 MB/s | 371 kB 00:00 2023-10-06T04:41:32.267 INFO:teuthology.orchestra.run.smithi158.stdout:(22/139): python3-rbd-17.2.6-1274.g68e53a4a.el8 3.5 MB/s | 358 kB 00:00 2023-10-06T04:41:32.376 INFO:teuthology.orchestra.run.smithi158.stdout:(23/139): librgw2-17.2.6-1274.g68e53a4a.el8.x86 9.2 MB/s | 5.6 MB 00:00 2023-10-06T04:41:32.420 INFO:teuthology.orchestra.run.smithi158.stdout:(24/139): python3-rgw-17.2.6-1274.g68e53a4a.el8 699 kB/s | 107 kB 00:00 2023-10-06T04:41:32.460 INFO:teuthology.orchestra.run.smithi158.stdout:(25/139): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.1 MB/s | 91 kB 00:00 2023-10-06T04:41:32.544 INFO:teuthology.orchestra.run.smithi158.stdout:(26/139): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 2.0 MB/s | 173 kB 00:00 2023-10-06T04:41:32.619 INFO:teuthology.orchestra.run.smithi158.stdout:(27/139): ceph-grafana-dashboards-17.2.6-1274.g 309 kB/s | 23 kB 00:00 2023-10-06T04:41:32.703 INFO:teuthology.orchestra.run.smithi158.stdout:(28/139): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 1.4 MB/s | 121 kB 00:00 2023-10-06T04:41:32.845 INFO:teuthology.orchestra.run.smithi158.stdout:(29/139): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 8.1 MB/s | 3.5 MB 00:00 2023-10-06T04:41:32.945 INFO:teuthology.orchestra.run.smithi158.stdout:(30/139): ceph-mgr-dashboard-17.2.6-1274.g68e53 7.0 MB/s | 1.7 MB 00:00 2023-10-06T04:41:33.054 INFO:teuthology.orchestra.run.smithi158.stdout:(31/139): ceph-mgr-modules-core-17.2.6-1274.g68 2.1 MB/s | 238 kB 00:00 2023-10-06T04:41:33.137 INFO:teuthology.orchestra.run.smithi158.stdout:(32/139): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 571 kB/s | 47 kB 00:00 2023-10-06T04:41:33.194 INFO:teuthology.orchestra.run.smithi124.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:41:33.194 INFO:teuthology.orchestra.run.smithi124.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:41:33.207 INFO:teuthology.orchestra.run.smithi124.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-06T04:41:33.207 INFO:teuthology.orchestra.run.smithi124.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-06T04:41:33.208 INFO:teuthology.orchestra.run.smithi124.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-06T04:41:33.209 INFO:teuthology.orchestra.run.smithi124.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-06T04:41:33.210 INFO:teuthology.orchestra.run.smithi124.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:41:33.212 INFO:teuthology.orchestra.run.smithi124.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:41:33.215 INFO:teuthology.orchestra.run.smithi124.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T04:41:33.216 INFO:teuthology.orchestra.run.smithi124.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T04:41:33.221 INFO:teuthology.orchestra.run.smithi158.stdout:(33/139): ceph-prometheus-alerts-17.2.6-1274.g6 173 kB/s | 14 kB 00:00 2023-10-06T04:41:33.321 INFO:teuthology.orchestra.run.smithi158.stdout:(34/139): ceph-volume-17.2.6-1274.g68e53a4a.el8 2.6 MB/s | 267 kB 00:00 2023-10-06T04:41:33.422 INFO:teuthology.orchestra.run.smithi158.stdout:(35/139): cephadm-17.2.6-1274.g68e53a4a.el8.noa 802 kB/s | 80 kB 00:00 2023-10-06T04:41:33.437 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-10-06T04:41:33.450 INFO:teuthology.orchestra.run.smithi124.stdout:==================================================================================================== 2023-10-06T04:41:33.450 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-10-06T04:41:33.450 INFO:teuthology.orchestra.run.smithi124.stdout:==================================================================================================== 2023-10-06T04:41:33.450 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:41:33.451 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-10-06T04:41:33.452 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-10-06T04:41:33.453 INFO:teuthology.orchestra.run.smithi124.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-06T04:41:33.453 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T04:41:33.453 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T04:41:33.453 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T04:41:33.453 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T04:41:33.453 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T04:41:33.453 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:41:33.453 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T04:41:33.453 INFO:teuthology.orchestra.run.smithi124.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-10-06T04:41:33.453 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrading: 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:41:33.454 INFO:teuthology.orchestra.run.smithi124.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-06T04:41:33.455 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-06T04:41:33.455 INFO:teuthology.orchestra.run.smithi124.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-06T04:41:33.455 INFO:teuthology.orchestra.run.smithi124.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-06T04:41:33.455 INFO:teuthology.orchestra.run.smithi124.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-10-06T04:41:33.455 INFO:teuthology.orchestra.run.smithi124.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-10-06T04:41:33.456 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-10-06T04:41:33.456 INFO:teuthology.orchestra.run.smithi124.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-06T04:41:33.457 INFO:teuthology.orchestra.run.smithi124.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-06T04:41:33.458 INFO:teuthology.orchestra.run.smithi124.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-06T04:41:33.459 INFO:teuthology.orchestra.run.smithi124.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:41:33.460 INFO:teuthology.orchestra.run.smithi124.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-06T04:41:33.460 INFO:teuthology.orchestra.run.smithi124.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:41:33.460 INFO:teuthology.orchestra.run.smithi124.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:41:33.460 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:41:33.460 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T04:41:33.460 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T04:41:33.460 INFO:teuthology.orchestra.run.smithi124.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:41:33.460 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-06T04:41:33.460 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:41:33.461 INFO:teuthology.orchestra.run.smithi124.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-06T04:41:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:41:33.463 INFO:teuthology.orchestra.run.smithi124.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-10-06T04:41:33.464 INFO:teuthology.orchestra.run.smithi124.stdout:==================================================================================================== 2023-10-06T04:41:33.465 INFO:teuthology.orchestra.run.smithi124.stdout:Install 123 Packages 2023-10-06T04:41:33.465 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrade 16 Packages 2023-10-06T04:41:33.465 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:41:33.466 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 209 M 2023-10-06T04:41:33.466 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-10-06T04:41:33.505 INFO:teuthology.orchestra.run.smithi158.stdout:(36/139): cephfs-top-17.2.6-1274.g68e53a4a.el8. 215 kB/s | 18 kB 00:00 2023-10-06T04:41:33.680 INFO:teuthology.orchestra.run.smithi158.stdout:(37/139): ceph-mgr-diskprediction-local-17.2.6- 8.9 MB/s | 7.4 MB 00:00 2023-10-06T04:41:33.839 INFO:teuthology.orchestra.run.smithi158.stdout:(38/139): automake-1.16.1-8.el8.noarch.rpm 2.2 MB/s | 740 kB 00:00 2023-10-06T04:41:33.906 INFO:teuthology.orchestra.run.smithi158.stdout:(39/139): flex-2.6.1-9.el8.x86_64.rpm 4.7 MB/s | 320 kB 00:00 2023-10-06T04:41:33.939 INFO:teuthology.orchestra.run.smithi124.stdout:(1/139): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 30 kB/s | 6.4 kB 00:00 2023-10-06T04:41:33.939 INFO:teuthology.orchestra.run.smithi158.stdout:(40/139): bison-3.0.4-10.el8.x86_64.rpm 2.6 MB/s | 688 kB 00:00 2023-10-06T04:41:33.965 INFO:teuthology.orchestra.run.smithi158.stdout:(41/139): jq-1.6-7.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-10-06T04:41:33.998 INFO:teuthology.orchestra.run.smithi158.stdout:(42/139): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-10-06T04:41:34.065 INFO:teuthology.orchestra.run.smithi158.stdout:(43/139): libtool-2.4.6-25.el8.x86_64.rpm 6.9 MB/s | 709 kB 00:00 2023-10-06T04:41:34.091 INFO:teuthology.orchestra.run.smithi158.stdout:(44/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-10-06T04:41:34.124 INFO:teuthology.orchestra.run.smithi158.stdout:(45/139): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-10-06T04:41:34.564 INFO:teuthology.orchestra.run.smithi124.stdout:(2/139): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.4 MB/s | 877 kB 00:00 2023-10-06T04:41:34.642 INFO:teuthology.orchestra.run.smithi158.stdout:(46/139): ceph-test-17.2.6-1274.g68e53a4a.el8.x 14 MB/s | 52 MB 00:03 2023-10-06T04:41:34.648 INFO:teuthology.orchestra.run.smithi124.stdout:(3/139): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 5.6 MB/s | 5.2 MB 00:00 2023-10-06T04:41:34.698 INFO:teuthology.orchestra.run.smithi124.stdout:(4/139): ceph-immutable-object-cache-17.2.6-127 1.2 MB/s | 162 kB 00:00 2023-10-06T04:41:34.775 INFO:teuthology.orchestra.run.smithi158.stdout:(47/139): openblas-threads-0.3.15-4.el8.x86_64. 7.5 MB/s | 4.9 MB 00:00 2023-10-06T04:41:34.850 INFO:teuthology.orchestra.run.smithi124.stdout:(5/139): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 12 MB/s | 2.3 MB 00:00 2023-10-06T04:41:34.850 INFO:teuthology.orchestra.run.smithi158.stdout:(48/139): openblas-0.3.15-4.el8.x86_64.rpm 6.2 MB/s | 4.7 MB 00:00 2023-10-06T04:41:34.886 INFO:teuthology.orchestra.run.smithi158.stdout:(49/139): python3-jinja2-2.10.1-3.el8.noarch.rp 4.8 MB/s | 538 kB 00:00 2023-10-06T04:41:34.903 INFO:teuthology.orchestra.run.smithi158.stdout:(50/139): python3-jsonpatch-1.21-2.el8.noarch.r 509 kB/s | 27 kB 00:00 2023-10-06T04:41:34.945 INFO:teuthology.orchestra.run.smithi158.stdout:(51/139): python3-jsonpointer-1.10-11.el8.noarc 342 kB/s | 20 kB 00:00 2023-10-06T04:41:34.970 INFO:teuthology.orchestra.run.smithi158.stdout:(52/139): python3-mako-1.0.6-14.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-06T04:41:34.996 INFO:teuthology.orchestra.run.smithi158.stdout:(53/139): python3-markupsafe-0.23-19.el8.x86_64 772 kB/s | 39 kB 00:00 2023-10-06T04:41:35.054 INFO:teuthology.orchestra.run.smithi158.stdout:(54/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-10-06T04:41:35.105 INFO:teuthology.orchestra.run.smithi158.stdout:(55/139): python3-prettytable-0.7.2-14.el8.noar 881 kB/s | 44 kB 00:00 2023-10-06T04:41:35.132 INFO:teuthology.orchestra.run.smithi124.stdout:(6/139): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 14 MB/s | 3.9 MB 00:00 2023-10-06T04:41:35.163 INFO:teuthology.orchestra.run.smithi158.stdout:(56/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-10-06T04:41:35.249 INFO:teuthology.orchestra.run.smithi158.stdout:(57/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.4 MB/s | 126 kB 00:00 2023-10-06T04:41:35.322 INFO:teuthology.orchestra.run.smithi158.stdout:(58/139): python3-numpy-1.14.3-10.el8.x86_64.rp 11 MB/s | 3.7 MB 00:00 2023-10-06T04:41:35.324 INFO:teuthology.orchestra.run.smithi124.stdout:(7/139): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 2.5 MB/s | 1.6 MB 00:00 2023-10-06T04:41:35.339 INFO:teuthology.orchestra.run.smithi158.stdout:(59/139): python3-pyasn1-modules-0.3.7-6.el8.no 1.2 MB/s | 110 kB 00:00 2023-10-06T04:41:35.406 INFO:teuthology.orchestra.run.smithi158.stdout:(60/139): python3-babel-2.5.1-7.el8.noarch.rpm 6.3 MB/s | 4.8 MB 00:00 2023-10-06T04:41:35.423 INFO:teuthology.orchestra.run.smithi158.stdout:(61/139): python3-pytz-2017.2-11.el8.noarch.rpm 566 kB/s | 57 kB 00:00 2023-10-06T04:41:35.473 INFO:teuthology.orchestra.run.smithi158.stdout:(62/139): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2023-10-06T04:41:35.499 INFO:teuthology.orchestra.run.smithi158.stdout:(63/139): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-10-06T04:41:35.524 INFO:teuthology.orchestra.run.smithi158.stdout:(64/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2023-10-06T04:41:36.041 INFO:teuthology.orchestra.run.smithi158.stdout:(65/139): python3-scipy-1.0.0-21.module_el8.5.0 20 MB/s | 14 MB 00:00 2023-10-06T04:41:36.066 INFO:teuthology.orchestra.run.smithi158.stdout:(66/139): elfutils-libelf-devel-0.189-3.el8.x86 109 kB/s | 62 kB 00:00 2023-10-06T04:41:36.174 INFO:teuthology.orchestra.run.smithi124.stdout:(8/139): ceph-osd-17.2.6-1274.g68e53a4a.el8.x86 16 MB/s | 17 MB 00:01 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi158.stdout:(67/139): fuse-2.9.7-17.el8.x86_64.rpm 121 kB/s | 83 kB 00:00 2023-10-06T04:41:36.224 INFO:teuthology.orchestra.run.smithi124.stdout:(9/139): ceph-selinux-17.2.6-1274.g68e53a4a.el8 490 kB/s | 24 kB 00:00 2023-10-06T04:41:36.568 INFO:teuthology.orchestra.run.smithi158.stdout:(68/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 91 kB/s | 48 kB 00:00 2023-10-06T04:41:36.617 INFO:teuthology.orchestra.run.smithi158.stdout:(69/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 46 kB/s | 19 kB 00:00 2023-10-06T04:41:37.118 INFO:teuthology.orchestra.run.smithi158.stdout:(70/139): libcom_err-devel-1.45.6-5.el8.x86_64. 70 kB/s | 39 kB 00:00 2023-10-06T04:41:37.659 INFO:teuthology.orchestra.run.smithi158.stdout:(71/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 352 kB/s | 561 kB 00:01 2023-10-06T04:41:38.034 INFO:teuthology.orchestra.run.smithi158.stdout:(72/139): libgfortran-8.5.0-20.el8.x86_64.rpm 455 kB/s | 645 kB 00:01 2023-10-06T04:41:38.176 INFO:teuthology.orchestra.run.smithi158.stdout:(73/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 91 kB/s | 47 kB 00:00 2023-10-06T04:41:38.202 INFO:teuthology.orchestra.run.smithi158.stdout:(74/139): libquadmath-8.5.0-20.el8.x86_64.rpm 159 kB/s | 172 kB 00:01 2023-10-06T04:41:38.233 INFO:teuthology.orchestra.run.smithi124.stdout:(10/139): ceph-common-17.2.6-1274.g68e53a4a.el8 5.2 MB/s | 23 MB 00:04 2023-10-06T04:41:38.458 INFO:teuthology.orchestra.run.smithi124.stdout:(11/139): ceph-radosgw-17.2.6-1274.g68e53a4a.el 5.4 MB/s | 17 MB 00:03 2023-10-06T04:41:38.483 INFO:teuthology.orchestra.run.smithi124.stdout:(12/139): cephfs-mirror-17.2.6-1274.g68e53a4a.e 1.0 MB/s | 255 kB 00:00 2023-10-06T04:41:38.525 INFO:teuthology.orchestra.run.smithi124.stdout:(13/139): libcephfs-devel-17.2.6-1274.g68e53a4a 373 kB/s | 25 kB 00:00 2023-10-06T04:41:38.609 INFO:teuthology.orchestra.run.smithi124.stdout:(14/139): libcephsqlite-17.2.6-1274.g68e53a4a.e 2.0 MB/s | 175 kB 00:00 2023-10-06T04:41:38.642 INFO:teuthology.orchestra.run.smithi124.stdout:(15/139): libcephfs2-17.2.6-1274.g68e53a4a.el8. 4.9 MB/s | 797 kB 00:00 2023-10-06T04:41:38.693 INFO:teuthology.orchestra.run.smithi124.stdout:(16/139): librados-devel-17.2.6-1274.g68e53a4a. 1.5 MB/s | 130 kB 00:00 2023-10-06T04:41:38.793 INFO:teuthology.orchestra.run.smithi124.stdout:(17/139): libradosstriper1-17.2.6-1274.g68e53a4 3.3 MB/s | 506 kB 00:00 2023-10-06T04:41:38.827 INFO:teuthology.orchestra.run.smithi158.stdout:(75/139): libsepol-devel-2.9-3.el8.x86_64.rpm 134 kB/s | 87 kB 00:00 2023-10-06T04:41:38.868 INFO:teuthology.orchestra.run.smithi124.stdout:(18/139): python3-ceph-argparse-17.2.6-1274.g68 598 kB/s | 45 kB 00:00 2023-10-06T04:41:38.969 INFO:teuthology.orchestra.run.smithi124.stdout:(19/139): python3-ceph-common-17.2.6-1274.g68e5 1.1 MB/s | 115 kB 00:00 2023-10-06T04:41:38.977 INFO:teuthology.orchestra.run.smithi158.stdout:(76/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 129 kB/s | 100 kB 00:00 2023-10-06T04:41:39.061 INFO:teuthology.orchestra.run.smithi124.stdout:(20/139): python3-cephfs-17.2.6-1274.g68e53a4a. 2.0 MB/s | 190 kB 00:00 2023-10-06T04:41:39.094 INFO:teuthology.orchestra.run.smithi158.stdout:(77/139): libselinux-devel-2.9-8.el8.x86_64.rpm 189 kB/s | 200 kB 00:01 2023-10-06T04:41:39.169 INFO:teuthology.orchestra.run.smithi124.stdout:(21/139): python3-rados-17.2.6-1274.g68e53a4a.e 3.3 MB/s | 371 kB 00:00 2023-10-06T04:41:39.270 INFO:teuthology.orchestra.run.smithi158.stdout:(78/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 41 kB/s | 18 kB 00:00 2023-10-06T04:41:39.270 INFO:teuthology.orchestra.run.smithi124.stdout:(22/139): python3-rbd-17.2.6-1274.g68e53a4a.el8 3.5 MB/s | 358 kB 00:00 2023-10-06T04:41:39.520 INFO:teuthology.orchestra.run.smithi158.stdout:(79/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 81 kB/s | 44 kB 00:00 2023-10-06T04:41:39.828 INFO:teuthology.orchestra.run.smithi124.stdout:(23/139): ceph-test-17.2.6-1274.g68e53a4a.el8.x 14 MB/s | 52 MB 00:03 2023-10-06T04:41:39.920 INFO:teuthology.orchestra.run.smithi124.stdout:(24/139): librgw2-17.2.6-1274.g68e53a4a.el8.x86 4.5 MB/s | 5.6 MB 00:01 2023-10-06T04:41:39.979 INFO:teuthology.orchestra.run.smithi124.stdout:(25/139): python3-rgw-17.2.6-1274.g68e53a4a.el8 150 kB/s | 107 kB 00:00 2023-10-06T04:41:39.995 INFO:teuthology.orchestra.run.smithi124.stdout:(26/139): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 544 kB/s | 91 kB 00:00 2023-10-06T04:41:40.046 INFO:teuthology.orchestra.run.smithi124.stdout:(27/139): ceph-grafana-dashboards-17.2.6-1274.g 463 kB/s | 23 kB 00:00 2023-10-06T04:41:40.079 INFO:teuthology.orchestra.run.smithi124.stdout:(28/139): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 1.7 MB/s | 173 kB 00:00 2023-10-06T04:41:40.105 INFO:teuthology.orchestra.run.smithi124.stdout:(29/139): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 2.0 MB/s | 121 kB 00:00 2023-10-06T04:41:40.347 INFO:teuthology.orchestra.run.smithi124.stdout:(30/139): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 8.1 MB/s | 3.5 MB 00:00 2023-10-06T04:41:40.405 INFO:teuthology.orchestra.run.smithi124.stdout:(31/139): ceph-mgr-dashboard-17.2.6-1274.g68e53 5.2 MB/s | 1.7 MB 00:00 2023-10-06T04:41:40.439 INFO:teuthology.orchestra.run.smithi124.stdout:(32/139): ceph-mgr-modules-core-17.2.6-1274.g68 2.5 MB/s | 238 kB 00:00 2023-10-06T04:41:40.481 INFO:teuthology.orchestra.run.smithi124.stdout:(33/139): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 634 kB/s | 47 kB 00:00 2023-10-06T04:41:40.514 INFO:teuthology.orchestra.run.smithi124.stdout:(34/139): ceph-prometheus-alerts-17.2.6-1274.g6 192 kB/s | 14 kB 00:00 2023-10-06T04:41:40.606 INFO:teuthology.orchestra.run.smithi124.stdout:(35/139): ceph-mgr-diskprediction-local-17.2.6- 15 MB/s | 7.4 MB 00:00 2023-10-06T04:41:40.632 INFO:teuthology.orchestra.run.smithi124.stdout:(36/139): cephadm-17.2.6-1274.g68e53a4a.el8.noa 687 kB/s | 80 kB 00:00 2023-10-06T04:41:40.657 INFO:teuthology.orchestra.run.smithi124.stdout:(37/139): cephfs-top-17.2.6-1274.g68e53a4a.el8. 356 kB/s | 18 kB 00:00 2023-10-06T04:41:40.690 INFO:teuthology.orchestra.run.smithi124.stdout:(38/139): ceph-volume-17.2.6-1274.g68e53a4a.el8 1.2 MB/s | 267 kB 00:00 2023-10-06T04:41:40.703 INFO:teuthology.orchestra.run.smithi158.stdout:(80/139): pcre2-devel-10.32-3.el8.x86_64.rpm 422 kB/s | 605 kB 00:01 2023-10-06T04:41:40.729 INFO:teuthology.orchestra.run.smithi158.stdout:(81/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 190 kB/s | 229 kB 00:01 2023-10-06T04:41:40.916 INFO:teuthology.orchestra.run.smithi124.stdout:(39/139): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2023-10-06T04:41:40.941 INFO:teuthology.orchestra.run.smithi124.stdout:(40/139): bison-3.0.4-10.el8.x86_64.rpm 2.4 MB/s | 688 kB 00:00 2023-10-06T04:41:40.974 INFO:teuthology.orchestra.run.smithi124.stdout:(41/139): automake-1.16.1-8.el8.noarch.rpm 2.1 MB/s | 740 kB 00:00 2023-10-06T04:41:41.000 INFO:teuthology.orchestra.run.smithi124.stdout:(42/139): jq-1.6-7.el8.x86_64.rpm 2.4 MB/s | 202 kB 00:00 2023-10-06T04:41:41.033 INFO:teuthology.orchestra.run.smithi124.stdout:(43/139): librdkafka-0.11.4-3.el8.x86_64.rpm 3.7 MB/s | 354 kB 00:00 2023-10-06T04:41:41.059 INFO:teuthology.orchestra.run.smithi124.stdout:(44/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-10-06T04:41:41.101 INFO:teuthology.orchestra.run.smithi124.stdout:(45/139): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2023-10-06T04:41:41.126 INFO:teuthology.orchestra.run.smithi124.stdout:(46/139): oniguruma-6.8.2-2.el8.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-10-06T04:41:41.254 INFO:teuthology.orchestra.run.smithi158.stdout:(82/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 1.5 MB/s | 3.2 MB 00:02 2023-10-06T04:41:41.460 INFO:teuthology.orchestra.run.smithi124.stdout:(47/139): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-10-06T04:41:41.526 INFO:teuthology.orchestra.run.smithi124.stdout:(48/139): openblas-threads-0.3.15-4.el8.x86_64. 11 MB/s | 4.9 MB 00:00 2023-10-06T04:41:41.593 INFO:teuthology.orchestra.run.smithi124.stdout:(49/139): python3-babel-2.5.1-7.el8.noarch.rpm 10 MB/s | 4.8 MB 00:00 2023-10-06T04:41:41.611 INFO:teuthology.orchestra.run.smithi124.stdout:(50/139): python3-jsonpatch-1.21-2.el8.noarch.r 316 kB/s | 27 kB 00:00 2023-10-06T04:41:41.636 INFO:teuthology.orchestra.run.smithi124.stdout:(51/139): python3-jinja2-2.10.1-3.el8.noarch.rp 3.0 MB/s | 538 kB 00:00 2023-10-06T04:41:41.653 INFO:teuthology.orchestra.run.smithi124.stdout:(52/139): python3-jsonpointer-1.10-11.el8.noarc 339 kB/s | 20 kB 00:00 2023-10-06T04:41:41.686 INFO:teuthology.orchestra.run.smithi124.stdout:(53/139): python3-mako-1.0.6-14.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-10-06T04:41:41.712 INFO:teuthology.orchestra.run.smithi124.stdout:(54/139): python3-markupsafe-0.23-19.el8.x86_64 513 kB/s | 39 kB 00:00 2023-10-06T04:41:41.737 INFO:teuthology.orchestra.run.smithi158.stdout:(83/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 213 kB/s | 220 kB 00:01 2023-10-06T04:41:41.745 INFO:teuthology.orchestra.run.smithi124.stdout:(55/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-10-06T04:41:41.762 INFO:teuthology.orchestra.run.smithi124.stdout:(56/139): python3-prettytable-0.7.2-14.el8.noar 875 kB/s | 44 kB 00:00 2023-10-06T04:41:41.763 INFO:teuthology.orchestra.run.smithi158.stdout:(84/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 241 kB/s | 249 kB 00:01 2023-10-06T04:41:41.804 INFO:teuthology.orchestra.run.smithi124.stdout:(57/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-10-06T04:41:41.829 INFO:teuthology.orchestra.run.smithi124.stdout:(58/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.8 MB/s | 126 kB 00:00 2023-10-06T04:41:41.863 INFO:teuthology.orchestra.run.smithi124.stdout:(59/139): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-10-06T04:41:41.888 INFO:teuthology.orchestra.run.smithi124.stdout:(60/139): python3-pytz-2017.2-11.el8.noarch.rpm 977 kB/s | 57 kB 00:00 2023-10-06T04:41:41.963 INFO:teuthology.orchestra.run.smithi124.stdout:(61/139): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2023-10-06T04:41:41.997 INFO:teuthology.orchestra.run.smithi124.stdout:(62/139): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2023-10-06T04:41:42.031 INFO:teuthology.orchestra.run.smithi124.stdout:(63/139): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-10-06T04:41:42.056 INFO:teuthology.orchestra.run.smithi124.stdout:(64/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-10-06T04:41:42.296 INFO:teuthology.orchestra.run.smithi158.stdout:(85/139): python3-jwt-1.6.1-2.el8.noarch.rpm 76 kB/s | 43 kB 00:00 2023-10-06T04:41:42.316 INFO:teuthology.orchestra.run.smithi124.stdout:[MIRROR] fuse-2.9.7-17.el8.x86_64.rpm: Status code: 503 for http://mirrors.rcs.alaska.edu/centos/8-stream/BaseOS/x86_64/os/Packages/fuse-2.9.7-17.el8.x86_64.rpm (IP: 199.165.82.202) 2023-10-06T04:41:42.515 INFO:teuthology.orchestra.run.smithi124.stdout:(65/139): python3-scipy-1.0.0-21.module_el8.5.0 21 MB/s | 14 MB 00:00 2023-10-06T04:41:42.671 INFO:teuthology.orchestra.run.smithi158.stdout:(86/139): python3-cryptography-3.2.1-6.el8.x86_ 452 kB/s | 641 kB 00:01 2023-10-06T04:41:42.705 INFO:teuthology.orchestra.run.smithi158.stdout:(87/139): python3-oauthlib-2.1.0-1.el8.noarch.r 164 kB/s | 155 kB 00:00 2023-10-06T04:41:42.706 INFO:teuthology.orchestra.run.smithi124.stdout:(66/139): elfutils-libelf-devel-0.189-3.el8.x86 91 kB/s | 62 kB 00:00 2023-10-06T04:41:42.774 INFO:teuthology.orchestra.run.smithi124.stdout:(67/139): fuse-2.9.7-17.el8.x86_64.rpm 116 kB/s | 83 kB 00:00 2023-10-06T04:41:42.774 INFO:teuthology.orchestra.run.smithi124.stdout:[MIRROR] keyutils-libs-devel-1.5.10-9.el8.x86_64.rpm: Status code: 503 for http://mirrors.rcs.alaska.edu/centos/8-stream/BaseOS/x86_64/os/Packages/keyutils-libs-devel-1.5.10-9.el8.x86_64.rpm (IP: 199.165.82.202) 2023-10-06T04:41:42.882 INFO:teuthology.orchestra.run.smithi124.stdout:(68/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 131 kB/s | 48 kB 00:00 2023-10-06T04:41:43.072 INFO:teuthology.orchestra.run.smithi158.stdout:(88/139): python3-pycparser-2.14-14.el8.noarch. 141 kB/s | 109 kB 00:00 2023-10-06T04:41:43.074 INFO:teuthology.orchestra.run.smithi124.stdout:(69/139): libcom_err-devel-1.45.6-5.el8.x86_64. 202 kB/s | 39 kB 00:00 2023-10-06T04:41:43.182 INFO:teuthology.orchestra.run.smithi124.stdout:(70/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 46 kB/s | 19 kB 00:00 2023-10-06T04:41:43.189 INFO:teuthology.orchestra.run.smithi158.stdout:(89/139): python3-requests-oauthlib-1.0.0-1.el8 82 kB/s | 43 kB 00:00 2023-10-06T04:41:43.423 INFO:teuthology.orchestra.run.smithi158.stdout:(90/139): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-10-06T04:41:43.458 INFO:teuthology.orchestra.run.smithi124.stdout:(71/139): libgfortran-8.5.0-20.el8.x86_64.rpm 1.6 MB/s | 645 kB 00:00 2023-10-06T04:41:43.473 INFO:teuthology.orchestra.run.smithi158.stdout:(91/139): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2023-10-06T04:41:43.490 INFO:teuthology.orchestra.run.smithi158.stdout:(92/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 95 kB/s | 74 kB 00:00 2023-10-06T04:41:43.532 INFO:teuthology.orchestra.run.smithi158.stdout:(93/139): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-10-06T04:41:43.582 INFO:teuthology.orchestra.run.smithi158.stdout:(94/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 870 kB/s | 44 kB 00:00 2023-10-06T04:41:43.599 INFO:teuthology.orchestra.run.smithi158.stdout:(95/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 110 kB/s | 58 kB 00:00 2023-10-06T04:41:43.649 INFO:teuthology.orchestra.run.smithi158.stdout:(96/139): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-10-06T04:41:43.699 INFO:teuthology.orchestra.run.smithi158.stdout:(97/139): python3-certifi-2018.10.15-7.el8.noar 327 kB/s | 16 kB 00:00 2023-10-06T04:41:43.750 INFO:teuthology.orchestra.run.smithi158.stdout:(98/139): python3-cachetools-3.1.1-4.el8.noarch 219 kB/s | 33 kB 00:00 2023-10-06T04:41:43.775 INFO:teuthology.orchestra.run.smithi158.stdout:(99/139): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-10-06T04:41:43.800 INFO:teuthology.orchestra.run.smithi158.stdout:(100/139): python3-asyncssh-2.7.0-2.el8.noarch. 1.5 MB/s | 476 kB 00:00 2023-10-06T04:41:43.842 INFO:teuthology.orchestra.run.smithi158.stdout:(101/139): python3-google-auth-1.1.1-10.el8.noa 1.2 MB/s | 81 kB 00:00 2023-10-06T04:41:43.867 INFO:teuthology.orchestra.run.smithi158.stdout:(102/139): python3-jaraco-6.2-6.el8.noarch.rpm 167 kB/s | 11 kB 00:00 2023-10-06T04:41:43.883 INFO:teuthology.orchestra.run.smithi124.stdout:(72/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 110 kB/s | 47 kB 00:00 2023-10-06T04:41:43.893 INFO:teuthology.orchestra.run.smithi158.stdout:(103/139): python3-jaraco-functools-2.0-4.el8.n 351 kB/s | 18 kB 00:00 2023-10-06T04:41:43.908 INFO:teuthology.orchestra.run.smithi124.stdout:(73/139): libquadmath-8.5.0-20.el8.x86_64.rpm 238 kB/s | 172 kB 00:00 2023-10-06T04:41:43.960 INFO:teuthology.orchestra.run.smithi158.stdout:(104/139): python3-logutils-0.3.5-11.el8.noarch 730 kB/s | 49 kB 00:00 2023-10-06T04:41:43.987 INFO:teuthology.orchestra.run.smithi158.stdout:(105/139): python3-cherrypy-18.4.0-1.el8.noarch 1.6 MB/s | 384 kB 00:00 2023-10-06T04:41:44.019 INFO:teuthology.orchestra.run.smithi158.stdout:(106/139): python3-kubernetes-11.0.0-6.el8.noar 7.7 MB/s | 1.2 MB 00:00 2023-10-06T04:41:44.044 INFO:teuthology.orchestra.run.smithi158.stdout:(107/139): python3-more-itertools-7.2.0-3.el8.n 700 kB/s | 59 kB 00:00 2023-10-06T04:41:44.069 INFO:teuthology.orchestra.run.smithi158.stdout:(108/139): python3-natsort-7.1.1-2.el8.noarch.r 720 kB/s | 60 kB 00:00 2023-10-06T04:41:44.075 INFO:teuthology.orchestra.run.smithi124.stdout:(74/139): libselinux-devel-2.9-8.el8.x86_64.rpm 1.0 MB/s | 200 kB 00:00 2023-10-06T04:41:44.095 INFO:teuthology.orchestra.run.smithi158.stdout:(109/139): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-10-06T04:41:44.128 INFO:teuthology.orchestra.run.smithi158.stdout:(110/139): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2023-10-06T04:41:44.142 INFO:teuthology.orchestra.run.smithi124.stdout:(75/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 391 kB/s | 561 kB 00:01 2023-10-06T04:41:44.154 INFO:teuthology.orchestra.run.smithi158.stdout:(111/139): python3-repoze-lru-0.7-6.el8.noarch. 402 kB/s | 34 kB 00:00 2023-10-06T04:41:44.179 INFO:teuthology.orchestra.run.smithi158.stdout:(112/139): python3-routes-2.4.1-12.el8.noarch.r 2.3 MB/s | 196 kB 00:00 2023-10-06T04:41:44.204 INFO:teuthology.orchestra.run.smithi158.stdout:(113/139): python3-rsa-4.9-2.el8.noarch.rpm 851 kB/s | 64 kB 00:00 2023-10-06T04:41:44.229 INFO:teuthology.orchestra.run.smithi158.stdout:(114/139): python3-simplegeneric-0.8.1-17.el8.n 249 kB/s | 19 kB 00:00 2023-10-06T04:41:44.280 INFO:teuthology.orchestra.run.smithi158.stdout:(115/139): python3-singledispatch-3.4.0.3-18.el 238 kB/s | 24 kB 00:00 2023-10-06T04:41:44.305 INFO:teuthology.orchestra.run.smithi158.stdout:(116/139): python3-tempora-1.14.1-5.el8.noarch. 291 kB/s | 29 kB 00:00 2023-10-06T04:41:44.330 INFO:teuthology.orchestra.run.smithi158.stdout:(117/139): python3-trustme-0.6.0-4.el8.noarch.r 274 kB/s | 27 kB 00:00 2023-10-06T04:41:44.356 INFO:teuthology.orchestra.run.smithi158.stdout:(118/139): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2023-10-06T04:41:44.359 INFO:teuthology.orchestra.run.smithi124.stdout:(76/139): libsepol-devel-2.9-3.el8.x86_64.rpm 193 kB/s | 87 kB 00:00 2023-10-06T04:41:44.398 INFO:teuthology.orchestra.run.smithi158.stdout:(119/139): python3-websocket-client-0.56.0-5.el 919 kB/s | 61 kB 00:00 2023-10-06T04:41:44.423 INFO:teuthology.orchestra.run.smithi158.stdout:(120/139): python3-webtest-2.0.33-1.el8.noarch. 1.2 MB/s | 85 kB 00:00 2023-10-06T04:41:44.448 INFO:teuthology.orchestra.run.smithi158.stdout:(121/139): python3-webob-1.8.5-1.el8.1.noarch.r 2.1 MB/s | 251 kB 00:00 2023-10-06T04:41:44.474 INFO:teuthology.orchestra.run.smithi158.stdout:(122/139): python3-zc-lockfile-2.0-2.el8.noarch 304 kB/s | 23 kB 00:00 2023-10-06T04:41:44.574 INFO:teuthology.orchestra.run.smithi158.stdout:(123/139): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-10-06T04:41:44.776 INFO:teuthology.orchestra.run.smithi124.stdout:(77/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 142 kB/s | 100 kB 00:00 2023-10-06T04:41:44.959 INFO:teuthology.orchestra.run.smithi124.stdout:(78/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 22 kB/s | 18 kB 00:00 2023-10-06T04:41:45.066 INFO:teuthology.orchestra.run.smithi158.stdout:(124/139): librados2-17.2.6-1274.g68e53a4a.el8. 5.5 MB/s | 3.4 MB 00:00 2023-10-06T04:41:45.141 INFO:teuthology.orchestra.run.smithi158.stdout:(125/139): librbd1-17.2.6-1274.g68e53a4a.el8.x8 5.3 MB/s | 3.5 MB 00:00 2023-10-06T04:41:45.160 INFO:teuthology.orchestra.run.smithi124.stdout:(79/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 55 kB/s | 44 kB 00:00 2023-10-06T04:41:45.491 INFO:teuthology.orchestra.run.smithi158.stdout:(126/139): NetworkManager-initscripts-updown-1. 156 kB/s | 143 kB 00:00 2023-10-06T04:41:45.725 INFO:teuthology.orchestra.run.smithi158.stdout:(127/139): elfutils-debuginfod-client-0.189-3.e 115 kB/s | 76 kB 00:00 2023-10-06T04:41:45.819 INFO:teuthology.orchestra.run.smithi124.stdout:(80/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 348 kB/s | 229 kB 00:00 2023-10-06T04:41:45.869 INFO:teuthology.orchestra.run.smithi124.stdout:(81/139): pcre2-devel-10.32-3.el8.x86_64.rpm 665 kB/s | 605 kB 00:00 2023-10-06T04:41:45.927 INFO:teuthology.orchestra.run.smithi124.stdout:(82/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-10-06T04:41:46.077 INFO:teuthology.orchestra.run.smithi124.stdout:(83/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 2.4 MB/s | 3.2 MB 00:01 2023-10-06T04:41:46.119 INFO:teuthology.orchestra.run.smithi124.stdout:(84/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 995 kB/s | 249 kB 00:00 2023-10-06T04:41:46.392 INFO:teuthology.orchestra.run.smithi158.stdout:(128/139): elfutils-libelf-0.189-3.el8.x86_64.r 185 kB/s | 232 kB 00:01 2023-10-06T04:41:46.436 INFO:teuthology.orchestra.run.smithi124.stdout:(85/139): python3-cryptography-3.2.1-6.el8.x86_ 1.2 MB/s | 641 kB 00:00 2023-10-06T04:41:46.520 INFO:teuthology.orchestra.run.smithi124.stdout:(86/139): python3-jwt-1.6.1-2.el8.noarch.rpm 96 kB/s | 43 kB 00:00 2023-10-06T04:41:46.728 INFO:teuthology.orchestra.run.smithi124.stdout:(87/139): python3-oauthlib-2.1.0-1.el8.noarch.r 254 kB/s | 155 kB 00:00 2023-10-06T04:41:46.809 INFO:teuthology.orchestra.run.smithi158.stdout:(129/139): elfutils-libs-0.189-3.el8.x86_64.rpm 230 kB/s | 303 kB 00:01 2023-10-06T04:41:46.920 INFO:teuthology.orchestra.run.smithi124.stdout:(88/139): python3-pycparser-2.14-14.el8.noarch. 225 kB/s | 109 kB 00:00 2023-10-06T04:41:47.121 INFO:teuthology.orchestra.run.smithi124.stdout:(89/139): python3-requests-oauthlib-1.0.0-1.el8 71 kB/s | 43 kB 00:00 2023-10-06T04:41:47.284 INFO:teuthology.orchestra.run.smithi158.stdout:(130/139): iproute-6.2.0-5.el8.x86_64.rpm 548 kB/s | 854 kB 00:01 2023-10-06T04:41:47.321 INFO:teuthology.orchestra.run.smithi124.stdout:(90/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 126 kB/s | 74 kB 00:00 2023-10-06T04:41:47.468 INFO:teuthology.orchestra.run.smithi158.stdout:(131/139): libblkid-2.32.1-43.el8.x86_64.rpm 205 kB/s | 220 kB 00:01 2023-10-06T04:41:47.521 INFO:teuthology.orchestra.run.smithi124.stdout:(91/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 97 kB/s | 58 kB 00:00 2023-10-06T04:41:47.596 INFO:teuthology.orchestra.run.smithi124.stdout:(92/139): liboath-2.6.2-3.el8.x86_64.rpm 214 kB/s | 59 kB 00:00 2023-10-06T04:41:47.697 INFO:teuthology.orchestra.run.smithi124.stdout:(93/139): gperftools-libs-2.7-9.el8.x86_64.rpm 532 kB/s | 306 kB 00:00 2023-10-06T04:41:47.782 INFO:teuthology.orchestra.run.smithi124.stdout:(94/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 526 kB/s | 44 kB 00:00 2023-10-06T04:41:47.839 INFO:teuthology.orchestra.run.smithi124.stdout:(95/139): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2023-10-06T04:41:47.865 INFO:teuthology.orchestra.run.smithi124.stdout:(96/139): libunwind-1.3.1-3.el8.x86_64.rpm 219 kB/s | 75 kB 00:00 2023-10-06T04:41:47.889 INFO:teuthology.orchestra.run.smithi124.stdout:(97/139): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-10-06T04:41:47.914 INFO:teuthology.orchestra.run.smithi124.stdout:(98/139): python3-cachetools-3.1.1-4.el8.noarch 438 kB/s | 33 kB 00:00 2023-10-06T04:41:47.948 INFO:teuthology.orchestra.run.smithi124.stdout:(99/139): python3-certifi-2018.10.15-7.el8.noar 194 kB/s | 16 kB 00:00 2023-10-06T04:41:47.982 INFO:teuthology.orchestra.run.smithi124.stdout:(100/139): python3-cheroot-8.5.2-1.el8.noarch.r 1.8 MB/s | 173 kB 00:00 2023-10-06T04:41:48.015 INFO:teuthology.orchestra.run.smithi124.stdout:(101/139): python3-cherrypy-18.4.0-1.el8.noarch 3.7 MB/s | 384 kB 00:00 2023-10-06T04:41:48.057 INFO:teuthology.orchestra.run.smithi124.stdout:(102/139): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-10-06T04:41:48.068 INFO:teuthology.orchestra.run.smithi158.stdout:(132/139): libfdisk-2.32.1-43.el8.x86_64.rpm 202 kB/s | 254 kB 00:01 2023-10-06T04:41:48.082 INFO:teuthology.orchestra.run.smithi124.stdout:(103/139): python3-google-auth-1.1.1-10.el8.noa 607 kB/s | 81 kB 00:00 2023-10-06T04:41:48.108 INFO:teuthology.orchestra.run.smithi124.stdout:(104/139): python3-jaraco-functools-2.0-4.el8.n 191 kB/s | 18 kB 00:00 2023-10-06T04:41:48.175 INFO:teuthology.orchestra.run.smithi124.stdout:(105/139): python3-logutils-0.3.5-11.el8.noarch 530 kB/s | 49 kB 00:00 2023-10-06T04:41:48.200 INFO:teuthology.orchestra.run.smithi124.stdout:(106/139): python3-more-itertools-7.2.0-3.el8.n 640 kB/s | 59 kB 00:00 2023-10-06T04:41:48.275 INFO:teuthology.orchestra.run.smithi124.stdout:(107/139): python3-kubernetes-11.0.0-6.el8.noar 5.4 MB/s | 1.2 MB 00:00 2023-10-06T04:41:48.301 INFO:teuthology.orchestra.run.smithi124.stdout:(108/139): python3-natsort-7.1.1-2.el8.noarch.r 481 kB/s | 60 kB 00:00 2023-10-06T04:41:48.326 INFO:teuthology.orchestra.run.smithi124.stdout:(109/139): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-10-06T04:41:48.360 INFO:teuthology.orchestra.run.smithi124.stdout:(110/139): python3-portend-2.6-1.el8.noarch.rpm 185 kB/s | 16 kB 00:00 2023-10-06T04:41:48.385 INFO:teuthology.orchestra.run.smithi124.stdout:(111/139): python3-repoze-lru-0.7-6.el8.noarch. 400 kB/s | 34 kB 00:00 2023-10-06T04:41:48.402 INFO:teuthology.orchestra.run.smithi158.stdout:(133/139): libmount-2.32.1-43.el8.x86_64.rpm 212 kB/s | 236 kB 00:01 2023-10-06T04:41:48.410 INFO:teuthology.orchestra.run.smithi124.stdout:(112/139): python3-routes-2.4.1-12.el8.noarch.r 2.3 MB/s | 196 kB 00:00 2023-10-06T04:41:48.427 INFO:teuthology.orchestra.run.smithi158.stdout:(134/139): libsmartcols-2.32.1-43.el8.x86_64.rp 187 kB/s | 179 kB 00:00 2023-10-06T04:41:48.435 INFO:teuthology.orchestra.run.smithi124.stdout:(113/139): python3-rsa-4.9-2.el8.noarch.rpm 854 kB/s | 64 kB 00:00 2023-10-06T04:41:48.487 INFO:teuthology.orchestra.run.smithi124.stdout:(114/139): python3-simplegeneric-0.8.1-17.el8.n 187 kB/s | 19 kB 00:00 2023-10-06T04:41:48.519 INFO:teuthology.orchestra.run.smithi124.stdout:(115/139): python3-singledispatch-3.4.0.3-18.el 220 kB/s | 24 kB 00:00 2023-10-06T04:41:48.544 INFO:teuthology.orchestra.run.smithi124.stdout:(116/139): python3-tempora-1.14.1-5.el8.noarch. 269 kB/s | 29 kB 00:00 2023-10-06T04:41:48.570 INFO:teuthology.orchestra.run.smithi124.stdout:(117/139): python3-trustme-0.6.0-4.el8.noarch.r 329 kB/s | 27 kB 00:00 2023-10-06T04:41:48.628 INFO:teuthology.orchestra.run.smithi124.stdout:(118/139): python3-waitress-1.4.3-1.el8.noarch. 3.0 MB/s | 255 kB 00:00 2023-10-06T04:41:48.795 INFO:teuthology.orchestra.run.smithi124.stdout:(119/139): python3-webob-1.8.5-1.el8.1.noarch.r 1.0 MB/s | 251 kB 00:00 2023-10-06T04:41:48.821 INFO:teuthology.orchestra.run.smithi124.stdout:(120/139): python3-websocket-client-0.56.0-5.el 244 kB/s | 61 kB 00:00 2023-10-06T04:41:48.846 INFO:teuthology.orchestra.run.smithi124.stdout:(121/139): python3-webtest-2.0.33-1.el8.noarch. 393 kB/s | 85 kB 00:00 2023-10-06T04:41:48.871 INFO:teuthology.orchestra.run.smithi124.stdout:(122/139): python3-zc-lockfile-2.0-2.el8.noarch 305 kB/s | 23 kB 00:00 2023-10-06T04:41:48.985 INFO:teuthology.orchestra.run.smithi158.stdout:(135/139): libuuid-2.32.1-43.el8.x86_64.rpm 108 kB/s | 99 kB 00:00 2023-10-06T04:41:49.121 INFO:teuthology.orchestra.run.smithi124.stdout:(123/139): thrift-0.13.0-2.el8.x86_64.rpm 5.8 MB/s | 1.7 MB 00:00 2023-10-06T04:41:49.335 INFO:teuthology.orchestra.run.smithi158.stdout:(136/139): util-linux-user-2.32.1-43.el8.x86_64 113 kB/s | 103 kB 00:00 2023-10-06T04:41:49.472 INFO:teuthology.orchestra.run.smithi124.stdout:(124/139): librbd1-17.2.6-1274.g68e53a4a.el8.x8 5.9 MB/s | 3.5 MB 00:00 2023-10-06T04:41:49.497 INFO:teuthology.orchestra.run.smithi124.stdout:(125/139): NetworkManager-initscripts-updown-1. 382 kB/s | 143 kB 00:00 2023-10-06T04:41:49.739 INFO:teuthology.orchestra.run.smithi124.stdout:(126/139): librados2-17.2.6-1274.g68e53a4a.el8. 3.8 MB/s | 3.4 MB 00:00 2023-10-06T04:41:49.756 INFO:teuthology.orchestra.run.smithi124.stdout:(127/139): elfutils-debuginfod-client-0.189-3.e 268 kB/s | 76 kB 00:00 2023-10-06T04:41:49.973 INFO:teuthology.orchestra.run.smithi124.stdout:(128/139): elfutils-libelf-0.189-3.el8.x86_64.r 488 kB/s | 232 kB 00:00 2023-10-06T04:41:50.161 INFO:teuthology.orchestra.run.smithi158.stdout:(137/139): util-linux-2.32.1-43.el8.x86_64.rpm 1.4 MB/s | 2.5 MB 00:01 2023-10-06T04:41:50.298 INFO:teuthology.orchestra.run.smithi124.stdout:(129/139): elfutils-libs-0.189-3.el8.x86_64.rpm 542 kB/s | 303 kB 00:00 2023-10-06T04:41:50.378 INFO:teuthology.orchestra.run.smithi158.stdout:(138/139): xfsdump-3.1.8-6.el8.x86_64.rpm 240 kB/s | 334 kB 00:01 2023-10-06T04:41:50.457 INFO:teuthology.orchestra.run.smithi124.stdout:(130/139): libblkid-2.32.1-43.el8.x86_64.rpm 456 kB/s | 220 kB 00:00 2023-10-06T04:41:50.532 INFO:teuthology.orchestra.run.smithi124.stdout:(131/139): iproute-6.2.0-5.el8.x86_64.rpm 1.1 MB/s | 854 kB 00:00 2023-10-06T04:41:50.657 INFO:teuthology.orchestra.run.smithi124.stdout:(132/139): libfdisk-2.32.1-43.el8.x86_64.rpm 707 kB/s | 254 kB 00:00 2023-10-06T04:41:50.857 INFO:teuthology.orchestra.run.smithi124.stdout:(133/139): libmount-2.32.1-43.el8.x86_64.rpm 591 kB/s | 236 kB 00:00 2023-10-06T04:41:50.983 INFO:teuthology.orchestra.run.smithi124.stdout:(134/139): libsmartcols-2.32.1-43.el8.x86_64.rp 398 kB/s | 179 kB 00:00 2023-10-06T04:41:51.136 INFO:teuthology.orchestra.run.smithi158.stdout:(139/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 615 kB/s | 1.1 MB 00:01 2023-10-06T04:41:51.140 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:41:51.140 INFO:teuthology.orchestra.run.smithi158.stdout:Total 8.9 MB/s | 209 MB 00:23 2023-10-06T04:41:51.166 INFO:teuthology.orchestra.run.smithi124.stdout:(135/139): libuuid-2.32.1-43.el8.x86_64.rpm 194 kB/s | 99 kB 00:00 2023-10-06T04:41:51.641 INFO:teuthology.orchestra.run.smithi124.stdout:(136/139): util-linux-user-2.32.1-43.el8.x86_64 156 kB/s | 103 kB 00:00 2023-10-06T04:41:51.925 INFO:teuthology.orchestra.run.smithi124.stdout:(137/139): xfsdump-3.1.8-6.el8.x86_64.rpm 440 kB/s | 334 kB 00:00 2023-10-06T04:41:51.992 INFO:teuthology.orchestra.run.smithi124.stdout:(138/139): util-linux-2.32.1-43.el8.x86_64.rpm 2.2 MB/s | 2.5 MB 00:01 2023-10-06T04:41:52.292 INFO:teuthology.orchestra.run.smithi124.stdout:(139/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 1.7 MB/s | 1.1 MB 00:00 2023-10-06T04:41:52.295 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:41:52.295 INFO:teuthology.orchestra.run.smithi124.stdout:Total 11 MB/s | 209 MB 00:18 2023-10-06T04:41:52.833 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-06T04:41:53.244 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-06T04:41:53.245 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-06T04:41:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-10-06T04:41:54.387 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-10-06T04:41:54.387 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-10-06T04:41:54.709 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-06T04:41:54.713 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-06T04:41:55.849 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-10-06T04:41:55.853 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-10-06T04:42:00.155 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-06T04:42:00.206 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-10-06T04:42:00.358 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T04:42:00.455 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T04:42:00.618 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T04:42:00.716 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T04:42:00.970 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-10-06T04:42:01.190 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-10-06T04:42:01.250 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-10-06T04:42:01.351 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 4/155 2023-10-06T04:42:01.388 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T04:42:01.479 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T04:42:01.555 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/155 2023-10-06T04:42:01.654 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T04:42:01.750 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T04:42:01.752 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-10-06T04:42:01.975 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T04:42:01.985 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-10-06T04:42:02.354 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 4/155 2023-10-06T04:42:02.399 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T04:42:02.534 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/155 2023-10-06T04:42:02.617 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T04:42:02.731 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-10-06T04:42:02.913 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T04:42:03.062 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T04:42:03.241 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T04:42:03.338 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T04:42:03.388 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T04:42:03.537 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T04:42:03.558 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T04:42:03.666 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T04:42:03.884 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/155 2023-10-06T04:42:03.974 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T04:42:04.066 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T04:42:04.146 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T04:42:04.295 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T04:42:04.462 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T04:42:04.579 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T04:42:04.668 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T04:42:04.772 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/155 2023-10-06T04:42:04.816 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T04:42:04.945 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T04:42:05.057 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T04:42:05.310 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T04:42:05.402 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T04:42:05.564 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T04:42:05.657 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-10-06T04:42:05.695 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T04:42:05.866 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-10-06T04:42:05.929 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T04:42:06.016 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 17/155 2023-10-06T04:42:06.141 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 17/155 2023-10-06T04:42:06.157 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T04:42:06.250 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T04:42:06.282 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T04:42:06.428 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T04:42:06.488 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-10-06T04:42:06.686 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-10-06T04:42:06.688 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-10-06T04:42:06.862 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 17/155 2023-10-06T04:42:06.870 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-10-06T04:42:06.988 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 17/155 2023-10-06T04:42:07.024 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T04:42:07.154 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T04:42:07.184 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T04:42:07.290 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T04:42:07.340 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T04:42:07.477 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-10-06T04:42:07.637 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-10-06T04:42:07.778 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T04:42:07.957 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T04:42:08.019 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T04:42:08.103 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T04:42:08.241 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T04:42:08.783 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T04:42:08.934 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T04:42:08.978 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T04:42:09.099 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T04:42:09.682 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T04:42:09.837 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T04:42:09.918 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T04:42:10.316 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-10-06T04:42:10.549 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-10-06T04:42:10.644 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T04:42:10.713 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-10-06T04:42:10.942 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-10-06T04:42:10.988 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-10-06T04:42:11.172 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 29/155 2023-10-06T04:42:11.196 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-10-06T04:42:11.302 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 30/155 2023-10-06T04:42:11.377 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-10-06T04:42:11.540 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 31/155 2023-10-06T04:42:11.581 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-10-06T04:42:11.785 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 29/155 2023-10-06T04:42:11.924 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 30/155 2023-10-06T04:42:12.170 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 31/155 2023-10-06T04:42:12.640 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-10-06T04:42:12.986 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-10-06T04:42:13.292 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-10-06T04:42:13.301 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-10-06T04:42:13.498 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T04:42:13.641 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-10-06T04:42:13.930 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-10-06T04:42:14.161 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T04:42:15.611 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T04:42:15.936 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-10-06T04:42:16.113 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-10-06T04:42:16.229 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T04:42:16.277 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-10-06T04:42:16.477 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/155 2023-10-06T04:42:16.540 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-10-06T04:42:16.687 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 40/155 2023-10-06T04:42:16.718 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-10-06T04:42:16.873 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-10-06T04:42:16.917 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 41/155 2023-10-06T04:42:17.065 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/155 2023-10-06T04:42:17.115 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-10-06T04:42:17.234 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 40/155 2023-10-06T04:42:17.333 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-10-06T04:42:17.455 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 41/155 2023-10-06T04:42:17.564 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T04:42:17.677 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-10-06T04:42:17.678 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T04:42:17.889 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T04:42:17.890 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-10-06T04:42:17.980 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T04:42:18.102 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T04:42:18.120 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-10-06T04:42:18.200 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T04:42:18.306 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T04:42:18.377 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T04:42:18.468 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T04:42:18.599 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-10-06T04:42:18.777 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T04:42:18.871 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T04:42:19.123 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T04:42:19.152 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T04:42:19.347 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-10-06T04:42:19.432 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T04:42:19.640 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-10-06T04:42:19.838 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-10-06T04:42:19.911 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T04:42:19.940 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T04:42:19.994 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-10-06T04:42:20.151 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-10-06T04:42:20.169 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-10-06T04:42:20.354 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-10-06T04:42:20.402 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-10-06T04:42:20.564 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-10-06T04:42:20.610 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-10-06T04:42:20.766 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-10-06T04:42:20.797 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/155 2023-10-06T04:42:20.923 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-10-06T04:42:20.985 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/155 2023-10-06T04:42:21.117 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-10-06T04:42:21.130 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/155 2023-10-06T04:42:21.329 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/155 2023-10-06T04:42:21.336 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-10-06T04:42:21.530 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/155 2023-10-06T04:42:21.535 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/155 2023-10-06T04:42:21.691 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/155 2023-10-06T04:42:21.723 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/155 2023-10-06T04:42:21.881 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/155 2023-10-06T04:42:21.884 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/155 2023-10-06T04:42:22.067 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/155 2023-10-06T04:42:22.093 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/155 2023-10-06T04:42:22.234 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/155 2023-10-06T04:42:22.362 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/155 2023-10-06T04:42:22.387 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/155 2023-10-06T04:42:22.571 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/155 2023-10-06T04:42:22.633 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/155 2023-10-06T04:42:22.838 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/155 2023-10-06T04:42:22.885 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/155 2023-10-06T04:42:23.066 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/155 2023-10-06T04:42:23.149 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/155 2023-10-06T04:42:23.242 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/155 2023-10-06T04:42:23.376 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/155 2023-10-06T04:42:23.562 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/155 2023-10-06T04:42:23.602 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/155 2023-10-06T04:42:23.816 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/155 2023-10-06T04:42:23.837 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/155 2023-10-06T04:42:24.040 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/155 2023-10-06T04:42:24.214 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/155 2023-10-06T04:42:24.246 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/155 2023-10-06T04:42:24.453 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/155 2023-10-06T04:42:24.471 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/155 2023-10-06T04:42:24.627 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/155 2023-10-06T04:42:24.882 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/155 2023-10-06T04:42:24.910 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/155 2023-10-06T04:42:25.139 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/155 2023-10-06T04:42:25.242 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/155 2023-10-06T04:42:25.409 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/155 2023-10-06T04:42:25.656 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/155 2023-10-06T04:42:25.894 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/155 2023-10-06T04:42:26.415 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/155 2023-10-06T04:42:26.798 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/155 2023-10-06T04:42:26.989 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/155 2023-10-06T04:42:27.167 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/155 2023-10-06T04:42:27.233 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/155 2023-10-06T04:42:27.546 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/155 2023-10-06T04:42:27.578 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/155 2023-10-06T04:42:27.752 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/155 2023-10-06T04:42:27.815 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/155 2023-10-06T04:42:27.971 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/155 2023-10-06T04:42:28.066 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/155 2023-10-06T04:42:28.259 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/155 2023-10-06T04:42:28.301 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T04:42:28.496 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/155 2023-10-06T04:42:28.645 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/155 2023-10-06T04:42:28.763 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/155 2023-10-06T04:42:28.885 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/155 2023-10-06T04:42:28.972 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T04:42:29.044 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/155 2023-10-06T04:42:29.214 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/155 2023-10-06T04:42:29.309 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/155 2023-10-06T04:42:29.533 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/155 2023-10-06T04:42:29.540 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/155 2023-10-06T04:42:29.738 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/155 2023-10-06T04:42:29.767 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/155 2023-10-06T04:42:29.919 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/155 2023-10-06T04:42:29.947 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/155 2023-10-06T04:42:30.128 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/155 2023-10-06T04:42:30.289 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/155 2023-10-06T04:42:30.340 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/155 2023-10-06T04:42:30.489 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/155 2023-10-06T04:42:30.549 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/155 2023-10-06T04:42:30.633 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/155 2023-10-06T04:42:30.821 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/155 2023-10-06T04:42:30.835 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/155 2023-10-06T04:42:31.004 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/155 2023-10-06T04:42:31.071 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/155 2023-10-06T04:42:31.145 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/155 2023-10-06T04:42:31.314 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/155 2023-10-06T04:42:31.568 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/155 2023-10-06T04:42:31.752 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/155 2023-10-06T04:42:31.893 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/155 2023-10-06T04:42:34.112 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T04:42:34.378 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T04:42:34.858 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T04:42:35.042 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T04:42:35.217 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T04:42:35.363 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 98/155 2023-10-06T04:42:35.563 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 98/155 2023-10-06T04:42:35.745 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 99/155 2023-10-06T04:42:35.878 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T04:42:36.141 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 98/155 2023-10-06T04:42:36.329 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 98/155 2023-10-06T04:42:36.500 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 99/155 2023-10-06T04:42:56.161 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 99/155 2023-10-06T04:42:56.161 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /sys 2023-10-06T04:42:56.161 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /proc 2023-10-06T04:42:56.161 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-10-06T04:42:56.162 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /run 2023-10-06T04:42:56.162 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /mnt 2023-10-06T04:42:56.162 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /var/tmp 2023-10-06T04:42:56.162 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /home 2023-10-06T04:42:56.162 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /tmp 2023-10-06T04:42:56.162 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-10-06T04:42:56.162 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:42:56.550 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 100/155 2023-10-06T04:42:56.603 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 99/155 2023-10-06T04:42:56.603 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /sys 2023-10-06T04:42:56.603 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /proc 2023-10-06T04:42:56.603 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /dev 2023-10-06T04:42:56.604 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /run 2023-10-06T04:42:56.604 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /mnt 2023-10-06T04:42:56.604 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /var/tmp 2023-10-06T04:42:56.604 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /home 2023-10-06T04:42:56.604 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /tmp 2023-10-06T04:42:56.604 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /dev 2023-10-06T04:42:56.604 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:42:57.023 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 100/155 2023-10-06T04:42:58.182 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 100/155 2023-10-06T04:42:58.400 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/155 2023-10-06T04:42:58.654 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 100/155 2023-10-06T04:42:58.669 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/155 2023-10-06T04:42:58.841 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 102/155 2023-10-06T04:42:58.863 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/155 2023-10-06T04:42:59.131 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/155 2023-10-06T04:42:59.295 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 102/155 2023-10-06T04:42:59.306 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 102/155 2023-10-06T04:42:59.482 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/155 2023-10-06T04:42:59.531 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/155 2023-10-06T04:42:59.724 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-10-06T04:42:59.757 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 102/155 2023-10-06T04:42:59.930 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/155 2023-10-06T04:42:59.946 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-10-06T04:42:59.980 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/155 2023-10-06T04:43:00.107 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T04:43:00.164 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-10-06T04:43:00.210 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T04:43:00.352 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-10-06T04:43:00.500 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-10-06T04:43:00.505 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T04:43:00.650 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T04:43:00.707 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-10-06T04:43:00.940 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-10-06T04:43:01.180 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-10-06T04:43:01.357 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 109/155 2023-10-06T04:43:01.519 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 109/155 2023-10-06T04:43:01.639 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 110/155 2023-10-06T04:43:01.831 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 111/155 2023-10-06T04:43:01.837 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 109/155 2023-10-06T04:43:01.999 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 109/155 2023-10-06T04:43:02.048 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 112/155 2023-10-06T04:43:02.113 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 110/155 2023-10-06T04:43:02.297 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 111/155 2023-10-06T04:43:02.305 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 112/155 2023-10-06T04:43:02.496 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 112/155 2023-10-06T04:43:03.513 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 113/155 2023-10-06T04:43:03.513 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 112/155 2023-10-06T04:43:03.514 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 113/155 2023-10-06T04:43:03.625 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 113/155 2023-10-06T04:43:03.848 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 114/155 2023-10-06T04:43:03.999 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 114/155 2023-10-06T04:43:04.080 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 113/155 2023-10-06T04:43:04.288 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 114/155 2023-10-06T04:43:04.341 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 115/155 2023-10-06T04:43:04.416 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 114/155 2023-10-06T04:43:04.541 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/155 2023-10-06T04:43:04.812 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/155 2023-10-06T04:43:04.813 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 117/155 2023-10-06T04:43:04.813 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 115/155 2023-10-06T04:43:04.825 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 117/155 2023-10-06T04:43:05.013 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 118/155 2023-10-06T04:43:05.021 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/155 2023-10-06T04:43:05.086 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/155 2023-10-06T04:43:05.181 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T04:43:05.254 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 117/155 2023-10-06T04:43:05.281 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 117/155 2023-10-06T04:43:05.487 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 118/155 2023-10-06T04:43:05.646 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T04:43:10.516 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T04:43:10.982 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T04:43:12.361 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 120/155 2023-10-06T04:43:12.581 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/155 2023-10-06T04:43:12.709 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/155 2023-10-06T04:43:12.835 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 120/155 2023-10-06T04:43:12.888 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 122/155 2023-10-06T04:43:12.958 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 122/155 2023-10-06T04:43:13.045 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/155 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/155 2023-10-06T04:43:13.180 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 123/155 2023-10-06T04:43:13.354 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 122/155 2023-10-06T04:43:13.424 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 122/155 2023-10-06T04:43:13.586 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 123/155 2023-10-06T04:43:13.612 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 123/155 2023-10-06T04:43:13.788 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T04:43:13.917 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T04:43:14.019 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 123/155 2023-10-06T04:43:14.212 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T04:43:14.341 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T04:43:15.150 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 125/155 2023-10-06T04:43:15.493 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-10-06T04:43:15.535 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 125/155 2023-10-06T04:43:15.694 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-10-06T04:43:15.825 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-10-06T04:43:15.917 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-10-06T04:43:16.008 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-10-06T04:43:16.083 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-10-06T04:43:16.200 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-10-06T04:43:16.324 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 130/155 2023-10-06T04:43:16.412 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-10-06T04:43:16.542 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-10-06T04:43:16.671 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 130/155 2023-10-06T04:43:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 132/155 2023-10-06T04:43:16.884 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-10-06T04:43:16.989 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 133/155 2023-10-06T04:43:17.088 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 132/155 2023-10-06T04:43:17.312 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 133/155 2023-10-06T04:43:17.345 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 134/155 2023-10-06T04:43:17.598 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 135/155 2023-10-06T04:43:17.654 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 134/155 2023-10-06T04:43:17.787 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T04:43:17.814 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T04:43:17.914 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 135/155 2023-10-06T04:43:18.030 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-10-06T04:43:18.053 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T04:43:18.078 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T04:43:18.253 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T04:43:18.280 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-10-06T04:43:18.362 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T04:43:18.502 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T04:43:18.612 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T04:43:18.637 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T04:43:18.664 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T04:43:18.855 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-10-06T04:43:18.869 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T04:43:18.895 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T04:43:19.024 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-10-06T04:43:19.063 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-10-06T04:43:19.167 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-10-06T04:43:19.167 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T04:43:19.237 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-10-06T04:43:19.390 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-10-06T04:43:19.390 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T04:43:19.441 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T04:43:19.442 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T04:43:19.634 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T04:43:19.634 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T04:43:19.723 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T04:43:19.739 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T04:43:19.868 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T04:43:19.868 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T04:43:19.873 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T04:43:19.888 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T04:43:20.017 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T04:43:20.018 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T04:43:20.136 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T04:43:20.260 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T04:43:20.331 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-10-06T04:43:20.438 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-10-06T04:43:20.523 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-10-06T04:43:20.585 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-10-06T04:43:20.755 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T04:43:20.755 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T04:43:20.804 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T04:43:20.805 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T04:43:20.990 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T04:43:20.990 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T04:43:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T04:43:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T04:43:21.190 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T04:43:21.190 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T04:43:21.222 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T04:43:21.222 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T04:43:21.448 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T04:43:21.448 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T04:43:21.464 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T04:43:21.464 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T04:43:21.673 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T04:43:21.673 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T04:43:21.681 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T04:43:21.681 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T04:43:21.881 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T04:43:21.890 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T04:43:22.070 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T04:43:22.089 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T04:43:22.278 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T04:43:22.278 INFO:teuthology.orchestra.run.smithi124.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T04:43:22.279 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:22.294 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T04:43:22.294 INFO:teuthology.orchestra.run.smithi158.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T04:43:22.294 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:22.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/155 2023-10-06T04:43:22.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/155 2023-10-06T04:43:22.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/155 2023-10-06T04:43:22.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/155 2023-10-06T04:43:22.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/155 2023-10-06T04:43:22.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/155 2023-10-06T04:43:22.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/155 2023-10-06T04:43:22.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T04:43:22.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T04:43:22.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T04:43:22.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/155 2023-10-06T04:43:22.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/155 2023-10-06T04:43:22.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T04:43:22.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/155 2023-10-06T04:43:22.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/155 2023-10-06T04:43:22.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/155 2023-10-06T04:43:22.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/155 2023-10-06T04:43:22.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T04:43:22.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/155 2023-10-06T04:43:22.992 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/155 2023-10-06T04:43:22.992 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/155 2023-10-06T04:43:22.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : jq-1.6-7.el8.x86_64 42/155 2023-10-06T04:43:22.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 43/155 2023-10-06T04:43:22.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 44/155 2023-10-06T04:43:22.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 45/155 2023-10-06T04:43:22.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 46/155 2023-10-06T04:43:22.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 47/155 2023-10-06T04:43:22.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 48/155 2023-10-06T04:43:22.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 49/155 2023-10-06T04:43:22.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 50/155 2023-10-06T04:43:22.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 51/155 2023-10-06T04:43:22.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 52/155 2023-10-06T04:43:22.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 53/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 55/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 56/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 59/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 60/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 61/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 62/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 64/155 2023-10-06T04:43:22.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 65/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 66/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 67/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 68/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 69/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 71/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 72/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 73/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 74/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 75/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 76/155 2023-10-06T04:43:22.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 77/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 78/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 80/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 81/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 82/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 84/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 85/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/155 2023-10-06T04:43:22.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 91/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 92/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 95/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-10-06T04:43:22.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 102/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 103/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 104/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 105/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 106/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 107/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 108/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 111/155 2023-10-06T04:43:23.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 112/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 113/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 114/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 115/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 116/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 117/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 118/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 122/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 123/155 2023-10-06T04:43:23.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 126/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 136/155 2023-10-06T04:43:23.002 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-10-06T04:43:23.003 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T04:43:23.004 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-10-06T04:43:23.004 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-10-06T04:43:23.004 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-10-06T04:43:23.004 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-10-06T04:43:23.004 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-10-06T04:43:23.017 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/155 2023-10-06T04:43:23.017 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/155 2023-10-06T04:43:23.017 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/155 2023-10-06T04:43:23.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/155 2023-10-06T04:43:23.019 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/155 2023-10-06T04:43:23.019 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/155 2023-10-06T04:43:23.019 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T04:43:23.019 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/155 2023-10-06T04:43:23.019 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/155 2023-10-06T04:43:23.019 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/155 2023-10-06T04:43:23.019 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/155 2023-10-06T04:43:23.020 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/155 2023-10-06T04:43:23.020 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/155 2023-10-06T04:43:23.020 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/155 2023-10-06T04:43:23.020 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/155 2023-10-06T04:43:23.020 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/155 2023-10-06T04:43:23.020 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/155 2023-10-06T04:43:23.020 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/155 2023-10-06T04:43:23.021 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/155 2023-10-06T04:43:23.021 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/155 2023-10-06T04:43:23.021 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/155 2023-10-06T04:43:23.021 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/155 2023-10-06T04:43:23.021 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/155 2023-10-06T04:43:23.021 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/155 2023-10-06T04:43:23.021 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/155 2023-10-06T04:43:23.022 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/155 2023-10-06T04:43:23.022 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/155 2023-10-06T04:43:23.022 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/155 2023-10-06T04:43:23.022 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/155 2023-10-06T04:43:23.022 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/155 2023-10-06T04:43:23.022 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : jq-1.6-7.el8.x86_64 42/155 2023-10-06T04:43:23.022 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 43/155 2023-10-06T04:43:23.023 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 44/155 2023-10-06T04:43:23.023 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 45/155 2023-10-06T04:43:23.023 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 46/155 2023-10-06T04:43:23.023 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 47/155 2023-10-06T04:43:23.023 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 48/155 2023-10-06T04:43:23.023 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 49/155 2023-10-06T04:43:23.023 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 50/155 2023-10-06T04:43:23.023 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 51/155 2023-10-06T04:43:23.023 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 52/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 53/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 55/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 56/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 59/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 60/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 61/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 62/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/155 2023-10-06T04:43:23.024 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 64/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 65/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 66/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 67/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 68/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 69/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 71/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 72/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 73/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 74/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 75/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 76/155 2023-10-06T04:43:23.025 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 77/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 78/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 80/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 81/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 82/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 84/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 85/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/155 2023-10-06T04:43:23.026 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 91/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 92/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 95/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-10-06T04:43:23.027 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 102/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 103/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 104/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 105/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 106/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 107/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 108/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 111/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 112/155 2023-10-06T04:43:23.028 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 113/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 114/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 115/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 116/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 117/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 118/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 122/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 123/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T04:43:23.029 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 126/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 136/155 2023-10-06T04:43:23.030 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T04:43:23.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-10-06T04:43:23.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-10-06T04:43:23.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-10-06T04:43:23.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-10-06T04:43:23.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-10-06T04:43:25.065 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-10-06T04:43:25.065 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:25.065 INFO:teuthology.orchestra.run.smithi124.stdout:Upgraded: 2023-10-06T04:43:25.065 INFO:teuthology.orchestra.run.smithi124.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-06T04:43:25.065 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-06T04:43:25.065 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-06T04:43:25.065 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-06T04:43:25.065 INFO:teuthology.orchestra.run.smithi124.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-06T04:43:25.065 INFO:teuthology.orchestra.run.smithi124.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.066 INFO:teuthology.orchestra.run.smithi124.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.066 INFO:teuthology.orchestra.run.smithi124.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.066 INFO:teuthology.orchestra.run.smithi124.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.066 INFO:teuthology.orchestra.run.smithi124.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.066 INFO:teuthology.orchestra.run.smithi124.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.066 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.066 INFO:teuthology.orchestra.run.smithi124.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.066 INFO:teuthology.orchestra.run.smithi124.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.067 INFO:teuthology.orchestra.run.smithi124.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-10-06T04:43:25.067 INFO:teuthology.orchestra.run.smithi124.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-10-06T04:43:25.067 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-10-06T04:43:25.067 INFO:teuthology.orchestra.run.smithi124.stdout: automake-1.16.1-8.el8.noarch 2023-10-06T04:43:25.067 INFO:teuthology.orchestra.run.smithi124.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:43:25.067 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.067 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.068 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.068 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.068 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.068 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.068 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.068 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.068 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.069 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.069 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.069 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.069 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.069 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.069 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.070 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.070 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.070 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.070 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.070 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.071 INFO:teuthology.orchestra.run.smithi124.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.071 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.071 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.071 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-06T04:43:25.071 INFO:teuthology.orchestra.run.smithi124.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:43:25.071 INFO:teuthology.orchestra.run.smithi124.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-06T04:43:25.071 INFO:teuthology.orchestra.run.smithi124.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:43:25.072 INFO:teuthology.orchestra.run.smithi124.stdout: jq-1.6-7.el8.x86_64 2023-10-06T04:43:25.072 INFO:teuthology.orchestra.run.smithi124.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-06T04:43:25.072 INFO:teuthology.orchestra.run.smithi124.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-06T04:43:25.072 INFO:teuthology.orchestra.run.smithi124.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:43:25.072 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.072 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.072 INFO:teuthology.orchestra.run.smithi124.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.073 INFO:teuthology.orchestra.run.smithi124.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-06T04:43:25.073 INFO:teuthology.orchestra.run.smithi124.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-06T04:43:25.073 INFO:teuthology.orchestra.run.smithi124.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:43:25.073 INFO:teuthology.orchestra.run.smithi124.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-06T04:43:25.073 INFO:teuthology.orchestra.run.smithi124.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-06T04:43:25.073 INFO:teuthology.orchestra.run.smithi124.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.074 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.074 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-06T04:43:25.074 INFO:teuthology.orchestra.run.smithi124.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.074 INFO:teuthology.orchestra.run.smithi124.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-06T04:43:25.074 INFO:teuthology.orchestra.run.smithi124.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-06T04:43:25.074 INFO:teuthology.orchestra.run.smithi124.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:43:25.075 INFO:teuthology.orchestra.run.smithi124.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:43:25.075 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.075 INFO:teuthology.orchestra.run.smithi124.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-06T04:43:25.075 INFO:teuthology.orchestra.run.smithi124.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-06T04:43:25.075 INFO:teuthology.orchestra.run.smithi124.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:43:25.075 INFO:teuthology.orchestra.run.smithi124.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:43:25.076 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:43:25.077 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-06T04:43:25.078 INFO:teuthology.orchestra.run.smithi124.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:43:25.079 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:43:25.080 INFO:teuthology.orchestra.run.smithi124.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:43:25.081 INFO:teuthology.orchestra.run.smithi124.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:43:25.081 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.081 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.081 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.081 INFO:teuthology.orchestra.run.smithi124.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-06T04:43:25.081 INFO:teuthology.orchestra.run.smithi124.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:43:25.081 INFO:teuthology.orchestra.run.smithi124.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-10-06T04:43:25.081 INFO:teuthology.orchestra.run.smithi124.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:43:25.082 INFO:teuthology.orchestra.run.smithi124.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-06T04:43:25.082 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:25.082 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-10-06T04:43:25.107 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-10-06T04:43:25.107 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:25.108 INFO:teuthology.orchestra.run.smithi158.stdout:Upgraded: 2023-10-06T04:43:25.108 INFO:teuthology.orchestra.run.smithi158.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-06T04:43:25.108 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-06T04:43:25.108 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-06T04:43:25.108 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-06T04:43:25.108 INFO:teuthology.orchestra.run.smithi158.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-06T04:43:25.108 INFO:teuthology.orchestra.run.smithi158.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-06T04:43:25.109 INFO:teuthology.orchestra.run.smithi158.stdout: automake-1.16.1-8.el8.noarch 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.111 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: jq-1.6-7.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.112 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-06T04:43:25.113 INFO:teuthology.orchestra.run.smithi158.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-06T04:43:25.114 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-06T04:43:25.115 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-06T04:43:25.115 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:43:25.115 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-06T04:43:25.115 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:43:25.115 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:43:25.115 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:43:25.115 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.116 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.116 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.116 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:43:25.116 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-06T04:43:25.116 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:43:25.116 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:43:25.116 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-06T04:43:25.117 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:43:25.117 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:43:25.117 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:43:25.117 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-06T04:43:25.117 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:43:25.117 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:43:25.118 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:43:25.118 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:43:25.118 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:43:25.118 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-06T04:43:25.118 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:43:25.118 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:43:25.119 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:43:25.119 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-06T04:43:25.119 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-06T04:43:25.119 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:43:25.119 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:43:25.119 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:43:25.120 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:43:25.120 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-06T04:43:25.120 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:43:25.120 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:43:25.120 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-06T04:43:25.120 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-06T04:43:25.120 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.120 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.121 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:43:25.121 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:43:25.121 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.121 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:43:25.121 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:43:25.121 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-06T04:43:25.121 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:43:25.121 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:43:25.122 INFO:teuthology.orchestra.run.smithi158.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-06T04:43:25.123 INFO:teuthology.orchestra.run.smithi158.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:43:25.123 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-10-06T04:43:25.123 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:43:25.123 INFO:teuthology.orchestra.run.smithi158.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-06T04:43:25.123 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:25.123 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-06T04:43:25.376 DEBUG:teuthology.parallel:result is None 2023-10-06T04:43:25.431 DEBUG:teuthology.parallel:result is None 2023-10-06T04:43:25.432 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:43:25.598 DEBUG:teuthology.orchestra.run.smithi124:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:43:25.654 INFO:teuthology.orchestra.run.smithi124.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T04:43:25.654 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T04:43:25.654 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T04:43:25.655 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:43:25.803 DEBUG:teuthology.orchestra.run.smithi158:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi158.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T04:43:25.861 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T04:43:25.861 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T04:43:25.861 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T04:43:25.862 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:25.862 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:43:25.937 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:43:25.937 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:43:26.014 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T04:43:26.014 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:26.014 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:43:26.084 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:43:26.194 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:43:26.194 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:43:26.265 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:43:26.381 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T04:43:26.381 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:26.381 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:43:26.452 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:43:26.564 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:43:26.564 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:43:26.636 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:43:26.748 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T04:43:26.748 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:26.749 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:43:26.820 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:43:26.933 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:43:26.934 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:43:27.004 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:43:27.119 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T04:43:27.182 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T04:43:27.183 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 777 /var/log/ceph 2023-10-06T04:43:27.188 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 777 /var/log/ceph 2023-10-06T04:43:27.259 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T04:43:27.259 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:43:27.263 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:43:27.334 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T04:43:27.334 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:43:27.339 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:43:27.418 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T04:43:27.418 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T04:43:27.418 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T04:43:27.419 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:27.419 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:43:27.465 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:43:27.668 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:43:27.740 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:43:27.740 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:43:27.786 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:43:28.046 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:43:28.122 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T04:43:28.122 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T04:43:28.122 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412280', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi124.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEAVo48XyyqF8WwhIz1EAN5JDzAT7TEbLY2hV1KnF9lHlHfXSpFsGEapl53q0wLw8jLEsJiEnpAsyZfCuQPoQ5s=', 'smithi158.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN0jY6eeKfnzMjCEO7OuloWVye6yPMWpc20GCQTKM8t6nbYP+PPIKt7THWED9cMoULky5wcnzIUcYy1evP1vkMo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_dump_tree']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T04:43:28.123 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:43:28.127 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:43:28.175 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:43:28.179 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:43:28.250 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:28.251 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:43:28.296 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:43:28.296 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_1 2023-10-06T04:43:28.384 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:43:28.384 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:43:28.384 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-06T04:43:28.384 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:43:28.384 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:43:28.384 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-10-06 04:43:22.484189822 +0000 2023-10-06T04:43:28.384 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-10-06 04:39:46.736916469 +0000 2023-10-06T04:43:28.384 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-10-06 04:39:46.736916469 +0000 2023-10-06T04:43:28.385 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2023-10-06 04:39:46.710916907 +0000 2023-10-06T04:43:28.385 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:43:28.452 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-10-06T04:43:28.452 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-10-06T04:43:28.452 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000276071 s, 1.9 MB/s 2023-10-06T04:43:28.455 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:43:28.505 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_2 2023-10-06T04:43:28.551 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:43:28.551 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:43:28.552 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-06T04:43:28.552 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:43:28.552 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:43:28.552 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-10-06 04:43:22.484189822 +0000 2023-10-06T04:43:28.552 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-10-06 04:39:47.564902508 +0000 2023-10-06T04:43:28.552 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-10-06 04:39:47.564902508 +0000 2023-10-06T04:43:28.552 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2023-10-06 04:39:47.538902946 +0000 2023-10-06T04:43:28.552 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:43:28.661 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-10-06T04:43:28.661 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-10-06T04:43:28.661 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000270982 s, 1.9 MB/s 2023-10-06T04:43:28.663 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:43:28.711 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_3 2023-10-06T04:43:28.758 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:43:28.758 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:43:28.758 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-06T04:43:28.758 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:43:28.758 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:43:28.758 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-10-06 04:43:22.484189822 +0000 2023-10-06T04:43:28.759 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-10-06 04:39:48.406888310 +0000 2023-10-06T04:43:28.759 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-10-06 04:39:48.406888310 +0000 2023-10-06T04:43:28.759 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2023-10-06 04:39:48.378888783 +0000 2023-10-06T04:43:28.759 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:43:28.826 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-10-06T04:43:28.826 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-10-06T04:43:28.826 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000269992 s, 1.9 MB/s 2023-10-06T04:43:28.828 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:43:28.878 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_4 2023-10-06T04:43:28.925 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:43:28.926 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:43:28.926 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-06T04:43:28.926 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:43:28.926 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:43:28.926 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-10-06 04:43:22.484189822 +0000 2023-10-06T04:43:28.926 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-10-06 04:39:49.281873557 +0000 2023-10-06T04:43:28.926 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-10-06 04:39:49.281873557 +0000 2023-10-06T04:43:28.926 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2023-10-06 04:39:49.255873995 +0000 2023-10-06T04:43:28.927 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:43:28.995 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-10-06T04:43:28.995 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-10-06T04:43:28.996 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000282282 s, 1.8 MB/s 2023-10-06T04:43:28.999 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:43:29.049 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:43:29.049 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:43:29.049 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:43:29.097 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:43:29.097 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_1 2023-10-06T04:43:29.186 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:43:29.186 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:43:29.186 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-10-06T04:43:29.186 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:43:29.186 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:43:29.186 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-06 04:43:22.507126367 +0000 2023-10-06T04:43:29.186 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-06 04:39:48.213013418 +0000 2023-10-06T04:43:29.186 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-06 04:39:48.213013418 +0000 2023-10-06T04:43:29.187 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: 2023-10-06 04:39:48.190013652 +0000 2023-10-06T04:43:29.187 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:43:29.255 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-06T04:43:29.255 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-06T04:43:29.255 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000182052 s, 2.8 MB/s 2023-10-06T04:43:29.257 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:43:29.306 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_2 2023-10-06T04:43:29.353 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:43:29.354 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:43:29.354 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-10-06T04:43:29.354 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:43:29.354 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:43:29.354 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-06 04:43:22.507126367 +0000 2023-10-06T04:43:29.354 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-06 04:39:49.104004355 +0000 2023-10-06T04:43:29.354 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-06 04:39:49.104004355 +0000 2023-10-06T04:43:29.354 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: 2023-10-06 04:39:49.083004569 +0000 2023-10-06T04:43:29.354 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:43:29.423 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-06T04:43:29.423 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-06T04:43:29.423 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000176642 s, 2.9 MB/s 2023-10-06T04:43:29.425 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:43:29.475 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_3 2023-10-06T04:43:29.524 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:43:29.524 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:43:29.524 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-10-06T04:43:29.525 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:43:29.525 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:43:29.525 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-06 04:43:22.508126356 +0000 2023-10-06T04:43:29.525 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-06 04:39:49.943995810 +0000 2023-10-06T04:43:29.525 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-06 04:39:49.943995810 +0000 2023-10-06T04:43:29.525 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: 2023-10-06 04:39:49.924996003 +0000 2023-10-06T04:43:29.525 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:43:29.594 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-06T04:43:29.594 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-06T04:43:29.594 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000158046 s, 3.2 MB/s 2023-10-06T04:43:29.597 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:43:29.647 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_4 2023-10-06T04:43:29.693 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:43:29.694 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:43:29.694 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-10-06T04:43:29.694 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:43:29.694 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:43:29.694 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-06 04:43:22.508126356 +0000 2023-10-06T04:43:29.694 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-06 04:39:50.768987418 +0000 2023-10-06T04:43:29.694 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-06 04:39:50.768987418 +0000 2023-10-06T04:43:29.694 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: 2023-10-06 04:39:50.749987611 +0000 2023-10-06T04:43:29.697 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:43:29.766 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-06T04:43:29.766 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-06T04:43:29.766 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000158209 s, 3.2 MB/s 2023-10-06T04:43:29.769 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:43:29.818 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:43:29.820 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi158.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:43:29.820 INFO:tasks.ceph:Generating config... 2023-10-06T04:43:29.822 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T04:43:29.822 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T04:43:29.822 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T04:43:29.822 INFO:tasks.ceph:[client] pid file = 2023-10-06T04:43:29.822 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T04:43:29.822 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T04:43:29.823 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T04:43:29.823 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T04:43:29.823 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T04:43:29.823 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T04:43:29.823 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T04:43:29.823 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T04:43:29.823 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T04:43:29.823 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T04:43:29.824 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T04:43:29.824 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T04:43:29.824 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T04:43:29.824 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T04:43:29.824 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T04:43:29.824 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T04:43:29.824 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T04:43:29.824 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T04:43:29.824 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T04:43:29.825 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T04:43:29.825 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T04:43:29.825 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T04:43:29.825 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T04:43:29.825 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T04:43:29.825 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T04:43:29.825 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T04:43:29.826 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T04:43:29.826 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T04:43:29.826 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T04:43:29.826 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T04:43:29.826 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T04:43:29.826 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T04:43:29.827 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T04:43:29.827 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T04:43:29.827 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T04:43:29.827 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T04:43:29.935 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T04:43:29.941 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T04:43:30.038 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:43:30.108 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.124'), ('mon.b', '172.21.15.158'), ('mon.c', '[v2:172.21.15.158:3301,v1:172.21.15.158:6790]')] 2023-10-06T04:43:30.109 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.124,172.21.15.158,[v2:172.21.15.158:3301,v1:172.21.15.158:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T04:43:30.109 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:30.110 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:43:30.155 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.124 --add b 172.21.15.158 --addv c '[v2:172.21.15.158:3301,v1:172.21.15.158:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:30.280 INFO:teuthology.orchestra.run.smithi124.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:30.280 INFO:teuthology.orchestra.run.smithi124.stdout:monmaptool: generated fsid 8703c690-5fd4-410f-8b5d-95264116cbcb 2023-10-06T04:43:30.280 INFO:teuthology.orchestra.run.smithi124.stdout:setting min_mon_release = octopus 2023-10-06T04:43:30.280 INFO:teuthology.orchestra.run.smithi124.stdout:epoch 0 2023-10-06T04:43:30.280 INFO:teuthology.orchestra.run.smithi124.stdout:fsid 8703c690-5fd4-410f-8b5d-95264116cbcb 2023-10-06T04:43:30.280 INFO:teuthology.orchestra.run.smithi124.stdout:last_changed 2023-10-06T04:43:30.279246+0000 2023-10-06T04:43:30.280 INFO:teuthology.orchestra.run.smithi124.stdout:created 2023-10-06T04:43:30.279246+0000 2023-10-06T04:43:30.280 INFO:teuthology.orchestra.run.smithi124.stdout:min_mon_release 15 (octopus) 2023-10-06T04:43:30.280 INFO:teuthology.orchestra.run.smithi124.stdout:election_strategy: 1 2023-10-06T04:43:30.281 INFO:teuthology.orchestra.run.smithi124.stdout:0: [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] mon.a 2023-10-06T04:43:30.281 INFO:teuthology.orchestra.run.smithi124.stdout:1: [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] mon.b 2023-10-06T04:43:30.281 INFO:teuthology.orchestra.run.smithi124.stdout:2: [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] mon.c 2023-10-06T04:43:30.281 INFO:teuthology.orchestra.run.smithi124.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T04:43:30.283 DEBUG:teuthology.orchestra.run.smithi124:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:43:30.329 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8703c690-5fd4-410f-8b5d-95264116cbcb... 2023-10-06T04:43:30.330 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:43:30.334 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:43:30.449 INFO:teuthology.orchestra.run.smithi124.stdout:[global] 2023-10-06T04:43:30.449 INFO:teuthology.orchestra.run.smithi124.stdout: chdir = "" 2023-10-06T04:43:30.449 INFO:teuthology.orchestra.run.smithi124.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:43:30.449 INFO:teuthology.orchestra.run.smithi124.stdout: auth supported = cephx 2023-10-06T04:43:30.449 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.450 INFO:teuthology.orchestra.run.smithi124.stdout: filestore xattr use omap = true 2023-10-06T04:43:30.450 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.450 INFO:teuthology.orchestra.run.smithi124.stdout: mon clock drift allowed = 1.000 2023-10-06T04:43:30.450 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.450 INFO:teuthology.orchestra.run.smithi124.stdout: osd crush chooseleaf type = 0 2023-10-06T04:43:30.450 INFO:teuthology.orchestra.run.smithi124.stdout: auth debug = true 2023-10-06T04:43:30.450 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.450 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on old message = true 2023-10-06T04:43:30.450 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on bug = true 2023-10-06T04:43:30.450 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: mon pg warn max object skew = 0 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default size = 2 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow primary affinity = true 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow pg remap = true 2023-10-06T04:43:30.451 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on no sortbitwise = false 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on too few osds = false 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: mon_allow_pool_size_one = true 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: osd default data pool replay window = 5 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.452 INFO:teuthology.orchestra.run.smithi124.stdout: mon allow pool delete = true 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout: mon cluster log file level = debug 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout: debug asserts on shutdown = true 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout: mon health detail to clog = false 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout: mon host = "172.21.15.124,172.21.15.158,[v2:172.21.15.158:3301,v1:172.21.15.158:6790]" 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on skipped message = False 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout: fsid = 8703c690-5fd4-410f-8b5d-95264116cbcb 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout:[osd] 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout: osd journal size = 100 2023-10-06T04:43:30.453 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub load threshold = 5.0 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub max interval = 600 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: osd recover clone overlap = true 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: osd recovery max chunk = 1048576 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug shutdown = true 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug op order = true 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug verify stray on activate = true 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.454 INFO:teuthology.orchestra.run.smithi124.stdout: osd open classes on start = true 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug pg log writeout = true 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: osd map max advance = 10 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: journal zero on create = true 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: filestore apply finisher threads = 3 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: bdev debug aio = true 2023-10-06T04:43:30.455 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug misdirected ops = true 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: bdev async discard = True 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: bdev enable discard = True 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore allocator = bitmap 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore block size = 96636764160 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore fsck on mount = True 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluefs = 1/20 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluestore = 1/20 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: debug osd = 20 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: debug rocksdb = 4/10 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:43:30.456 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd full ratio = 0.9 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: osd objectstore = bluestore 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr] 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: debug mgr = 20 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:43:30.457 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:43:30.458 INFO:teuthology.orchestra.run.smithi124.stdout: mgr/telemetry/nag = false 2023-10-06T04:43:30.458 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:[mon] 2023-10-06T04:43:30.458 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-06T04:43:30.458 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2023-10-06T04:43:30.458 INFO:teuthology.orchestra.run.smithi124.stdout: debug paxos = 20 2023-10-06T04:43:30.458 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2023-10-06T04:43:30.458 INFO:teuthology.orchestra.run.smithi124.stdout: mon data avail warn = 5 2023-10-06T04:43:30.458 INFO:teuthology.orchestra.run.smithi124.stdout: mon mgr mkfs grace = 240 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd reporter subtree level = osd 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd prime pg temp = true 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:43:30.459 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: # 1m isn't quite enough 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: mon op complaint time = 120 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout:[client] 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: rgw cache enabled = true 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable ops log = true 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable usage log = true 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:43:30.460 INFO:teuthology.orchestra.run.smithi124.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout: client mount timeout = 600 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout: debug client = 20 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout: pid file = "" 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.a] 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.b] 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.c] 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.c] 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2023-10-06T04:43:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.d] 2023-10-06T04:43:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:[mds] 2023-10-06T04:43:30.462 INFO:teuthology.orchestra.run.smithi124.stdout: debug mds = 20 2023-10-06T04:43:30.462 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-06T04:43:30.462 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug frag = True 2023-10-06T04:43:30.462 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug scatterstat = True 2023-10-06T04:43:30.462 INFO:teuthology.orchestra.run.smithi124.stdout: mds op complaint time = 180 2023-10-06T04:43:30.462 INFO:teuthology.orchestra.run.smithi124.stdout: mds verify scatter = True 2023-10-06T04:43:30.462 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2023-10-06T04:43:30.462 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2023-10-06T04:43:30.462 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2023-10-06T04:43:30.463 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2023-10-06T04:43:30.463 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2023-10-06T04:43:30.463 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:43:30.463 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2023-10-06T04:43:30.463 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.463 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2023-10-06T04:43:30.463 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.463 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2023-10-06T04:43:30.463 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:43:30.464 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:43:30.465 INFO:teuthology.orchestra.run.smithi158.stdout: mon_allow_pool_size_one = true 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: mon health detail to clog = false 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = "172.21.15.124,172.21.15.158,[v2:172.21.15.158:3301,v1:172.21.15.158:6790]" 2023-10-06T04:43:30.466 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on skipped message = False 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = 8703c690-5fd4-410f-8b5d-95264116cbcb 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.467 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:43:30.468 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2023-10-06T04:43:30.469 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.469 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2023-10-06T04:43:30.469 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2023-10-06T04:43:30.469 INFO:teuthology.orchestra.run.smithi158.stdout: bdev async discard = True 2023-10-06T04:43:30.469 INFO:teuthology.orchestra.run.smithi158.stdout: bdev enable discard = True 2023-10-06T04:43:30.469 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore allocator = bitmap 2023-10-06T04:43:30.469 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore block size = 96636764160 2023-10-06T04:43:30.469 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore fsck on mount = True 2023-10-06T04:43:30.469 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluefs = 1/20 2023-10-06T04:43:30.470 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluestore = 1/20 2023-10-06T04:43:30.470 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-06T04:43:30.470 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 20 2023-10-06T04:43:30.470 INFO:teuthology.orchestra.run.smithi158.stdout: debug rocksdb = 4/10 2023-10-06T04:43:30.470 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:43:30.470 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.9 2023-10-06T04:43:30.470 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:43:30.470 INFO:teuthology.orchestra.run.smithi158.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:43:30.470 INFO:teuthology.orchestra.run.smithi158.stdout: osd objectstore = bluestore 2023-10-06T04:43:30.470 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-10-06T04:43:30.471 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.471 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2023-10-06T04:43:30.471 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-06T04:43:30.471 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2023-10-06T04:43:30.471 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-10-06T04:43:30.471 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-10-06T04:43:30.471 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:43:30.471 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:43:30.471 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2023-10-06T04:43:30.471 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2023-10-06T04:43:30.472 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: # 1m isn't quite enough 2023-10-06T04:43:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: mon op complaint time = 120 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: client mount timeout = 600 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2023-10-06T04:43:30.474 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = "" 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.b] 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.c] 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.c] 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.d] 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout:[mds] 2023-10-06T04:43:30.475 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds = 20 2023-10-06T04:43:30.476 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-06T04:43:30.476 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug frag = True 2023-10-06T04:43:30.476 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug scatterstat = True 2023-10-06T04:43:30.476 INFO:teuthology.orchestra.run.smithi158.stdout: mds op complaint time = 180 2023-10-06T04:43:30.476 INFO:teuthology.orchestra.run.smithi158.stdout: mds verify scatter = True 2023-10-06T04:43:30.476 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-10-06T04:43:30.476 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-10-06T04:43:30.476 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-10-06T04:43:30.487 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T04:43:30.487 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T04:43:30.597 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T04:43:30.598 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:30.598 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T04:43:30.644 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:30.644 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T04:43:30.730 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:43:30.730 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:30.730 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:43:30.731 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:43:30.869 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:43:30.869 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:30.957 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:43:30.958 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:43:30.958 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:43:30.958 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:43:31.052 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:43:31.052 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:31.137 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T04:43:31.137 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T04:43:31.137 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:43:31.254 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:43:31.259 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:43:31.403 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:43:31.409 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T04:43:31.409 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:43:31.525 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:43:31.530 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T04:43:31.598 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:43:31.714 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:43:31.719 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T04:43:31.787 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:43:31.914 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:43:31.919 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T04:43:31.988 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:43:32.105 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:43:32.109 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T04:43:32.179 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T04:43:32.180 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T04:43:32.271 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T04:43:32.300 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T04:43:32.391 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T04:43:32.420 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T04:43:32.512 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T04:43:32.541 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T04:43:32.633 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T04:43:32.662 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T04:43:32.663 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi158.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:43:32.663 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T04:43:32.732 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:43:32.732 INFO:tasks.ceph:role: osd.0 2023-10-06T04:43:32.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:43:32.733 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:43:32.808 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:43:32.808 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:43:32.808 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:43:32.808 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T04:43:32.809 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:43:32.809 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:43:32.809 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:43:32.809 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:43:32.809 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:43:32.809 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:43:33.246 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-10-06T04:43:33.250 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-10-06T04:43:33.251 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T04:43:33.434 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T04:43:33.513 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T04:43:33.581 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:43:33.582 INFO:tasks.ceph:role: osd.1 2023-10-06T04:43:33.582 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:43:33.582 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:43:33.657 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:43:33.658 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:43:33.658 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:43:33.658 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T04:43:33.658 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:43:33.658 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:43:33.658 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:43:33.658 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:43:33.658 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:43:33.659 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:43:34.105 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-10-06T04:43:34.109 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-10-06T04:43:34.109 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T04:43:34.238 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T04:43:34.314 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T04:43:34.383 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:43:34.383 INFO:tasks.ceph:role: osd.2 2023-10-06T04:43:34.383 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:43:34.383 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:43:34.459 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:43:34.459 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:43:34.460 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:43:34.460 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T04:43:34.460 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:43:34.460 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:43:34.460 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:43:34.460 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:43:34.460 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:43:34.460 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:43:34.904 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-10-06T04:43:34.908 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-10-06T04:43:34.908 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T04:43:35.072 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T04:43:35.149 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T04:43:35.219 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:43:35.219 INFO:tasks.ceph:role: osd.3 2023-10-06T04:43:35.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:43:35.219 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:43:35.295 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:43:35.295 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:43:35.295 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:43:35.296 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T04:43:35.296 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:43:35.296 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:43:35.296 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:43:35.296 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:43:35.296 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:43:35.296 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:43:35.736 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-10-06T04:43:35.739 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-10-06T04:43:35.739 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T04:43:35.860 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T04:43:35.935 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:36.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:36.410+0000 7fbb417bb540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T04:43:36.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:36.411+0000 7fbb417bb540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T04:43:36.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:36.411+0000 7fbb417bb540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:43:36.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:36.411+0000 7fbb417bb540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:43:36.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:36.411+0000 7fbb417bb540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:43:36.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:36.413+0000 7fbb417bb540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T04:43:36.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:36.953+0000 7fbb417bb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:37.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:37.713+0000 7fbb417bb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:38.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:38.477+0000 7fbb417bb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:39.294 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T04:43:39.366 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:39.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:39.463+0000 7f9a89ac4540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T04:43:39.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:39.463+0000 7f9a89ac4540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T04:43:39.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:39.463+0000 7f9a89ac4540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:43:39.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:39.463+0000 7f9a89ac4540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:43:39.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:39.463+0000 7f9a89ac4540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:43:39.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:39.465+0000 7f9a89ac4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T04:43:40.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:40.004+0000 7f9a89ac4540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:40.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:40.762+0000 7f9a89ac4540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:41.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:41.529+0000 7f9a89ac4540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:42.354 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T04:43:42.432 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:42.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:42.531+0000 7f4db3384540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T04:43:42.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:42.531+0000 7f4db3384540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T04:43:42.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:42.531+0000 7f4db3384540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:43:42.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:42.532+0000 7f4db3384540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:43:42.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:42.532+0000 7f4db3384540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:43:42.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:42.533+0000 7f4db3384540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T04:43:43.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:43.081+0000 7f4db3384540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:43.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:43.841+0000 7f4db3384540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:44.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:44.607+0000 7f4db3384540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:45.429 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T04:43:45.501 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:45.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:45.597+0000 7f4e2f93f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T04:43:45.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:45.597+0000 7f4e2f93f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T04:43:45.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:45.597+0000 7f4e2f93f540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:43:45.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:45.598+0000 7f4e2f93f540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:43:45.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:45.598+0000 7f4e2f93f540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:43:45.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:45.599+0000 7f4e2f93f540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T04:43:46.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:46.139+0000 7f4e2f93f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:46.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:46.901+0000 7f4e2f93f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:47.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:43:47.668+0000 7f4e2f93f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:48.482 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T04:43:48.553 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T04:43:48.630 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:43:48.631 INFO:tasks.ceph:role: osd.4 2023-10-06T04:43:48.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:43:48.631 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:43:48.702 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:43:48.702 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:43:48.702 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:43:48.703 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T04:43:48.703 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:43:48.703 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:43:48.703 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:43:48.703 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:43:48.703 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:43:48.703 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:43:48.726 INFO:teuthology.orchestra.run.smithi158.stdout:Discarding blocks...Done. 2023-10-06T04:43:48.729 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-06T04:43:48.729 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T04:43:48.834 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T04:43:48.910 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T04:43:48.980 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:43:48.980 INFO:tasks.ceph:role: osd.5 2023-10-06T04:43:48.981 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:43:48.981 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:43:49.050 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:43:49.050 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:43:49.050 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:43:49.050 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T04:43:49.050 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:43:49.050 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:43:49.050 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:43:49.050 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:43:49.050 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:43:49.050 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:43:49.073 INFO:teuthology.orchestra.run.smithi158.stdout:Discarding blocks...Done. 2023-10-06T04:43:49.078 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-06T04:43:49.078 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T04:43:49.183 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T04:43:49.260 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T04:43:49.330 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:43:49.330 INFO:tasks.ceph:role: osd.6 2023-10-06T04:43:49.331 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:43:49.331 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:43:49.401 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:43:49.401 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:43:49.402 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:43:49.402 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T04:43:49.402 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:43:49.402 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:43:49.402 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:43:49.402 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:43:49.402 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:43:49.403 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:43:49.424 INFO:teuthology.orchestra.run.smithi158.stdout:Discarding blocks...Done. 2023-10-06T04:43:49.428 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-06T04:43:49.428 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T04:43:49.535 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T04:43:49.611 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T04:43:49.681 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:43:49.681 INFO:tasks.ceph:role: osd.7 2023-10-06T04:43:49.681 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:43:49.681 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:43:49.750 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:43:49.750 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:43:49.750 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:43:49.750 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T04:43:49.750 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:43:49.751 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:43:49.751 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:43:49.751 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:43:49.751 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:43:49.751 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:43:49.774 INFO:teuthology.orchestra.run.smithi158.stdout:Discarding blocks...Done. 2023-10-06T04:43:49.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-06T04:43:49.778 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T04:43:49.883 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T04:43:49.958 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:50.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:50.069+0000 7f7718389540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T04:43:50.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:50.069+0000 7f7718389540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T04:43:50.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:50.069+0000 7f7718389540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:43:50.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:50.069+0000 7f7718389540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:43:50.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:50.069+0000 7f7718389540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:43:50.073 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:50.071+0000 7f7718389540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T04:43:50.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:50.607+0000 7f7718389540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:51.371 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:51.369+0000 7f7718389540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:52.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:52.138+0000 7f7718389540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:52.955 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T04:43:53.030 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:53.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:53.129+0000 7f26b2ede540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T04:43:53.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:53.129+0000 7f26b2ede540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T04:43:53.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:53.129+0000 7f26b2ede540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:43:53.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:53.129+0000 7f26b2ede540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:43:53.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:53.129+0000 7f26b2ede540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:43:53.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:53.130+0000 7f26b2ede540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T04:43:53.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:53.668+0000 7f26b2ede540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:54.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:54.432+0000 7f26b2ede540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:55.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:55.195+0000 7f26b2ede540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:56.011 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T04:43:56.084 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:56.184 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:56.182+0000 7fe4affc9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T04:43:56.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:56.182+0000 7fe4affc9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T04:43:56.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:56.182+0000 7fe4affc9540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:43:56.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:56.182+0000 7fe4affc9540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:43:56.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:56.182+0000 7fe4affc9540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:43:56.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:56.183+0000 7fe4affc9540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T04:43:56.725 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:56.723+0000 7fe4affc9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:57.485 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:57.483+0000 7fe4affc9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:58.124 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:43:58.129 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:43:58.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:58.246+0000 7fe4affc9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:59.059 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T04:43:59.131 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:59.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:59.228+0000 7fb2e9834540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T04:43:59.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:59.229+0000 7fb2e9834540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T04:43:59.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:59.229+0000 7fb2e9834540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:43:59.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:59.229+0000 7fb2e9834540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:43:59.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:59.229+0000 7fb2e9834540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:43:59.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:59.230+0000 7fb2e9834540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T04:43:59.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:43:59.770+0000 7fb2e9834540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:44:00.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:00.532+0000 7fb2e9834540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:44:01.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:01.295+0000 7fb2e9834540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:44:02.111 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T04:44:02.182 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T04:44:02.182 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:02.182 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T04:44:02.262 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:02.262 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T04:44:02.332 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:02.332 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T04:44:02.441 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:02.441 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T04:44:02.549 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:02.550 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T04:44:02.658 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:02.658 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T04:44:02.766 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:02.766 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T04:44:02.875 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:02.875 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T04:44:02.949 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:02.949 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T04:44:03.059 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:03.059 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T04:44:03.168 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:03.168 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T04:44:03.277 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:03.277 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T04:44:03.385 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:03.386 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T04:44:03.494 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:03.494 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T04:44:03.603 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:03.604 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T04:44:03.650 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:03.650 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T04:44:03.736 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:03.736 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T04:44:03.782 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:03.782 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T04:44:03.867 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T04:44:03.867 DEBUG:teuthology.orchestra.run.smithi124:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:44:03.872 DEBUG:teuthology.orchestra.run.smithi158:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:44:03.933 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr.y] 2023-10-06T04:44:03.933 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBzkB9lI5AdDxAA2ySdMloWexLYXANF7ODlIQ== 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBzkB9lKBFMHxAAXgC27c+1ERz5OgJHsiAy4A== 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.c] 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBzkB9loGWOKhAAfZgSi/yqg2vp6u8ewu566w== 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.0] 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQB4kB9l+SyRGBAA39xHrh7excQVD8NW32swvg== 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.1] 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQB7kB9lfpKxGxAA3F2cmJ5/fCVxSTYpwim3QA== 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.2] 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQB+kB9lv5/HHxAAqoGgt106VO/Hz5cQHozPwg== 2023-10-06T04:44:03.934 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.3] 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQCBkB9lwh+3IxAA7Eg9nU/Oxv+3UcIniSuZiA== 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr.x] 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBzkB9ligUHGBAAHbLmqM3wPTbD84xLUB/n2w== 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBzkB9lvdR3NhAANuznjRvM5pPthiP1y6Pz4Q== 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.d] 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQB0kB9lXmA5BhAA2JCdPcOUZw1qb5iNn0SLNg== 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.4] 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQCGkB9lxXs1BBAAwZEwn6qRy5C+8I7GhtEj1g== 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.5] 2023-10-06T04:44:03.935 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQCJkB9lhGXKBxAAIlFlDabyRQva71ZvtM+l+g== 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.6] 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQCMkB9lMxz1ChAA824wwFpjXzKt7FvK3EgXFA== 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.7] 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQCPkB9lcRe+DRAA+4LUd77sN+aMHaIh78oTjA== 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout:[client.0] 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQB0kB9lMOEjEBAAntffMklHDpj3DVWL1iTmTQ== 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout:[client.2] 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQB0kB9lg3JIFxAAPmfPWXfFG6FTOtQnvkJ/Hg== 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout:[client.1] 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQB0kB9lT1B7HhAAJbSOHYRH/tQ8+HTJvLd5aA== 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout:[client.3] 2023-10-06T04:44:03.936 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQB0kB9l5oq1JRAAKYKlHwhFevVgR4qCohC3Bg== 2023-10-06T04:44:03.973 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr.y] 2023-10-06T04:44:03.974 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBzkB9lI5AdDxAA2ySdMloWexLYXANF7ODlIQ== 2023-10-06T04:44:03.974 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2023-10-06T04:44:03.974 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBzkB9lKBFMHxAAXgC27c+1ERz5OgJHsiAy4A== 2023-10-06T04:44:03.974 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.c] 2023-10-06T04:44:03.974 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBzkB9loGWOKhAAfZgSi/yqg2vp6u8ewu566w== 2023-10-06T04:44:03.974 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.0] 2023-10-06T04:44:03.974 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB4kB9l+SyRGBAA39xHrh7excQVD8NW32swvg== 2023-10-06T04:44:03.974 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.1] 2023-10-06T04:44:03.975 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB7kB9lfpKxGxAA3F2cmJ5/fCVxSTYpwim3QA== 2023-10-06T04:44:03.975 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.2] 2023-10-06T04:44:03.975 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB+kB9lv5/HHxAAqoGgt106VO/Hz5cQHozPwg== 2023-10-06T04:44:03.975 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.3] 2023-10-06T04:44:03.975 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCBkB9lwh+3IxAA7Eg9nU/Oxv+3UcIniSuZiA== 2023-10-06T04:44:03.975 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr.x] 2023-10-06T04:44:03.975 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBzkB9ligUHGBAAHbLmqM3wPTbD84xLUB/n2w== 2023-10-06T04:44:03.975 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2023-10-06T04:44:03.975 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBzkB9lvdR3NhAANuznjRvM5pPthiP1y6Pz4Q== 2023-10-06T04:44:03.975 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.d] 2023-10-06T04:44:03.976 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB0kB9lXmA5BhAA2JCdPcOUZw1qb5iNn0SLNg== 2023-10-06T04:44:03.976 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.4] 2023-10-06T04:44:03.976 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCGkB9lxXs1BBAAwZEwn6qRy5C+8I7GhtEj1g== 2023-10-06T04:44:03.976 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.5] 2023-10-06T04:44:03.976 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCJkB9lhGXKBxAAIlFlDabyRQva71ZvtM+l+g== 2023-10-06T04:44:03.976 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.6] 2023-10-06T04:44:03.976 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCMkB9lMxz1ChAA824wwFpjXzKt7FvK3EgXFA== 2023-10-06T04:44:03.976 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.7] 2023-10-06T04:44:03.976 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCPkB9lcRe+DRAA+4LUd77sN+aMHaIh78oTjA== 2023-10-06T04:44:03.976 INFO:teuthology.orchestra.run.smithi158.stdout:[client.0] 2023-10-06T04:44:03.977 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB0kB9lMOEjEBAAntffMklHDpj3DVWL1iTmTQ== 2023-10-06T04:44:03.977 INFO:teuthology.orchestra.run.smithi158.stdout:[client.2] 2023-10-06T04:44:03.977 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB0kB9lg3JIFxAAPmfPWXfFG6FTOtQnvkJ/Hg== 2023-10-06T04:44:03.977 INFO:teuthology.orchestra.run.smithi158.stdout:[client.1] 2023-10-06T04:44:03.977 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB0kB9lT1B7HhAAJbSOHYRH/tQ8+HTJvLd5aA== 2023-10-06T04:44:03.977 INFO:teuthology.orchestra.run.smithi158.stdout:[client.3] 2023-10-06T04:44:03.977 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB0kB9l5oq1JRAAKYKlHwhFevVgR4qCohC3Bg== 2023-10-06T04:44:03.979 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:44:03.983 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:44:04.122 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:44:04.126 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:44:04.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:44:04.236 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:44:04.342 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:04.347 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:04.450 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:04.454 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:04.557 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:04.561 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:04.665 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:04.669 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:04.772 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:44:04.776 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:44:04.879 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:44:04.883 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:44:04.989 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:44:04.993 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:44:05.099 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:05.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:05.206 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:05.210 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:05.313 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:05.317 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:05.420 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:05.425 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:44:05.527 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:44:05.532 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:44:05.637 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:44:05.642 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:44:05.748 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:44:05.752 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:44:05.858 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:44:05.862 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:44:05.968 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T04:44:05.968 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T04:44:06.037 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:44:06.154 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T04:44:06.223 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T04:44:06.293 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:44:06.408 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T04:44:06.477 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T04:44:06.548 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:44:06.664 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T04:44:06.734 DEBUG:teuthology.orchestra.run.smithi124:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:44:06.738 DEBUG:teuthology.orchestra.run.smithi158:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:44:06.784 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T04:44:06.784 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T04:44:06.784 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T04:44:06.825 INFO:tasks.ceph.mon.a:Started 2023-10-06T04:44:06.825 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T04:44:06.825 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T04:44:06.829 INFO:tasks.ceph.mon.b:Started 2023-10-06T04:44:06.829 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T04:44:06.830 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T04:44:06.833 INFO:tasks.ceph.mon.c:Started 2023-10-06T04:44:06.834 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T04:44:06.834 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T04:44:06.834 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T04:44:06.838 INFO:tasks.ceph.mgr.y:Started 2023-10-06T04:44:06.838 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T04:44:06.838 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T04:44:06.842 INFO:tasks.ceph.mgr.x:Started 2023-10-06T04:44:06.843 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T04:44:06.843 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T04:44:07.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.033+0000 7fce65fff700 1 Processor -- start 2023-10-06T04:44:07.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.033+0000 7fce65fff700 1 -- start start 2023-10-06T04:44:07.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.034+0000 7fce65fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fce60156680 0x7fce600adc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.034+0000 7fce65fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce600ad790 con 0x7fce601562b0 2023-10-06T04:44:07.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.034+0000 7fce65fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce600acb80 con 0x7fce600cca10 2023-10-06T04:44:07.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.034+0000 7fce65fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600ace60 con 0x7fce60156680 2023-10-06T04:44:07.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.035+0000 7fce5ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fce60156680 0x7fce600adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.035+0000 7fce5effd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fce600cca10 0x7fce600c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:40922/0 (socket says 172.21.15.124:40922) 2023-10-06T04:44:07.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.035+0000 7fce5effd700 1 -- 172.21.15.124:0/1567111850 learned_addr learned my addr 172.21.15.124:0/1567111850 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:07.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.035+0000 7fce5ffff700 1 -- 172.21.15.124:0/1567111850 >> v2:172.21.15.124:3300/0 conn(0x7fce60156680 msgr2=0x7fce600adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T04:44:07.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.035+0000 7fce5ffff700 1 -- 172.21.15.124:0/1567111850 >> v2:172.21.15.124:3300/0 conn(0x7fce60156680 msgr2=0x7fce600adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:44:07.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.035+0000 7fce5ffff700 1 --2- 172.21.15.124:0/1567111850 >> v2:172.21.15.124:3300/0 conn(0x7fce60156680 0x7fce600adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:44:07.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.035+0000 7fce5ffff700 1 --2- 172.21.15.124:0/1567111850 >> v2:172.21.15.124:3300/0 conn(0x7fce60156680 0x7fce600adc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:44:07.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.212+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472306793 0 0) 0x7fce600ad790 con 0x7fce601562b0 2023-10-06T04:44:07.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.212+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce48003570 con 0x7fce601562b0 2023-10-06T04:44:07.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191990658 0 0) 0x7fce600acb80 con 0x7fce600cca10 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce600ad790 con 0x7fce600cca10 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1781343130 0 0) 0x7fce48003570 con 0x7fce601562b0 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 >> v2:172.21.15.124:3300/0 conn(0x7fce60156680 msgr2=0x7fce600adc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 --2- 172.21.15.124:0/1567111850 >> v2:172.21.15.124:3300/0 conn(0x7fce60156680 0x7fce600adc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 >> v1:172.21.15.158:6789/0 conn(0x7fce600cca10 legacy=0x7fce600c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce600ad140 con 0x7fce601562b0 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fce50001470 con 0x7fce601562b0 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 >> v1:172.21.15.124:6789/0 conn(0x7fce601562b0 legacy=0x7fce6015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 --2- 172.21.15.124:0/1567111850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce48003bf0 0x7fce48003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 --2- 172.21.15.124:0/1567111850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce48004810 0x7fce48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 --2- 172.21.15.124:0/1567111850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce48005230 0x7fce4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600ace60 con 0x7fce48003bf0 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4800e370 con 0x7fce48004810 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4800e530 con 0x7fce48005230 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.213+0000 7fce5f7fe700 1 --2- 172.21.15.124:0/1567111850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce48003bf0 0x7fce48003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.214+0000 7fce5f7fe700 1 -- 172.21.15.124:0/1567111850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce48005230 msgr2=0x7fce4800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.214+0000 7fce5f7fe700 1 --2- 172.21.15.124:0/1567111850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce48005230 0x7fce4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.214+0000 7fce5f7fe700 1 -- 172.21.15.124:0/1567111850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce48004810 msgr2=0x7fce48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.214+0000 7fce5f7fe700 1 --2- 172.21.15.124:0/1567111850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce48004810 0x7fce48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.214+0000 7fce5f7fe700 1 -- 172.21.15.124:0/1567111850 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce48003570 con 0x7fce48003bf0 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.214+0000 7fce5ffff700 1 -- 172.21.15.124:0/1567111850 reap_dead start 2023-10-06T04:44:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.214+0000 7fce5f7fe700 1 --2- 172.21.15.124:0/1567111850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce48003bf0 0x7fce48003fe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c1e0 tx=0x7fce50002e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403f293ce45d297c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:07.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.216+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50007a90 con 0x7fce48003bf0 2023-10-06T04:44:07.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.216+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5000cb10 con 0x7fce48003bf0 2023-10-06T04:44:07.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.216+0000 7fce5e7fc700 1 -- 172.21.15.124:0/1567111850 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50006820 con 0x7fce48003bf0 2023-10-06T04:44:07.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.217+0000 7fce65fff700 1 -- 172.21.15.124:0/1567111850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce48003bf0 msgr2=0x7fce48003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.217+0000 7fce65fff700 1 --2- 172.21.15.124:0/1567111850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce48003bf0 0x7fce48003fe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c1e0 tx=0x7fce50002e80 comp rx=0 tx=0).stop 2023-10-06T04:44:07.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.217+0000 7fce65fff700 1 -- 172.21.15.124:0/1567111850 shutdown_connections 2023-10-06T04:44:07.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.217+0000 7fce65fff700 1 --2- 172.21.15.124:0/1567111850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce48003bf0 0x7fce48003fe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.217+0000 7fce65fff700 1 -- 172.21.15.124:0/1567111850 >> 172.21.15.124:0/1567111850 conn(0x7fce600680c0 msgr2=0x7fce600cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:07.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.217+0000 7fce65fff700 1 -- 172.21.15.124:0/1567111850 shutdown_connections 2023-10-06T04:44:07.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.217+0000 7fce65fff700 1 -- 172.21.15.124:0/1567111850 wait complete. 2023-10-06T04:44:07.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.219+0000 7fce65fff700 1 Processor -- start 2023-10-06T04:44:07.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.220+0000 7fce65fff700 1 -- start start 2023-10-06T04:44:07.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.221+0000 7fce65fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce6014d300 0x7fce600c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.221+0000 7fce65fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce60154660 0x7fce600ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.221+0000 7fce65fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce600caac0 0x7fce6014e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.221+0000 7fce65fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600caf40 con 0x7fce6014d300 2023-10-06T04:44:07.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.221+0000 7fce65fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600c2660 con 0x7fce60154660 2023-10-06T04:44:07.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.221+0000 7fce65fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6014db90 con 0x7fce600caac0 2023-10-06T04:44:07.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.221+0000 7fce5f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce6014d300 0x7fce600c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.221+0000 7fce5f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce6014d300 0x7fce600c3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38434/0 (socket says 172.21.15.124:38434) 2023-10-06T04:44:07.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.222+0000 7fce5f7fe700 1 -- 172.21.15.124:0/3868203572 learned_addr learned my addr 172.21.15.124:0/3868203572 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:07.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.222+0000 7fce5ffff700 1 --2- 172.21.15.124:0/3868203572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce600caac0 0x7fce6014e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.222+0000 7fce5effd700 1 --2- 172.21.15.124:0/3868203572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce60154660 0x7fce600ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.222+0000 7fce5f7fe700 1 -- 172.21.15.124:0/3868203572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce600caac0 msgr2=0x7fce6014e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.222+0000 7fce5f7fe700 1 --2- 172.21.15.124:0/3868203572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce600caac0 0x7fce6014e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.222+0000 7fce5f7fe700 1 -- 172.21.15.124:0/3868203572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce60154660 msgr2=0x7fce600ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.222+0000 7fce5f7fe700 1 --2- 172.21.15.124:0/3868203572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce60154660 0x7fce600ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.222+0000 7fce5f7fe700 1 -- 172.21.15.124:0/3868203572 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6014d6d0 con 0x7fce6014d300 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.222+0000 7fce5f7fe700 1 --2- 172.21.15.124:0/3868203572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce6014d300 0x7fce600c3020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce50012000 tx=0x7fce50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.223+0000 7fce477fe700 1 -- 172.21.15.124:0/3868203572 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000c800 con 0x7fce6014d300 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.223+0000 7fce477fe700 1 -- 172.21.15.124:0/3868203572 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce50001640 con 0x7fce6014d300 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.223+0000 7fce65fff700 1 -- 172.21.15.124:0/3868203572 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce60154b20 con 0x7fce6014d300 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.223+0000 7fce477fe700 1 -- 172.21.15.124:0/3868203572 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50001ba0 con 0x7fce6014d300 2023-10-06T04:44:07.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.223+0000 7fce65fff700 1 -- 172.21.15.124:0/3868203572 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce600c2b90 con 0x7fce6014d300 2023-10-06T04:44:07.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.223+0000 7fce477fe700 1 -- 172.21.15.124:0/3868203572 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fce50007280 con 0x7fce6014d300 2023-10-06T04:44:07.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.223+0000 7fce477fe700 1 -- 172.21.15.124:0/3868203572 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fce500023e0 con 0x7fce6014d300 2023-10-06T04:44:07.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.224+0000 7fce65fff700 1 -- 172.21.15.124:0/3868203572 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce60064850 con 0x7fce6014d300 2023-10-06T04:44:07.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.227+0000 7fce477fe700 1 -- 172.21.15.124:0/3868203572 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fce5002c060 con 0x7fce6014d300 2023-10-06T04:44:07.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.304+0000 7fce65fff700 1 -- 172.21.15.124:0/3868203572 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fce600caec0 con 0x7fce6014d300 2023-10-06T04:44:07.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.308+0000 7fce477fe700 1 -- 172.21.15.124:0/3868203572 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fce50036090 con 0x7fce6014d300 2023-10-06T04:44:07.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.309+0000 7fce65fff700 1 -- 172.21.15.124:0/3868203572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce6014d300 msgr2=0x7fce600c3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.309+0000 7fce65fff700 1 --2- 172.21.15.124:0/3868203572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce6014d300 0x7fce600c3020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce50012000 tx=0x7fce50016000 comp rx=0 tx=0).stop 2023-10-06T04:44:07.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.309+0000 7fce65fff700 1 -- 172.21.15.124:0/3868203572 shutdown_connections 2023-10-06T04:44:07.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.309+0000 7fce65fff700 1 --2- 172.21.15.124:0/3868203572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce600caac0 0x7fce6014e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.309+0000 7fce65fff700 1 --2- 172.21.15.124:0/3868203572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce6014d300 0x7fce600c3020 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.309+0000 7fce65fff700 1 --2- 172.21.15.124:0/3868203572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce60154660 0x7fce600ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.309+0000 7fce65fff700 1 -- 172.21.15.124:0/3868203572 >> 172.21.15.124:0/3868203572 conn(0x7fce600680c0 msgr2=0x7fce6014f960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:07.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.309+0000 7fce65fff700 1 -- 172.21.15.124:0/3868203572 shutdown_connections 2023-10-06T04:44:07.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:07.309+0000 7fce65fff700 1 -- 172.21.15.124:0/3868203572 wait complete. 2023-10-06T04:44:07.312 INFO:teuthology.orchestra.run.smithi124.stderr:adjusted tunables profile to default 2023-10-06T04:44:07.327 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T04:44:07.327 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:07.327 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T04:44:07.374 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:07.373+0000 7f1dd80bc1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:44:07.377 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:07.375+0000 7fc4d3a3b1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:44:07.397 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:07.397 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T04:44:07.525 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:07.525 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T04:44:07.587 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:07.585+0000 7fc4d3a3b1c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:44:07.601 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:07.599+0000 7f1dd80bc1c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:44:07.635 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T04:44:07.635 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T04:44:07.744 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:07.744 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T04:44:07.814 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:07.814 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T04:44:07.924 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:07.924 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T04:44:08.001 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:07.999+0000 7fc4d3a3b1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:44:08.007 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:08.006+0000 7f1dd80bc1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:44:08.035 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T04:44:08.035 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T04:44:08.144 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 807ce8ea-baf2-43be-89e4-37b356e735e9 0 2023-10-06T04:44:08.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.373+0000 7f54f2bff700 1 Processor -- start 2023-10-06T04:44:08.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.374+0000 7f54f2bff700 1 -- start start 2023-10-06T04:44:08.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.375+0000 7f54f2bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec15dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.375+0000 7f54f2bff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f54ec06d770 0x7f54ec069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.375+0000 7f54f2bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec068700 con 0x7f54ec0c8840 2023-10-06T04:44:08.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.375+0000 7f54f2bff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ec0c9030 con 0x7f54ec06d770 2023-10-06T04:44:08.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.375+0000 7f54f2bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec068950 con 0x7f54ec159480 2023-10-06T04:44:08.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.375+0000 7f54f119c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f54ec06d770 0x7f54ec069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.375+0000 7f54f099b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec15dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.375+0000 7f54ebfff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f54ec0c8840 0x7f54ec06d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:39250/0 (socket says 172.21.15.158:39250) 2023-10-06T04:44:08.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.375+0000 7f54ebfff700 1 -- 172.21.15.158:0/3387523231 learned_addr learned my addr 172.21.15.158:0/3387523231 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-06T04:44:08.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.376+0000 7f54f099b700 1 -- 172.21.15.158:0/3387523231 >> v2:172.21.15.158:3300/0 conn(0x7f54ec06d770 msgr2=0x7f54ec069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:08.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.376+0000 7f54f099b700 1 --2- 172.21.15.158:0/3387523231 >> v2:172.21.15.158:3300/0 conn(0x7f54ec06d770 0x7f54ec069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.376+0000 7f54f099b700 1 -- 172.21.15.158:0/3387523231 >> v1:172.21.15.158:6789/0 conn(0x7f54ec0c8840 legacy=0x7f54ec06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.376+0000 7f54f099b700 1 -- 172.21.15.158:0/3387523231 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec068c30 con 0x7f54ec159480 2023-10-06T04:44:08.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.376+0000 7f54eb7fe700 1 -- 172.21.15.158:0/3387523231 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931634936 0 0) 0x7f54ec068700 con 0x7f54ec0c8840 2023-10-06T04:44:08.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.376+0000 7f54f099b700 1 --2- 172.21.15.158:0/3387523231 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec15dce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f54e00098e0 tx=0x7f54e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7b0963f15f10888 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:08.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.376+0000 7f54eb7fe700 1 -- 172.21.15.158:0/3387523231 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e000b640 con 0x7f54ec159480 2023-10-06T04:44:08.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.376+0000 7f54eb7fe700 1 -- 172.21.15.158:0/3387523231 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e000b7a0 con 0x7f54ec159480 2023-10-06T04:44:08.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.376+0000 7f54eb7fe700 1 -- 172.21.15.158:0/3387523231 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e000bb40 con 0x7f54ec159480 2023-10-06T04:44:08.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.377+0000 7f54f2bff700 1 -- 172.21.15.158:0/3387523231 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 msgr2=0x7f54ec15dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.377+0000 7f54f2bff700 1 --2- 172.21.15.158:0/3387523231 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec15dce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f54e00098e0 tx=0x7f54e00091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.377+0000 7f54f2bff700 1 -- 172.21.15.158:0/3387523231 shutdown_connections 2023-10-06T04:44:08.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.377+0000 7f54f2bff700 1 --2- 172.21.15.158:0/3387523231 >> v2:172.21.15.158:3300/0 conn(0x7f54ec06d770 0x7f54ec069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.377+0000 7f54f2bff700 1 --2- 172.21.15.158:0/3387523231 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec15dce0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.377+0000 7f54f2bff700 1 -- 172.21.15.158:0/3387523231 >> 172.21.15.158:0/3387523231 conn(0x7f54ec063cc0 msgr2=0x7f54ec0ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:08.382 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.377+0000 7f54f2bff700 1 -- 172.21.15.158:0/3387523231 shutdown_connections 2023-10-06T04:44:08.382 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.377+0000 7f54f2bff700 1 -- 172.21.15.158:0/3387523231 wait complete. 2023-10-06T04:44:08.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.378+0000 7f54f2bff700 1 Processor -- start 2023-10-06T04:44:08.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.379+0000 7f54f2bff700 1 -- start start 2023-10-06T04:44:08.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.379+0000 7f54f2bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54ec06d770 0x7f54ec0c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f2bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54ec0c8840 0x7f54ec153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f2bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f2bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec15a9f0 con 0x7f54ec0c8840 2023-10-06T04:44:08.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f2bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec159d50 con 0x7f54ec06d770 2023-10-06T04:44:08.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f2bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec15a030 con 0x7f54ec159480 2023-10-06T04:44:08.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f099b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54ec06d770 0x7f54ec0c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f119c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f119c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec0cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:40856/0 (socket says 172.21.15.158:40856) 2023-10-06T04:44:08.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f099b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54ec06d770 0x7f54ec0c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:43000/0 (socket says 172.21.15.158:43000) 2023-10-06T04:44:08.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f119c700 1 -- 172.21.15.158:0/720805258 learned_addr learned my addr 172.21.15.158:0/720805258 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:08.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54ebfff700 1 --2- 172.21.15.158:0/720805258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54ec0c8840 0x7f54ec153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f119c700 1 -- 172.21.15.158:0/720805258 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54ec06d770 msgr2=0x7f54ec0c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f119c700 1 --2- 172.21.15.158:0/720805258 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54ec06d770 0x7f54ec0c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f119c700 1 -- 172.21.15.158:0/720805258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54ec0c8840 msgr2=0x7f54ec153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f119c700 1 --2- 172.21.15.158:0/720805258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54ec0c8840 0x7f54ec153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f119c700 1 -- 172.21.15.158:0/720805258 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e0009420 con 0x7f54ec159480 2023-10-06T04:44:08.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.380+0000 7f54f099b700 1 --2- 172.21.15.158:0/720805258 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54ec06d770 0x7f54ec0c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:08.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.381+0000 7f54f119c700 1 --2- 172.21.15.158:0/720805258 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec0cbdd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009d10 tx=0x7f54e400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:08.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.381+0000 7f54e8ff9700 1 -- 172.21.15.158:0/720805258 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4009e70 con 0x7f54ec159480 2023-10-06T04:44:08.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.381+0000 7f54e8ff9700 1 -- 172.21.15.158:0/720805258 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e400f040 con 0x7f54ec159480 2023-10-06T04:44:08.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.381+0000 7f54e8ff9700 1 -- 172.21.15.158:0/720805258 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e400ccf0 con 0x7f54ec159480 2023-10-06T04:44:08.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.381+0000 7f54f2bff700 1 -- 172.21.15.158:0/720805258 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec15a310 con 0x7f54ec159480 2023-10-06T04:44:08.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.381+0000 7f54f2bff700 1 -- 172.21.15.158:0/720805258 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec0c8460 con 0x7f54ec159480 2023-10-06T04:44:08.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.381+0000 7f54e8ff9700 1 -- 172.21.15.158:0/720805258 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f54e4014690 con 0x7f54ec159480 2023-10-06T04:44:08.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.381+0000 7f54e8ff9700 1 -- 172.21.15.158:0/720805258 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f54e401d750 con 0x7f54ec159480 2023-10-06T04:44:08.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.382+0000 7f54f2bff700 1 -- 172.21.15.158:0/720805258 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec04c380 con 0x7f54ec159480 2023-10-06T04:44:08.389 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.387+0000 7f54e8ff9700 1 -- 172.21.15.158:0/720805258 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f54e403b6d0 con 0x7f54ec159480 2023-10-06T04:44:08.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.473+0000 7f54f2bff700 1 -- 172.21.15.158:0/720805258 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd new", "uuid": "807ce8ea-baf2-43be-89e4-37b356e735e9", "id": 0} v 0) v1 -- 0x7f54ec068f10 con 0x7f54ec159480 2023-10-06T04:44:08.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.479+0000 7f54e8ff9700 1 -- 172.21.15.158:0/720805258 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "807ce8ea-baf2-43be-89e4-37b356e735e9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54e402a070 con 0x7f54ec159480 2023-10-06T04:44:08.481 INFO:teuthology.orchestra.run.smithi158.stdout:0 2023-10-06T04:44:08.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.480+0000 7f54f2bff700 1 -- 172.21.15.158:0/720805258 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 msgr2=0x7f54ec0cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.480+0000 7f54f2bff700 1 --2- 172.21.15.158:0/720805258 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec0cbdd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009d10 tx=0x7f54e400b040 comp rx=0 tx=0).stop 2023-10-06T04:44:08.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.480+0000 7f54f2bff700 1 -- 172.21.15.158:0/720805258 shutdown_connections 2023-10-06T04:44:08.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.480+0000 7f54f2bff700 1 --2- 172.21.15.158:0/720805258 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54ec159480 0x7f54ec0cbdd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.480+0000 7f54f2bff700 1 --2- 172.21.15.158:0/720805258 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54ec06d770 0x7f54ec0c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.480+0000 7f54f2bff700 1 --2- 172.21.15.158:0/720805258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54ec0c8840 0x7f54ec153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.480+0000 7f54f2bff700 1 -- 172.21.15.158:0/720805258 >> 172.21.15.158:0/720805258 conn(0x7f54ec063cc0 msgr2=0x7f54ec0b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:08.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.480+0000 7f54f2bff700 1 -- 172.21.15.158:0/720805258 shutdown_connections 2023-10-06T04:44:08.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.480+0000 7f54f2bff700 1 -- 172.21.15.158:0/720805258 wait complete. 2023-10-06T04:44:08.499 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new c75a4623-8fcc-4936-9425-87f83d2c27c8 1 2023-10-06T04:44:08.625 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:08.624+0000 7f1dd80bc1c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:44:08.664 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:08.662+0000 7fc4d3a3b1c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:44:08.691 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.688+0000 7f1b135ff700 1 Processor -- start 2023-10-06T04:44:08.691 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.688+0000 7f1b135ff700 1 -- start start 2023-10-06T04:44:08.692 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b135ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0a9cf0 0x7f1b0c069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.692 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b135ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1b0c0aa0c0 0x7f1b0c06a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.692 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b135ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0c15df90 con 0x7f1b0c0675f0 2023-10-06T04:44:08.692 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b135ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c0ab310 con 0x7f1b0c0aa0c0 2023-10-06T04:44:08.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b135ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c06aa00 con 0x7f1b0c0a9cf0 2023-10-06T04:44:08.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b1139b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0a9cf0 0x7f1b0c069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b10b9a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1b0c0aa0c0 0x7f1b0c06a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b1139b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0a9cf0 0x7f1b0c069f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:40866/0 (socket says 172.21.15.158:40866) 2023-10-06T04:44:08.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b1139b700 1 -- 172.21.15.158:0/1761921347 learned_addr learned my addr 172.21.15.158:0/1761921347 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:08.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b1139b700 1 -- 172.21.15.158:0/1761921347 >> v2:172.21.15.158:3300/0 conn(0x7f1b0c0aa0c0 msgr2=0x7f1b0c06a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:08.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b1139b700 1 --2- 172.21.15.158:0/1761921347 >> v2:172.21.15.158:3300/0 conn(0x7f1b0c0aa0c0 0x7f1b0c06a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b1139b700 1 -- 172.21.15.158:0/1761921347 >> v1:172.21.15.124:6789/0 conn(0x7f1b0c0675f0 legacy=0x7f1b0c067a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b03fff700 1 -- 172.21.15.158:0/1761921347 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377831495 0 0) 0x7f1b0c15df90 con 0x7f1b0c0675f0 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.690+0000 7f1b1139b700 1 -- 172.21.15.158:0/1761921347 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c15d380 con 0x7f1b0c0a9cf0 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.691+0000 7f1b10b9a700 1 --2- 172.21.15.158:0/1761921347 >> v2:172.21.15.158:3300/0 conn(0x7f1b0c0aa0c0 0x7f1b0c06a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.691+0000 7f1b1139b700 1 --2- 172.21.15.158:0/1761921347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0a9cf0 0x7f1b0c069f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1b080099b0 tx=0x7f1b08009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0d2659ca6f8145 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.691+0000 7f1b03fff700 1 -- 172.21.15.158:0/1761921347 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08009ea0 con 0x7f1b0c0a9cf0 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.691+0000 7f1b03fff700 1 -- 172.21.15.158:0/1761921347 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0800b860 con 0x7f1b0c0a9cf0 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.691+0000 7f1b03fff700 1 -- 172.21.15.158:0/1761921347 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800bc00 con 0x7f1b0c0a9cf0 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.692+0000 7f1b135ff700 1 -- 172.21.15.158:0/1761921347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0a9cf0 msgr2=0x7f1b0c069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.692+0000 7f1b135ff700 1 --2- 172.21.15.158:0/1761921347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0a9cf0 0x7f1b0c069f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1b080099b0 tx=0x7f1b08009250 comp rx=0 tx=0).stop 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.692+0000 7f1b135ff700 1 -- 172.21.15.158:0/1761921347 shutdown_connections 2023-10-06T04:44:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.692+0000 7f1b135ff700 1 --2- 172.21.15.158:0/1761921347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0a9cf0 0x7f1b0c069f80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.696 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.692+0000 7f1b135ff700 1 --2- 172.21.15.158:0/1761921347 >> v2:172.21.15.158:3300/0 conn(0x7f1b0c0aa0c0 0x7f1b0c06a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.696 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.692+0000 7f1b135ff700 1 -- 172.21.15.158:0/1761921347 >> 172.21.15.158:0/1761921347 conn(0x7f1b0c06bf10 msgr2=0x7f1b0c0ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:08.696 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.692+0000 7f1b135ff700 1 -- 172.21.15.158:0/1761921347 shutdown_connections 2023-10-06T04:44:08.696 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.692+0000 7f1b135ff700 1 -- 172.21.15.158:0/1761921347 wait complete. 2023-10-06T04:44:08.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.694+0000 7f1b135ff700 1 Processor -- start 2023-10-06T04:44:08.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.694+0000 7f1b135ff700 1 -- start start 2023-10-06T04:44:08.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b135ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0675f0 0x7f1b0c150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b135ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b0c0a9cf0 0x7f1b0c15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b135ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1b0c0aa0c0 0x7f1b0c169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b135ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0b0700 con 0x7f1b0c0aa0c0 2023-10-06T04:44:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b135ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0b15c0 con 0x7f1b0c0a9cf0 2023-10-06T04:44:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b135ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c1541d0 con 0x7f1b0c0675f0 2023-10-06T04:44:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b1139b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0675f0 0x7f1b0c150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b10b9a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b0c0a9cf0 0x7f1b0c15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b1139b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0675f0 0x7f1b0c150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:40872/0 (socket says 172.21.15.158:40872) 2023-10-06T04:44:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b10b9a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b0c0a9cf0 0x7f1b0c15c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:43004/0 (socket says 172.21.15.158:43004) 2023-10-06T04:44:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b1139b700 1 -- 172.21.15.158:0/3754149542 learned_addr learned my addr 172.21.15.158:0/3754149542 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:08.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.696+0000 7f1b11b9c700 1 --2- 172.21.15.158:0/3754149542 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1b0c0aa0c0 0x7f1b0c169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b1139b700 1 -- 172.21.15.158:0/3754149542 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b0c0a9cf0 msgr2=0x7f1b0c15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b1139b700 1 --2- 172.21.15.158:0/3754149542 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b0c0a9cf0 0x7f1b0c15c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b1139b700 1 -- 172.21.15.158:0/3754149542 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1b0c0aa0c0 msgr2=0x7f1b0c169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b1139b700 1 --2- 172.21.15.158:0/3754149542 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1b0c0aa0c0 0x7f1b0c169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b1139b700 1 -- 172.21.15.158:0/3754149542 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc009420 con 0x7f1b0c0675f0 2023-10-06T04:44:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b1139b700 1 --2- 172.21.15.158:0/3754149542 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0675f0 0x7f1b0c150f50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c06ab40 tx=0x7f1b08017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b017fa700 1 -- 172.21.15.158:0/3754149542 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08000d10 con 0x7f1b0c0675f0 2023-10-06T04:44:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b017fa700 1 -- 172.21.15.158:0/3754149542 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0800bbe0 con 0x7f1b0c0675f0 2023-10-06T04:44:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b135ff700 1 -- 172.21.15.158:0/3754149542 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b080094f0 con 0x7f1b0c0675f0 2023-10-06T04:44:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b017fa700 1 -- 172.21.15.158:0/3754149542 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08011670 con 0x7f1b0c0675f0 2023-10-06T04:44:08.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.697+0000 7f1b135ff700 1 -- 172.21.15.158:0/3754149542 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0c0b0420 con 0x7f1b0c0675f0 2023-10-06T04:44:08.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.698+0000 7f1b017fa700 1 -- 172.21.15.158:0/3754149542 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1b08011d20 con 0x7f1b0c0675f0 2023-10-06T04:44:08.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.698+0000 7f1b017fa700 1 -- 172.21.15.158:0/3754149542 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f1b0802edc0 con 0x7f1b0c0675f0 2023-10-06T04:44:08.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.699+0000 7f1b135ff700 1 -- 172.21.15.158:0/3754149542 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0c04c380 con 0x7f1b0c0675f0 2023-10-06T04:44:08.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.701+0000 7f1b017fa700 1 -- 172.21.15.158:0/3754149542 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1b08033060 con 0x7f1b0c0675f0 2023-10-06T04:44:08.793 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:08.792+0000 7f1dd80bc1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:44:08.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.798+0000 7f1b135ff700 1 -- 172.21.15.158:0/3754149542 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c75a4623-8fcc-4936-9425-87f83d2c27c8", "id": 1} v 0) v1 -- 0x7f1b0c15d660 con 0x7f1b0c0675f0 2023-10-06T04:44:08.809 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.806+0000 7f1b017fa700 1 -- 172.21.15.158:0/3754149542 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c75a4623-8fcc-4936-9425-87f83d2c27c8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1b08015020 con 0x7f1b0c0675f0 2023-10-06T04:44:08.809 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-06T04:44:08.810 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.807+0000 7f1b135ff700 1 -- 172.21.15.158:0/3754149542 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0675f0 msgr2=0x7f1b0c150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.810 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.807+0000 7f1b135ff700 1 --2- 172.21.15.158:0/3754149542 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0675f0 0x7f1b0c150f50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c06ab40 tx=0x7f1b08017000 comp rx=0 tx=0).stop 2023-10-06T04:44:08.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.808+0000 7f1b135ff700 1 -- 172.21.15.158:0/3754149542 shutdown_connections 2023-10-06T04:44:08.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.808+0000 7f1b135ff700 1 --2- 172.21.15.158:0/3754149542 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1b0c0aa0c0 0x7f1b0c169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.808+0000 7f1b135ff700 1 --2- 172.21.15.158:0/3754149542 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b0c0675f0 0x7f1b0c150f50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.808+0000 7f1b135ff700 1 --2- 172.21.15.158:0/3754149542 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b0c0a9cf0 0x7f1b0c15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.808+0000 7f1b135ff700 1 -- 172.21.15.158:0/3754149542 >> 172.21.15.158:0/3754149542 conn(0x7f1b0c06bf10 msgr2=0x7f1b0c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:08.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.808+0000 7f1b135ff700 1 -- 172.21.15.158:0/3754149542 shutdown_connections 2023-10-06T04:44:08.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:08.808+0000 7f1b135ff700 1 -- 172.21.15.158:0/3754149542 wait complete. 2023-10-06T04:44:08.827 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new d9bef997-67c1-4421-861f-d44964c1db74 2 2023-10-06T04:44:08.855 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:08.853+0000 7fc4d3a3b1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:44:09.014 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.012+0000 7f98fb5ff700 1 Processor -- start 2023-10-06T04:44:09.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.012+0000 7f98fb5ff700 1 -- start start 2023-10-06T04:44:09.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.013+0000 7f98fb5ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98f4159680 0x7f98f40b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.013+0000 7f98fb5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.013+0000 7f98fb5ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f415d620 con 0x7f98f41592b0 2023-10-06T04:44:09.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.013+0000 7f98fb5ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f415d0d0 con 0x7f98f4159680 2023-10-06T04:44:09.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.013+0000 7f98fb5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40b2ed0 con 0x7f98f40cc780 2023-10-06T04:44:09.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f8b9a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98f4159680 0x7f98f40b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f9b9c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f8b9a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98f4159680 0x7f98f40b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:43018/0 (socket says 172.21.15.158:43018) 2023-10-06T04:44:09.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f9b9c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f40ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:40880/0 (socket says 172.21.15.158:40880) 2023-10-06T04:44:09.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f939b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f98f41592b0 0x7f98f415dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:39264/0 (socket says 172.21.15.158:39264) 2023-10-06T04:44:09.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f8b9a700 1 -- 172.21.15.158:0/2505978171 learned_addr learned my addr 172.21.15.158:0/2505978171 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:09.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f9b9c700 1 -- 172.21.15.158:0/2505978171 >> v2:172.21.15.158:3300/0 conn(0x7f98f4159680 msgr2=0x7f98f40b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:09.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f9b9c700 1 --2- 172.21.15.158:0/2505978171 >> v2:172.21.15.158:3300/0 conn(0x7f98f4159680 0x7f98f40b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f9b9c700 1 -- 172.21.15.158:0/2505978171 >> v1:172.21.15.158:6789/0 conn(0x7f98f41592b0 legacy=0x7f98f415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f9b9c700 1 -- 172.21.15.158:0/2505978171 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f40ccc00 con 0x7f98f40cc780 2023-10-06T04:44:09.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f8b9a700 1 --2- 172.21.15.158:0/2505978171 >> v2:172.21.15.158:3300/0 conn(0x7f98f4159680 0x7f98f40b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:09.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98ebfff700 1 -- 172.21.15.158:0/2505978171 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491140767 0 0) 0x7f98f415d620 con 0x7f98f41592b0 2023-10-06T04:44:09.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.014+0000 7f98f9b9c700 1 --2- 172.21.15.158:0/2505978171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f40ccea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009e60 tx=0x7f98ec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82590eb1c045650e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98ebfff700 1 -- 172.21.15.158:0/2505978171 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec00e070 con 0x7f98f40cc780 2023-10-06T04:44:09.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98ebfff700 1 -- 172.21.15.158:0/2505978171 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec00bb60 con 0x7f98f40cc780 2023-10-06T04:44:09.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98ebfff700 1 -- 172.21.15.158:0/2505978171 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec012430 con 0x7f98f40cc780 2023-10-06T04:44:09.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98fb5ff700 1 -- 172.21.15.158:0/2505978171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 msgr2=0x7f98f40ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98fb5ff700 1 --2- 172.21.15.158:0/2505978171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f40ccea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009e60 tx=0x7f98ec009780 comp rx=0 tx=0).stop 2023-10-06T04:44:09.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98fb5ff700 1 -- 172.21.15.158:0/2505978171 shutdown_connections 2023-10-06T04:44:09.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98fb5ff700 1 --2- 172.21.15.158:0/2505978171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f40ccea0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98fb5ff700 1 --2- 172.21.15.158:0/2505978171 >> v2:172.21.15.158:3300/0 conn(0x7f98f4159680 0x7f98f40b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98fb5ff700 1 -- 172.21.15.158:0/2505978171 >> 172.21.15.158:0/2505978171 conn(0x7f98f406ed20 msgr2=0x7f98f406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98fb5ff700 1 -- 172.21.15.158:0/2505978171 shutdown_connections 2023-10-06T04:44:09.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.015+0000 7f98fb5ff700 1 -- 172.21.15.158:0/2505978171 wait complete. 2023-10-06T04:44:09.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.017+0000 7f98fb5ff700 1 Processor -- start 2023-10-06T04:44:09.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.017+0000 7f98fb5ff700 1 -- start start 2023-10-06T04:44:09.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98fb5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f416c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98fb5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98f41592b0 0x7f98f41698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98fb5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98f4159680 0x7f98f40c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98fb5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f41562f0 con 0x7f98f4159680 2023-10-06T04:44:09.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98fb5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40c51d0 con 0x7f98f41592b0 2023-10-06T04:44:09.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98fb5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40c9f70 con 0x7f98f40cc780 2023-10-06T04:44:09.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98f939b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f416c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98f939b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f416c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:40888/0 (socket says 172.21.15.158:40888) 2023-10-06T04:44:09.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98f939b700 1 -- 172.21.15.158:0/3819392318 learned_addr learned my addr 172.21.15.158:0/3819392318 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:09.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98f8b9a700 1 --2- 172.21.15.158:0/3819392318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98f41592b0 0x7f98f41698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.018+0000 7f98f9b9c700 1 --2- 172.21.15.158:0/3819392318 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98f4159680 0x7f98f40c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98f939b700 1 -- 172.21.15.158:0/3819392318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98f41592b0 msgr2=0x7f98f41698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98f939b700 1 --2- 172.21.15.158:0/3819392318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98f41592b0 0x7f98f41698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98f939b700 1 -- 172.21.15.158:0/3819392318 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98f4159680 msgr2=0x7f98f40c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98f939b700 1 --2- 172.21.15.158:0/3819392318 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98f4159680 0x7f98f40c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98f939b700 1 -- 172.21.15.158:0/3819392318 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e40094f0 con 0x7f98f40cc780 2023-10-06T04:44:09.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98f9b9c700 1 --2- 172.21.15.158:0/3819392318 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98f4159680 0x7f98f40c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:09.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98f939b700 1 --2- 172.21.15.158:0/3819392318 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f416c910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f98f00011e0 tx=0x7f98f0007e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98e97fa700 1 -- 172.21.15.158:0/3819392318 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0005a70 con 0x7f98f40cc780 2023-10-06T04:44:09.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98e97fa700 1 -- 172.21.15.158:0/3819392318 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f0005bd0 con 0x7f98f40cc780 2023-10-06T04:44:09.027 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98fb5ff700 1 -- 172.21.15.158:0/3819392318 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec009a20 con 0x7f98f40cc780 2023-10-06T04:44:09.027 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98e97fa700 1 -- 172.21.15.158:0/3819392318 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f00070d0 con 0x7f98f40cc780 2023-10-06T04:44:09.027 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98fb5ff700 1 -- 172.21.15.158:0/3819392318 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f40ca530 con 0x7f98f40cc780 2023-10-06T04:44:09.027 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.019+0000 7f98e97fa700 1 -- 172.21.15.158:0/3819392318 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f98f0012400 con 0x7f98f40cc780 2023-10-06T04:44:09.027 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.020+0000 7f98e97fa700 1 -- 172.21.15.158:0/3819392318 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f98f0012ae0 con 0x7f98f40cc780 2023-10-06T04:44:09.027 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.020+0000 7f98fb5ff700 1 -- 172.21.15.158:0/3819392318 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f40c4fa0 con 0x7f98f40cc780 2023-10-06T04:44:09.028 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.025+0000 7f98e97fa700 1 -- 172.21.15.158:0/3819392318 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f98f40c4fa0 con 0x7f98f40cc780 2023-10-06T04:44:09.113 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.111+0000 7f98fb5ff700 1 -- 172.21.15.158:0/3819392318 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d9bef997-67c1-4421-861f-d44964c1db74", "id": 2} v 0) v1 -- 0x7f98f404c380 con 0x7f98f40cc780 2023-10-06T04:44:09.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.119+0000 7f98e97fa700 1 -- 172.21.15.158:0/3819392318 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9bef997-67c1-4421-861f-d44964c1db74", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f98f0021060 con 0x7f98f40cc780 2023-10-06T04:44:09.121 INFO:teuthology.orchestra.run.smithi158.stdout:2 2023-10-06T04:44:09.122 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.120+0000 7f98fb5ff700 1 -- 172.21.15.158:0/3819392318 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 msgr2=0x7f98f416c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.122 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.120+0000 7f98fb5ff700 1 --2- 172.21.15.158:0/3819392318 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f416c910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f98f00011e0 tx=0x7f98f0007e10 comp rx=0 tx=0).stop 2023-10-06T04:44:09.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.120+0000 7f98fb5ff700 1 -- 172.21.15.158:0/3819392318 shutdown_connections 2023-10-06T04:44:09.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.120+0000 7f98fb5ff700 1 --2- 172.21.15.158:0/3819392318 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98f4159680 0x7f98f40c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.120+0000 7f98fb5ff700 1 --2- 172.21.15.158:0/3819392318 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98f40cc780 0x7f98f416c910 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.120+0000 7f98fb5ff700 1 --2- 172.21.15.158:0/3819392318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98f41592b0 0x7f98f41698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.120+0000 7f98fb5ff700 1 -- 172.21.15.158:0/3819392318 >> 172.21.15.158:0/3819392318 conn(0x7f98f406ed20 msgr2=0x7f98f40684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.120+0000 7f98fb5ff700 1 -- 172.21.15.158:0/3819392318 shutdown_connections 2023-10-06T04:44:09.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.120+0000 7f98fb5ff700 1 -- 172.21.15.158:0/3819392318 wait complete. 2023-10-06T04:44:09.139 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b 3 2023-10-06T04:44:09.222 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:09.221+0000 7f1dd80bc1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:44:09.298 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:09.296+0000 7fc4d3a3b1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:44:09.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.366+0000 7f9bce5ff700 1 Processor -- start 2023-10-06T04:44:09.370 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.367+0000 7f9bce5ff700 1 -- start start 2023-10-06T04:44:09.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bce5ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9bc8157700 0x7f9bc806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bce5ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9bc806a3d0 0x7f9bc80aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bce5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc80694c0 0x7f9bc8069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bce5ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc8157ad0 con 0x7f9bc8157700 2023-10-06T04:44:09.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bce5ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc8069e40 con 0x7f9bc806a3d0 2023-10-06T04:44:09.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bce5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc806db30 con 0x7f9bc80694c0 2023-10-06T04:44:09.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bbffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9bc806a3d0 0x7f9bc80aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bccb9c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc80694c0 0x7f9bc8069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bbffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9bc806a3d0 0x7f9bc80aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:43030/0 (socket says 172.21.15.158:43030) 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bbffff700 1 -- 172.21.15.158:0/1874476463 learned_addr learned my addr 172.21.15.158:0/1874476463 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.368+0000 7f9bc7fff700 1 --2- 172.21.15.158:0/1874476463 >> v2:172.21.15.124:3300/0 conn(0x7f9bc8157700 0x7f9bc806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.369+0000 7f9bccb9c700 1 -- 172.21.15.158:0/1874476463 >> v2:172.21.15.158:3300/0 conn(0x7f9bc806a3d0 msgr2=0x7f9bc80aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.369+0000 7f9bccb9c700 1 --2- 172.21.15.158:0/1874476463 >> v2:172.21.15.158:3300/0 conn(0x7f9bc806a3d0 0x7f9bc80aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.369+0000 7f9bccb9c700 1 -- 172.21.15.158:0/1874476463 >> v2:172.21.15.124:3300/0 conn(0x7f9bc8157700 msgr2=0x7f9bc806d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.369+0000 7f9bccb9c700 1 --2- 172.21.15.158:0/1874476463 >> v2:172.21.15.124:3300/0 conn(0x7f9bc8157700 0x7f9bc806d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.369+0000 7f9bccb9c700 1 -- 172.21.15.158:0/1874476463 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc806de10 con 0x7f9bc80694c0 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.369+0000 7f9bbffff700 1 --2- 172.21.15.158:0/1874476463 >> v2:172.21.15.158:3300/0 conn(0x7f9bc806a3d0 0x7f9bc80aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.369+0000 7f9bccb9c700 1 --2- 172.21.15.158:0/1874476463 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc80694c0 0x7f9bc8069900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80c2fb0 tx=0x7f9bc0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca55520b25a8b836 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.369+0000 7f9bc77fe700 1 -- 172.21.15.158:0/1874476463 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc000e070 con 0x7f9bc80694c0 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.369+0000 7f9bc77fe700 1 -- 172.21.15.158:0/1874476463 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc000bab0 con 0x7f9bc80694c0 2023-10-06T04:44:09.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.369+0000 7f9bc77fe700 1 -- 172.21.15.158:0/1874476463 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc000be70 con 0x7f9bc80694c0 2023-10-06T04:44:09.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.370+0000 7f9bce5ff700 1 -- 172.21.15.158:0/1874476463 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc80694c0 msgr2=0x7f9bc8069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.370+0000 7f9bce5ff700 1 --2- 172.21.15.158:0/1874476463 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc80694c0 0x7f9bc8069900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80c2fb0 tx=0x7f9bc0009780 comp rx=0 tx=0).stop 2023-10-06T04:44:09.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.370+0000 7f9bce5ff700 1 -- 172.21.15.158:0/1874476463 shutdown_connections 2023-10-06T04:44:09.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.370+0000 7f9bce5ff700 1 --2- 172.21.15.158:0/1874476463 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc80694c0 0x7f9bc8069900 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.370+0000 7f9bce5ff700 1 --2- 172.21.15.158:0/1874476463 >> v2:172.21.15.124:3300/0 conn(0x7f9bc8157700 0x7f9bc806d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.370+0000 7f9bce5ff700 1 --2- 172.21.15.158:0/1874476463 >> v2:172.21.15.158:3300/0 conn(0x7f9bc806a3d0 0x7f9bc80aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.370+0000 7f9bce5ff700 1 -- 172.21.15.158:0/1874476463 >> 172.21.15.158:0/1874476463 conn(0x7f9bc80680c0 msgr2=0x7f9bc80cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.370+0000 7f9bce5ff700 1 -- 172.21.15.158:0/1874476463 shutdown_connections 2023-10-06T04:44:09.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.370+0000 7f9bce5ff700 1 -- 172.21.15.158:0/1874476463 wait complete. 2023-10-06T04:44:09.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.372+0000 7f9bce5ff700 1 Processor -- start 2023-10-06T04:44:09.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.372+0000 7f9bce5ff700 1 -- start start 2023-10-06T04:44:09.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bce5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9bc80694c0 0x7f9bc80c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bce5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc806a3d0 0x7f9bc81484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bce5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bc8157700 0x7f9bc80bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bce5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc8148a20 con 0x7f9bc80694c0 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bce5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80a98a0 con 0x7f9bc8157700 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bce5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc815a830 con 0x7f9bc806a3d0 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bbffff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc806a3d0 0x7f9bc81484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bbffff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc806a3d0 0x7f9bc81484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:40900/0 (socket says 172.21.15.158:40900) 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bbffff700 1 -- 172.21.15.158:0/415853271 learned_addr learned my addr 172.21.15.158:0/415853271 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bccb9c700 1 --2- 172.21.15.158:0/415853271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bc8157700 0x7f9bc80bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.373+0000 7f9bc7fff700 1 --2- 172.21.15.158:0/415853271 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9bc80694c0 0x7f9bc80c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bc7fff700 1 -- 172.21.15.158:0/415853271 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc806a3d0 msgr2=0x7f9bc81484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bc7fff700 1 --2- 172.21.15.158:0/415853271 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc806a3d0 0x7f9bc81484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bc7fff700 1 -- 172.21.15.158:0/415853271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bc8157700 msgr2=0x7f9bc80bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bc7fff700 1 --2- 172.21.15.158:0/415853271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bc8157700 0x7f9bc80bff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bc7fff700 1 -- 172.21.15.158:0/415853271 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00094f0 con 0x7f9bc80694c0 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bc7fff700 1 --2- 172.21.15.158:0/415853271 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9bc80694c0 0x7f9bc80c2990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800ea50 tx=0x7f9bb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bc4ff9700 1 -- 172.21.15.158:0/415853271 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800c7f0 con 0x7f9bc80694c0 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bc4ff9700 1 -- 172.21.15.158:0/415853271 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb800c950 con 0x7f9bc80694c0 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bce5ff700 1 -- 172.21.15.158:0/415853271 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc0009a20 con 0x7f9bc80694c0 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bc4ff9700 1 -- 172.21.15.158:0/415853271 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800ccd0 con 0x7f9bc80694c0 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bce5ff700 1 -- 172.21.15.158:0/415853271 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc80a9af0 con 0x7f9bc80694c0 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.374+0000 7f9bc4ff9700 1 -- 172.21.15.158:0/415853271 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9bb8013900 con 0x7f9bc80694c0 2023-10-06T04:44:09.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.375+0000 7f9bc4ff9700 1 -- 172.21.15.158:0/415853271 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f9bb8013bb0 con 0x7f9bc80694c0 2023-10-06T04:44:09.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.375+0000 7f9bce5ff700 1 -- 172.21.15.158:0/415853271 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc8064850 con 0x7f9bc80694c0 2023-10-06T04:44:09.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.378+0000 7f9bc4ff9700 1 -- 172.21.15.158:0/415853271 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9bb803a6d0 con 0x7f9bc80694c0 2023-10-06T04:44:09.466 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.464+0000 7f9bce5ff700 1 -- 172.21.15.158:0/415853271 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b", "id": 3} v 0) v1 -- 0x7f9bc80a9d10 con 0x7f9bc80694c0 2023-10-06T04:44:09.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.471+0000 7f9bc4ff9700 1 -- 172.21.15.158:0/415853271 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9bb8029070 con 0x7f9bc80694c0 2023-10-06T04:44:09.474 INFO:teuthology.orchestra.run.smithi158.stdout:3 2023-10-06T04:44:09.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.473+0000 7f9bce5ff700 1 -- 172.21.15.158:0/415853271 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9bc80694c0 msgr2=0x7f9bc80c2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.473+0000 7f9bce5ff700 1 --2- 172.21.15.158:0/415853271 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9bc80694c0 0x7f9bc80c2990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800ea50 tx=0x7f9bb80091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.473+0000 7f9bce5ff700 1 -- 172.21.15.158:0/415853271 shutdown_connections 2023-10-06T04:44:09.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.473+0000 7f9bce5ff700 1 --2- 172.21.15.158:0/415853271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bc8157700 0x7f9bc80bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.473+0000 7f9bce5ff700 1 --2- 172.21.15.158:0/415853271 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9bc80694c0 0x7f9bc80c2990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.473+0000 7f9bce5ff700 1 --2- 172.21.15.158:0/415853271 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9bc806a3d0 0x7f9bc81484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.473+0000 7f9bce5ff700 1 -- 172.21.15.158:0/415853271 >> 172.21.15.158:0/415853271 conn(0x7f9bc80680c0 msgr2=0x7f9bc80aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.473+0000 7f9bce5ff700 1 -- 172.21.15.158:0/415853271 shutdown_connections 2023-10-06T04:44:09.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.473+0000 7f9bce5ff700 1 -- 172.21.15.158:0/415853271 wait complete. 2023-10-06T04:44:09.492 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 127d525e-e2e9-4e9f-afcb-d240e6b59712 4 2023-10-06T04:44:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.676+0000 7f0e6f9ff700 1 Processor -- start 2023-10-06T04:44:09.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.676+0000 7f0e6f9ff700 1 -- start start 2023-10-06T04:44:09.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.677+0000 7f0e6f9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e68159480 0x7f0e6815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.677+0000 7f0e6f9ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0e6806d770 0x7f0e68069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.677+0000 7f0e6f9ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e68068700 con 0x7f0e680c8840 2023-10-06T04:44:09.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.677+0000 7f0e6f9ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e680c9030 con 0x7f0e6806d770 2023-10-06T04:44:09.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.677+0000 7f0e6f9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68068950 con 0x7f0e68159480 2023-10-06T04:44:09.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6d79b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e68159480 0x7f0e6815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6df9c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0e6806d770 0x7f0e68069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6d79b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e68159480 0x7f0e6815dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:40914/0 (socket says 172.21.15.158:40914) 2023-10-06T04:44:09.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6d79b700 1 -- 172.21.15.158:0/3411890046 learned_addr learned my addr 172.21.15.158:0/3411890046 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:09.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6cf9a700 1 --1- 172.21.15.158:0/3411890046 >> v1:172.21.15.158:6789/0 conn(0x7f0e680c8840 0x7f0e6806d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:39280/0 (socket says 172.21.15.158:39280) 2023-10-06T04:44:09.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6df9c700 1 -- 172.21.15.158:0/3411890046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e68159480 msgr2=0x7f0e6815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:09.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6df9c700 1 --2- 172.21.15.158:0/3411890046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e68159480 0x7f0e6815dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6df9c700 1 -- 172.21.15.158:0/3411890046 >> v1:172.21.15.158:6789/0 conn(0x7f0e680c8840 legacy=0x7f0e6806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6df9c700 1 -- 172.21.15.158:0/3411890046 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68068c30 con 0x7f0e6806d770 2023-10-06T04:44:09.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6d79b700 1 --2- 172.21.15.158:0/3411890046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e68159480 0x7f0e6815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e5ffff700 1 -- 172.21.15.158:0/3411890046 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497664975 0 0) 0x7f0e68068700 con 0x7f0e680c8840 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.678+0000 7f0e6df9c700 1 --2- 172.21.15.158:0/3411890046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0e6806d770 0x7f0e68069430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009e60 tx=0x7f0e60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=599186325bbe0492 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.679+0000 7f0e5ffff700 1 -- 172.21.15.158:0/3411890046 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000e070 con 0x7f0e6806d770 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.679+0000 7f0e5ffff700 1 -- 172.21.15.158:0/3411890046 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6000bb60 con 0x7f0e6806d770 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.679+0000 7f0e5ffff700 1 -- 172.21.15.158:0/3411890046 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60012430 con 0x7f0e6806d770 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.679+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3411890046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0e6806d770 msgr2=0x7f0e68069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.679+0000 7f0e6f9ff700 1 --2- 172.21.15.158:0/3411890046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0e6806d770 0x7f0e68069430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009e60 tx=0x7f0e60009780 comp rx=0 tx=0).stop 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.679+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3411890046 shutdown_connections 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.679+0000 7f0e6f9ff700 1 --2- 172.21.15.158:0/3411890046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0e6806d770 0x7f0e68069430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.679+0000 7f0e6f9ff700 1 --2- 172.21.15.158:0/3411890046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e68159480 0x7f0e6815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.679+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3411890046 >> 172.21.15.158:0/3411890046 conn(0x7f0e68063cc0 msgr2=0x7f0e680ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.679+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3411890046 shutdown_connections 2023-10-06T04:44:09.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.680+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3411890046 wait complete. 2023-10-06T04:44:09.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.681+0000 7f0e6f9ff700 1 Processor -- start 2023-10-06T04:44:09.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.681+0000 7f0e6f9ff700 1 -- start start 2023-10-06T04:44:09.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6f9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e6806d770 0x7f0e681529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6f9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0e680c8840 0x7f0e6815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6f9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e68159480 0x7f0e680b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6f9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680c7730 con 0x7f0e68159480 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6f9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680c8220 con 0x7f0e680c8840 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6f9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68152ef0 con 0x7f0e6806d770 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6d79b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e6806d770 0x7f0e681529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6cf9a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0e680c8840 0x7f0e6815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6d79b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e6806d770 0x7f0e681529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:40922/0 (socket says 172.21.15.158:40922) 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6d79b700 1 -- 172.21.15.158:0/3515909983 learned_addr learned my addr 172.21.15.158:0/3515909983 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.682+0000 7f0e6df9c700 1 --2- 172.21.15.158:0/3515909983 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e68159480 0x7f0e680b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e6d79b700 1 -- 172.21.15.158:0/3515909983 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0e680c8840 msgr2=0x7f0e6815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e6d79b700 1 --2- 172.21.15.158:0/3515909983 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0e680c8840 0x7f0e6815c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e6d79b700 1 -- 172.21.15.158:0/3515909983 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e68159480 msgr2=0x7f0e680b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e6d79b700 1 --2- 172.21.15.158:0/3515909983 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e68159480 0x7f0e680b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e6d79b700 1 -- 172.21.15.158:0/3515909983 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640094f0 con 0x7f0e6806d770 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e6d79b700 1 --2- 172.21.15.158:0/3515909983 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e6806d770 0x7f0e681529b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400ec80 tx=0x7f0e64009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e5d7fa700 1 -- 172.21.15.158:0/3515909983 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6400c920 con 0x7f0e6806d770 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e5d7fa700 1 -- 172.21.15.158:0/3515909983 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6400ca80 con 0x7f0e6806d770 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3515909983 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e60009a20 con 0x7f0e6806d770 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e5d7fa700 1 -- 172.21.15.158:0/3515909983 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6400ce00 con 0x7f0e6806d770 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3515909983 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e680c7c60 con 0x7f0e6806d770 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.683+0000 7f0e5d7fa700 1 -- 172.21.15.158:0/3515909983 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0e64013900 con 0x7f0e6806d770 2023-10-06T04:44:09.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.684+0000 7f0e5d7fa700 1 -- 172.21.15.158:0/3515909983 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f0e6401cd20 con 0x7f0e6806d770 2023-10-06T04:44:09.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.684+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3515909983 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6804c380 con 0x7f0e6806d770 2023-10-06T04:44:09.691 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.688+0000 7f0e5d7fa700 1 -- 172.21.15.158:0/3515909983 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0e64021060 con 0x7f0e6806d770 2023-10-06T04:44:09.775 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.773+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3515909983 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd new", "uuid": "127d525e-e2e9-4e9f-afcb-d240e6b59712", "id": 4} v 0) v1 -- 0x7f0e68068f10 con 0x7f0e6806d770 2023-10-06T04:44:09.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.781+0000 7f0e5d7fa700 1 -- 172.21.15.158:0/3515909983 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "127d525e-e2e9-4e9f-afcb-d240e6b59712", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0e64017070 con 0x7f0e6806d770 2023-10-06T04:44:09.783 INFO:teuthology.orchestra.run.smithi158.stdout:4 2023-10-06T04:44:09.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.782+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3515909983 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e6806d770 msgr2=0x7f0e681529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.782+0000 7f0e6f9ff700 1 --2- 172.21.15.158:0/3515909983 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e6806d770 0x7f0e681529b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400ec80 tx=0x7f0e64009250 comp rx=0 tx=0).stop 2023-10-06T04:44:09.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.782+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3515909983 shutdown_connections 2023-10-06T04:44:09.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.782+0000 7f0e6f9ff700 1 --2- 172.21.15.158:0/3515909983 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e68159480 0x7f0e680b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.782+0000 7f0e6f9ff700 1 --2- 172.21.15.158:0/3515909983 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0e6806d770 0x7f0e681529b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.785 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.782+0000 7f0e6f9ff700 1 --2- 172.21.15.158:0/3515909983 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0e680c8840 0x7f0e6815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.785 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.782+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3515909983 >> 172.21.15.158:0/3515909983 conn(0x7f0e68063cc0 msgr2=0x7f0e6806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.785 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.782+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3515909983 shutdown_connections 2023-10-06T04:44:09.785 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.782+0000 7f0e6f9ff700 1 -- 172.21.15.158:0/3515909983 wait complete. 2023-10-06T04:44:09.801 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 556394bc-73d7-43c2-a456-377c3f140fa5 5 2023-10-06T04:44:09.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.990+0000 7fd6eddff700 1 Processor -- start 2023-10-06T04:44:09.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.990+0000 7fd6eddff700 1 -- start start 2023-10-06T04:44:09.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.991+0000 7fd6eddff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd6e80c6a10 0x7fd6e80aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6eddff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e806a580 con 0x7fd6e806f440 2023-10-06T04:44:09.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6eddff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e806d910 con 0x7fd6e80c6de0 2023-10-06T04:44:09.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6eddff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e80c8380 con 0x7fd6e80c6a10 2023-10-06T04:44:09.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6e7fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd6e80c6de0 0x7fd6e815c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:39284/0 (socket says 172.21.15.158:39284) 2023-10-06T04:44:09.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6e7fff700 1 -- 172.21.15.158:0/87861617 learned_addr learned my addr 172.21.15.158:0/87861617 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-06T04:44:09.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6e77fe700 1 --2- 172.21.15.158:0/87861617 >> v2:172.21.15.124:3300/0 conn(0x7fd6e80c6a10 0x7fd6e80aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6e67fc700 1 -- 172.21.15.158:0/87861617 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065018020 0 0) 0x7fd6e806a580 con 0x7fd6e806f440 2023-10-06T04:44:09.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6e67fc700 1 -- 172.21.15.158:0/87861617 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d0003570 con 0x7fd6e806f440 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6e67fc700 1 -- 172.21.15.158:0/87861617 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123364518 0 0) 0x7fd6e806d910 con 0x7fd6e80c6de0 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6e77fe700 1 -- 172.21.15.158:0/87861617 >> v1:172.21.15.158:6789/0 conn(0x7fd6e80c6de0 legacy=0x7fd6e815c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6e77fe700 1 -- 172.21.15.158:0/87861617 >> v1:172.21.15.124:6789/0 conn(0x7fd6e806f440 legacy=0x7fd6e8069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.992+0000 7fd6e77fe700 1 -- 172.21.15.158:0/87861617 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e806dbf0 con 0x7fd6e80c6a10 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.993+0000 7fd6e77fe700 1 --2- 172.21.15.158:0/87861617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e80c6a10 0x7fd6e80aede0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80098e0 tx=0x7fd6d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d81d33a56c650 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.993+0000 7fd6e67fc700 1 -- 172.21.15.158:0/87861617 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800b640 con 0x7fd6e80c6a10 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.993+0000 7fd6e67fc700 1 -- 172.21.15.158:0/87861617 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d800b7a0 con 0x7fd6e80c6a10 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.993+0000 7fd6e67fc700 1 -- 172.21.15.158:0/87861617 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800bb40 con 0x7fd6e80c6a10 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.993+0000 7fd6eddff700 1 -- 172.21.15.158:0/87861617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e80c6a10 msgr2=0x7fd6e80aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.993+0000 7fd6eddff700 1 --2- 172.21.15.158:0/87861617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e80c6a10 0x7fd6e80aede0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80098e0 tx=0x7fd6d80091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.994+0000 7fd6eddff700 1 -- 172.21.15.158:0/87861617 shutdown_connections 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.994+0000 7fd6eddff700 1 --2- 172.21.15.158:0/87861617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e80c6a10 0x7fd6e80aede0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.994+0000 7fd6eddff700 1 -- 172.21.15.158:0/87861617 >> 172.21.15.158:0/87861617 conn(0x7fd6e80680c0 msgr2=0x7fd6e80cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.994+0000 7fd6eddff700 1 -- 172.21.15.158:0/87861617 shutdown_connections 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.994+0000 7fd6eddff700 1 -- 172.21.15.158:0/87861617 wait complete. 2023-10-06T04:44:10.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.995+0000 7fd6eddff700 1 Processor -- start 2023-10-06T04:44:10.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.995+0000 7fd6eddff700 1 -- start start 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.996+0000 7fd6eddff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e806f440 0x7fd6e8154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.996+0000 7fd6eddff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6e80c6a10 0x7fd6e8153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.996+0000 7fd6eddff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6e80c6de0 0x7fd6e81505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.996+0000 7fd6eddff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80c3020 con 0x7fd6e806f440 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.996+0000 7fd6eddff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e81553c0 con 0x7fd6e80c6de0 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.996+0000 7fd6eddff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e81556a0 con 0x7fd6e80c6a10 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.996+0000 7fd6e6ffd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6e80c6a10 0x7fd6e8153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.996+0000 7fd6e77fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e806f440 0x7fd6e8154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.996+0000 7fd6e7fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6e80c6de0 0x7fd6e81505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.997+0000 7fd6e77fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e806f440 0x7fd6e8154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.158:47674/0 (socket says 172.21.15.158:47674) 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.997+0000 7fd6e77fe700 1 -- 172.21.15.158:0/1907458710 learned_addr learned my addr 172.21.15.158:0/1907458710 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.997+0000 7fd6e77fe700 1 -- 172.21.15.158:0/1907458710 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6e80c6a10 msgr2=0x7fd6e8153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.997+0000 7fd6e77fe700 1 --2- 172.21.15.158:0/1907458710 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6e80c6a10 0x7fd6e8153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.997+0000 7fd6e77fe700 1 -- 172.21.15.158:0/1907458710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6e80c6de0 msgr2=0x7fd6e81505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.997+0000 7fd6e77fe700 1 --2- 172.21.15.158:0/1907458710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6e80c6de0 0x7fd6e81505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.997+0000 7fd6e77fe700 1 -- 172.21.15.158:0/1907458710 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8009420 con 0x7fd6e806f440 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.997+0000 7fd6e7fff700 1 --2- 172.21.15.158:0/1907458710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6e80c6de0 0x7fd6e81505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.997+0000 7fd6e77fe700 1 --2- 172.21.15.158:0/1907458710 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e806f440 0x7fd6e8154db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6e806cf10 tx=0x7fd6d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.998+0000 7fd6cf7fe700 1 -- 172.21.15.158:0/1907458710 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d801f070 con 0x7fd6e806f440 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.998+0000 7fd6cf7fe700 1 -- 172.21.15.158:0/1907458710 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d800b910 con 0x7fd6e806f440 2023-10-06T04:44:10.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.998+0000 7fd6cf7fe700 1 -- 172.21.15.158:0/1907458710 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8011420 con 0x7fd6e806f440 2023-10-06T04:44:10.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.998+0000 7fd6eddff700 1 -- 172.21.15.158:0/1907458710 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e8155980 con 0x7fd6e806f440 2023-10-06T04:44:10.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.998+0000 7fd6eddff700 1 -- 172.21.15.158:0/1907458710 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e8150b30 con 0x7fd6e806f440 2023-10-06T04:44:10.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.998+0000 7fd6cf7fe700 1 -- 172.21.15.158:0/1907458710 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd6d8011a90 con 0x7fd6e806f440 2023-10-06T04:44:10.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.998+0000 7fd6cf7fe700 1 -- 172.21.15.158:0/1907458710 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fd6d8011d40 con 0x7fd6e806f440 2023-10-06T04:44:10.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:09.999+0000 7fd6eddff700 1 -- 172.21.15.158:0/1907458710 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e8064850 con 0x7fd6e806f440 2023-10-06T04:44:10.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.001+0000 7fd6cf7fe700 1 -- 172.21.15.158:0/1907458710 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd6d8028070 con 0x7fd6e806f440 2023-10-06T04:44:10.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.087+0000 7fd6eddff700 1 -- 172.21.15.158:0/1907458710 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd new", "uuid": "556394bc-73d7-43c2-a456-377c3f140fa5", "id": 5} v 0) v1 -- 0x7fd6e8155e80 con 0x7fd6e806f440 2023-10-06T04:44:10.091 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:10.090+0000 7f1dd80bc1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:44:10.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.092+0000 7fd6cf7fe700 1 -- 172.21.15.158:0/1907458710 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "556394bc-73d7-43c2-a456-377c3f140fa5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd6d8015020 con 0x7fd6e806f440 2023-10-06T04:44:10.095 INFO:teuthology.orchestra.run.smithi158.stdout:5 2023-10-06T04:44:10.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.093+0000 7fd6eddff700 1 -- 172.21.15.158:0/1907458710 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e806f440 msgr2=0x7fd6e8154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.093+0000 7fd6eddff700 1 --2- 172.21.15.158:0/1907458710 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e806f440 0x7fd6e8154db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6e806cf10 tx=0x7fd6d8017000 comp rx=0 tx=0).stop 2023-10-06T04:44:10.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.093+0000 7fd6eddff700 1 -- 172.21.15.158:0/1907458710 shutdown_connections 2023-10-06T04:44:10.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.093+0000 7fd6eddff700 1 --2- 172.21.15.158:0/1907458710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6e80c6de0 0x7fd6e81505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.093+0000 7fd6eddff700 1 --2- 172.21.15.158:0/1907458710 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6e806f440 0x7fd6e8154db0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.093+0000 7fd6eddff700 1 --2- 172.21.15.158:0/1907458710 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6e80c6a10 0x7fd6e8153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.093+0000 7fd6eddff700 1 -- 172.21.15.158:0/1907458710 >> 172.21.15.158:0/1907458710 conn(0x7fd6e80680c0 msgr2=0x7fd6e80cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:10.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.094+0000 7fd6eddff700 1 -- 172.21.15.158:0/1907458710 shutdown_connections 2023-10-06T04:44:10.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.094+0000 7fd6eddff700 1 -- 172.21.15.158:0/1907458710 wait complete. 2023-10-06T04:44:10.114 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 59060e72-05b9-45fb-bc86-1d35db63d75f 6 2023-10-06T04:44:10.181 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:10.179+0000 7f1dd80bc1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:44:10.225 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:10.223+0000 7fc4d3a3b1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:44:10.304 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.301+0000 7fa3d3dff700 1 Processor -- start 2023-10-06T04:44:10.304 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.301+0000 7fa3d3dff700 1 -- start start 2023-10-06T04:44:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d3dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa3cc0cd5b0 0x7fa3cc0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d3dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3cc15d620 con 0x7fa3cc1592b0 2023-10-06T04:44:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d3dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3cc0b0760 con 0x7fa3cc159680 2023-10-06T04:44:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d3dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3cc15d0d0 con 0x7fa3cc0cd5b0 2023-10-06T04:44:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d139a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fa3cc159680 0x7fa3cc0ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:39294/0 (socket says 172.21.15.158:39294) 2023-10-06T04:44:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d139a700 1 -- 172.21.15.158:0/3117142650 learned_addr learned my addr 172.21.15.158:0/3117142650 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-06T04:44:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d239c700 1 --2- 172.21.15.158:0/3117142650 >> v2:172.21.15.124:3300/0 conn(0x7fa3cc0cd5b0 0x7fa3cc0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d0b99700 1 -- 172.21.15.158:0/3117142650 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816235624 0 0) 0x7fa3cc15d620 con 0x7fa3cc1592b0 2023-10-06T04:44:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d0b99700 1 -- 172.21.15.158:0/3117142650 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b8003570 con 0x7fa3cc1592b0 2023-10-06T04:44:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d0b99700 1 -- 172.21.15.158:0/3117142650 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907450014 0 0) 0x7fa3cc0b0760 con 0x7fa3cc159680 2023-10-06T04:44:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d0b99700 1 -- 172.21.15.158:0/3117142650 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3cc15d620 con 0x7fa3cc159680 2023-10-06T04:44:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d239c700 1 -- 172.21.15.158:0/3117142650 >> v1:172.21.15.158:6789/0 conn(0x7fa3cc159680 legacy=0x7fa3cc0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.303+0000 7fa3d239c700 1 -- 172.21.15.158:0/3117142650 >> v1:172.21.15.124:6789/0 conn(0x7fa3cc1592b0 legacy=0x7fa3cc15dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.304+0000 7fa3d0b99700 1 -- 172.21.15.158:0/3117142650 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 84433174 0 0) 0x7fa3b8003570 con 0x7fa3cc1592b0 2023-10-06T04:44:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.304+0000 7fa3d239c700 1 -- 172.21.15.158:0/3117142650 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0b0a40 con 0x7fa3cc0cd5b0 2023-10-06T04:44:10.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.304+0000 7fa3d239c700 1 --2- 172.21.15.158:0/3117142650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3cc0cd5b0 0x7fa3cc0b0080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009e60 tx=0x7fa3c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bc0254458d6a2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.304+0000 7fa3d0b99700 1 -- 172.21.15.158:0/3117142650 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c400e070 con 0x7fa3cc0cd5b0 2023-10-06T04:44:10.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.304+0000 7fa3d0b99700 1 -- 172.21.15.158:0/3117142650 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c400b7a0 con 0x7fa3cc0cd5b0 2023-10-06T04:44:10.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.304+0000 7fa3d0b99700 1 -- 172.21.15.158:0/3117142650 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8001470 con 0x7fa3cc0cd5b0 2023-10-06T04:44:10.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.305+0000 7fa3d3dff700 1 -- 172.21.15.158:0/3117142650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3cc0cd5b0 msgr2=0x7fa3cc0b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.305+0000 7fa3d3dff700 1 --2- 172.21.15.158:0/3117142650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3cc0cd5b0 0x7fa3cc0b0080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009e60 tx=0x7fa3c4009780 comp rx=0 tx=0).stop 2023-10-06T04:44:10.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.305+0000 7fa3d3dff700 1 -- 172.21.15.158:0/3117142650 shutdown_connections 2023-10-06T04:44:10.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.305+0000 7fa3d3dff700 1 --2- 172.21.15.158:0/3117142650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3cc0cd5b0 0x7fa3cc0b0080 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.305+0000 7fa3d3dff700 1 -- 172.21.15.158:0/3117142650 >> 172.21.15.158:0/3117142650 conn(0x7fa3cc06ed20 msgr2=0x7fa3cc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:10.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.305+0000 7fa3d3dff700 1 -- 172.21.15.158:0/3117142650 shutdown_connections 2023-10-06T04:44:10.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.305+0000 7fa3d3dff700 1 -- 172.21.15.158:0/3117142650 wait complete. 2023-10-06T04:44:10.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.307+0000 7fa3d3dff700 1 Processor -- start 2023-10-06T04:44:10.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.307+0000 7fa3d3dff700 1 -- start start 2023-10-06T04:44:10.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d3dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3cc0cd5b0 0x7fa3cc0c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d3dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3cc1592b0 0x7fa3cc14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d3dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3cc159680 0x7fa3cc0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d3dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc15c120 con 0x7fa3cc0cd5b0 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d3dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc14f000 con 0x7fa3cc1592b0 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d3dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc15a0a0 con 0x7fa3cc159680 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d139a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3cc1592b0 0x7fa3cc14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d239c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3cc159680 0x7fa3cc0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d139a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3cc1592b0 0x7fa3cc14eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:43052/0 (socket says 172.21.15.158:43052) 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d139a700 1 -- 172.21.15.158:0/101038805 learned_addr learned my addr 172.21.15.158:0/101038805 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d1b9b700 1 --2- 172.21.15.158:0/101038805 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3cc0cd5b0 0x7fa3cc0c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d139a700 1 -- 172.21.15.158:0/101038805 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3cc159680 msgr2=0x7fa3cc0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d139a700 1 --2- 172.21.15.158:0/101038805 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3cc159680 0x7fa3cc0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d139a700 1 -- 172.21.15.158:0/101038805 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3cc0cd5b0 msgr2=0x7fa3cc0c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d139a700 1 --2- 172.21.15.158:0/101038805 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3cc0cd5b0 0x7fa3cc0c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.308+0000 7fa3d139a700 1 -- 172.21.15.158:0/101038805 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4009a20 con 0x7fa3cc1592b0 2023-10-06T04:44:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.309+0000 7fa3d139a700 1 --2- 172.21.15.158:0/101038805 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3cc1592b0 0x7fa3cc14eac0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00c590 tx=0x7fa3bc007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.309+0000 7fa3c1ffb700 1 -- 172.21.15.158:0/101038805 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc005b30 con 0x7fa3cc1592b0 2023-10-06T04:44:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.309+0000 7fa3c1ffb700 1 -- 172.21.15.158:0/101038805 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc005cb0 con 0x7fa3cc1592b0 2023-10-06T04:44:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.309+0000 7fa3d3dff700 1 -- 172.21.15.158:0/101038805 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc15a380 con 0x7fa3cc1592b0 2023-10-06T04:44:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.309+0000 7fa3c1ffb700 1 -- 172.21.15.158:0/101038805 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc007320 con 0x7fa3cc1592b0 2023-10-06T04:44:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.309+0000 7fa3d3dff700 1 -- 172.21.15.158:0/101038805 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3cc15a940 con 0x7fa3cc1592b0 2023-10-06T04:44:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.309+0000 7fa3c1ffb700 1 -- 172.21.15.158:0/101038805 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa3bc01c6c0 con 0x7fa3cc1592b0 2023-10-06T04:44:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.309+0000 7fa3c1ffb700 1 -- 172.21.15.158:0/101038805 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fa3bc005e20 con 0x7fa3cc1592b0 2023-10-06T04:44:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.310+0000 7fa3d3dff700 1 -- 172.21.15.158:0/101038805 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc04c380 con 0x7fa3cc1592b0 2023-10-06T04:44:10.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.313+0000 7fa3c1ffb700 1 -- 172.21.15.158:0/101038805 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa3bc017070 con 0x7fa3cc1592b0 2023-10-06T04:44:10.320 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:10.318+0000 7fc4d3a3b1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:44:10.344 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:10.343+0000 7f1dd80bc1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:44:10.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.398+0000 7fa3d3dff700 1 -- 172.21.15.158:0/101038805 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd new", "uuid": "59060e72-05b9-45fb-bc86-1d35db63d75f", "id": 6} v 0) v1 -- 0x7fa3cc064ed0 con 0x7fa3cc1592b0 2023-10-06T04:44:10.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.402+0000 7fa3c1ffb700 1 -- 172.21.15.158:0/101038805 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59060e72-05b9-45fb-bc86-1d35db63d75f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa3bc007710 con 0x7fa3cc1592b0 2023-10-06T04:44:10.405 INFO:teuthology.orchestra.run.smithi158.stdout:6 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.404+0000 7fa3d3dff700 1 -- 172.21.15.158:0/101038805 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3cc1592b0 msgr2=0x7fa3cc14eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.404+0000 7fa3d3dff700 1 --2- 172.21.15.158:0/101038805 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3cc1592b0 0x7fa3cc14eac0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00c590 tx=0x7fa3bc007e00 comp rx=0 tx=0).stop 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.404+0000 7fa3d3dff700 1 -- 172.21.15.158:0/101038805 shutdown_connections 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.404+0000 7fa3d3dff700 1 --2- 172.21.15.158:0/101038805 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3cc159680 0x7fa3cc0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.404+0000 7fa3d3dff700 1 --2- 172.21.15.158:0/101038805 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3cc0cd5b0 0x7fa3cc0c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.404+0000 7fa3d3dff700 1 --2- 172.21.15.158:0/101038805 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3cc1592b0 0x7fa3cc14eac0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.404+0000 7fa3d3dff700 1 -- 172.21.15.158:0/101038805 >> 172.21.15.158:0/101038805 conn(0x7fa3cc06ed20 msgr2=0x7fa3cc0ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.404+0000 7fa3d3dff700 1 -- 172.21.15.158:0/101038805 shutdown_connections 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.404+0000 7fa3d3dff700 1 -- 172.21.15.158:0/101038805 wait complete. 2023-10-06T04:44:10.425 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 2107313e-ce80-4983-9c73-1056a0fafc82 7 2023-10-06T04:44:10.429 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:10.428+0000 7f1dd80bc1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:44:10.497 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:10.494+0000 7fc4d3a3b1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:44:10.588 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:10.586+0000 7fc4d3a3b1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:44:10.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.608+0000 7f8a489ff700 1 Processor -- start 2023-10-06T04:44:10.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.609+0000 7f8a489ff700 1 -- start start 2023-10-06T04:44:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.610+0000 7f8a489ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8a441592b0 0x7f8a440b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.610+0000 7f8a489ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a440cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.610+0000 7f8a489ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4415d620 con 0x7f8a4415dab0 2023-10-06T04:44:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.610+0000 7f8a489ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4415d0d0 con 0x7f8a441592b0 2023-10-06T04:44:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.610+0000 7f8a489ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a440b2ed0 con 0x7f8a44159680 2023-10-06T04:44:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.610+0000 7f8a41d9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a440cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.610+0000 7f8a42d9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f8a4415dab0 0x7f8a440ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:39300/0 (socket says 172.21.15.158:39300) 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.610+0000 7f8a42d9d700 1 -- 172.21.15.158:0/665904242 learned_addr learned my addr 172.21.15.158:0/665904242 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.610+0000 7f8a4259c700 1 --2- 172.21.15.158:0/665904242 >> v2:172.21.15.124:3300/0 conn(0x7f8a441592b0 0x7f8a440b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.610+0000 7f8a4159a700 1 -- 172.21.15.158:0/665904242 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131452080 0 0) 0x7f8a4415d620 con 0x7f8a4415dab0 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.611+0000 7f8a41d9b700 1 -- 172.21.15.158:0/665904242 >> v2:172.21.15.124:3300/0 conn(0x7f8a441592b0 msgr2=0x7f8a440b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.611+0000 7f8a41d9b700 1 --2- 172.21.15.158:0/665904242 >> v2:172.21.15.124:3300/0 conn(0x7f8a441592b0 0x7f8a440b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.611+0000 7f8a41d9b700 1 -- 172.21.15.158:0/665904242 >> v1:172.21.15.158:6789/0 conn(0x7f8a4415dab0 legacy=0x7f8a440ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.611+0000 7f8a41d9b700 1 -- 172.21.15.158:0/665904242 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a440b0760 con 0x7f8a44159680 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.611+0000 7f8a41d9b700 1 --2- 172.21.15.158:0/665904242 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a440cc780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a380098e0 tx=0x7f8a380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be18a23e0e27b1c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.611+0000 7f8a4159a700 1 -- 172.21.15.158:0/665904242 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800b640 con 0x7f8a44159680 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.611+0000 7f8a4159a700 1 -- 172.21.15.158:0/665904242 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3800b7a0 con 0x7f8a44159680 2023-10-06T04:44:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.611+0000 7f8a4159a700 1 -- 172.21.15.158:0/665904242 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800bb40 con 0x7f8a44159680 2023-10-06T04:44:10.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.612+0000 7f8a489ff700 1 -- 172.21.15.158:0/665904242 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 msgr2=0x7f8a440cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.612+0000 7f8a489ff700 1 --2- 172.21.15.158:0/665904242 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a440cc780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a380098e0 tx=0x7f8a380091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.612+0000 7f8a489ff700 1 -- 172.21.15.158:0/665904242 shutdown_connections 2023-10-06T04:44:10.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.612+0000 7f8a489ff700 1 --2- 172.21.15.158:0/665904242 >> v2:172.21.15.124:3300/0 conn(0x7f8a441592b0 0x7f8a440b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.612+0000 7f8a489ff700 1 --2- 172.21.15.158:0/665904242 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a440cc780 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.612+0000 7f8a489ff700 1 -- 172.21.15.158:0/665904242 >> 172.21.15.158:0/665904242 conn(0x7f8a4406ed20 msgr2=0x7f8a4406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:10.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.612+0000 7f8a489ff700 1 -- 172.21.15.158:0/665904242 shutdown_connections 2023-10-06T04:44:10.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.612+0000 7f8a489ff700 1 -- 172.21.15.158:0/665904242 wait complete. 2023-10-06T04:44:10.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.613+0000 7f8a489ff700 1 Processor -- start 2023-10-06T04:44:10.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.613+0000 7f8a489ff700 1 -- start start 2023-10-06T04:44:10.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.614+0000 7f8a489ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a441592b0 0x7f8a44159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.614+0000 7f8a489ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a4415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.614+0000 7f8a489ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a4415dab0 0x7f8a440ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.614+0000 7f8a489ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4416a5b0 con 0x7f8a4415dab0 2023-10-06T04:44:10.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.614+0000 7f8a489ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a44169c80 con 0x7f8a441592b0 2023-10-06T04:44:10.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.614+0000 7f8a489ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a44169f60 con 0x7f8a44159680 2023-10-06T04:44:10.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a41d9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a4415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a4259c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a441592b0 0x7f8a44159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a41d9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a4415aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:40950/0 (socket says 172.21.15.158:40950) 2023-10-06T04:44:10.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a41d9b700 1 -- 172.21.15.158:0/1608411288 learned_addr learned my addr 172.21.15.158:0/1608411288 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-06T04:44:10.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a42d9d700 1 --2- 172.21.15.158:0/1608411288 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a4415dab0 0x7f8a440ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a41d9b700 1 -- 172.21.15.158:0/1608411288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a441592b0 msgr2=0x7f8a44159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a41d9b700 1 --2- 172.21.15.158:0/1608411288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a441592b0 0x7f8a44159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a41d9b700 1 -- 172.21.15.158:0/1608411288 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a4415dab0 msgr2=0x7f8a440ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a41d9b700 1 --2- 172.21.15.158:0/1608411288 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a4415dab0 0x7f8a440ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a41d9b700 1 -- 172.21.15.158:0/1608411288 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a38009420 con 0x7f8a44159680 2023-10-06T04:44:10.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a4259c700 1 --2- 172.21.15.158:0/1608411288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a441592b0 0x7f8a44159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:10.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.615+0000 7f8a41d9b700 1 --2- 172.21.15.158:0/1608411288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a4415aef0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8a440b5b20 tx=0x7f8a38017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.616+0000 7f8a327fc700 1 -- 172.21.15.158:0/1608411288 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800bb20 con 0x7f8a44159680 2023-10-06T04:44:10.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.616+0000 7f8a327fc700 1 -- 172.21.15.158:0/1608411288 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a38000c90 con 0x7f8a44159680 2023-10-06T04:44:10.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.616+0000 7f8a489ff700 1 -- 172.21.15.158:0/1608411288 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4416a240 con 0x7f8a44159680 2023-10-06T04:44:10.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.616+0000 7f8a327fc700 1 -- 172.21.15.158:0/1608411288 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38011650 con 0x7f8a44159680 2023-10-06T04:44:10.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.616+0000 7f8a489ff700 1 -- 172.21.15.158:0/1608411288 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4415a230 con 0x7f8a44159680 2023-10-06T04:44:10.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.617+0000 7f8a327fc700 1 -- 172.21.15.158:0/1608411288 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8a38011c80 con 0x7f8a44159680 2023-10-06T04:44:10.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.617+0000 7f8a327fc700 1 -- 172.21.15.158:0/1608411288 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f8a38025400 con 0x7f8a44159680 2023-10-06T04:44:10.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.617+0000 7f8a489ff700 1 -- 172.21.15.158:0/1608411288 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4404c380 con 0x7f8a44159680 2023-10-06T04:44:10.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.619+0000 7f8a327fc700 1 -- 172.21.15.158:0/1608411288 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8a38029070 con 0x7f8a44159680 2023-10-06T04:44:10.644 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:10.643+0000 7f1dd80bc1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:44:10.705 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.702+0000 7f8a489ff700 1 -- 172.21.15.158:0/1608411288 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2107313e-ce80-4983-9c73-1056a0fafc82", "id": 7} v 0) v1 -- 0x7f8a4416a6f0 con 0x7f8a44159680 2023-10-06T04:44:10.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.706+0000 7f8a327fc700 1 -- 172.21.15.158:0/1608411288 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2107313e-ce80-4983-9c73-1056a0fafc82", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8a380330b0 con 0x7f8a44159680 2023-10-06T04:44:10.709 INFO:teuthology.orchestra.run.smithi158.stdout:7 2023-10-06T04:44:10.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.707+0000 7f8a489ff700 1 -- 172.21.15.158:0/1608411288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 msgr2=0x7f8a4415aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.707+0000 7f8a489ff700 1 --2- 172.21.15.158:0/1608411288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a4415aef0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8a440b5b20 tx=0x7f8a38017000 comp rx=0 tx=0).stop 2023-10-06T04:44:10.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.708+0000 7f8a489ff700 1 -- 172.21.15.158:0/1608411288 shutdown_connections 2023-10-06T04:44:10.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.708+0000 7f8a489ff700 1 --2- 172.21.15.158:0/1608411288 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a4415dab0 0x7f8a440ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.708+0000 7f8a489ff700 1 --2- 172.21.15.158:0/1608411288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a441592b0 0x7f8a44159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.708+0000 7f8a489ff700 1 --2- 172.21.15.158:0/1608411288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a44159680 0x7f8a4415aef0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.708+0000 7f8a489ff700 1 -- 172.21.15.158:0/1608411288 >> 172.21.15.158:0/1608411288 conn(0x7f8a4406ed20 msgr2=0x7f8a440cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:10.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.708+0000 7f8a489ff700 1 -- 172.21.15.158:0/1608411288 shutdown_connections 2023-10-06T04:44:10.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06T04:44:10.708+0000 7f8a489ff700 1 -- 172.21.15.158:0/1608411288 wait complete. 2023-10-06T04:44:10.728 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T04:44:10.728 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T04:44:10.732 INFO:tasks.ceph.osd.0:Started 2023-10-06T04:44:10.732 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T04:44:10.732 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T04:44:10.737 INFO:tasks.ceph.osd.1:Started 2023-10-06T04:44:10.737 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T04:44:10.737 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T04:44:10.741 INFO:tasks.ceph.osd.2:Started 2023-10-06T04:44:10.741 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T04:44:10.741 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T04:44:10.742 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:10.739+0000 7f1dd80bc1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:44:10.747 INFO:tasks.ceph.osd.3:Started 2023-10-06T04:44:10.747 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T04:44:10.747 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T04:44:10.751 INFO:tasks.ceph.osd.4:Started 2023-10-06T04:44:10.751 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T04:44:10.752 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T04:44:10.755 INFO:tasks.ceph.osd.5:Started 2023-10-06T04:44:10.756 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T04:44:10.756 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T04:44:10.760 INFO:tasks.ceph.osd.6:Started 2023-10-06T04:44:10.760 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T04:44:10.761 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T04:44:10.766 INFO:tasks.ceph.osd.7:Started 2023-10-06T04:44:10.767 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:10.827 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:10.825+0000 7fc4d3a3b1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:44:10.884 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:10.883+0000 7f1dd80bc1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:44:10.946 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:10.943+0000 7fc4d3a3b1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:44:11.014 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:11.013+0000 7f1dd80bc1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:44:11.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.026+0000 7f946efff700 1 Processor -- start 2023-10-06T04:44:11.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.026+0000 7f946efff700 1 -- start start 2023-10-06T04:44:11.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.028+0000 7f946efff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f94680ccbb0 0x7f94680cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.028+0000 7f946efff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 0x7f94680ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.028+0000 7f946efff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f94680ccf80 0x7f94680cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.028+0000 7f946efff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94680cf6b0 con 0x7f94680ccbb0 2023-10-06T04:44:11.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.028+0000 7f946efff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94680ceaa0 con 0x7f94680ccf80 2023-10-06T04:44:11.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.028+0000 7f946efff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94680ced80 con 0x7f94680cdfe0 2023-10-06T04:44:11.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946cd9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f94680ccbb0 0x7f94680cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946cd9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f94680ccbb0 0x7f94680cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38462/0 (socket says 172.21.15.124:38462) 2023-10-06T04:44:11.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946cd9b700 1 -- 172.21.15.124:0/1221920162 learned_addr learned my addr 172.21.15.124:0/1221920162 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:11.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f9467fff700 1 --2- 172.21.15.124:0/1221920162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 0x7f94680ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946d59c700 1 --2- 172.21.15.124:0/1221920162 >> v2:172.21.15.158:3300/0 conn(0x7f94680ccf80 0x7f94680cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946cd9b700 1 -- 172.21.15.124:0/1221920162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 msgr2=0x7f94680ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:11.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946cd9b700 1 --2- 172.21.15.124:0/1221920162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 0x7f94680ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946cd9b700 1 -- 172.21.15.124:0/1221920162 >> v2:172.21.15.158:3300/0 conn(0x7f94680ccf80 msgr2=0x7f94680cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:11.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946cd9b700 1 --2- 172.21.15.124:0/1221920162 >> v2:172.21.15.158:3300/0 conn(0x7f94680ccf80 0x7f94680cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946cd9b700 1 -- 172.21.15.124:0/1221920162 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680cf060 con 0x7f94680ccbb0 2023-10-06T04:44:11.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f9467fff700 1 --2- 172.21.15.124:0/1221920162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 0x7f94680ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:11.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946d59c700 1 --2- 172.21.15.124:0/1221920162 >> v2:172.21.15.158:3300/0 conn(0x7f94680ccf80 0x7f94680cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:11.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f946cd9b700 1 --2- 172.21.15.124:0/1221920162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccbb0 0x7f94680cfb40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9468063dc0 tx=0x7f945c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62b5de079966028 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:11.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.029+0000 7f94677fe700 1 -- 172.21.15.124:0/1221920162 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c00b860 con 0x7f94680ccbb0 2023-10-06T04:44:11.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.030+0000 7f94677fe700 1 -- 172.21.15.124:0/1221920162 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c00b9c0 con 0x7f94680ccbb0 2023-10-06T04:44:11.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.030+0000 7f94677fe700 1 -- 172.21.15.124:0/1221920162 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c00bd60 con 0x7f94680ccbb0 2023-10-06T04:44:11.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.030+0000 7f946efff700 1 -- 172.21.15.124:0/1221920162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccbb0 msgr2=0x7f94680cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.030+0000 7f946efff700 1 --2- 172.21.15.124:0/1221920162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccbb0 0x7f94680cfb40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9468063dc0 tx=0x7f945c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:11.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.030+0000 7f946efff700 1 -- 172.21.15.124:0/1221920162 shutdown_connections 2023-10-06T04:44:11.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.030+0000 7f946efff700 1 --2- 172.21.15.124:0/1221920162 >> v2:172.21.15.158:3300/0 conn(0x7f94680ccf80 0x7f94680cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.030+0000 7f946efff700 1 --2- 172.21.15.124:0/1221920162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccbb0 0x7f94680cfb40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.030+0000 7f946efff700 1 --2- 172.21.15.124:0/1221920162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 0x7f94680ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.030+0000 7f946efff700 1 -- 172.21.15.124:0/1221920162 >> 172.21.15.124:0/1221920162 conn(0x7f9468099710 msgr2=0x7f946806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:11.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.031+0000 7f946efff700 1 -- 172.21.15.124:0/1221920162 shutdown_connections 2023-10-06T04:44:11.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.031+0000 7f946efff700 1 -- 172.21.15.124:0/1221920162 wait complete. 2023-10-06T04:44:11.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.032+0000 7f946efff700 1 Processor -- start 2023-10-06T04:44:11.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.032+0000 7f946efff700 1 -- start start 2023-10-06T04:44:11.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f946efff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94680ccbb0 0x7f94680c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f946efff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccf80 0x7f94680b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f946efff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 0x7f94680b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f946efff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946816a820 con 0x7f94680ccf80 2023-10-06T04:44:11.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f946efff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9468169bc0 con 0x7f94680ccbb0 2023-10-06T04:44:11.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f946efff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9468169ea0 con 0x7f94680cdfe0 2023-10-06T04:44:11.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f9467fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccf80 0x7f94680b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f9467fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccf80 0x7f94680b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38476/0 (socket says 172.21.15.124:38476) 2023-10-06T04:44:11.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f9467fff700 1 -- 172.21.15.124:0/2418373005 learned_addr learned my addr 172.21.15.124:0/2418373005 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:11.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f946cd9b700 1 --2- 172.21.15.124:0/2418373005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94680ccbb0 0x7f94680c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.033+0000 7f946d59c700 1 --2- 172.21.15.124:0/2418373005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 0x7f94680b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f9467fff700 1 -- 172.21.15.124:0/2418373005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 msgr2=0x7f94680b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f9467fff700 1 --2- 172.21.15.124:0/2418373005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 0x7f94680b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f9467fff700 1 -- 172.21.15.124:0/2418373005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94680ccbb0 msgr2=0x7f94680c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f9467fff700 1 --2- 172.21.15.124:0/2418373005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94680ccbb0 0x7f94680c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f9467fff700 1 -- 172.21.15.124:0/2418373005 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0094f0 con 0x7f94680ccf80 2023-10-06T04:44:11.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f946d59c700 1 --2- 172.21.15.124:0/2418373005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 0x7f94680b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:11.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f9467fff700 1 --2- 172.21.15.124:0/2418373005 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccf80 0x7f94680b4480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f945400d860 tx=0x7f9454008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:11.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f9464ff9700 1 -- 172.21.15.124:0/2418373005 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540125f0 con 0x7f94680ccf80 2023-10-06T04:44:11.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f9464ff9700 1 -- 172.21.15.124:0/2418373005 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9454012750 con 0x7f94680ccf80 2023-10-06T04:44:11.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f9464ff9700 1 -- 172.21.15.124:0/2418373005 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454012af0 con 0x7f94680ccf80 2023-10-06T04:44:11.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f946efff700 1 -- 172.21.15.124:0/2418373005 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946816a180 con 0x7f94680ccf80 2023-10-06T04:44:11.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.034+0000 7f946efff700 1 -- 172.21.15.124:0/2418373005 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94680c84f0 con 0x7f94680ccf80 2023-10-06T04:44:11.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.035+0000 7f9464ff9700 1 -- 172.21.15.124:0/2418373005 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9454014430 con 0x7f94680ccf80 2023-10-06T04:44:11.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.035+0000 7f9464ff9700 1 -- 172.21.15.124:0/2418373005 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f9454014e10 con 0x7f94680ccf80 2023-10-06T04:44:11.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.035+0000 7f946efff700 1 -- 172.21.15.124:0/2418373005 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946816a9d0 con 0x7f94680ccf80 2023-10-06T04:44:11.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.038+0000 7f9464ff9700 1 -- 172.21.15.124:0/2418373005 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f946816a9d0 con 0x7f94680ccf80 2023-10-06T04:44:11.046 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:11.044+0000 7fc4d3a3b1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:44:11.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.109+0000 7f946efff700 1 -- 172.21.15.124:0/2418373005 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94680717a0 con 0x7f94680ccf80 2023-10-06T04:44:11.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.109+0000 7f9464ff9700 1 -- 172.21.15.124:0/2418373005 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f9454014960 con 0x7f94680ccf80 2023-10-06T04:44:11.113 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:11.114 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":10,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:10.705153+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:11.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.110+0000 7f946efff700 1 -- 172.21.15.124:0/2418373005 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccf80 msgr2=0x7f94680b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.110+0000 7f946efff700 1 --2- 172.21.15.124:0/2418373005 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccf80 0x7f94680b4480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f945400d860 tx=0x7f9454008040 comp rx=0 tx=0).stop 2023-10-06T04:44:11.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.110+0000 7f946efff700 1 -- 172.21.15.124:0/2418373005 shutdown_connections 2023-10-06T04:44:11.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.110+0000 7f946efff700 1 --2- 172.21.15.124:0/2418373005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94680cdfe0 0x7f94680b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.110+0000 7f946efff700 1 --2- 172.21.15.124:0/2418373005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94680ccbb0 0x7f94680c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.110+0000 7f946efff700 1 --2- 172.21.15.124:0/2418373005 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94680ccf80 0x7f94680b4480 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.110+0000 7f946efff700 1 -- 172.21.15.124:0/2418373005 >> 172.21.15.124:0/2418373005 conn(0x7f9468099710 msgr2=0x7f94680ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:11.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.110+0000 7f946efff700 1 -- 172.21.15.124:0/2418373005 shutdown_connections 2023-10-06T04:44:11.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:11.110+0000 7f946efff700 1 -- 172.21.15.124:0/2418373005 wait complete. 2023-10-06T04:44:11.129 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T04:44:11.130 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T04:44:11.153 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:11.151+0000 7fc4d3a3b1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:44:11.187 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-06T04:44:11.186+0000 7fe819cd0540 -1 Falling back to public interface 2023-10-06T04:44:11.190 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-06T04:44:11.189+0000 7fe60f9fd540 -1 Falling back to public interface 2023-10-06T04:44:11.250 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:11.249+0000 7f1dd80bc1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:44:11.350 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:11.348+0000 7f1dd80bc1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:44:11.377 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:11.375+0000 7fc4d3a3b1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:44:11.445 INFO:tasks.ceph.osd.4.smithi158.stderr:2023-10-06T04:44:11.443+0000 7fd3a7419540 -1 Falling back to public interface 2023-10-06T04:44:11.453 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-06T04:44:11.452+0000 7f21ccf9d540 -1 Falling back to public interface 2023-10-06T04:44:11.454 INFO:tasks.ceph.osd.5.smithi158.stderr:2023-10-06T04:44:11.452+0000 7fda1456a540 -1 Falling back to public interface 2023-10-06T04:44:11.468 INFO:tasks.ceph.osd.6.smithi158.stderr:2023-10-06T04:44:11.465+0000 7f98d6870540 -1 Falling back to public interface 2023-10-06T04:44:11.477 INFO:tasks.ceph.osd.7.smithi158.stderr:2023-10-06T04:44:11.475+0000 7f1152912540 -1 Falling back to public interface 2023-10-06T04:44:11.480 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:11.478+0000 7fc4d3a3b1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:44:11.481 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-06T04:44:11.480+0000 7fde1547a540 -1 Falling back to public interface 2023-10-06T04:44:11.702 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:11.701+0000 7f1dd80bc1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:44:11.791 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:11.790+0000 7f1dd80bc1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:44:11.831 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:11.829+0000 7fc4d3a3b1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:44:11.918 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:11.915+0000 7fc4d3a3b1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:44:11.935 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:12.105 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.104+0000 7f5fe45ff700 1 Processor -- start 2023-10-06T04:44:12.105 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.104+0000 7f5fe45ff700 1 -- start start 2023-10-06T04:44:12.107 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.105+0000 7f5fe45ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fdc068d20 0x7f5fdc15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.107 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.105+0000 7f5fe45ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5fdc1599d0 0x7f5fdc15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.107 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.105+0000 7f5fe45ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc0b61c0 con 0x7f5fdc159600 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.105+0000 7f5fe45ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc15a250 con 0x7f5fdc1599d0 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.105+0000 7f5fe45ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0883e0 con 0x7f5fdc068d20 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.105+0000 7f5fe2b9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5fdc1599d0 0x7f5fdc15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.105+0000 7f5fe239b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f5fdc159600 0x7f5fdc068610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35674/0 (socket says 172.21.15.124:35674) 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.105+0000 7f5fe239b700 1 -- 172.21.15.124:0/3862930927 learned_addr learned my addr 172.21.15.124:0/3862930927 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.105+0000 7f5fe1b9a700 1 --2- 172.21.15.124:0/3862930927 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fdc068d20 0x7f5fdc15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.106+0000 7f5fe1399700 1 -- 172.21.15.124:0/3862930927 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011472500 0 0) 0x7f5fdc0b61c0 con 0x7f5fdc159600 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.106+0000 7f5fe1399700 1 -- 172.21.15.124:0/3862930927 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc8003570 con 0x7f5fdc159600 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.106+0000 7f5fe2b9c700 1 -- 172.21.15.124:0/3862930927 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fdc068d20 msgr2=0x7f5fdc15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.106+0000 7f5fe2b9c700 1 --2- 172.21.15.124:0/3862930927 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fdc068d20 0x7f5fdc15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.108 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.106+0000 7f5fe2b9c700 1 -- 172.21.15.124:0/3862930927 >> v1:172.21.15.124:6789/0 conn(0x7f5fdc159600 legacy=0x7f5fdc068610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.109 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.106+0000 7f5fe2b9c700 1 -- 172.21.15.124:0/3862930927 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc0b5c00 con 0x7f5fdc1599d0 2023-10-06T04:44:12.109 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.106+0000 7f5fe2b9c700 1 --2- 172.21.15.124:0/3862930927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc1599d0 0x7f5fdc15ac20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009e60 tx=0x7f5fd4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470b6424dd8aef85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.110 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.106+0000 7f5fe1399700 1 -- 172.21.15.124:0/3862930927 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400e070 con 0x7f5fdc1599d0 2023-10-06T04:44:12.110 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.107+0000 7f5fe1399700 1 -- 172.21.15.124:0/3862930927 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd400bab0 con 0x7f5fdc1599d0 2023-10-06T04:44:12.110 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.107+0000 7f5fe1399700 1 -- 172.21.15.124:0/3862930927 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400be70 con 0x7f5fdc1599d0 2023-10-06T04:44:12.110 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.107+0000 7f5fe45ff700 1 -- 172.21.15.124:0/3862930927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc1599d0 msgr2=0x7f5fdc15ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.110 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.107+0000 7f5fe45ff700 1 --2- 172.21.15.124:0/3862930927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc1599d0 0x7f5fdc15ac20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009e60 tx=0x7f5fd4009780 comp rx=0 tx=0).stop 2023-10-06T04:44:12.110 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.107+0000 7f5fe45ff700 1 -- 172.21.15.124:0/3862930927 shutdown_connections 2023-10-06T04:44:12.110 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.107+0000 7f5fe45ff700 1 --2- 172.21.15.124:0/3862930927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc1599d0 0x7f5fdc15ac20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.110 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.107+0000 7f5fe45ff700 1 --2- 172.21.15.124:0/3862930927 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fdc068d20 0x7f5fdc15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.111 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.107+0000 7f5fe45ff700 1 -- 172.21.15.124:0/3862930927 >> 172.21.15.124:0/3862930927 conn(0x7f5fdc06f820 msgr2=0x7f5fdc0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:12.111 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.107+0000 7f5fe45ff700 1 -- 172.21.15.124:0/3862930927 shutdown_connections 2023-10-06T04:44:12.111 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.107+0000 7f5fe45ff700 1 -- 172.21.15.124:0/3862930927 wait complete. 2023-10-06T04:44:12.111 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.109+0000 7f5fe45ff700 1 Processor -- start 2023-10-06T04:44:12.111 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.109+0000 7f5fe45ff700 1 -- start start 2023-10-06T04:44:12.113 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe45ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fdc068d20 0x7f5fdc1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.113 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe45ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc159600 0x7f5fdc14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.113 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe45ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fdc1599d0 0x7f5fdc1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.113 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe45ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc14b480 con 0x7f5fdc159600 2023-10-06T04:44:12.113 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe45ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15eb10 con 0x7f5fdc1599d0 2023-10-06T04:44:12.113 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe45ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc14b1a0 con 0x7f5fdc068d20 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe1b9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc159600 0x7f5fdc14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe239b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fdc068d20 0x7f5fdc1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe1b9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc159600 0x7f5fdc14ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38492/0 (socket says 172.21.15.124:38492) 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe1b9a700 1 -- 172.21.15.124:0/2436360731 learned_addr learned my addr 172.21.15.124:0/2436360731 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe2b9c700 1 --2- 172.21.15.124:0/2436360731 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fdc1599d0 0x7f5fdc1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe1b9a700 1 -- 172.21.15.124:0/2436360731 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fdc068d20 msgr2=0x7f5fdc1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe1b9a700 1 --2- 172.21.15.124:0/2436360731 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fdc068d20 0x7f5fdc1557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe1b9a700 1 -- 172.21.15.124:0/2436360731 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fdc1599d0 msgr2=0x7f5fdc1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe1b9a700 1 --2- 172.21.15.124:0/2436360731 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fdc1599d0 0x7f5fdc1583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.110+0000 7f5fe1b9a700 1 -- 172.21.15.124:0/2436360731 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4009a20 con 0x7f5fdc159600 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.111+0000 7f5fe1b9a700 1 --2- 172.21.15.124:0/2436360731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc159600 0x7f5fdc14ab70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00ecb0 tx=0x7f5fcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.114 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.111+0000 7f5fd27fc700 1 -- 172.21.15.124:0/2436360731 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00c850 con 0x7f5fdc159600 2023-10-06T04:44:12.115 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.111+0000 7f5fd27fc700 1 -- 172.21.15.124:0/2436360731 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc00c9d0 con 0x7f5fdc159600 2023-10-06T04:44:12.115 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.111+0000 7f5fe45ff700 1 -- 172.21.15.124:0/2436360731 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc15e4c0 con 0x7f5fdc159600 2023-10-06T04:44:12.115 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.111+0000 7f5fd27fc700 1 -- 172.21.15.124:0/2436360731 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00cd90 con 0x7f5fdc159600 2023-10-06T04:44:12.115 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.111+0000 7f5fe45ff700 1 -- 172.21.15.124:0/2436360731 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc0cf5b0 con 0x7f5fdc159600 2023-10-06T04:44:12.115 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.111+0000 7f5fd27fc700 1 -- 172.21.15.124:0/2436360731 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5fcc005c80 con 0x7f5fdc159600 2023-10-06T04:44:12.115 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.111+0000 7f5fd27fc700 1 -- 172.21.15.124:0/2436360731 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f5fcc013680 con 0x7f5fdc159600 2023-10-06T04:44:12.115 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.112+0000 7f5fe45ff700 1 -- 172.21.15.124:0/2436360731 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc064d10 con 0x7f5fdc159600 2023-10-06T04:44:12.117 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.116+0000 7f5fd27fc700 1 -- 172.21.15.124:0/2436360731 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5fcc021060 con 0x7f5fdc159600 2023-10-06T04:44:12.190 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.188+0000 7f5fe45ff700 1 -- 172.21.15.124:0/2436360731 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fdc0b5ee0 con 0x7f5fdc159600 2023-10-06T04:44:12.191 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.189+0000 7f5fd27fc700 1 -- 172.21.15.124:0/2436360731 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f5fcc029020 con 0x7f5fdc159600 2023-10-06T04:44:12.191 INFO:teuthology.misc.health.smithi124.stdout: 2023-10-06T04:44:12.191 INFO:teuthology.misc.health.smithi124.stdout:{"epoch":10,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:10.705153+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:12.192 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.190+0000 7f5fe45ff700 1 -- 172.21.15.124:0/2436360731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc159600 msgr2=0x7f5fdc14ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.192 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.190+0000 7f5fe45ff700 1 --2- 172.21.15.124:0/2436360731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc159600 0x7f5fdc14ab70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00ecb0 tx=0x7f5fcc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.192 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.191+0000 7f5fe45ff700 1 -- 172.21.15.124:0/2436360731 shutdown_connections 2023-10-06T04:44:12.192 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.191+0000 7f5fe45ff700 1 --2- 172.21.15.124:0/2436360731 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fdc1599d0 0x7f5fdc1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.193 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.191+0000 7f5fe45ff700 1 --2- 172.21.15.124:0/2436360731 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fdc068d20 0x7f5fdc1557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.193 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.191+0000 7f5fe45ff700 1 --2- 172.21.15.124:0/2436360731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fdc159600 0x7f5fdc14ab70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.193 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.191+0000 7f5fe45ff700 1 -- 172.21.15.124:0/2436360731 >> 172.21.15.124:0/2436360731 conn(0x7f5fdc06f820 msgr2=0x7f5fdc154260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:12.193 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.191+0000 7f5fe45ff700 1 -- 172.21.15.124:0/2436360731 shutdown_connections 2023-10-06T04:44:12.193 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:12.191+0000 7f5fe45ff700 1 -- 172.21.15.124:0/2436360731 wait complete. 2023-10-06T04:44:12.207 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T04:44:12.415 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:12.414+0000 7f1dd80bc1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:44:12.529 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:12.527+0000 7fc4d3a3b1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:44:12.787 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:12.785+0000 7f1dd80bc1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:44:12.917 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:12.914+0000 7fc4d3a3b1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:44:12.963 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:12.961+0000 7f1dd80bc1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:44:13.091 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:13.088+0000 7fc4d3a3b1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:44:13.399 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:13.398+0000 7f1dd80bc1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:44:13.531 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:13.528+0000 7fc4d3a3b1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:44:13.577 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:13.576+0000 7f1dd80bc1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:44:13.711 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:13.708+0000 7fc4d3a3b1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:44:13.770 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:13.769+0000 7f1dd80bc1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:44:13.893 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:13.891+0000 7f1dd80bc1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:44:13.898 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:13.896+0000 7fc4d3a3b1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:44:14.058 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-06T04:44:14.056+0000 7fc4d3a3b1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:44:14.719 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-06T04:44:14.718+0000 7fe819cd0540 -1 osd.1 0 log_to_monitors true 2023-10-06T04:44:14.742 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-06T04:44:14.741+0000 7fe60f9fd540 -1 osd.0 0 log_to_monitors true 2023-10-06T04:44:14.912 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:14.910+0000 7f1d973fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T04:44:14.912 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-06T04:44:14.910+0000 7f1d973fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T04:44:14.986 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-06T04:44:14.985+0000 7f21ccf9d540 -1 osd.2 0 log_to_monitors true 2023-10-06T04:44:15.020 INFO:tasks.ceph.osd.6.smithi158.stderr:2023-10-06T04:44:15.018+0000 7f98d6870540 -1 osd.6 0 log_to_monitors true 2023-10-06T04:44:15.064 INFO:tasks.ceph.osd.7.smithi158.stderr:2023-10-06T04:44:15.062+0000 7f1152912540 -1 osd.7 0 log_to_monitors true 2023-10-06T04:44:15.082 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-06T04:44:15.081+0000 7fde1547a540 -1 osd.3 0 log_to_monitors true 2023-10-06T04:44:15.243 INFO:tasks.ceph.osd.4.smithi158.stderr:2023-10-06T04:44:15.241+0000 7fd3a7419540 -1 osd.4 0 log_to_monitors true 2023-10-06T04:44:15.272 INFO:tasks.ceph.osd.5.smithi158.stderr:2023-10-06T04:44:15.270+0000 7fda1456a540 -1 osd.5 0 log_to_monitors true 2023-10-06T04:44:17.764 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-06T04:44:17.759+0000 7fe6033f6700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T04:44:17.768 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-06T04:44:17.767+0000 7fe80d7f6700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T04:44:17.778 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-06T04:44:17.776+0000 7fe5fc3e8700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:44:17.783 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-06T04:44:17.782+0000 7fe8067e8700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:44:18.262 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-06T04:44:18.260+0000 7f21c09f6700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T04:44:18.270 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-06T04:44:18.268+0000 7f21b99e8700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:44:18.439 INFO:tasks.ceph.osd.4.smithi158.stderr:2023-10-06T04:44:18.437+0000 7fd39c7f9700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T04:44:18.455 INFO:tasks.ceph.osd.4.smithi158.stderr:2023-10-06T04:44:18.452+0000 7fd393fe8700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:44:18.455 INFO:tasks.ceph.osd.5.smithi158.stderr:2023-10-06T04:44:18.454+0000 7fda07ff6700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T04:44:18.456 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-06T04:44:18.455+0000 7fde08ff6700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T04:44:18.464 INFO:tasks.ceph.osd.5.smithi158.stderr:2023-10-06T04:44:18.459+0000 7fda00fe8700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:44:18.464 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-06T04:44:18.463+0000 7fde01fe8700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:44:18.578 INFO:tasks.ceph.osd.7.smithi158.stderr:2023-10-06T04:44:18.577+0000 7f11463f6700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T04:44:18.585 INFO:tasks.ceph.osd.7.smithi158.stderr:2023-10-06T04:44:18.583+0000 7f113f3e8700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:44:18.664 INFO:tasks.ceph.osd.6.smithi158.stderr:2023-10-06T04:44:18.662+0000 7f98ca3f6700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T04:44:18.669 INFO:tasks.ceph.osd.6.smithi158.stderr:2023-10-06T04:44:18.668+0000 7f98c33e8700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:44:19.014 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:19.186 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.185+0000 7f41bebff700 1 Processor -- start 2023-10-06T04:44:19.187 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.185+0000 7f41bebff700 1 -- start start 2023-10-06T04:44:19.188 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.186+0000 7f41bebff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f41b8154df0 0x7f41b8158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.188 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.186+0000 7f41bebff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f41b8159130 0x7f41b806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.188 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.186+0000 7f41bebff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b80ca8e0 con 0x7f41b81551c0 2023-10-06T04:44:19.188 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.186+0000 7f41bebff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b8158a20 con 0x7f41b8159130 2023-10-06T04:44:19.189 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.186+0000 7f41bebff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b80c9da0 con 0x7f41b8154df0 2023-10-06T04:44:19.189 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.187+0000 7f41bd19c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f41b8159130 0x7f41b806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.189 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.187+0000 7f41bd19c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f41b8159130 0x7f41b806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:33018/0 (socket says 172.21.15.124:33018) 2023-10-06T04:44:19.189 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.187+0000 7f41bd19c700 1 -- 172.21.15.124:0/1452441996 learned_addr learned my addr 172.21.15.124:0/1452441996 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:19.189 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.187+0000 7f41bc99b700 1 --2- 172.21.15.124:0/1452441996 >> v2:172.21.15.158:3300/0 conn(0x7f41b8154df0 0x7f41b8158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.189 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.187+0000 7f41bd19c700 1 -- 172.21.15.124:0/1452441996 >> v2:172.21.15.158:3300/0 conn(0x7f41b8154df0 msgr2=0x7f41b8158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:19.189 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.187+0000 7f41bd19c700 1 --2- 172.21.15.124:0/1452441996 >> v2:172.21.15.158:3300/0 conn(0x7f41b8154df0 0x7f41b8158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.189 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.187+0000 7f41bd19c700 1 -- 172.21.15.124:0/1452441996 >> v1:172.21.15.158:6789/0 conn(0x7f41b81551c0 legacy=0x7f41b80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:19.189 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.187+0000 7f41bd19c700 1 -- 172.21.15.124:0/1452441996 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80b2070 con 0x7f41b8159130 2023-10-06T04:44:19.191 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.187+0000 7f41bd19c700 1 --2- 172.21.15.124:0/1452441996 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 0x7f41b806a610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f41b8069180 tx=0x7f41b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c315eb069b9d9bfa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.191 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.187+0000 7f41b77fe700 1 -- 172.21.15.124:0/1452441996 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b000e070 con 0x7f41b8159130 2023-10-06T04:44:19.191 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.188+0000 7f41b77fe700 1 -- 172.21.15.124:0/1452441996 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b000ba10 con 0x7f41b8159130 2023-10-06T04:44:19.191 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.188+0000 7f41b77fe700 1 -- 172.21.15.124:0/1452441996 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00092e0 con 0x7f41b8159130 2023-10-06T04:44:19.191 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.188+0000 7f41bebff700 1 -- 172.21.15.124:0/1452441996 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 msgr2=0x7f41b806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.191 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.188+0000 7f41bebff700 1 --2- 172.21.15.124:0/1452441996 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 0x7f41b806a610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f41b8069180 tx=0x7f41b0009840 comp rx=0 tx=0).stop 2023-10-06T04:44:19.191 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.188+0000 7f41bebff700 1 -- 172.21.15.124:0/1452441996 shutdown_connections 2023-10-06T04:44:19.191 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.188+0000 7f41bebff700 1 --2- 172.21.15.124:0/1452441996 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 0x7f41b806a610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.191 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.188+0000 7f41bebff700 1 --2- 172.21.15.124:0/1452441996 >> v2:172.21.15.158:3300/0 conn(0x7f41b8154df0 0x7f41b8158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.192 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.188+0000 7f41bebff700 1 -- 172.21.15.124:0/1452441996 >> 172.21.15.124:0/1452441996 conn(0x7f41b80cc140 msgr2=0x7f41b80cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:19.192 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.188+0000 7f41bebff700 1 -- 172.21.15.124:0/1452441996 shutdown_connections 2023-10-06T04:44:19.192 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.188+0000 7f41bebff700 1 -- 172.21.15.124:0/1452441996 wait complete. 2023-10-06T04:44:19.192 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.190+0000 7f41bebff700 1 Processor -- start 2023-10-06T04:44:19.192 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.191+0000 7f41bebff700 1 -- start start 2023-10-06T04:44:19.194 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41bebff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41b8154df0 0x7f41b80c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.195 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41bebff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41b81551c0 0x7f41b8168170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.195 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41bebff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 0x7f41b80a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.195 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41bebff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80c8bb0 con 0x7f41b8159130 2023-10-06T04:44:19.195 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41bebff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b81686b0 con 0x7f41b81551c0 2023-10-06T04:44:19.195 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41bebff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80aa2a0 con 0x7f41b8154df0 2023-10-06T04:44:19.195 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41bd19c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 0x7f41b80a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.195 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41bd19c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 0x7f41b80a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:33032/0 (socket says 172.21.15.124:33032) 2023-10-06T04:44:19.195 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41bd19c700 1 -- 172.21.15.124:0/1720400575 learned_addr learned my addr 172.21.15.124:0/1720400575 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:19.195 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41b7fff700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41b81551c0 0x7f41b8168170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.195 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.192+0000 7f41bc99b700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41b8154df0 0x7f41b80c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41bd19c700 1 -- 172.21.15.124:0/1720400575 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41b8154df0 msgr2=0x7f41b80c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41bd19c700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41b8154df0 0x7f41b80c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41bd19c700 1 -- 172.21.15.124:0/1720400575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41b81551c0 msgr2=0x7f41b8168170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41bd19c700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41b81551c0 0x7f41b8168170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41bd19c700 1 -- 172.21.15.124:0/1720400575 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0009ae0 con 0x7f41b8159130 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41bc99b700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41b8154df0 0x7f41b80c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41bd19c700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 0x7f41b80a7fc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f41b8069200 tx=0x7f41b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41b4ff9700 1 -- 172.21.15.124:0/1720400575 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00032f0 con 0x7f41b8159130 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41b4ff9700 1 -- 172.21.15.124:0/1720400575 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b0012db0 con 0x7f41b8159130 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41bebff700 1 -- 172.21.15.124:0/1720400575 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b80aa560 con 0x7f41b8159130 2023-10-06T04:44:19.196 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41b4ff9700 1 -- 172.21.15.124:0/1720400575 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b001d670 con 0x7f41b8159130 2023-10-06T04:44:19.197 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.193+0000 7f41bebff700 1 -- 172.21.15.124:0/1720400575 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b80aab20 con 0x7f41b8159130 2023-10-06T04:44:19.197 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.194+0000 7f41bebff700 1 -- 172.21.15.124:0/1720400575 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b8064d10 con 0x7f41b8159130 2023-10-06T04:44:19.197 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.195+0000 7f41b4ff9700 1 -- 172.21.15.124:0/1720400575 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f41b001daa0 con 0x7f41b8159130 2023-10-06T04:44:19.197 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.196+0000 7f41b4ff9700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f419c066ea0 0x7f419c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.198 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.196+0000 7f41b4ff9700 1 -- 172.21.15.124:0/1720400575 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f41b0085740 con 0x7f41b8159130 2023-10-06T04:44:19.198 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.196+0000 7f41bc99b700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f419c066ea0 0x7f419c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.198 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.197+0000 7f41bc99b700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f419c066ea0 0x7f419c069350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f41ac006fd0 tx=0x7f41ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.202 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.201+0000 7f41b4ff9700 1 -- 172.21.15.124:0/1720400575 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41b0052ec0 con 0x7f41b8159130 2023-10-06T04:44:19.397 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.396+0000 7f41bebff700 1 -- 172.21.15.124:0/1720400575 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41b806f520 con 0x7f41b8159130 2023-10-06T04:44:19.398 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.397+0000 7f41b4ff9700 1 -- 172.21.15.124:0/1720400575 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10540 (secure 0 0 0) 0x7f41b00093a0 con 0x7f41b8159130 2023-10-06T04:44:19.398 INFO:teuthology.misc.health.smithi124.stdout: 2023-10-06T04:44:19.398 INFO:teuthology.misc.health.smithi124.stdout:{"epoch":14,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:18.779865+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:19.401 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 -- 172.21.15.124:0/1720400575 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f419c066ea0 msgr2=0x7f419c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.401 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f419c066ea0 0x7f419c069350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f41ac006fd0 tx=0x7f41ac008040 comp rx=0 tx=0).stop 2023-10-06T04:44:19.401 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 -- 172.21.15.124:0/1720400575 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 msgr2=0x7f41b80a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.401 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 0x7f41b80a7fc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f41b8069200 tx=0x7f41b0017000 comp rx=0 tx=0).stop 2023-10-06T04:44:19.401 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 -- 172.21.15.124:0/1720400575 shutdown_connections 2023-10-06T04:44:19.401 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41b8159130 0x7f41b80a7fc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.401 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f419c066ea0 0x7f419c069350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.401 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41b8154df0 0x7f41b80c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.401 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 --2- 172.21.15.124:0/1720400575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41b81551c0 0x7f41b8168170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.402 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 -- 172.21.15.124:0/1720400575 >> 172.21.15.124:0/1720400575 conn(0x7f41b80cc140 msgr2=0x7f41b8155900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:19.402 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 -- 172.21.15.124:0/1720400575 shutdown_connections 2023-10-06T04:44:19.402 INFO:teuthology.misc.health.smithi124.stderr:2023-10-06T04:44:19.399+0000 7f41bebff700 1 -- 172.21.15.124:0/1720400575 wait complete. 2023-10-06T04:44:19.415 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T04:44:19.415 INFO:tasks.ceph:Creating RBD pool 2023-10-06T04:44:19.415 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T04:44:19.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.596+0000 7f45ef7ff700 1 Processor -- start 2023-10-06T04:44:19.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.596+0000 7f45ef7ff700 1 -- start start 2023-10-06T04:44:19.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.597+0000 7f45ef7ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e8068600 0x7f45e806a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.597+0000 7f45ef7ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f45e80aa0c0 0x7f45e8159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.597+0000 7f45ef7ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e815df90 con 0x7f45e80a9cf0 2023-10-06T04:44:19.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.597+0000 7f45ef7ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e80ab310 con 0x7f45e80aa0c0 2023-10-06T04:44:19.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.597+0000 7f45ef7ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e815d380 con 0x7f45e8068600 2023-10-06T04:44:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.598+0000 7f45edd9c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f45e80aa0c0 0x7f45e8159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.598+0000 7f45ecd9a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e8068600 0x7f45e806a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.598+0000 7f45ecd9a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e8068600 0x7f45e806a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:58688/0 (socket says 172.21.15.124:58688) 2023-10-06T04:44:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.598+0000 7f45ecd9a700 1 -- 172.21.15.124:0/629957817 learned_addr learned my addr 172.21.15.124:0/629957817 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.598+0000 7f45edd9c700 1 -- 172.21.15.124:0/629957817 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e8068600 msgr2=0x7f45e806a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.598+0000 7f45edd9c700 1 --2- 172.21.15.124:0/629957817 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e8068600 0x7f45e806a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.598+0000 7f45edd9c700 1 -- 172.21.15.124:0/629957817 >> v1:172.21.15.158:6789/0 conn(0x7f45e80a9cf0 legacy=0x7f45e8069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.598+0000 7f45edd9c700 1 -- 172.21.15.124:0/629957817 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e815d660 con 0x7f45e80aa0c0 2023-10-06T04:44:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.598+0000 7f45ecd9a700 1 --2- 172.21.15.124:0/629957817 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e8068600 0x7f45e806a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.598+0000 7f45edd9c700 1 --2- 172.21.15.124:0/629957817 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45e80aa0c0 0x7f45e8159200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009e90 tx=0x7f45e0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cb2c4ee6674b02f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45dffff700 1 -- 172.21.15.124:0/629957817 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000e070 con 0x7f45e80aa0c0 2023-10-06T04:44:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45dffff700 1 -- 172.21.15.124:0/629957817 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e000bbf0 con 0x7f45e80aa0c0 2023-10-06T04:44:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45dffff700 1 -- 172.21.15.124:0/629957817 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0012430 con 0x7f45e80aa0c0 2023-10-06T04:44:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45ef7ff700 1 -- 172.21.15.124:0/629957817 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45e80aa0c0 msgr2=0x7f45e8159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45ef7ff700 1 --2- 172.21.15.124:0/629957817 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45e80aa0c0 0x7f45e8159200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009e90 tx=0x7f45e0009780 comp rx=0 tx=0).stop 2023-10-06T04:44:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45ef7ff700 1 -- 172.21.15.124:0/629957817 shutdown_connections 2023-10-06T04:44:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45ef7ff700 1 --2- 172.21.15.124:0/629957817 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45e80aa0c0 0x7f45e8159200 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45ef7ff700 1 --2- 172.21.15.124:0/629957817 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e8068600 0x7f45e806a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45ef7ff700 1 -- 172.21.15.124:0/629957817 >> 172.21.15.124:0/629957817 conn(0x7f45e806bf10 msgr2=0x7f45e80ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45ef7ff700 1 -- 172.21.15.124:0/629957817 shutdown_connections 2023-10-06T04:44:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.599+0000 7f45ef7ff700 1 -- 172.21.15.124:0/629957817 wait complete. 2023-10-06T04:44:19.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.601+0000 7f45ef7ff700 1 Processor -- start 2023-10-06T04:44:19.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.601+0000 7f45ef7ff700 1 -- start start 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ef7ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45e8068600 0x7f45e8145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ef7ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45e80a9cf0 0x7f45e81590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ef7ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e80aa0c0 0x7f45e8159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ef7ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e815fdb0 con 0x7f45e80a9cf0 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ef7ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e815f510 con 0x7f45e8068600 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ef7ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e815f7f0 con 0x7f45e80aa0c0 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ecd9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45e80a9cf0 0x7f45e81590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ecd9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45e80a9cf0 0x7f45e81590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:33046/0 (socket says 172.21.15.124:33046) 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ecd9a700 1 -- 172.21.15.124:0/3233118601 learned_addr learned my addr 172.21.15.124:0/3233118601 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ed59b700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45e8068600 0x7f45e8145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45edd9c700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e80aa0c0 0x7f45e8159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ecd9a700 1 -- 172.21.15.124:0/3233118601 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e80aa0c0 msgr2=0x7f45e8159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ecd9a700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e80aa0c0 0x7f45e8159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ecd9a700 1 -- 172.21.15.124:0/3233118601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45e8068600 msgr2=0x7f45e8145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ecd9a700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45e8068600 0x7f45e8145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.602+0000 7f45ecd9a700 1 -- 172.21.15.124:0/3233118601 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80094f0 con 0x7f45e80a9cf0 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.603+0000 7f45ecd9a700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45e80a9cf0 0x7f45e81590b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45d800ec80 tx=0x7f45d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.603+0000 7f45dd7fa700 1 -- 172.21.15.124:0/3233118601 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800c850 con 0x7f45e80a9cf0 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.603+0000 7f45dd7fa700 1 -- 172.21.15.124:0/3233118601 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d800c9b0 con 0x7f45e80a9cf0 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.603+0000 7f45ef7ff700 1 -- 172.21.15.124:0/3233118601 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e0009a20 con 0x7f45e80a9cf0 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.603+0000 7f45dd7fa700 1 -- 172.21.15.124:0/3233118601 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800cd50 con 0x7f45e80a9cf0 2023-10-06T04:44:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.603+0000 7f45ef7ff700 1 -- 172.21.15.124:0/3233118601 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e80af7c0 con 0x7f45e80a9cf0 2023-10-06T04:44:19.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.604+0000 7f45ef7ff700 1 -- 172.21.15.124:0/3233118601 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e80af9e0 con 0x7f45e80a9cf0 2023-10-06T04:44:19.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.605+0000 7f45dd7fa700 1 -- 172.21.15.124:0/3233118601 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f45d8013680 con 0x7f45e80a9cf0 2023-10-06T04:44:19.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.606+0000 7f45dd7fa700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f45cc066ed0 0x7f45cc069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.606+0000 7f45dd7fa700 1 -- 172.21.15.124:0/3233118601 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f45d8084210 con 0x7f45e80a9cf0 2023-10-06T04:44:19.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.606+0000 7f45ed59b700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f45cc066ed0 0x7f45cc069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.606+0000 7f45ed59b700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f45cc066ed0 0x7f45cc069380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f45e4003a80 tx=0x7f45e4007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.610+0000 7f45dd7fa700 1 -- 172.21.15.124:0/3233118601 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45d8051990 con 0x7f45e80a9cf0 2023-10-06T04:44:19.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:19.806+0000 7f45ef7ff700 1 -- 172.21.15.124:0/3233118601 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f45e804c380 con 0x7f45e80a9cf0 2023-10-06T04:44:20.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.794+0000 7f45dd7fa700 1 -- 172.21.15.124:0/3233118601 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f45d8054fb0 con 0x7f45e80a9cf0 2023-10-06T04:44:20.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 -- 172.21.15.124:0/3233118601 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f45cc066ed0 msgr2=0x7f45cc069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f45cc066ed0 0x7f45cc069380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f45e4003a80 tx=0x7f45e4007ec0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 -- 172.21.15.124:0/3233118601 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45e80a9cf0 msgr2=0x7f45e81590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45e80a9cf0 0x7f45e81590b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45d800ec80 tx=0x7f45d8009250 comp rx=0 tx=0).stop 2023-10-06T04:44:20.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 -- 172.21.15.124:0/3233118601 shutdown_connections 2023-10-06T04:44:20.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f45cc066ed0 0x7f45cc069380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45e80aa0c0 0x7f45e8159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45e8068600 0x7f45e8145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 --2- 172.21.15.124:0/3233118601 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45e80a9cf0 0x7f45e81590b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 -- 172.21.15.124:0/3233118601 >> 172.21.15.124:0/3233118601 conn(0x7f45e806bf10 msgr2=0x7f45e8069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:20.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.798+0000 7f45ef7ff700 1 -- 172.21.15.124:0/3233118601 shutdown_connections 2023-10-06T04:44:20.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:20.799+0000 7f45ef7ff700 1 -- 172.21.15.124:0/3233118601 wait complete. 2023-10-06T04:44:20.802 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'rbd' created 2023-10-06T04:44:20.819 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T04:44:21.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.007+0000 7f4941fff700 1 Processor -- start 2023-10-06T04:44:21.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.007+0000 7f4941fff700 1 -- start start 2023-10-06T04:44:21.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.009+0000 7f4941fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c15d4d0 0x7f493c0a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.009+0000 7f4941fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c0cc510 con 0x7f493c1598d0 2023-10-06T04:44:21.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.009+0000 7f4941fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c0cc770 con 0x7f493c15d8a0 2023-10-06T04:44:21.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.009+0000 7f4941fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c067690 con 0x7f493c15d4d0 2023-10-06T04:44:21.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.009+0000 7f493bfff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f493c1598d0 0x7f493c0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53234/0 (socket says 172.21.15.124:53234) 2023-10-06T04:44:21.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.009+0000 7f493bfff700 1 -- 172.21.15.124:0/793324090 learned_addr learned my addr 172.21.15.124:0/793324090 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:21.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.009+0000 7f493b7fe700 1 --2- 172.21.15.124:0/793324090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c15d4d0 0x7f493c0a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.009+0000 7f493a7fc700 1 -- 172.21.15.124:0/793324090 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900427628 0 0) 0x7f493c0cc510 con 0x7f493c1598d0 2023-10-06T04:44:21.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.009+0000 7f493a7fc700 1 -- 172.21.15.124:0/793324090 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4924003570 con 0x7f493c1598d0 2023-10-06T04:44:21.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.010+0000 7f493a7fc700 1 -- 172.21.15.124:0/793324090 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99322382 0 0) 0x7f493c0cc770 con 0x7f493c15d8a0 2023-10-06T04:44:21.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.010+0000 7f493a7fc700 1 -- 172.21.15.124:0/793324090 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f493c0cc510 con 0x7f493c15d8a0 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.010+0000 7f493a7fc700 1 -- 172.21.15.124:0/793324090 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433801843 0 0) 0x7f4924003570 con 0x7f493c1598d0 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.010+0000 7f493b7fe700 1 -- 172.21.15.124:0/793324090 >> v1:172.21.15.158:6789/0 conn(0x7f493c15d8a0 legacy=0x7f493c1591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.010+0000 7f493b7fe700 1 -- 172.21.15.124:0/793324090 >> v1:172.21.15.124:6789/0 conn(0x7f493c1598d0 legacy=0x7f493c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.010+0000 7f493b7fe700 1 -- 172.21.15.124:0/793324090 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c067970 con 0x7f493c15d4d0 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.010+0000 7f493b7fe700 1 --2- 172.21.15.124:0/793324090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c15d4d0 0x7f493c0a9890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f492c009910 tx=0x7f492c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b9da3b9c659f028 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.010+0000 7f493a7fc700 1 -- 172.21.15.124:0/793324090 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49340017f0 con 0x7f493c15d4d0 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.010+0000 7f493a7fc700 1 -- 172.21.15.124:0/793324090 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c011420 con 0x7f493c15d4d0 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.010+0000 7f493a7fc700 1 -- 172.21.15.124:0/793324090 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c0117c0 con 0x7f493c15d4d0 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.011+0000 7f4941fff700 1 -- 172.21.15.124:0/793324090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c15d4d0 msgr2=0x7f493c0a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.011+0000 7f4941fff700 1 --2- 172.21.15.124:0/793324090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c15d4d0 0x7f493c0a9890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f492c009910 tx=0x7f492c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.011+0000 7f4941fff700 1 -- 172.21.15.124:0/793324090 shutdown_connections 2023-10-06T04:44:21.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.011+0000 7f4941fff700 1 --2- 172.21.15.124:0/793324090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c15d4d0 0x7f493c0a9890 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.011+0000 7f4941fff700 1 -- 172.21.15.124:0/793324090 >> 172.21.15.124:0/793324090 conn(0x7f493c0c94c0 msgr2=0x7f493c0c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:21.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.011+0000 7f4941fff700 1 -- 172.21.15.124:0/793324090 shutdown_connections 2023-10-06T04:44:21.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.011+0000 7f4941fff700 1 -- 172.21.15.124:0/793324090 wait complete. 2023-10-06T04:44:21.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.012+0000 7f4941fff700 1 Processor -- start 2023-10-06T04:44:21.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.013+0000 7f4941fff700 1 -- start start 2023-10-06T04:44:21.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.013+0000 7f4941fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c1598d0 0x7f493c151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.013+0000 7f4941fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f493c15d4d0 0x7f493c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.013+0000 7f4941fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f493c15d8a0 0x7f493c0a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.013+0000 7f4941fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0b1c70 con 0x7f493c15d8a0 2023-10-06T04:44:21.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.013+0000 7f4941fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0b1060 con 0x7f493c15d4d0 2023-10-06T04:44:21.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.013+0000 7f4941fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0b1340 con 0x7f493c1598d0 2023-10-06T04:44:21.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f493c15d8a0 0x7f493c0a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f493c15d8a0 0x7f493c0a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:33058/0 (socket says 172.21.15.124:33058) 2023-10-06T04:44:21.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493bfff700 1 -- 172.21.15.124:0/254092196 learned_addr learned my addr 172.21.15.124:0/254092196 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493b7fe700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c1598d0 0x7f493c151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493affd700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f493c15d4d0 0x7f493c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493bfff700 1 -- 172.21.15.124:0/254092196 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c1598d0 msgr2=0x7f493c151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493bfff700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c1598d0 0x7f493c151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493bfff700 1 -- 172.21.15.124:0/254092196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f493c15d4d0 msgr2=0x7f493c1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493bfff700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f493c15d4d0 0x7f493c1584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493bfff700 1 -- 172.21.15.124:0/254092196 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c009420 con 0x7f493c15d8a0 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f493bfff700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f493c15d8a0 0x7f493c0a9890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f493400cc80 tx=0x7f4934007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.014+0000 7f49237fe700 1 -- 172.21.15.124:0/254092196 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934004dc0 con 0x7f493c15d8a0 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.015+0000 7f49237fe700 1 -- 172.21.15.124:0/254092196 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400a660 con 0x7f493c15d8a0 2023-10-06T04:44:21.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.015+0000 7f49237fe700 1 -- 172.21.15.124:0/254092196 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400aa20 con 0x7f493c15d8a0 2023-10-06T04:44:21.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.015+0000 7f4941fff700 1 -- 172.21.15.124:0/254092196 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c0b1620 con 0x7f493c15d8a0 2023-10-06T04:44:21.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.015+0000 7f4941fff700 1 -- 172.21.15.124:0/254092196 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c0b2100 con 0x7f493c15d8a0 2023-10-06T04:44:21.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.016+0000 7f4941fff700 1 -- 172.21.15.124:0/254092196 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c0718b0 con 0x7f493c15d8a0 2023-10-06T04:44:21.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.017+0000 7f49237fe700 1 -- 172.21.15.124:0/254092196 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f4934007150 con 0x7f493c15d8a0 2023-10-06T04:44:21.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.017+0000 7f49237fe700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4928066ea0 0x7f4928069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.018+0000 7f49237fe700 1 -- 172.21.15.124:0/254092196 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f4934083870 con 0x7f493c15d8a0 2023-10-06T04:44:21.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.018+0000 7f493b7fe700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4928066ea0 0x7f4928069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.018+0000 7f493b7fe700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4928066ea0 0x7f4928069350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f492c0030c0 tx=0x7f492c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.022+0000 7f49237fe700 1 -- 172.21.15.124:0/254092196 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4934050dd0 con 0x7f493c15d8a0 2023-10-06T04:44:21.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.216+0000 7f4941fff700 1 -- 172.21.15.124:0/254092196 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f493c067c50 con 0x7f493c15d8a0 2023-10-06T04:44:21.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.796+0000 7f49237fe700 1 -- 172.21.15.124:0/254092196 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4934018020 con 0x7f493c15d8a0 2023-10-06T04:44:21.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 -- 172.21.15.124:0/254092196 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4928066ea0 msgr2=0x7f4928069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4928066ea0 0x7f4928069350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f492c0030c0 tx=0x7f492c016000 comp rx=0 tx=0).stop 2023-10-06T04:44:21.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 -- 172.21.15.124:0/254092196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f493c15d8a0 msgr2=0x7f493c0a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f493c15d8a0 0x7f493c0a9890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f493400cc80 tx=0x7f4934007d20 comp rx=0 tx=0).stop 2023-10-06T04:44:21.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 -- 172.21.15.124:0/254092196 shutdown_connections 2023-10-06T04:44:21.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f493c15d8a0 0x7f493c0a9890 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4928066ea0 0x7f4928069350 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f493c1598d0 0x7f493c151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 --2- 172.21.15.124:0/254092196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f493c15d4d0 0x7f493c1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 -- 172.21.15.124:0/254092196 >> 172.21.15.124:0/254092196 conn(0x7f493c0c94c0 msgr2=0x7f493c0c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:21.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 -- 172.21.15.124:0/254092196 shutdown_connections 2023-10-06T04:44:21.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:21.800+0000 7f4941fff700 1 -- 172.21.15.124:0/254092196 wait complete. 2023-10-06T04:44:21.808 INFO:teuthology.orchestra.run.smithi124.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T04:44:21.823 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T04:44:21.823 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:44:21.823 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:44:21.827 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:44:21.828 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:44:21.828 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:44:21.832 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:44:21.833 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:44:21.833 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:44:21.840 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:44:21.841 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:44:21.843 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:44:21.848 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:44:21.848 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T04:44:21.848 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:21.993 INFO:tasks.ceph.mds.a.smithi124.stdout:starting mds.a at 2023-10-06T04:44:21.995 INFO:tasks.ceph.mds.c.smithi124.stdout:starting mds.c at 2023-10-06T04:44:22.003 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-06T04:44:22.003 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-06T04:44:22.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.081+0000 7f4bd2fff700 1 Processor -- start 2023-10-06T04:44:22.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.081+0000 7f4bd2fff700 1 -- start start 2023-10-06T04:44:22.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.082+0000 7f4bd2fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4bcc0cb250 0x7f4bcc1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.082+0000 7f4bd2fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4bcc159710 0x7f4bcc0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.082+0000 7f4bd2fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc159b90 con 0x7f4bcc0cae80 2023-10-06T04:44:22.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.082+0000 7f4bd2fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc0cd430 con 0x7f4bcc159710 2023-10-06T04:44:22.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.082+0000 7f4bd2fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0c1d10 con 0x7f4bcc0cb250 2023-10-06T04:44:22.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.082+0000 7f4bd159c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4bcc159710 0x7f4bcc0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.082+0000 7f4bd159c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4bcc159710 0x7f4bcc0afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:33114/0 (socket says 172.21.15.124:33114) 2023-10-06T04:44:22.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.082+0000 7f4bd159c700 1 -- 172.21.15.124:0/1437243470 learned_addr learned my addr 172.21.15.124:0/1437243470 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:22.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.082+0000 7f4bcbfff700 1 --2- 172.21.15.124:0/1437243470 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4bcc0cb250 0x7f4bcc1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.083+0000 7f4bd159c700 1 -- 172.21.15.124:0/1437243470 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4bcc0cb250 msgr2=0x7f4bcc1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:22.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.083+0000 7f4bd159c700 1 --2- 172.21.15.124:0/1437243470 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4bcc0cb250 0x7f4bcc1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.083+0000 7f4bd159c700 1 -- 172.21.15.124:0/1437243470 >> v1:172.21.15.158:6789/0 conn(0x7f4bcc0cae80 legacy=0x7f4bcc0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.083+0000 7f4bd159c700 1 -- 172.21.15.124:0/1437243470 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0688a0 con 0x7f4bcc159710 2023-10-06T04:44:22.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.083+0000 7f4bd159c700 1 --2- 172.21.15.124:0/1437243470 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc159710 0x7f4bcc0afe40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009f20 tx=0x7f4bc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cbd7fac674fa50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.083+0000 7f4bcb7fe700 1 -- 172.21.15.124:0/1437243470 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc400e070 con 0x7f4bcc159710 2023-10-06T04:44:22.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.083+0000 7f4bcb7fe700 1 -- 172.21.15.124:0/1437243470 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc400ba80 con 0x7f4bcc159710 2023-10-06T04:44:22.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.083+0000 7f4bcb7fe700 1 -- 172.21.15.124:0/1437243470 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40092e0 con 0x7f4bcc159710 2023-10-06T04:44:22.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.084+0000 7f4bd2fff700 1 -- 172.21.15.124:0/1437243470 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc159710 msgr2=0x7f4bcc0afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.084+0000 7f4bd2fff700 1 --2- 172.21.15.124:0/1437243470 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc159710 0x7f4bcc0afe40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009f20 tx=0x7f4bc4009840 comp rx=0 tx=0).stop 2023-10-06T04:44:22.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.084+0000 7f4bd2fff700 1 -- 172.21.15.124:0/1437243470 shutdown_connections 2023-10-06T04:44:22.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.084+0000 7f4bd2fff700 1 --2- 172.21.15.124:0/1437243470 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc159710 0x7f4bcc0afe40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.084+0000 7f4bd2fff700 1 --2- 172.21.15.124:0/1437243470 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4bcc0cb250 0x7f4bcc1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.084+0000 7f4bd2fff700 1 -- 172.21.15.124:0/1437243470 >> 172.21.15.124:0/1437243470 conn(0x7f4bcc0974f0 msgr2=0x7f4bcc0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:22.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.084+0000 7f4bd2fff700 1 -- 172.21.15.124:0/1437243470 shutdown_connections 2023-10-06T04:44:22.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.084+0000 7f4bd2fff700 1 -- 172.21.15.124:0/1437243470 wait complete. 2023-10-06T04:44:22.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.086+0000 7f4bd2fff700 1 Processor -- start 2023-10-06T04:44:22.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.086+0000 7f4bd2fff700 1 -- start start 2023-10-06T04:44:22.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.087+0000 7f4bd2fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4bcc0cae80 0x7f4bcc158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.087+0000 7f4bd2fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc0cb250 0x7f4bcc161de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.087+0000 7f4bd2fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4bcc159710 0x7f4bcc0b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.087+0000 7f4bd2fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc16ea50 con 0x7f4bcc0cb250 2023-10-06T04:44:22.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.087+0000 7f4bd2fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc16f5d0 con 0x7f4bcc0cae80 2023-10-06T04:44:22.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.087+0000 7f4bd2fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc16eca0 con 0x7f4bcc159710 2023-10-06T04:44:22.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.087+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc0cb250 0x7f4bcc161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.087+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc0cb250 0x7f4bcc161de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:33120/0 (socket says 172.21.15.124:33120) 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.087+0000 7f4bcbfff700 1 -- 172.21.15.124:0/3052883531 learned_addr learned my addr 172.21.15.124:0/3052883531 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.087+0000 7f4bd0d9b700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4bcc0cae80 0x7f4bcc158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bd159c700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4bcc159710 0x7f4bcc0b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bcbfff700 1 -- 172.21.15.124:0/3052883531 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4bcc159710 msgr2=0x7f4bcc0b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bcbfff700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4bcc159710 0x7f4bcc0b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bcbfff700 1 -- 172.21.15.124:0/3052883531 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4bcc0cae80 msgr2=0x7f4bcc158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bcbfff700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4bcc0cae80 0x7f4bcc158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bcbfff700 1 -- 172.21.15.124:0/3052883531 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc4009ae0 con 0x7f4bcc0cb250 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bcbfff700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc0cb250 0x7f4bcc161de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800d8c0 tx=0x7f4bb8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bc8ff9700 1 -- 172.21.15.124:0/3052883531 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb80125f0 con 0x7f4bcc0cb250 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bc8ff9700 1 -- 172.21.15.124:0/3052883531 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb8012770 con 0x7f4bcc0cb250 2023-10-06T04:44:22.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bd2fff700 1 -- 172.21.15.124:0/3052883531 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc16ef80 con 0x7f4bcc0cb250 2023-10-06T04:44:22.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.088+0000 7f4bc8ff9700 1 -- 172.21.15.124:0/3052883531 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8012b30 con 0x7f4bcc0cb250 2023-10-06T04:44:22.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.089+0000 7f4bd2fff700 1 -- 172.21.15.124:0/3052883531 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc162320 con 0x7f4bcc0cb250 2023-10-06T04:44:22.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.090+0000 7f4bd2fff700 1 -- 172.21.15.124:0/3052883531 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc0c4a40 con 0x7f4bcc0cb250 2023-10-06T04:44:22.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.090+0000 7f4bc8ff9700 1 -- 172.21.15.124:0/3052883531 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f4bb801e460 con 0x7f4bcc0cb250 2023-10-06T04:44:22.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.091+0000 7f4bc8ff9700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4bb0066ea0 0x7f4bb0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.091+0000 7f4bc8ff9700 1 -- 172.21.15.124:0/3052883531 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4bb80847a0 con 0x7f4bcc0cb250 2023-10-06T04:44:22.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.092+0000 7f4bd0d9b700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4bb0066ea0 0x7f4bb0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.092+0000 7f4bd0d9b700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4bb0066ea0 0x7f4bb0069350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc161540 tx=0x7f4bc0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.096+0000 7f4bc8ff9700 1 -- 172.21.15.124:0/3052883531 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bb8051ce0 con 0x7f4bcc0cb250 2023-10-06T04:44:22.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.313+0000 7f4bd2fff700 1 -- 172.21.15.124:0/3052883531 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bcc1624e0 con 0x7f4bcc0cb250 2023-10-06T04:44:22.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.314+0000 7f4bc8ff9700 1 -- 172.21.15.124:0/3052883531 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13818 (secure 0 0 0) 0x7f4bb8055300 con 0x7f4bcc0cb250 2023-10-06T04:44:22.318 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:22.319 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:21.790456+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:22.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.316+0000 7f4bd2fff700 1 -- 172.21.15.124:0/3052883531 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4bb0066ea0 msgr2=0x7f4bb0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.316+0000 7f4bd2fff700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4bb0066ea0 0x7f4bb0069350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc161540 tx=0x7f4bc0009040 comp rx=0 tx=0).stop 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.316+0000 7f4bd2fff700 1 -- 172.21.15.124:0/3052883531 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc0cb250 msgr2=0x7f4bcc161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.316+0000 7f4bd2fff700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc0cb250 0x7f4bcc161de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800d8c0 tx=0x7f4bb8008040 comp rx=0 tx=0).stop 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.316+0000 7f4bd2fff700 1 -- 172.21.15.124:0/3052883531 shutdown_connections 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.316+0000 7f4bd2fff700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4bb0066ea0 0x7f4bb0069350 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.316+0000 7f4bd2fff700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4bcc159710 0x7f4bcc0b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.316+0000 7f4bd2fff700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4bcc0cae80 0x7f4bcc158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.316+0000 7f4bd2fff700 1 --2- 172.21.15.124:0/3052883531 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4bcc0cb250 0x7f4bcc161de0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.316+0000 7f4bd2fff700 1 -- 172.21.15.124:0/3052883531 >> 172.21.15.124:0/3052883531 conn(0x7f4bcc0974f0 msgr2=0x7f4bcc069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.317+0000 7f4bd2fff700 1 -- 172.21.15.124:0/3052883531 shutdown_connections 2023-10-06T04:44:22.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.317+0000 7f4bd2fff700 1 -- 172.21.15.124:0/3052883531 wait complete. 2023-10-06T04:44:22.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:44:22.336 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:44:22.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.533+0000 7fdd64bff700 1 Processor -- start 2023-10-06T04:44:22.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.533+0000 7fdd64bff700 1 -- start start 2023-10-06T04:44:22.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.534+0000 7fdd64bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd601592b0 0x7fdd600b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.534+0000 7fdd64bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd60159680 0x7fdd600cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd64bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6015d620 con 0x7fdd6015dab0 2023-10-06T04:44:22.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd64bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6015d0d0 con 0x7fdd601592b0 2023-10-06T04:44:22.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd64bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600b2ed0 con 0x7fdd60159680 2023-10-06T04:44:22.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd5e59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd601592b0 0x7fdd600b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd5e59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd601592b0 0x7fdd600b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:33132/0 (socket says 172.21.15.124:33132) 2023-10-06T04:44:22.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd5e59c700 1 -- 172.21.15.124:0/3024504559 learned_addr learned my addr 172.21.15.124:0/3024504559 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:22.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd57fff700 1 --2- 172.21.15.124:0/3024504559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd60159680 0x7fdd600cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd5e59c700 1 -- 172.21.15.124:0/3024504559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd60159680 msgr2=0x7fdd600cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:22.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd5e59c700 1 --2- 172.21.15.124:0/3024504559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd60159680 0x7fdd600cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd5e59c700 1 -- 172.21.15.124:0/3024504559 >> v1:172.21.15.158:6789/0 conn(0x7fdd6015dab0 legacy=0x7fdd600ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:22.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd5e59c700 1 -- 172.21.15.124:0/3024504559 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600b0760 con 0x7fdd601592b0 2023-10-06T04:44:22.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.535+0000 7fdd57fff700 1 --2- 172.21.15.124:0/3024504559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd60159680 0x7fdd600cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:22.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.536+0000 7fdd5e59c700 1 --2- 172.21.15.124:0/3024504559 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd601592b0 0x7fdd600b0080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd500099b0 tx=0x7fdd50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f621a7005edb90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.536+0000 7fdd5dd9b700 1 -- 172.21.15.124:0/3024504559 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000b820 con 0x7fdd601592b0 2023-10-06T04:44:22.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.536+0000 7fdd5dd9b700 1 -- 172.21.15.124:0/3024504559 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5000b980 con 0x7fdd601592b0 2023-10-06T04:44:22.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.536+0000 7fdd5dd9b700 1 -- 172.21.15.124:0/3024504559 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000bd20 con 0x7fdd601592b0 2023-10-06T04:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.537+0000 7fdd64bff700 1 -- 172.21.15.124:0/3024504559 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd601592b0 msgr2=0x7fdd600b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.537+0000 7fdd64bff700 1 --2- 172.21.15.124:0/3024504559 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd601592b0 0x7fdd600b0080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd500099b0 tx=0x7fdd50009250 comp rx=0 tx=0).stop 2023-10-06T04:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.537+0000 7fdd64bff700 1 -- 172.21.15.124:0/3024504559 shutdown_connections 2023-10-06T04:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.537+0000 7fdd64bff700 1 --2- 172.21.15.124:0/3024504559 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd601592b0 0x7fdd600b0080 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.537+0000 7fdd64bff700 1 --2- 172.21.15.124:0/3024504559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd60159680 0x7fdd600cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.537+0000 7fdd64bff700 1 -- 172.21.15.124:0/3024504559 >> 172.21.15.124:0/3024504559 conn(0x7fdd6006ed20 msgr2=0x7fdd6006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.537+0000 7fdd64bff700 1 -- 172.21.15.124:0/3024504559 shutdown_connections 2023-10-06T04:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.537+0000 7fdd64bff700 1 -- 172.21.15.124:0/3024504559 wait complete. 2023-10-06T04:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.538+0000 7fdd64bff700 1 Processor -- start 2023-10-06T04:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.538+0000 7fdd64bff700 1 -- start start 2023-10-06T04:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.539+0000 7fdd64bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd601592b0 0x7fdd600c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.539+0000 7fdd64bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd60159680 0x7fdd600c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.539+0000 7fdd64bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd6015dab0 0x7fdd6016a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.539+0000 7fdd64bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600c9e30 con 0x7fdd6015dab0 2023-10-06T04:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.539+0000 7fdd64bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600ca100 con 0x7fdd601592b0 2023-10-06T04:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.539+0000 7fdd64bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600ca3e0 con 0x7fdd60159680 2023-10-06T04:44:22.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd5ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd6015dab0 0x7fdd6016a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd5ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd6015dab0 0x7fdd6016a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:33134/0 (socket says 172.21.15.124:33134) 2023-10-06T04:44:22.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd5ed9d700 1 -- 172.21.15.124:0/488528193 learned_addr learned my addr 172.21.15.124:0/488528193 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:22.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd5ed9d700 1 -- 172.21.15.124:0/488528193 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd60159680 msgr2=0x7fdd600c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd5ed9d700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd60159680 0x7fdd600c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd5ed9d700 1 -- 172.21.15.124:0/488528193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd601592b0 msgr2=0x7fdd600c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd5ed9d700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd601592b0 0x7fdd600c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd5ed9d700 1 -- 172.21.15.124:0/488528193 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500094f0 con 0x7fdd6015dab0 2023-10-06T04:44:22.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd5ed9d700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd6015dab0 0x7fdd6016a060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800bc30 tx=0x7fdd58009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd567fc700 1 -- 172.21.15.124:0/488528193 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800c9b0 con 0x7fdd6015dab0 2023-10-06T04:44:22.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.540+0000 7fdd567fc700 1 -- 172.21.15.124:0/488528193 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5800cb50 con 0x7fdd6015dab0 2023-10-06T04:44:22.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.541+0000 7fdd567fc700 1 -- 172.21.15.124:0/488528193 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58014410 con 0x7fdd6015dab0 2023-10-06T04:44:22.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.541+0000 7fdd64bff700 1 -- 172.21.15.124:0/488528193 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd600ca6c0 con 0x7fdd6015dab0 2023-10-06T04:44:22.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.541+0000 7fdd64bff700 1 -- 172.21.15.124:0/488528193 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd600c4650 con 0x7fdd6015dab0 2023-10-06T04:44:22.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.542+0000 7fdd64bff700 1 -- 172.21.15.124:0/488528193 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6015bbf0 con 0x7fdd6015dab0 2023-10-06T04:44:22.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.542+0000 7fdd567fc700 1 -- 172.21.15.124:0/488528193 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fdd58014800 con 0x7fdd6015dab0 2023-10-06T04:44:22.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.543+0000 7fdd567fc700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd40066ea0 0x7fdd40069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.543+0000 7fdd567fc700 1 -- 172.21.15.124:0/488528193 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdd58084370 con 0x7fdd6015dab0 2023-10-06T04:44:22.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.544+0000 7fdd5e59c700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd40066ea0 0x7fdd40069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.544+0000 7fdd5e59c700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd40066ea0 0x7fdd40069350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd500099b0 tx=0x7fdd50016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.547+0000 7fdd567fc700 1 -- 172.21.15.124:0/488528193 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd5804c5a0 con 0x7fdd6015dab0 2023-10-06T04:44:22.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.743+0000 7fdd64bff700 1 -- 172.21.15.124:0/488528193 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd6004c380 con 0x7fdd6015dab0 2023-10-06T04:44:22.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.743+0000 7fdd567fc700 1 -- 172.21.15.124:0/488528193 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd6015bbf0 con 0x7fdd6015dab0 2023-10-06T04:44:22.745 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:44:22.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 -- 172.21.15.124:0/488528193 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd40066ea0 msgr2=0x7fdd40069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd40066ea0 0x7fdd40069350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd500099b0 tx=0x7fdd50016000 comp rx=0 tx=0).stop 2023-10-06T04:44:22.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 -- 172.21.15.124:0/488528193 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd6015dab0 msgr2=0x7fdd6016a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd6015dab0 0x7fdd6016a060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800bc30 tx=0x7fdd58009820 comp rx=0 tx=0).stop 2023-10-06T04:44:22.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 -- 172.21.15.124:0/488528193 shutdown_connections 2023-10-06T04:44:22.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd6015dab0 0x7fdd6016a060 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd601592b0 0x7fdd600c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd40066ea0 0x7fdd40069350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 --2- 172.21.15.124:0/488528193 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd60159680 0x7fdd600c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 -- 172.21.15.124:0/488528193 >> 172.21.15.124:0/488528193 conn(0x7fdd6006ed20 msgr2=0x7fdd600ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:22.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 -- 172.21.15.124:0/488528193 shutdown_connections 2023-10-06T04:44:22.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.746+0000 7fdd64bff700 1 -- 172.21.15.124:0/488528193 wait complete. 2023-10-06T04:44:22.766 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:44:22.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.958+0000 7f0529fff700 1 Processor -- start 2023-10-06T04:44:22.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.958+0000 7f0529fff700 1 -- start start 2023-10-06T04:44:22.962 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.959+0000 7f0529fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05241592b0 0x7f05240b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.962 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.959+0000 7f0529fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f05240cc780 0x7f05240ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.962 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.959+0000 7f0529fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052415d620 con 0x7f0524159680 2023-10-06T04:44:22.962 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.959+0000 7f0529fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052415d0d0 con 0x7f05240cc780 2023-10-06T04:44:22.962 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.959+0000 7f0529fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05240b2ed0 con 0x7f05241592b0 2023-10-06T04:44:22.962 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.959+0000 7f0522ffd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f0524159680 0x7f052415dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:46486/0 (socket says 172.21.15.124:46486) 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.959+0000 7f0522ffd700 1 -- 172.21.15.124:0/3935436795 learned_addr learned my addr 172.21.15.124:0/3935436795 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.960+0000 7f05237fe700 1 --2- 172.21.15.124:0/3935436795 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05241592b0 0x7f05240b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.960+0000 7f0523fff700 1 --2- 172.21.15.124:0/3935436795 >> v2:172.21.15.158:3300/0 conn(0x7f05240cc780 0x7f05240ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.960+0000 7f05227fc700 1 -- 172.21.15.124:0/3935436795 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301245074 0 0) 0x7f052415d620 con 0x7f0524159680 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.960+0000 7f05227fc700 1 -- 172.21.15.124:0/3935436795 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f050c003570 con 0x7f0524159680 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.960+0000 7f05237fe700 1 -- 172.21.15.124:0/3935436795 >> v2:172.21.15.158:3300/0 conn(0x7f05240cc780 msgr2=0x7f05240ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.960+0000 7f05237fe700 1 --2- 172.21.15.124:0/3935436795 >> v2:172.21.15.158:3300/0 conn(0x7f05240cc780 0x7f05240ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.960+0000 7f05237fe700 1 -- 172.21.15.124:0/3935436795 >> v1:172.21.15.124:6789/0 conn(0x7f0524159680 legacy=0x7f052415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.960+0000 7f05237fe700 1 -- 172.21.15.124:0/3935436795 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240ccc20 con 0x7f05241592b0 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.960+0000 7f05237fe700 1 --2- 172.21.15.124:0/3935436795 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05241592b0 0x7f05240b0080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f05140098e0 tx=0x7f05140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7a5269f7884885a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f05227fc700 1 -- 172.21.15.124:0/3935436795 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514011630 con 0x7f05241592b0 2023-10-06T04:44:22.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f05227fc700 1 -- 172.21.15.124:0/3935436795 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0514011790 con 0x7f05241592b0 2023-10-06T04:44:22.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f05227fc700 1 -- 172.21.15.124:0/3935436795 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514011b30 con 0x7f05241592b0 2023-10-06T04:44:22.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f0529fff700 1 -- 172.21.15.124:0/3935436795 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05241592b0 msgr2=0x7f05240b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f0529fff700 1 --2- 172.21.15.124:0/3935436795 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05241592b0 0x7f05240b0080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f05140098e0 tx=0x7f05140091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f0529fff700 1 -- 172.21.15.124:0/3935436795 shutdown_connections 2023-10-06T04:44:22.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f0529fff700 1 --2- 172.21.15.124:0/3935436795 >> v2:172.21.15.158:3300/0 conn(0x7f05240cc780 0x7f05240ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f0529fff700 1 --2- 172.21.15.124:0/3935436795 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05241592b0 0x7f05240b0080 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f0529fff700 1 -- 172.21.15.124:0/3935436795 >> 172.21.15.124:0/3935436795 conn(0x7f052406ed20 msgr2=0x7f052406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:22.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f0529fff700 1 -- 172.21.15.124:0/3935436795 shutdown_connections 2023-10-06T04:44:22.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.961+0000 7f0529fff700 1 -- 172.21.15.124:0/3935436795 wait complete. 2023-10-06T04:44:22.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.963+0000 7f0529fff700 1 Processor -- start 2023-10-06T04:44:22.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.963+0000 7f0529fff700 1 -- start start 2023-10-06T04:44:22.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0529fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05240cc780 0x7f05240c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0529fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05241592b0 0x7f05240c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0529fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0524159680 0x7f0524169fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0529fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0524156de0 con 0x7f0524159680 2023-10-06T04:44:22.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0529fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240ca000 con 0x7f05241592b0 2023-10-06T04:44:22.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0529fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05240ca2e0 con 0x7f05240cc780 2023-10-06T04:44:22.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0523fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0524159680 0x7f0524169fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0523fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0524159680 0x7f0524169fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:58998/0 (socket says 172.21.15.124:58998) 2023-10-06T04:44:22.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0523fff700 1 -- 172.21.15.124:0/2999820047 learned_addr learned my addr 172.21.15.124:0/2999820047 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:22.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f05237fe700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05240cc780 0x7f05240c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0522ffd700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05241592b0 0x7f05240c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0523fff700 1 -- 172.21.15.124:0/2999820047 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05240cc780 msgr2=0x7f05240c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0523fff700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05240cc780 0x7f05240c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0523fff700 1 -- 172.21.15.124:0/2999820047 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05241592b0 msgr2=0x7f05240c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0523fff700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05241592b0 0x7f05240c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.964+0000 7f0523fff700 1 -- 172.21.15.124:0/2999820047 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514009420 con 0x7f0524159680 2023-10-06T04:44:22.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.965+0000 7f0523fff700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0524159680 0x7f0524169fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f051c009e90 tx=0x7f051c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.965+0000 7f050b7fe700 1 -- 172.21.15.124:0/2999820047 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c00cb70 con 0x7f0524159680 2023-10-06T04:44:22.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.965+0000 7f050b7fe700 1 -- 172.21.15.124:0/2999820047 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c00f040 con 0x7f0524159680 2023-10-06T04:44:22.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.965+0000 7f0529fff700 1 -- 172.21.15.124:0/2999820047 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05240ca5c0 con 0x7f0524159680 2023-10-06T04:44:22.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.965+0000 7f050b7fe700 1 -- 172.21.15.124:0/2999820047 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c014480 con 0x7f0524159680 2023-10-06T04:44:22.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.965+0000 7f0529fff700 1 -- 172.21.15.124:0/2999820047 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05240c6b10 con 0x7f0524159680 2023-10-06T04:44:22.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.966+0000 7f0529fff700 1 -- 172.21.15.124:0/2999820047 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05240b5260 con 0x7f0524159680 2023-10-06T04:44:22.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.967+0000 7f050b7fe700 1 -- 172.21.15.124:0/2999820047 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f051c014830 con 0x7f0524159680 2023-10-06T04:44:22.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.968+0000 7f050b7fe700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0510066ea0 0x7f0510069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.968+0000 7f050b7fe700 1 -- 172.21.15.124:0/2999820047 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f051c084c50 con 0x7f0524159680 2023-10-06T04:44:22.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.968+0000 7f05237fe700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0510066ea0 0x7f0510069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.969+0000 7f05237fe700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0510066ea0 0x7f0510069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f05140091e0 tx=0x7f0514017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:22.972+0000 7f050b7fe700 1 -- 172.21.15.124:0/2999820047 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f051c052190 con 0x7f0524159680 2023-10-06T04:44:23.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.163+0000 7f0529fff700 1 -- 172.21.15.124:0/2999820047 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05240b6410 con 0x7f0524159680 2023-10-06T04:44:23.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.164+0000 7f050b7fe700 1 -- 172.21.15.124:0/2999820047 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f051c018020 con 0x7f0524159680 2023-10-06T04:44:23.165 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:44:23.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 -- 172.21.15.124:0/2999820047 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0510066ea0 msgr2=0x7f0510069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0510066ea0 0x7f0510069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f05140091e0 tx=0x7f0514017000 comp rx=0 tx=0).stop 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 -- 172.21.15.124:0/2999820047 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0524159680 msgr2=0x7f0524169fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0524159680 0x7f0524169fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f051c009e90 tx=0x7f051c00b040 comp rx=0 tx=0).stop 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 -- 172.21.15.124:0/2999820047 shutdown_connections 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0524159680 0x7f0524169fc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0510066ea0 0x7f0510069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05240cc780 0x7f05240c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 --2- 172.21.15.124:0/2999820047 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05241592b0 0x7f05240c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 -- 172.21.15.124:0/2999820047 >> 172.21.15.124:0/2999820047 conn(0x7f052406ed20 msgr2=0x7f05241560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 -- 172.21.15.124:0/2999820047 shutdown_connections 2023-10-06T04:44:23.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.166+0000 7f0529fff700 1 -- 172.21.15.124:0/2999820047 wait complete. 2023-10-06T04:44:23.185 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:23.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.379+0000 7f0c363ff700 1 Processor -- start 2023-10-06T04:44:23.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.379+0000 7f0c363ff700 1 -- start start 2023-10-06T04:44:23.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.381+0000 7f0c363ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c300ade80 0x7f0c301577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.381+0000 7f0c363ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c300ab910 con 0x7f0c301573e0 2023-10-06T04:44:23.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.381+0000 7f0c363ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c300abbf0 con 0x7f0c300a6c60 2023-10-06T04:44:23.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.381+0000 7f0c363ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3006a4a0 con 0x7f0c300ade80 2023-10-06T04:44:23.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.381+0000 7f0c2f7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0c300a6c60 0x7f0c300ad770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:58238/0 (socket says 172.21.15.124:58238) 2023-10-06T04:44:23.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.381+0000 7f0c2f7fe700 1 -- 172.21.15.124:0/1336801723 learned_addr learned my addr 172.21.15.124:0/1336801723 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:23.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.381+0000 7f0c3499c700 1 --2- 172.21.15.124:0/1336801723 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c300ade80 0x7f0c301577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.381+0000 7f0c2effd700 1 -- 172.21.15.124:0/1336801723 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895211463 0 0) 0x7f0c300abbf0 con 0x7f0c300a6c60 2023-10-06T04:44:23.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.381+0000 7f0c2effd700 1 -- 172.21.15.124:0/1336801723 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c18003570 con 0x7f0c300a6c60 2023-10-06T04:44:23.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.382+0000 7f0c3499c700 1 -- 172.21.15.124:0/1336801723 >> v1:172.21.15.158:6789/0 conn(0x7f0c300a6c60 legacy=0x7f0c300ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.382+0000 7f0c3499c700 1 -- 172.21.15.124:0/1336801723 >> v1:172.21.15.124:6789/0 conn(0x7f0c301573e0 legacy=0x7f0c30069a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.382+0000 7f0c3499c700 1 -- 172.21.15.124:0/1336801723 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3006a780 con 0x7f0c300ade80 2023-10-06T04:44:23.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.382+0000 7f0c3499c700 1 --2- 172.21.15.124:0/1336801723 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c300ade80 0x7f0c301577b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009e90 tx=0x7f0c28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3f3e87cf47c849f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:23.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.382+0000 7f0c2effd700 1 -- 172.21.15.124:0/1336801723 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800e070 con 0x7f0c300ade80 2023-10-06T04:44:23.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.382+0000 7f0c2effd700 1 -- 172.21.15.124:0/1336801723 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800bc30 con 0x7f0c300ade80 2023-10-06T04:44:23.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.382+0000 7f0c2effd700 1 -- 172.21.15.124:0/1336801723 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28012430 con 0x7f0c300ade80 2023-10-06T04:44:23.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.383+0000 7f0c363ff700 1 -- 172.21.15.124:0/1336801723 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c300ade80 msgr2=0x7f0c301577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.383+0000 7f0c363ff700 1 --2- 172.21.15.124:0/1336801723 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c300ade80 0x7f0c301577b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009e90 tx=0x7f0c28009780 comp rx=0 tx=0).stop 2023-10-06T04:44:23.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.383+0000 7f0c363ff700 1 -- 172.21.15.124:0/1336801723 shutdown_connections 2023-10-06T04:44:23.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.383+0000 7f0c363ff700 1 --2- 172.21.15.124:0/1336801723 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c300ade80 0x7f0c301577b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.383+0000 7f0c363ff700 1 -- 172.21.15.124:0/1336801723 >> 172.21.15.124:0/1336801723 conn(0x7f0c300cc050 msgr2=0x7f0c300cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:23.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.383+0000 7f0c363ff700 1 -- 172.21.15.124:0/1336801723 shutdown_connections 2023-10-06T04:44:23.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.383+0000 7f0c363ff700 1 -- 172.21.15.124:0/1336801723 wait complete. 2023-10-06T04:44:23.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.384+0000 7f0c363ff700 1 Processor -- start 2023-10-06T04:44:23.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.384+0000 7f0c363ff700 1 -- start start 2023-10-06T04:44:23.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.385+0000 7f0c363ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c300ade80 0x7f0c30154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.385+0000 7f0c363ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c301573e0 0x7f0c301551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.385+0000 7f0c363ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300c7150 0x7f0c300c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.385+0000 7f0c363ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300c7b30 con 0x7f0c300c7150 2023-10-06T04:44:23.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.385+0000 7f0c363ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300c61d0 con 0x7f0c300ade80 2023-10-06T04:44:23.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.385+0000 7f0c363ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3006ec30 con 0x7f0c301573e0 2023-10-06T04:44:23.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c2ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c300ade80 0x7f0c30154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c3499c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300c7150 0x7f0c300c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c2f7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c301573e0 0x7f0c301551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c2ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c300ade80 0x7f0c30154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:51222/0 (socket says 172.21.15.124:51222) 2023-10-06T04:44:23.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c2ffff700 1 -- 172.21.15.124:0/658487249 learned_addr learned my addr 172.21.15.124:0/658487249 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:23.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c2ffff700 1 -- 172.21.15.124:0/658487249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c301573e0 msgr2=0x7f0c301551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c2ffff700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c301573e0 0x7f0c301551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c2ffff700 1 -- 172.21.15.124:0/658487249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300c7150 msgr2=0x7f0c300c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c2ffff700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300c7150 0x7f0c300c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c2ffff700 1 -- 172.21.15.124:0/658487249 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28009a20 con 0x7f0c300ade80 2023-10-06T04:44:23.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c3499c700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300c7150 0x7f0c300c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:23.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.386+0000 7f0c2ffff700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c300ade80 0x7f0c30154ca0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000c590 tx=0x7f0c2000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:23.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.387+0000 7f0c17fff700 1 -- 172.21.15.124:0/658487249 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c20011590 con 0x7f0c300ade80 2023-10-06T04:44:23.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.387+0000 7f0c17fff700 1 -- 172.21.15.124:0/658487249 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c20011710 con 0x7f0c300ade80 2023-10-06T04:44:23.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.387+0000 7f0c363ff700 1 -- 172.21.15.124:0/658487249 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c300c55c0 con 0x7f0c300ade80 2023-10-06T04:44:23.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.387+0000 7f0c17fff700 1 -- 172.21.15.124:0/658487249 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c20011ad0 con 0x7f0c300ade80 2023-10-06T04:44:23.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.387+0000 7f0c363ff700 1 -- 172.21.15.124:0/658487249 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c300c5b80 con 0x7f0c300ade80 2023-10-06T04:44:23.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.388+0000 7f0c363ff700 1 -- 172.21.15.124:0/658487249 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c300717a0 con 0x7f0c300ade80 2023-10-06T04:44:23.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.389+0000 7f0c17fff700 1 -- 172.21.15.124:0/658487249 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f0c2001b3b0 con 0x7f0c300ade80 2023-10-06T04:44:23.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.390+0000 7f0c17fff700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0c1c066ea0 0x7f0c1c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.390+0000 7f0c17fff700 1 -- 172.21.15.124:0/658487249 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0c200837a0 con 0x7f0c300ade80 2023-10-06T04:44:23.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.391+0000 7f0c2f7fe700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0c1c066ea0 0x7f0c1c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.391+0000 7f0c2f7fe700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0c1c066ea0 0x7f0c1c069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0c300ca170 tx=0x7f0c24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:23.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.396+0000 7f0c17fff700 1 -- 172.21.15.124:0/658487249 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c20050c40 con 0x7f0c300ade80 2023-10-06T04:44:23.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.630+0000 7f0c363ff700 1 -- 172.21.15.124:0/658487249 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c3006ae20 con 0x7f0c300ade80 2023-10-06T04:44:23.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.631+0000 7f0c17fff700 1 -- 172.21.15.124:0/658487249 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f0c20017070 con 0x7f0c300ade80 2023-10-06T04:44:23.632 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:23.632 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/3828511424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":3828511424},{"type":"v1","addr":"172.21.15.124:6836","nonce":3828511424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/1252041103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1252041103},{"type":"v1","addr":"172.21.15.158:6834","nonce":1252041103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/978440229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":978440229},{"type":"v1","addr":"172.21.15.124:6837","nonce":978440229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/1693475602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":1693475602},{"type":"v1","addr":"172.21.15.158:6835","nonce":1693475602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T04:44:23.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 -- 172.21.15.124:0/658487249 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0c1c066ea0 msgr2=0x7f0c1c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0c1c066ea0 0x7f0c1c069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0c300ca170 tx=0x7f0c24009040 comp rx=0 tx=0).stop 2023-10-06T04:44:23.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 -- 172.21.15.124:0/658487249 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c300ade80 msgr2=0x7f0c30154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c300ade80 0x7f0c30154ca0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000c590 tx=0x7f0c2000c8a0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 -- 172.21.15.124:0/658487249 shutdown_connections 2023-10-06T04:44:23.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300c7150 0x7f0c300c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c300ade80 0x7f0c30154ca0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0c1c066ea0 0x7f0c1c069350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 --2- 172.21.15.124:0/658487249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c301573e0 0x7f0c301551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 -- 172.21.15.124:0/658487249 >> 172.21.15.124:0/658487249 conn(0x7f0c300cc050 msgr2=0x7f0c300afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:23.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.633+0000 7f0c363ff700 1 -- 172.21.15.124:0/658487249 shutdown_connections 2023-10-06T04:44:23.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.634+0000 7f0c363ff700 1 -- 172.21.15.124:0/658487249 wait complete. 2023-10-06T04:44:23.636 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 3 2023-10-06T04:44:23.653 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:23.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.845+0000 7f9d6e3ff700 1 Processor -- start 2023-10-06T04:44:23.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.846+0000 7f9d6e3ff700 1 -- start start 2023-10-06T04:44:23.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.847+0000 7f9d6e3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68068bb0 0x7f9d680b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.847+0000 7f9d6e3ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d680cc040 con 0x7f9d68159040 2023-10-06T04:44:23.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.847+0000 7f9d6e3ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6806e990 con 0x7f9d6806ddc0 2023-10-06T04:44:23.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.847+0000 7f9d6e3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680cb9f0 con 0x7f9d68068bb0 2023-10-06T04:44:23.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.847+0000 7f9d6c99c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f9d68159040 0x7f9d681594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:46514/0 (socket says 172.21.15.124:46514) 2023-10-06T04:44:23.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.847+0000 7f9d6c99c700 1 -- 172.21.15.124:0/3144330337 learned_addr learned my addr 172.21.15.124:0/3144330337 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:23.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.847+0000 7f9d677fe700 1 --2- 172.21.15.124:0/3144330337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68068bb0 0x7f9d680b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d66ffd700 1 -- 172.21.15.124:0/3144330337 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631171701 0 0) 0x7f9d680cc040 con 0x7f9d68159040 2023-10-06T04:44:23.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d66ffd700 1 -- 172.21.15.124:0/3144330337 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d50003570 con 0x7f9d68159040 2023-10-06T04:44:23.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d66ffd700 1 -- 172.21.15.124:0/3144330337 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483370716 0 0) 0x7f9d6806e990 con 0x7f9d6806ddc0 2023-10-06T04:44:23.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d66ffd700 1 -- 172.21.15.124:0/3144330337 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d680cc040 con 0x7f9d6806ddc0 2023-10-06T04:44:23.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d677fe700 1 -- 172.21.15.124:0/3144330337 >> v1:172.21.15.158:6789/0 conn(0x7f9d6806ddc0 legacy=0x7f9d6806e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d677fe700 1 -- 172.21.15.124:0/3144330337 >> v1:172.21.15.124:6789/0 conn(0x7f9d68159040 legacy=0x7f9d681594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d677fe700 1 -- 172.21.15.124:0/3144330337 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d680cbcd0 con 0x7f9d68068bb0 2023-10-06T04:44:23.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d677fe700 1 --2- 172.21.15.124:0/3144330337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68068bb0 0x7f9d680b1f50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009910 tx=0x7f9d5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=434d3aad795b0a49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:23.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d66ffd700 1 -- 172.21.15.124:0/3144330337 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c011630 con 0x7f9d68068bb0 2023-10-06T04:44:23.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d66ffd700 1 -- 172.21.15.124:0/3144330337 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c011790 con 0x7f9d68068bb0 2023-10-06T04:44:23.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.848+0000 7f9d66ffd700 1 -- 172.21.15.124:0/3144330337 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c011b30 con 0x7f9d68068bb0 2023-10-06T04:44:23.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.849+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/3144330337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68068bb0 msgr2=0x7f9d680b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.849+0000 7f9d6e3ff700 1 --2- 172.21.15.124:0/3144330337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68068bb0 0x7f9d680b1f50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009910 tx=0x7f9d5c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.849+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/3144330337 shutdown_connections 2023-10-06T04:44:23.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.849+0000 7f9d6e3ff700 1 --2- 172.21.15.124:0/3144330337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68068bb0 0x7f9d680b1f50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.849+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/3144330337 >> 172.21.15.124:0/3144330337 conn(0x7f9d680cd390 msgr2=0x7f9d680b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:23.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.849+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/3144330337 shutdown_connections 2023-10-06T04:44:23.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.849+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/3144330337 wait complete. 2023-10-06T04:44:23.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.850+0000 7f9d6e3ff700 1 Processor -- start 2023-10-06T04:44:23.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.851+0000 7f9d6e3ff700 1 -- start start 2023-10-06T04:44:23.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.851+0000 7f9d6e3ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d68068bb0 0x7f9d6813eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.851+0000 7f9d6e3ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d6806ddc0 0x7f9d681575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d6e3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68159040 0x7f9d6815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d6e3ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c7c00 con 0x7f9d6806ddc0 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d6e3ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d681580a0 con 0x7f9d68068bb0 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d6e3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d68158380 con 0x7f9d68159040 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d677fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d6806ddc0 0x7f9d681575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d677fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d6806ddc0 0x7f9d681575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59030/0 (socket says 172.21.15.124:59030) 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d677fe700 1 -- 172.21.15.124:0/235549847 learned_addr learned my addr 172.21.15.124:0/235549847 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d6c99c700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68159040 0x7f9d6815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d67fff700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d68068bb0 0x7f9d6813eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d677fe700 1 -- 172.21.15.124:0/235549847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68159040 msgr2=0x7f9d6815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d677fe700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68159040 0x7f9d6815e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d677fe700 1 -- 172.21.15.124:0/235549847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d68068bb0 msgr2=0x7f9d6813eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d677fe700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d68068bb0 0x7f9d6813eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d677fe700 1 -- 172.21.15.124:0/235549847 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c009420 con 0x7f9d6806ddc0 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d6c99c700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68159040 0x7f9d6815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.852+0000 7f9d677fe700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d6806ddc0 0x7f9d681575c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009f00 tx=0x7f9d5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.853+0000 7f9d4ffff700 1 -- 172.21.15.124:0/235549847 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c01f070 con 0x7f9d6806ddc0 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.853+0000 7f9d4ffff700 1 -- 172.21.15.124:0/235549847 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c011900 con 0x7f9d6806ddc0 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.853+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/235549847 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d68158660 con 0x7f9d6806ddc0 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.853+0000 7f9d4ffff700 1 -- 172.21.15.124:0/235549847 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c023410 con 0x7f9d6806ddc0 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.853+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/235549847 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d681542e0 con 0x7f9d6806ddc0 2023-10-06T04:44:23.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.854+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/235549847 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d680717a0 con 0x7f9d6806ddc0 2023-10-06T04:44:23.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.855+0000 7f9d4ffff700 1 -- 172.21.15.124:0/235549847 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f9d5c023800 con 0x7f9d6806ddc0 2023-10-06T04:44:23.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.856+0000 7f9d4ffff700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9d54066ea0 0x7f9d54069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.856+0000 7f9d4ffff700 1 -- 172.21.15.124:0/235549847 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9d5c085cd0 con 0x7f9d6806ddc0 2023-10-06T04:44:23.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.856+0000 7f9d67fff700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9d54066ea0 0x7f9d54069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.857+0000 7f9d67fff700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9d54066ea0 0x7f9d54069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9d58003870 tx=0x7f9d58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:23.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:23.860+0000 7f9d4ffff700 1 -- 172.21.15.124:0/235549847 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d5c0531f0 con 0x7f9d6806ddc0 2023-10-06T04:44:24.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.058+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/235549847 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d680c7d40 con 0x7f9d6806ddc0 2023-10-06T04:44:24.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.059+0000 7f9d4ffff700 1 -- 172.21.15.124:0/235549847 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13792 (secure 0 0 0) 0x7f9d5c015090 con 0x7f9d6806ddc0 2023-10-06T04:44:24.060 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:24.060 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":18,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:22.792766+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:24.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/235549847 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9d54066ea0 msgr2=0x7f9d54069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9d54066ea0 0x7f9d54069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9d58003870 tx=0x7f9d58009040 comp rx=0 tx=0).stop 2023-10-06T04:44:24.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/235549847 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d6806ddc0 msgr2=0x7f9d681575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d6806ddc0 0x7f9d681575c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009f00 tx=0x7f9d5c017000 comp rx=0 tx=0).stop 2023-10-06T04:44:24.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/235549847 shutdown_connections 2023-10-06T04:44:24.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9d54066ea0 0x7f9d54069350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d68159040 0x7f9d6815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d68068bb0 0x7f9d6813eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 --2- 172.21.15.124:0/235549847 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d6806ddc0 0x7f9d681575c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/235549847 >> 172.21.15.124:0/235549847 conn(0x7f9d680cd390 msgr2=0x7f9d681538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:24.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/235549847 shutdown_connections 2023-10-06T04:44:24.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.061+0000 7f9d6e3ff700 1 -- 172.21.15.124:0/235549847 wait complete. 2023-10-06T04:44:24.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:44:24.081 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:44:24.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.275+0000 7f9ffcfff700 1 Processor -- start 2023-10-06T04:44:24.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.275+0000 7f9ffcfff700 1 -- start start 2023-10-06T04:44:24.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.276+0000 7f9ffcfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff8156680 0x7f9ff80adc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.276+0000 7f9ffcfff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80ad790 con 0x7f9ff81562b0 2023-10-06T04:44:24.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.276+0000 7f9ffcfff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80acb80 con 0x7f9ff80cca10 2023-10-06T04:44:24.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.276+0000 7f9ffcfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80ace60 con 0x7f9ff8156680 2023-10-06T04:44:24.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff659c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f9ff81562b0 0x7f9ff815aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:46520/0 (socket says 172.21.15.124:46520) 2023-10-06T04:44:24.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff659c700 1 -- 172.21.15.124:0/1786406255 learned_addr learned my addr 172.21.15.124:0/1786406255 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:24.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff6d9d700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff8156680 0x7f9ff80adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230431318 0 0) 0x7f9ff80ad790 con 0x7f9ff81562b0 2023-10-06T04:44:24.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe0003570 con 0x7f9ff81562b0 2023-10-06T04:44:24.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979682241 0 0) 0x7f9ff80acb80 con 0x7f9ff80cca10 2023-10-06T04:44:24.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff80ad790 con 0x7f9ff80cca10 2023-10-06T04:44:24.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2812450487 0 0) 0x7f9fe0003570 con 0x7f9ff81562b0 2023-10-06T04:44:24.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff8156680 msgr2=0x7f9ff80adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:24.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff8156680 0x7f9ff80adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 >> v1:172.21.15.158:6789/0 conn(0x7f9ff80cca10 legacy=0x7f9ff80c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80ad140 con 0x7f9ff81562b0 2023-10-06T04:44:24.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f9fe8001470 con 0x7f9ff81562b0 2023-10-06T04:44:24.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 >> v1:172.21.15.124:6789/0 conn(0x7f9ff81562b0 legacy=0x7f9ff815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe0003c20 0x7f9fe0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 0x7f9fe0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff8156680 0x7f9fe0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80ace60 con 0x7f9fe0004810 2023-10-06T04:44:24.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.277+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe000bbf0 con 0x7f9fe0003c20 2023-10-06T04:44:24.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe000dfc0 con 0x7f9ff8156680 2023-10-06T04:44:24.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff659c700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe0003c20 0x7f9fe0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff5d9b700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 0x7f9fe0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff6d9d700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff8156680 0x7f9fe0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff5d9b700 1 -- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff8156680 msgr2=0x7f9fe0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:24.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff5d9b700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff8156680 0x7f9fe0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff5d9b700 1 -- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe0003c20 msgr2=0x7f9fe0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:24.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff5d9b700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe0003c20 0x7f9fe0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff5d9b700 1 -- 172.21.15.124:0/1786406255 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe0003570 con 0x7f9fe0004810 2023-10-06T04:44:24.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff659c700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe0003c20 0x7f9fe0004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:24.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.278+0000 7f9ff5d9b700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 0x7f9fe0004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0019e0 tx=0x7f9fec007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d343de624c6e192b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.279+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec00c5d0 con 0x7f9fe0004810 2023-10-06T04:44:24.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.279+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec00c730 con 0x7f9fe0004810 2023-10-06T04:44:24.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.279+0000 7f9ff559a700 1 -- 172.21.15.124:0/1786406255 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec00cad0 con 0x7f9fe0004810 2023-10-06T04:44:24.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.279+0000 7f9ffcfff700 1 -- 172.21.15.124:0/1786406255 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 msgr2=0x7f9fe0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.279+0000 7f9ffcfff700 1 --2- 172.21.15.124:0/1786406255 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 0x7f9fe0004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0019e0 tx=0x7f9fec007d30 comp rx=0 tx=0).stop 2023-10-06T04:44:24.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.279+0000 7f9ff6d9d700 1 -- 172.21.15.124:0/1786406255 reap_dead start 2023-10-06T04:44:24.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.279+0000 7f9ffcfff700 1 -- 172.21.15.124:0/1786406255 shutdown_connections 2023-10-06T04:44:24.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.279+0000 7f9ffcfff700 1 -- 172.21.15.124:0/1786406255 >> 172.21.15.124:0/1786406255 conn(0x7f9ff80680c0 msgr2=0x7f9ff80cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:24.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.279+0000 7f9ffcfff700 1 -- 172.21.15.124:0/1786406255 shutdown_connections 2023-10-06T04:44:24.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.279+0000 7f9ffcfff700 1 -- 172.21.15.124:0/1786406255 wait complete. 2023-10-06T04:44:24.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.281+0000 7f9ffcfff700 1 Processor -- start 2023-10-06T04:44:24.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.281+0000 7f9ffcfff700 1 -- start start 2023-10-06T04:44:24.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ffcfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 0x7f9ff80c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ffcfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ff80b1070 0x7f9ff814f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ffcfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff80af7a0 0x7f9ff8150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ffcfff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80b0be0 con 0x7f9fe0004810 2023-10-06T04:44:24.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ffcfff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff814fa90 con 0x7f9ff80b1070 2023-10-06T04:44:24.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ffcfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80affd0 con 0x7f9ff80af7a0 2023-10-06T04:44:24.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ff659c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 0x7f9ff80c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ff659c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 0x7f9ff80c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59044/0 (socket says 172.21.15.124:59044) 2023-10-06T04:44:24.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ff659c700 1 -- 172.21.15.124:0/3320907059 learned_addr learned my addr 172.21.15.124:0/3320907059 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:24.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ff659c700 1 -- 172.21.15.124:0/3320907059 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff80af7a0 msgr2=0x7f9ff8150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ff6d9d700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff80af7a0 0x7f9ff8150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ff5d9b700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ff80b1070 0x7f9ff814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ff659c700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff80af7a0 0x7f9ff8150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ff659c700 1 -- 172.21.15.124:0/3320907059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ff80b1070 msgr2=0x7f9ff814f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ff659c700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ff80b1070 0x7f9ff814f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.282+0000 7f9ff659c700 1 -- 172.21.15.124:0/3320907059 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80b02b0 con 0x7f9fe0004810 2023-10-06T04:44:24.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.283+0000 7f9ff659c700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 0x7f9ff80c5490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8007390 tx=0x7f9fe8001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.283+0000 7f9fe67fc700 1 -- 172.21.15.124:0/3320907059 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8018030 con 0x7f9fe0004810 2023-10-06T04:44:24.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.283+0000 7f9fe67fc700 1 -- 172.21.15.124:0/3320907059 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe800f920 con 0x7f9fe0004810 2023-10-06T04:44:24.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.283+0000 7f9ffcfff700 1 -- 172.21.15.124:0/3320907059 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff80b0590 con 0x7f9fe0004810 2023-10-06T04:44:24.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.283+0000 7f9fe67fc700 1 -- 172.21.15.124:0/3320907059 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe800fca0 con 0x7f9fe0004810 2023-10-06T04:44:24.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.283+0000 7f9ffcfff700 1 -- 172.21.15.124:0/3320907059 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff80afc10 con 0x7f9fe0004810 2023-10-06T04:44:24.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.284+0000 7f9ffcfff700 1 -- 172.21.15.124:0/3320907059 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff8064850 con 0x7f9fe0004810 2023-10-06T04:44:24.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.285+0000 7f9fe67fc700 1 -- 172.21.15.124:0/3320907059 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fe801b070 con 0x7f9fe0004810 2023-10-06T04:44:24.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.286+0000 7f9fe67fc700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fd8066f30 0x7f9fd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.286+0000 7f9fe67fc700 1 -- 172.21.15.124:0/3320907059 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9fe8019070 con 0x7f9fe0004810 2023-10-06T04:44:24.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.286+0000 7f9ff5d9b700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fd8066f30 0x7f9fd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.286+0000 7f9ff5d9b700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fd8066f30 0x7f9fd80693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ff815ef00 tx=0x7f9fec015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.290+0000 7f9fe67fc700 1 -- 172.21.15.124:0/3320907059 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fe8055370 con 0x7f9fe0004810 2023-10-06T04:44:24.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.479+0000 7f9ffcfff700 1 -- 172.21.15.124:0/3320907059 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ff804c380 con 0x7f9fe0004810 2023-10-06T04:44:24.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.479+0000 7f9fe67fc700 1 -- 172.21.15.124:0/3320907059 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9fe8054f00 con 0x7f9fe0004810 2023-10-06T04:44:24.481 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:44:24.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 -- 172.21.15.124:0/3320907059 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fd8066f30 msgr2=0x7f9fd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fd8066f30 0x7f9fd80693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ff815ef00 tx=0x7f9fec015000 comp rx=0 tx=0).stop 2023-10-06T04:44:24.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 -- 172.21.15.124:0/3320907059 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 msgr2=0x7f9ff80c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 0x7f9ff80c5490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8007390 tx=0x7f9fe8001d40 comp rx=0 tx=0).stop 2023-10-06T04:44:24.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 -- 172.21.15.124:0/3320907059 shutdown_connections 2023-10-06T04:44:24.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fd8066f30 0x7f9fd80693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ff80af7a0 0x7f9ff8150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe0004810 0x7f9ff80c5490 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 --2- 172.21.15.124:0/3320907059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ff80b1070 0x7f9ff814f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 -- 172.21.15.124:0/3320907059 >> 172.21.15.124:0/3320907059 conn(0x7f9ff80680c0 msgr2=0x7f9ff80c73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:24.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.481+0000 7f9ffcfff700 1 -- 172.21.15.124:0/3320907059 shutdown_connections 2023-10-06T04:44:24.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.482+0000 7f9ffcfff700 1 -- 172.21.15.124:0/3320907059 wait complete. 2023-10-06T04:44:24.500 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:44:24.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.690+0000 7fd4945ff700 1 Processor -- start 2023-10-06T04:44:24.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.690+0000 7fd4945ff700 1 -- start start 2023-10-06T04:44:24.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.691+0000 7fd4945ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd48c15dce0 0x7fd48c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.691+0000 7fd4945ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 0x7fd48c069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.691+0000 7fd4945ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c068700 con 0x7fd48c159480 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.691+0000 7fd4945ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c06da20 con 0x7fd48c15dce0 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.691+0000 7fd4945ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0c9030 con 0x7fd48c06d5a0 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.691+0000 7fd491b9a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd48c15dce0 0x7fd48c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.691+0000 7fd491b9a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd48c15dce0 0x7fd48c06d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59056/0 (socket says 172.21.15.124:59056) 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.691+0000 7fd491b9a700 1 -- 172.21.15.124:0/932482410 learned_addr learned my addr 172.21.15.124:0/932482410 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.692+0000 7fd492b9c700 1 --2- 172.21.15.124:0/932482410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 0x7fd48c069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.692+0000 7fd491b9a700 1 -- 172.21.15.124:0/932482410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 msgr2=0x7fd48c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.692+0000 7fd491b9a700 1 --2- 172.21.15.124:0/932482410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 0x7fd48c069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.692+0000 7fd491b9a700 1 -- 172.21.15.124:0/932482410 >> v1:172.21.15.158:6789/0 conn(0x7fd48c159480 legacy=0x7fd48c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.692+0000 7fd491b9a700 1 -- 172.21.15.124:0/932482410 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c068950 con 0x7fd48c15dce0 2023-10-06T04:44:24.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.692+0000 7fd491b9a700 1 --2- 172.21.15.124:0/932482410 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 0x7fd48c06d060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0099b0 tx=0x7fd47c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5339d51ca86ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.692+0000 7fd491399700 1 -- 172.21.15.124:0/932482410 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c009ea0 con 0x7fd48c15dce0 2023-10-06T04:44:24.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.692+0000 7fd491399700 1 -- 172.21.15.124:0/932482410 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c00b860 con 0x7fd48c15dce0 2023-10-06T04:44:24.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.692+0000 7fd491399700 1 -- 172.21.15.124:0/932482410 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00bc00 con 0x7fd48c15dce0 2023-10-06T04:44:24.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.693+0000 7fd4945ff700 1 -- 172.21.15.124:0/932482410 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 msgr2=0x7fd48c06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.693+0000 7fd4945ff700 1 --2- 172.21.15.124:0/932482410 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 0x7fd48c06d060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0099b0 tx=0x7fd47c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:24.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.693+0000 7fd4945ff700 1 -- 172.21.15.124:0/932482410 shutdown_connections 2023-10-06T04:44:24.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.693+0000 7fd4945ff700 1 --2- 172.21.15.124:0/932482410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 0x7fd48c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.693+0000 7fd4945ff700 1 --2- 172.21.15.124:0/932482410 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 0x7fd48c06d060 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.693+0000 7fd4945ff700 1 -- 172.21.15.124:0/932482410 >> 172.21.15.124:0/932482410 conn(0x7fd48c063cc0 msgr2=0x7fd48c0ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:24.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.693+0000 7fd4945ff700 1 -- 172.21.15.124:0/932482410 shutdown_connections 2023-10-06T04:44:24.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.693+0000 7fd4945ff700 1 -- 172.21.15.124:0/932482410 wait complete. 2023-10-06T04:44:24.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.695+0000 7fd4945ff700 1 Processor -- start 2023-10-06T04:44:24.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.695+0000 7fd4945ff700 1 -- start start 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.696+0000 7fd4945ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 0x7fd48c0c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.696+0000 7fd4945ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd48c159480 0x7fd48c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.696+0000 7fd4945ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 0x7fd48c15a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.696+0000 7fd4945ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0c7c40 con 0x7fd48c15dce0 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.696+0000 7fd4945ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0b10f0 con 0x7fd48c159480 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.696+0000 7fd4945ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0b13d0 con 0x7fd48c06d5a0 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd492b9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 0x7fd48c15a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd492b9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 0x7fd48c15a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59060/0 (socket says 172.21.15.124:59060) 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd492b9c700 1 -- 172.21.15.124:0/3398253523 learned_addr learned my addr 172.21.15.124:0/3398253523 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd492b9c700 1 -- 172.21.15.124:0/3398253523 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 msgr2=0x7fd48c0c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd49239b700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 0x7fd48c0c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd491b9a700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd48c159480 0x7fd48c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd492b9c700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 0x7fd48c0c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd492b9c700 1 -- 172.21.15.124:0/3398253523 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd48c159480 msgr2=0x7fd48c0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd492b9c700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd48c159480 0x7fd48c0c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd492b9c700 1 -- 172.21.15.124:0/3398253523 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c0094f0 con 0x7fd48c15dce0 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd49239b700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 0x7fd48c0c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.697+0000 7fd492b9c700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 0x7fd48c15a480 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd484009df0 tx=0x7fd48400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.698+0000 7fd4827fc700 1 -- 172.21.15.124:0/3398253523 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48400cb50 con 0x7fd48c15dce0 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.698+0000 7fd4827fc700 1 -- 172.21.15.124:0/3398253523 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48400f040 con 0x7fd48c15dce0 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.698+0000 7fd4827fc700 1 -- 172.21.15.124:0/3398253523 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484014480 con 0x7fd48c15dce0 2023-10-06T04:44:24.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.698+0000 7fd4945ff700 1 -- 172.21.15.124:0/3398253523 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c0b16b0 con 0x7fd48c15dce0 2023-10-06T04:44:24.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.698+0000 7fd4945ff700 1 -- 172.21.15.124:0/3398253523 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c15a9c0 con 0x7fd48c15dce0 2023-10-06T04:44:24.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.699+0000 7fd4945ff700 1 -- 172.21.15.124:0/3398253523 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c0b1230 con 0x7fd48c15dce0 2023-10-06T04:44:24.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.700+0000 7fd4827fc700 1 -- 172.21.15.124:0/3398253523 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd484014830 con 0x7fd48c15dce0 2023-10-06T04:44:24.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.701+0000 7fd4827fc700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd470066f30 0x7fd4700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.701+0000 7fd4827fc700 1 -- 172.21.15.124:0/3398253523 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd484084de0 con 0x7fd48c15dce0 2023-10-06T04:44:24.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.701+0000 7fd49239b700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd470066f30 0x7fd4700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.702+0000 7fd49239b700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd470066f30 0x7fd4700693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd4880017a0 tx=0x7fd488009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.705+0000 7fd4827fc700 1 -- 172.21.15.124:0/3398253523 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd48c0b1230 con 0x7fd48c15dce0 2023-10-06T04:44:24.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.895+0000 7fd4945ff700 1 -- 172.21.15.124:0/3398253523 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd48c0b1230 con 0x7fd48c15dce0 2023-10-06T04:44:24.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.896+0000 7fd4827fc700 1 -- 172.21.15.124:0/3398253523 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd484018020 con 0x7fd48c15dce0 2023-10-06T04:44:24.898 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:44:24.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 -- 172.21.15.124:0/3398253523 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd470066f30 msgr2=0x7fd4700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd470066f30 0x7fd4700693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd4880017a0 tx=0x7fd488009040 comp rx=0 tx=0).stop 2023-10-06T04:44:24.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 -- 172.21.15.124:0/3398253523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 msgr2=0x7fd48c15a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 0x7fd48c15a480 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd484009df0 tx=0x7fd48400b040 comp rx=0 tx=0).stop 2023-10-06T04:44:24.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 -- 172.21.15.124:0/3398253523 shutdown_connections 2023-10-06T04:44:24.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd48c15dce0 0x7fd48c15a480 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd470066f30 0x7fd4700693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c06d5a0 0x7fd48c0c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 --2- 172.21.15.124:0/3398253523 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd48c159480 0x7fd48c0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 -- 172.21.15.124:0/3398253523 >> 172.21.15.124:0/3398253523 conn(0x7fd48c063cc0 msgr2=0x7fd48c156220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:24.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 -- 172.21.15.124:0/3398253523 shutdown_connections 2023-10-06T04:44:24.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:24.898+0000 7fd4945ff700 1 -- 172.21.15.124:0/3398253523 wait complete. 2023-10-06T04:44:24.917 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:44:25.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.104+0000 7f10681ff700 1 Processor -- start 2023-10-06T04:44:25.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.104+0000 7f10681ff700 1 -- start start 2023-10-06T04:44:25.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.105+0000 7f10681ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f106006ddc0 0x7f10600b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.105+0000 7f10681ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1060068bb0 0x7f106006e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.105+0000 7f10681ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10600cc040 con 0x7f1060159040 2023-10-06T04:44:25.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.105+0000 7f10681ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106006e6d0 con 0x7f1060068bb0 2023-10-06T04:44:25.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.105+0000 7f10681ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106006e990 con 0x7f106006ddc0 2023-10-06T04:44:25.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f1065f9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f106006ddc0 0x7f10600b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f106579a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1060068bb0 0x7f106006e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f1065f9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f106006ddc0 0x7f10600b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:51012/0 (socket says 172.21.15.124:51012) 2023-10-06T04:44:25.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f106579a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1060068bb0 0x7f106006e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:51274/0 (socket says 172.21.15.124:51274) 2023-10-06T04:44:25.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f1065f9b700 1 -- 172.21.15.124:0/2269438040 learned_addr learned my addr 172.21.15.124:0/2269438040 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:25.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f1064f99700 1 -- 172.21.15.124:0/2269438040 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477200582 0 0) 0x7f10600cc040 con 0x7f1060159040 2023-10-06T04:44:25.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f1064f99700 1 -- 172.21.15.124:0/2269438040 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f104c003570 con 0x7f1060159040 2023-10-06T04:44:25.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f106579a700 1 -- 172.21.15.124:0/2269438040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f106006ddc0 msgr2=0x7f10600b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:25.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f106579a700 1 --2- 172.21.15.124:0/2269438040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f106006ddc0 0x7f10600b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f106579a700 1 -- 172.21.15.124:0/2269438040 >> v1:172.21.15.158:6789/0 conn(0x7f1060159040 legacy=0x7f10601594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f106579a700 1 -- 172.21.15.124:0/2269438040 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600cb9f0 con 0x7f1060068bb0 2023-10-06T04:44:25.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.106+0000 7f1065f9b700 1 --2- 172.21.15.124:0/2269438040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f106006ddc0 0x7f10600b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:25.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.107+0000 7f106579a700 1 --2- 172.21.15.124:0/2269438040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1060068bb0 0x7f106006e190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f10500098e0 tx=0x7f10500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5429221b6090f12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.107+0000 7f1064f99700 1 -- 172.21.15.124:0/2269438040 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011630 con 0x7f1060068bb0 2023-10-06T04:44:25.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.107+0000 7f1064f99700 1 -- 172.21.15.124:0/2269438040 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1050011790 con 0x7f1060068bb0 2023-10-06T04:44:25.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.107+0000 7f1064f99700 1 -- 172.21.15.124:0/2269438040 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011b30 con 0x7f1060068bb0 2023-10-06T04:44:25.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.107+0000 7f10681ff700 1 -- 172.21.15.124:0/2269438040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1060068bb0 msgr2=0x7f106006e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.107+0000 7f10681ff700 1 --2- 172.21.15.124:0/2269438040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1060068bb0 0x7f106006e190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f10500098e0 tx=0x7f10500091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.107+0000 7f10681ff700 1 -- 172.21.15.124:0/2269438040 shutdown_connections 2023-10-06T04:44:25.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.107+0000 7f10681ff700 1 --2- 172.21.15.124:0/2269438040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f106006ddc0 0x7f10600b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.107+0000 7f10681ff700 1 --2- 172.21.15.124:0/2269438040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1060068bb0 0x7f106006e190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.107+0000 7f10681ff700 1 -- 172.21.15.124:0/2269438040 >> 172.21.15.124:0/2269438040 conn(0x7f10600cd390 msgr2=0x7f10600b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:25.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.108+0000 7f10681ff700 1 -- 172.21.15.124:0/2269438040 shutdown_connections 2023-10-06T04:44:25.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.108+0000 7f10681ff700 1 -- 172.21.15.124:0/2269438040 wait complete. 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.109+0000 7f10681ff700 1 Processor -- start 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.109+0000 7f10681ff700 1 -- start start 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.110+0000 7f10681ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1060068bb0 0x7f106014eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.110+0000 7f10681ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106006ddc0 0x7f1060169780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.110+0000 7f10681ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1060159040 0x7f1060154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.110+0000 7f10681ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106014fa30 con 0x7f106006ddc0 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.110+0000 7f10681ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106016cdc0 con 0x7f1060159040 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.110+0000 7f10681ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106016d060 con 0x7f1060068bb0 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.110+0000 7f106579a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106006ddc0 0x7f1060169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.110+0000 7f106579a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106006ddc0 0x7f1060169780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59064/0 (socket says 172.21.15.124:59064) 2023-10-06T04:44:25.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.110+0000 7f106579a700 1 -- 172.21.15.124:0/175631689 learned_addr learned my addr 172.21.15.124:0/175631689 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f106579a700 1 -- 172.21.15.124:0/175631689 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1060068bb0 msgr2=0x7f106014eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f106579a700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1060068bb0 0x7f106014eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f106579a700 1 -- 172.21.15.124:0/175631689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1060159040 msgr2=0x7f1060154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f106579a700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1060159040 0x7f1060154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f106579a700 1 -- 172.21.15.124:0/175631689 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0094f0 con 0x7f106006ddc0 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f106579a700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106006ddc0 0x7f1060169780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f10600694e0 tx=0x7f1050017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f1055ffb700 1 -- 172.21.15.124:0/175631689 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011b10 con 0x7f106006ddc0 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f1055ffb700 1 -- 172.21.15.124:0/175631689 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10500253f0 con 0x7f106006ddc0 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f10681ff700 1 -- 172.21.15.124:0/175631689 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1050009420 con 0x7f106006ddc0 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f1055ffb700 1 -- 172.21.15.124:0/175631689 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050025790 con 0x7f106006ddc0 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.111+0000 7f10681ff700 1 -- 172.21.15.124:0/175631689 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1060169f60 con 0x7f106006ddc0 2023-10-06T04:44:25.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.112+0000 7f10681ff700 1 -- 172.21.15.124:0/175631689 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1060158ab0 con 0x7f106006ddc0 2023-10-06T04:44:25.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.113+0000 7f1055ffb700 1 -- 172.21.15.124:0/175631689 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1050025b80 con 0x7f106006ddc0 2023-10-06T04:44:25.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.114+0000 7f1055ffb700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1044066f30 0x7f10440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.114+0000 7f1055ffb700 1 -- 172.21.15.124:0/175631689 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1050085c60 con 0x7f106006ddc0 2023-10-06T04:44:25.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.114+0000 7f1065f9b700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1044066f30 0x7f10440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.115+0000 7f1065f9b700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1044066f30 0x7f10440693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f105c006fd0 tx=0x7f105c009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.118+0000 7f1055ffb700 1 -- 172.21.15.124:0/175631689 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1050053020 con 0x7f106006ddc0 2023-10-06T04:44:25.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.314+0000 7f10681ff700 1 -- 172.21.15.124:0/175631689 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f106016d1f0 con 0x7f106006ddc0 2023-10-06T04:44:25.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.314+0000 7f1055ffb700 1 -- 172.21.15.124:0/175631689 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1050056640 con 0x7f106006ddc0 2023-10-06T04:44:25.316 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:25.316 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2023-10-06T04:44:25.316 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:44:25.316 INFO:teuthology.orchestra.run.smithi124.stdout: "poolnum": 1, 2023-10-06T04:44:25.316 INFO:teuthology.orchestra.run.smithi124.stdout: "poolname": "rbd" 2023-10-06T04:44:25.316 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:44:25.317 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:44:25.317 INFO:teuthology.orchestra.run.smithi124.stdout: "poolnum": 2, 2023-10-06T04:44:25.317 INFO:teuthology.orchestra.run.smithi124.stdout: "poolname": ".mgr" 2023-10-06T04:44:25.317 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:44:25.317 INFO:teuthology.orchestra.run.smithi124.stdout:] 2023-10-06T04:44:25.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.316+0000 7f10681ff700 1 -- 172.21.15.124:0/175631689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1044066f30 msgr2=0x7f10440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.316+0000 7f10681ff700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1044066f30 0x7f10440693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f105c006fd0 tx=0x7f105c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:25.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.316+0000 7f10681ff700 1 -- 172.21.15.124:0/175631689 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106006ddc0 msgr2=0x7f1060169780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.316+0000 7f10681ff700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106006ddc0 0x7f1060169780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f10600694e0 tx=0x7f1050017000 comp rx=0 tx=0).stop 2023-10-06T04:44:25.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.316+0000 7f10681ff700 1 -- 172.21.15.124:0/175631689 shutdown_connections 2023-10-06T04:44:25.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.316+0000 7f10681ff700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1060159040 0x7f1060154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.317+0000 7f10681ff700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1044066f30 0x7f10440693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.317+0000 7f10681ff700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1060068bb0 0x7f106014eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.317+0000 7f10681ff700 1 --2- 172.21.15.124:0/175631689 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106006ddc0 0x7f1060169780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.317+0000 7f10681ff700 1 -- 172.21.15.124:0/175631689 >> 172.21.15.124:0/175631689 conn(0x7f10600cd390 msgr2=0x7f106015c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:25.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.317+0000 7f10681ff700 1 -- 172.21.15.124:0/175631689 shutdown_connections 2023-10-06T04:44:25.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.317+0000 7f10681ff700 1 -- 172.21.15.124:0/175631689 wait complete. 2023-10-06T04:44:25.335 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:44:25.336 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:44:25.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.528+0000 7faded1ff700 1 Processor -- start 2023-10-06T04:44:25.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.528+0000 7faded1ff700 1 -- start start 2023-10-06T04:44:25.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.529+0000 7faded1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade8159b90 0x7fade80b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.529+0000 7faded1ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fade80cd410 0x7fade80cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.529+0000 7faded1ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade80b11a0 con 0x7fade80cd040 2023-10-06T04:44:25.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.529+0000 7faded1ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade815d970 con 0x7fade80cd410 2023-10-06T04:44:25.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.529+0000 7faded1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade815dc50 con 0x7fade8159b90 2023-10-06T04:44:25.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.529+0000 7fade759e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fade80cd410 0x7fade80cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.529+0000 7fade759e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fade80cd410 0x7fade80cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59076/0 (socket says 172.21.15.124:59076) 2023-10-06T04:44:25.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.529+0000 7fade759e700 1 -- 172.21.15.124:0/148883958 learned_addr learned my addr 172.21.15.124:0/148883958 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:25.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.529+0000 7fade659c700 1 --2- 172.21.15.124:0/148883958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade8159b90 0x7fade80b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.529+0000 7fade6d9d700 1 --1- 172.21.15.124:0/148883958 >> v1:172.21.15.158:6789/0 conn(0x7fade80cd040 0x7fade8159480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:58284/0 (socket says 172.21.15.124:58284) 2023-10-06T04:44:25.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.530+0000 7fade759e700 1 -- 172.21.15.124:0/148883958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade8159b90 msgr2=0x7fade80b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:25.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.530+0000 7fade759e700 1 --2- 172.21.15.124:0/148883958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade8159b90 0x7fade80b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.530+0000 7fade759e700 1 -- 172.21.15.124:0/148883958 >> v1:172.21.15.158:6789/0 conn(0x7fade80cd040 legacy=0x7fade8159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.530+0000 7fade759e700 1 -- 172.21.15.124:0/148883958 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade815df30 con 0x7fade80cd410 2023-10-06T04:44:25.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.530+0000 7fade5d9b700 1 -- 172.21.15.124:0/148883958 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945389645 0 0) 0x7fade80b11a0 con 0x7fade80cd040 2023-10-06T04:44:25.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.530+0000 7fade759e700 1 --2- 172.21.15.124:0/148883958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade80cd410 0x7fade80cb570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fade0009f20 tx=0x7fade0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c173bdf525ac9ebe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.530+0000 7fade5d9b700 1 -- 172.21.15.124:0/148883958 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade000e070 con 0x7fade80cd410 2023-10-06T04:44:25.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.530+0000 7fade5d9b700 1 -- 172.21.15.124:0/148883958 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade000b9d0 con 0x7fade80cd410 2023-10-06T04:44:25.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.530+0000 7fade5d9b700 1 -- 172.21.15.124:0/148883958 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00092e0 con 0x7fade80cd410 2023-10-06T04:44:25.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.531+0000 7faded1ff700 1 -- 172.21.15.124:0/148883958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade80cd410 msgr2=0x7fade80cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.531+0000 7faded1ff700 1 --2- 172.21.15.124:0/148883958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade80cd410 0x7fade80cb570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fade0009f20 tx=0x7fade0009840 comp rx=0 tx=0).stop 2023-10-06T04:44:25.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.531+0000 7faded1ff700 1 -- 172.21.15.124:0/148883958 shutdown_connections 2023-10-06T04:44:25.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.531+0000 7faded1ff700 1 --2- 172.21.15.124:0/148883958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade80cd410 0x7fade80cb570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.531+0000 7faded1ff700 1 --2- 172.21.15.124:0/148883958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade8159b90 0x7fade80b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.531+0000 7faded1ff700 1 -- 172.21.15.124:0/148883958 >> 172.21.15.124:0/148883958 conn(0x7fade806ed20 msgr2=0x7fade806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.531+0000 7faded1ff700 1 -- 172.21.15.124:0/148883958 shutdown_connections 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.531+0000 7faded1ff700 1 -- 172.21.15.124:0/148883958 wait complete. 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.532+0000 7faded1ff700 1 Processor -- start 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.533+0000 7faded1ff700 1 -- start start 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.533+0000 7faded1ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fade80cd040 0x7fade80c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.533+0000 7faded1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade80cd410 0x7fade80afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.533+0000 7faded1ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade8159b90 0x7fade8157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.533+0000 7faded1ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade815a190 con 0x7fade8159b90 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.533+0000 7faded1ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade80c7bf0 con 0x7fade80cd040 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.533+0000 7faded1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade80c7ed0 con 0x7fade80cd410 2023-10-06T04:44:25.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade759e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade8159b90 0x7fade8157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade759e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade8159b90 0x7fade8157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59084/0 (socket says 172.21.15.124:59084) 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade759e700 1 -- 172.21.15.124:0/1069894777 learned_addr learned my addr 172.21.15.124:0/1069894777 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade6d9d700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fade80cd040 0x7fade80c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade659c700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade80cd410 0x7fade80afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade759e700 1 -- 172.21.15.124:0/1069894777 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade80cd410 msgr2=0x7fade80afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade759e700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade80cd410 0x7fade80afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade759e700 1 -- 172.21.15.124:0/1069894777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fade80cd040 msgr2=0x7fade80c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade759e700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fade80cd040 0x7fade80c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade759e700 1 -- 172.21.15.124:0/1069894777 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade0009ae0 con 0x7fade8159b90 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fade759e700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade8159b90 0x7fade8157d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fade80d0190 tx=0x7fade0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.534+0000 7fadceffd700 1 -- 172.21.15.124:0/1069894777 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0008bc0 con 0x7fade8159b90 2023-10-06T04:44:25.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.535+0000 7fadceffd700 1 -- 172.21.15.124:0/1069894777 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade0008d40 con 0x7fade8159b90 2023-10-06T04:44:25.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.535+0000 7faded1ff700 1 -- 172.21.15.124:0/1069894777 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade80c81b0 con 0x7fade8159b90 2023-10-06T04:44:25.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.535+0000 7fadceffd700 1 -- 172.21.15.124:0/1069894777 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00266b0 con 0x7fade8159b90 2023-10-06T04:44:25.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.535+0000 7faded1ff700 1 -- 172.21.15.124:0/1069894777 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade80b03a0 con 0x7fade8159b90 2023-10-06T04:44:25.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.536+0000 7faded1ff700 1 -- 172.21.15.124:0/1069894777 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade80718b0 con 0x7fade8159b90 2023-10-06T04:44:25.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.536+0000 7fadceffd700 1 -- 172.21.15.124:0/1069894777 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fade0003040 con 0x7fade8159b90 2023-10-06T04:44:25.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.537+0000 7fadceffd700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fadd4066f30 0x7fadd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.537+0000 7fadceffd700 1 -- 172.21.15.124:0/1069894777 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fade0086380 con 0x7fade8159b90 2023-10-06T04:44:25.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.537+0000 7fade6d9d700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fadd4066f30 0x7fadd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.538+0000 7fade6d9d700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fadd4066f30 0x7fadd40693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fadd8007fd0 tx=0x7fadd8007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.542+0000 7fadceffd700 1 -- 172.21.15.124:0/1069894777 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fade0053740 con 0x7fade8159b90 2023-10-06T04:44:25.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:25.734+0000 7faded1ff700 1 -- 172.21.15.124:0/1069894777 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fade815a2d0 con 0x7fade8159b90 2023-10-06T04:44:26.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.142+0000 7fadceffd700 1 -- 172.21.15.124:0/1069894777 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fade0056d60 con 0x7fade8159b90 2023-10-06T04:44:26.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.145+0000 7faded1ff700 1 -- 172.21.15.124:0/1069894777 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fadd4066f30 msgr2=0x7fadd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.145+0000 7faded1ff700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fadd4066f30 0x7fadd40693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fadd8007fd0 tx=0x7fadd8007d50 comp rx=0 tx=0).stop 2023-10-06T04:44:26.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.145+0000 7faded1ff700 1 -- 172.21.15.124:0/1069894777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade8159b90 msgr2=0x7fade8157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.145+0000 7faded1ff700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade8159b90 0x7fade8157d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fade80d0190 tx=0x7fade0018000 comp rx=0 tx=0).stop 2023-10-06T04:44:26.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.146+0000 7faded1ff700 1 -- 172.21.15.124:0/1069894777 shutdown_connections 2023-10-06T04:44:26.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.146+0000 7faded1ff700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade8159b90 0x7fade8157d20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.146+0000 7faded1ff700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fade80cd040 0x7fade80c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.146+0000 7faded1ff700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fadd4066f30 0x7fadd40693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.146+0000 7faded1ff700 1 --2- 172.21.15.124:0/1069894777 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade80cd410 0x7fade80afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.146+0000 7faded1ff700 1 -- 172.21.15.124:0/1069894777 >> 172.21.15.124:0/1069894777 conn(0x7fade806ed20 msgr2=0x7fade8158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:26.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.146+0000 7faded1ff700 1 -- 172.21.15.124:0/1069894777 shutdown_connections 2023-10-06T04:44:26.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.146+0000 7faded1ff700 1 -- 172.21.15.124:0/1069894777 wait complete. 2023-10-06T04:44:26.149 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' created 2023-10-06T04:44:26.169 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:44:26.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.364+0000 7f597ebff700 1 Processor -- start 2023-10-06T04:44:26.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.364+0000 7f597ebff700 1 -- start start 2023-10-06T04:44:26.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.366+0000 7f597ebff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 0x7f5978069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.366+0000 7f597ebff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5978068600 0x7f5978159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.366+0000 7f597ebff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597815df90 con 0x7f59780aa0c0 2023-10-06T04:44:26.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.366+0000 7f597ebff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59780ab310 con 0x7f5978068600 2023-10-06T04:44:26.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.366+0000 7f597ebff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597815d380 con 0x7f59780a9cf0 2023-10-06T04:44:26.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.366+0000 7f5977fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f59780aa0c0 0x7f597806a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:46534/0 (socket says 172.21.15.124:46534) 2023-10-06T04:44:26.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.366+0000 7f5977fff700 1 -- 172.21.15.124:0/2279898400 learned_addr learned my addr 172.21.15.124:0/2279898400 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:26.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.366+0000 7f597d19c700 1 --2- 172.21.15.124:0/2279898400 >> v2:172.21.15.158:3300/0 conn(0x7f5978068600 0x7f5978159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.366+0000 7f597c99b700 1 --2- 172.21.15.124:0/2279898400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 0x7f5978069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.366+0000 7f59777fe700 1 -- 172.21.15.124:0/2279898400 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359036637 0 0) 0x7f597815df90 con 0x7f59780aa0c0 2023-10-06T04:44:26.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.367+0000 7f59777fe700 1 -- 172.21.15.124:0/2279898400 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5968003570 con 0x7f59780aa0c0 2023-10-06T04:44:26.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.367+0000 7f597c99b700 1 -- 172.21.15.124:0/2279898400 >> v2:172.21.15.158:3300/0 conn(0x7f5978068600 msgr2=0x7f5978159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:26.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.367+0000 7f597c99b700 1 --2- 172.21.15.124:0/2279898400 >> v2:172.21.15.158:3300/0 conn(0x7f5978068600 0x7f5978159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.367+0000 7f597c99b700 1 -- 172.21.15.124:0/2279898400 >> v1:172.21.15.124:6789/0 conn(0x7f59780aa0c0 legacy=0x7f597806a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.367+0000 7f597c99b700 1 -- 172.21.15.124:0/2279898400 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597815d660 con 0x7f59780a9cf0 2023-10-06T04:44:26.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.367+0000 7f597d19c700 1 --2- 172.21.15.124:0/2279898400 >> v2:172.21.15.158:3300/0 conn(0x7f5978068600 0x7f5978159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:26.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.367+0000 7f597c99b700 1 --2- 172.21.15.124:0/2279898400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 0x7f5978069f80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f596c009910 tx=0x7f596c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5294632f4da75589 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.367+0000 7f59777fe700 1 -- 172.21.15.124:0/2279898400 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c011630 con 0x7f59780a9cf0 2023-10-06T04:44:26.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.367+0000 7f59777fe700 1 -- 172.21.15.124:0/2279898400 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c011790 con 0x7f59780a9cf0 2023-10-06T04:44:26.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.367+0000 7f59777fe700 1 -- 172.21.15.124:0/2279898400 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c011b30 con 0x7f59780a9cf0 2023-10-06T04:44:26.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.368+0000 7f597ebff700 1 -- 172.21.15.124:0/2279898400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 msgr2=0x7f5978069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.368+0000 7f597ebff700 1 --2- 172.21.15.124:0/2279898400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 0x7f5978069f80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f596c009910 tx=0x7f596c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.368+0000 7f597ebff700 1 -- 172.21.15.124:0/2279898400 shutdown_connections 2023-10-06T04:44:26.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.368+0000 7f597ebff700 1 --2- 172.21.15.124:0/2279898400 >> v2:172.21.15.158:3300/0 conn(0x7f5978068600 0x7f5978159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.368+0000 7f597ebff700 1 --2- 172.21.15.124:0/2279898400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 0x7f5978069f80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.368+0000 7f597ebff700 1 -- 172.21.15.124:0/2279898400 >> 172.21.15.124:0/2279898400 conn(0x7f597806bf10 msgr2=0x7f59780ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:26.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.368+0000 7f597ebff700 1 -- 172.21.15.124:0/2279898400 shutdown_connections 2023-10-06T04:44:26.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.368+0000 7f597ebff700 1 -- 172.21.15.124:0/2279898400 wait complete. 2023-10-06T04:44:26.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.370+0000 7f597ebff700 1 Processor -- start 2023-10-06T04:44:26.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.370+0000 7f597ebff700 1 -- start start 2023-10-06T04:44:26.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.371+0000 7f597ebff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5978068600 0x7f5978153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.371+0000 7f597ebff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 0x7f597815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.371+0000 7f597ebff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59780aa0c0 0x7f5978144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597ebff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59780af910 con 0x7f5978068600 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597ebff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59780afb20 con 0x7f59780aa0c0 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597ebff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59780afe00 con 0x7f59780a9cf0 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597c99b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5978068600 0x7f5978153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597c99b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5978068600 0x7f5978153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59090/0 (socket says 172.21.15.124:59090) 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597c99b700 1 -- 172.21.15.124:0/1272878198 learned_addr learned my addr 172.21.15.124:0/1272878198 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597d19c700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59780aa0c0 0x7f5978144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f5977fff700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 0x7f597815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597c99b700 1 -- 172.21.15.124:0/1272878198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 msgr2=0x7f597815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597c99b700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 0x7f597815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597c99b700 1 -- 172.21.15.124:0/1272878198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59780aa0c0 msgr2=0x7f5978144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597c99b700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59780aa0c0 0x7f5978144190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597c99b700 1 -- 172.21.15.124:0/1272878198 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970009a20 con 0x7f5978068600 2023-10-06T04:44:26.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.372+0000 7f597c99b700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5978068600 0x7f5978153a70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f597815d4c0 tx=0x7f596c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.373+0000 7f5974ff9700 1 -- 172.21.15.124:0/1272878198 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c011900 con 0x7f5978068600 2023-10-06T04:44:26.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.373+0000 7f5974ff9700 1 -- 172.21.15.124:0/1272878198 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c011a80 con 0x7f5978068600 2023-10-06T04:44:26.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.373+0000 7f597ebff700 1 -- 172.21.15.124:0/1272878198 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596c009420 con 0x7f5978068600 2023-10-06T04:44:26.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.373+0000 7f5974ff9700 1 -- 172.21.15.124:0/1272878198 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c025670 con 0x7f5978068600 2023-10-06T04:44:26.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.373+0000 7f597ebff700 1 -- 172.21.15.124:0/1272878198 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59780b03c0 con 0x7f5978068600 2023-10-06T04:44:26.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.374+0000 7f597ebff700 1 -- 172.21.15.124:0/1272878198 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59780b05e0 con 0x7f5978068600 2023-10-06T04:44:26.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.375+0000 7f5974ff9700 1 -- 172.21.15.124:0/1272878198 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f596c023070 con 0x7f5978068600 2023-10-06T04:44:26.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.376+0000 7f5974ff9700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f595c066f30 0x7f595c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.376+0000 7f5974ff9700 1 -- 172.21.15.124:0/1272878198 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f596c0858f0 con 0x7f5978068600 2023-10-06T04:44:26.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.376+0000 7f5977fff700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f595c066f30 0x7f595c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.376+0000 7f5977fff700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f595c066f30 0x7f595c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5978154980 tx=0x7f5964009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.380+0000 7f5974ff9700 1 -- 172.21.15.124:0/1272878198 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f596c052ce0 con 0x7f5978068600 2023-10-06T04:44:26.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:26.572+0000 7f597ebff700 1 -- 172.21.15.124:0/1272878198 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f597804c380 con 0x7f5978068600 2023-10-06T04:44:27.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.149+0000 7f5974ff9700 1 -- 172.21.15.124:0/1272878198 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f596c02a0d0 con 0x7f5978068600 2023-10-06T04:44:27.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.157+0000 7f597ebff700 1 -- 172.21.15.124:0/1272878198 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f595c066f30 msgr2=0x7f595c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.157+0000 7f597ebff700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f595c066f30 0x7f595c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5978154980 tx=0x7f5964009040 comp rx=0 tx=0).stop 2023-10-06T04:44:27.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.157+0000 7f597ebff700 1 -- 172.21.15.124:0/1272878198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5978068600 msgr2=0x7f5978153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.157+0000 7f597ebff700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5978068600 0x7f5978153a70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f597815d4c0 tx=0x7f596c017000 comp rx=0 tx=0).stop 2023-10-06T04:44:27.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.161+0000 7f597ebff700 1 -- 172.21.15.124:0/1272878198 shutdown_connections 2023-10-06T04:44:27.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.161+0000 7f597ebff700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59780aa0c0 0x7f5978144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.161+0000 7f597ebff700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5978068600 0x7f5978153a70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.161+0000 7f597ebff700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f595c066f30 0x7f595c0693e0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5978154980 tx=0x7f5964009040 comp rx=0 tx=0).stop 2023-10-06T04:44:27.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.161+0000 7f597ebff700 1 --2- 172.21.15.124:0/1272878198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59780a9cf0 0x7f597815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.161+0000 7f597ebff700 1 -- 172.21.15.124:0/1272878198 >> 172.21.15.124:0/1272878198 conn(0x7f597806bf10 msgr2=0x7f59780ac3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:27.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.168+0000 7f597ebff700 1 -- 172.21.15.124:0/1272878198 shutdown_connections 2023-10-06T04:44:27.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.170+0000 7f597ebff700 1 -- 172.21.15.124:0/1272878198 wait complete. 2023-10-06T04:44:27.175 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' created 2023-10-06T04:44:27.194 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:44:27.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.385+0000 7f13d11ff700 1 Processor -- start 2023-10-06T04:44:27.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.385+0000 7f13d11ff700 1 -- start start 2023-10-06T04:44:27.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13d11ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13cc159480 0x7f13cc15dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13d11ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f13cc0c8840 0x7f13cc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13d11ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f13cc06d5a0 0x7f13cc06b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13d11ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc06da20 con 0x7f13cc06d5a0 2023-10-06T04:44:27.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13d11ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc068700 con 0x7f13cc0c8840 2023-10-06T04:44:27.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13d11ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0c9030 con 0x7f13cc159480 2023-10-06T04:44:27.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13cb59e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f13cc06d5a0 0x7f13cc06b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13ca59c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f13cc0c8840 0x7f13cc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13cad9d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13cc159480 0x7f13cc15dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13cb59e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f13cc06d5a0 0x7f13cc06b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59104/0 (socket says 172.21.15.124:59104) 2023-10-06T04:44:27.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13cb59e700 1 -- 172.21.15.124:0/4064006946 learned_addr learned my addr 172.21.15.124:0/4064006946 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:27.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13cb59e700 1 -- 172.21.15.124:0/4064006946 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13cc159480 msgr2=0x7f13cc15dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:27.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13cb59e700 1 --2- 172.21.15.124:0/4064006946 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13cc159480 0x7f13cc15dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13cb59e700 1 -- 172.21.15.124:0/4064006946 >> v2:172.21.15.158:3300/0 conn(0x7f13cc0c8840 msgr2=0x7f13cc06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:27.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13cb59e700 1 --2- 172.21.15.124:0/4064006946 >> v2:172.21.15.158:3300/0 conn(0x7f13cc0c8840 0x7f13cc06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.387+0000 7f13cb59e700 1 -- 172.21.15.124:0/4064006946 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc068950 con 0x7f13cc06d5a0 2023-10-06T04:44:27.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13cb59e700 1 --2- 172.21.15.124:0/4064006946 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 0x7f13cc06b850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13cc06b330 tx=0x7f13c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc475f78327fb4c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13c9d9b700 1 -- 172.21.15.124:0/4064006946 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c400e070 con 0x7f13cc06d5a0 2023-10-06T04:44:27.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13c9d9b700 1 -- 172.21.15.124:0/4064006946 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c400b970 con 0x7f13cc06d5a0 2023-10-06T04:44:27.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13c9d9b700 1 -- 172.21.15.124:0/4064006946 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c40092e0 con 0x7f13cc06d5a0 2023-10-06T04:44:27.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13d11ff700 1 -- 172.21.15.124:0/4064006946 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 msgr2=0x7f13cc06b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13d11ff700 1 --2- 172.21.15.124:0/4064006946 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 0x7f13cc06b850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13cc06b330 tx=0x7f13c4009840 comp rx=0 tx=0).stop 2023-10-06T04:44:27.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13d11ff700 1 -- 172.21.15.124:0/4064006946 shutdown_connections 2023-10-06T04:44:27.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13d11ff700 1 --2- 172.21.15.124:0/4064006946 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 0x7f13cc06b850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13d11ff700 1 --2- 172.21.15.124:0/4064006946 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13cc159480 0x7f13cc15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13d11ff700 1 --2- 172.21.15.124:0/4064006946 >> v2:172.21.15.158:3300/0 conn(0x7f13cc0c8840 0x7f13cc06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.388+0000 7f13d11ff700 1 -- 172.21.15.124:0/4064006946 >> 172.21.15.124:0/4064006946 conn(0x7f13cc063cc0 msgr2=0x7f13cc0ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:27.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.389+0000 7f13d11ff700 1 -- 172.21.15.124:0/4064006946 shutdown_connections 2023-10-06T04:44:27.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.389+0000 7f13d11ff700 1 -- 172.21.15.124:0/4064006946 wait complete. 2023-10-06T04:44:27.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.391+0000 7f13d11ff700 1 Processor -- start 2023-10-06T04:44:27.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.391+0000 7f13d11ff700 1 -- start start 2023-10-06T04:44:27.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13d11ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 0x7f13cc15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13d11ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13cc0c8840 0x7f13cc153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13d11ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13cc159480 0x7f13cc15e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13d11ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc15e4d0 con 0x7f13cc06d5a0 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13d11ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc153cd0 con 0x7f13cc0c8840 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13d11ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc15d8c0 con 0x7f13cc159480 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13cad9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 0x7f13cc15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13cad9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 0x7f13cc15a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59120/0 (socket says 172.21.15.124:59120) 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13cad9d700 1 -- 172.21.15.124:0/3328782331 learned_addr learned my addr 172.21.15.124:0/3328782331 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13cad9d700 1 -- 172.21.15.124:0/3328782331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13cc159480 msgr2=0x7f13cc15e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13cad9d700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13cc159480 0x7f13cc15e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.392+0000 7f13cad9d700 1 -- 172.21.15.124:0/3328782331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13cc0c8840 msgr2=0x7f13cc153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.393+0000 7f13cad9d700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13cc0c8840 0x7f13cc153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.393+0000 7f13cad9d700 1 -- 172.21.15.124:0/3328782331 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4009ae0 con 0x7f13cc06d5a0 2023-10-06T04:44:27.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.393+0000 7f13cad9d700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 0x7f13cc15a770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00ec80 tx=0x7f13bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.393+0000 7f13b2ffd700 1 -- 172.21.15.124:0/3328782331 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00c9d0 con 0x7f13cc06d5a0 2023-10-06T04:44:27.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.393+0000 7f13b2ffd700 1 -- 172.21.15.124:0/3328782331 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc00cb50 con 0x7f13cc06d5a0 2023-10-06T04:44:27.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.393+0000 7f13b2ffd700 1 -- 172.21.15.124:0/3328782331 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc013470 con 0x7f13cc06d5a0 2023-10-06T04:44:27.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.393+0000 7f13d11ff700 1 -- 172.21.15.124:0/3328782331 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13cc15dba0 con 0x7f13cc06d5a0 2023-10-06T04:44:27.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.393+0000 7f13d11ff700 1 -- 172.21.15.124:0/3328782331 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13cc15e160 con 0x7f13cc06d5a0 2023-10-06T04:44:27.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.394+0000 7f13d11ff700 1 -- 172.21.15.124:0/3328782331 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13cc0b3fc0 con 0x7f13cc06d5a0 2023-10-06T04:44:27.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.395+0000 7f13b2ffd700 1 -- 172.21.15.124:0/3328782331 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13bc013860 con 0x7f13cc06d5a0 2023-10-06T04:44:27.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.397+0000 7f13b2ffd700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f13b8066f30 0x7f13b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.397+0000 7f13b2ffd700 1 -- 172.21.15.124:0/3328782331 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f13bc084a10 con 0x7f13cc06d5a0 2023-10-06T04:44:27.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.397+0000 7f13ca59c700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f13b8066f30 0x7f13b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.398+0000 7f13ca59c700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f13b8066f30 0x7f13b80693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009b10 tx=0x7f13c00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.401+0000 7f13b2ffd700 1 -- 172.21.15.124:0/3328782331 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13bc051b80 con 0x7f13cc06d5a0 2023-10-06T04:44:27.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:27.633+0000 7f13d11ff700 1 -- 172.21.15.124:0/3328782331 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f13cc0cbb10 con 0x7f13cc06d5a0 2023-10-06T04:44:28.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.167+0000 7f13b2ffd700 1 -- 172.21.15.124:0/3328782331 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f13bc0551a0 con 0x7f13cc06d5a0 2023-10-06T04:44:28.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.171+0000 7f13d11ff700 1 -- 172.21.15.124:0/3328782331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f13b8066f30 msgr2=0x7f13b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.171+0000 7f13d11ff700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f13b8066f30 0x7f13b80693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009b10 tx=0x7f13c00091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.171+0000 7f13d11ff700 1 -- 172.21.15.124:0/3328782331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 msgr2=0x7f13cc15a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.171+0000 7f13d11ff700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 0x7f13cc15a770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00ec80 tx=0x7f13bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.177+0000 7f13d11ff700 1 -- 172.21.15.124:0/3328782331 shutdown_connections 2023-10-06T04:44:28.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.177+0000 7f13d11ff700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f13b8066f30 0x7f13b80693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.177+0000 7f13d11ff700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13cc159480 0x7f13cc15e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.177+0000 7f13d11ff700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13cc06d5a0 0x7f13cc15a770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.177+0000 7f13d11ff700 1 --2- 172.21.15.124:0/3328782331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13cc0c8840 0x7f13cc153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.177+0000 7f13d11ff700 1 -- 172.21.15.124:0/3328782331 >> 172.21.15.124:0/3328782331 conn(0x7f13cc063cc0 msgr2=0x7f13cc154890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:28.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.180+0000 7f13d11ff700 1 -- 172.21.15.124:0/3328782331 shutdown_connections 2023-10-06T04:44:28.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.180+0000 7f13d11ff700 1 -- 172.21.15.124:0/3328782331 wait complete. 2023-10-06T04:44:28.184 INFO:teuthology.orchestra.run.smithi124.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T04:44:28.203 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:28.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.392+0000 7f45483ff700 1 Processor -- start 2023-10-06T04:44:28.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.392+0000 7f45483ff700 1 -- start start 2023-10-06T04:44:28.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f45483ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f454015c6d0 0x7f45400cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f45483ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f45400cd380 0x7f45400cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f45483ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45400cbf10 con 0x7f454015a750 2023-10-06T04:44:28.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f45483ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454015b230 con 0x7f45400cd380 2023-10-06T04:44:28.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f45483ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45400cb6e0 con 0x7f454015c6d0 2023-10-06T04:44:28.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f454619b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f454015a750 0x7f45400ccc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:46536/0 (socket says 172.21.15.124:46536) 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f454619b700 1 -- 172.21.15.124:0/1782081477 learned_addr learned my addr 172.21.15.124:0/1782081477 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f454699c700 1 --2- 172.21.15.124:0/1782081477 >> v2:172.21.15.124:3300/0 conn(0x7f45400cd380 0x7f45400cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f454599a700 1 --2- 172.21.15.124:0/1782081477 >> v2:172.21.15.158:3300/0 conn(0x7f454015c6d0 0x7f45400cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f4545199700 1 -- 172.21.15.124:0/1782081477 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439620042 0 0) 0x7f45400cbf10 con 0x7f454015a750 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f4545199700 1 -- 172.21.15.124:0/1782081477 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f452c003570 con 0x7f454015a750 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f454699c700 1 -- 172.21.15.124:0/1782081477 >> v2:172.21.15.158:3300/0 conn(0x7f454015c6d0 msgr2=0x7f45400cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f454699c700 1 --2- 172.21.15.124:0/1782081477 >> v2:172.21.15.158:3300/0 conn(0x7f454015c6d0 0x7f45400cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f454699c700 1 -- 172.21.15.124:0/1782081477 >> v1:172.21.15.124:6789/0 conn(0x7f454015a750 legacy=0x7f45400ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.394+0000 7f454699c700 1 -- 172.21.15.124:0/1782081477 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45400cb950 con 0x7f45400cd380 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.395+0000 7f454699c700 1 --2- 172.21.15.124:0/1782081477 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45400cd380 0x7f45400cb1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4540088740 tx=0x7f4538009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26bf4cd1979c141a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.395+0000 7f4545199700 1 -- 172.21.15.124:0/1782081477 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800e070 con 0x7f45400cd380 2023-10-06T04:44:28.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.395+0000 7f4545199700 1 -- 172.21.15.124:0/1782081477 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453800bab0 con 0x7f45400cd380 2023-10-06T04:44:28.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.395+0000 7f4545199700 1 -- 172.21.15.124:0/1782081477 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800be70 con 0x7f45400cd380 2023-10-06T04:44:28.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.395+0000 7f45483ff700 1 -- 172.21.15.124:0/1782081477 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45400cd380 msgr2=0x7f45400cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.395+0000 7f45483ff700 1 --2- 172.21.15.124:0/1782081477 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45400cd380 0x7f45400cb1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4540088740 tx=0x7f4538009780 comp rx=0 tx=0).stop 2023-10-06T04:44:28.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.395+0000 7f45483ff700 1 -- 172.21.15.124:0/1782081477 shutdown_connections 2023-10-06T04:44:28.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.395+0000 7f45483ff700 1 --2- 172.21.15.124:0/1782081477 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45400cd380 0x7f45400cb1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.395+0000 7f45483ff700 1 --2- 172.21.15.124:0/1782081477 >> v2:172.21.15.158:3300/0 conn(0x7f454015c6d0 0x7f45400cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.395+0000 7f45483ff700 1 -- 172.21.15.124:0/1782081477 >> 172.21.15.124:0/1782081477 conn(0x7f4540099710 msgr2=0x7f454006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:28.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.396+0000 7f45483ff700 1 -- 172.21.15.124:0/1782081477 shutdown_connections 2023-10-06T04:44:28.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.396+0000 7f45483ff700 1 -- 172.21.15.124:0/1782081477 wait complete. 2023-10-06T04:44:28.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.398+0000 7f45483ff700 1 Processor -- start 2023-10-06T04:44:28.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.398+0000 7f45483ff700 1 -- start start 2023-10-06T04:44:28.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f45483ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45400cd380 0x7f454015ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f45483ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f454015a750 0x7f454015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f45483ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f454015c6d0 0x7f45401525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f45483ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454015efb0 con 0x7f454015c6d0 2023-10-06T04:44:28.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f45483ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454016cb30 con 0x7f454015a750 2023-10-06T04:44:28.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f45483ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454016ce10 con 0x7f45400cd380 2023-10-06T04:44:28.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f454699c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f454015c6d0 0x7f45401525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f454619b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45400cd380 0x7f454015ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f454699c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f454015c6d0 0x7f45401525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59132/0 (socket says 172.21.15.124:59132) 2023-10-06T04:44:28.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f454699c700 1 -- 172.21.15.124:0/2351870524 learned_addr learned my addr 172.21.15.124:0/2351870524 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:28.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.399+0000 7f454599a700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f454015a750 0x7f454015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f454699c700 1 -- 172.21.15.124:0/2351870524 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45400cd380 msgr2=0x7f454015ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f454699c700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45400cd380 0x7f454015ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f454699c700 1 -- 172.21.15.124:0/2351870524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f454015a750 msgr2=0x7f454015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f454699c700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f454015a750 0x7f454015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f454699c700 1 -- 172.21.15.124:0/2351870524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4538009a20 con 0x7f454015c6d0 2023-10-06T04:44:28.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f454699c700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f454015c6d0 0x7f45401525d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4540088b90 tx=0x7f4538019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:28.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f45367fc700 1 -- 172.21.15.124:0/2351870524 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538012dd0 con 0x7f454015c6d0 2023-10-06T04:44:28.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f45367fc700 1 -- 172.21.15.124:0/2351870524 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4538027470 con 0x7f454015c6d0 2023-10-06T04:44:28.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f45483ff700 1 -- 172.21.15.124:0/2351870524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454016d0f0 con 0x7f454015c6d0 2023-10-06T04:44:28.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f45367fc700 1 -- 172.21.15.124:0/2351870524 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538027830 con 0x7f454015c6d0 2023-10-06T04:44:28.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.400+0000 7f45483ff700 1 -- 172.21.15.124:0/2351870524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454016c790 con 0x7f454015c6d0 2023-10-06T04:44:28.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.401+0000 7f45483ff700 1 -- 172.21.15.124:0/2351870524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45400717a0 con 0x7f454015c6d0 2023-10-06T04:44:28.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.402+0000 7f45367fc700 1 -- 172.21.15.124:0/2351870524 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4538024070 con 0x7f454015c6d0 2023-10-06T04:44:28.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.403+0000 7f45367fc700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4524066f30 0x7f45240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.403+0000 7f45367fc700 1 -- 172.21.15.124:0/2351870524 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4538087130 con 0x7f454015c6d0 2023-10-06T04:44:28.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.403+0000 7f454619b700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4524066f30 0x7f45240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.404+0000 7f454619b700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4524066f30 0x7f45240693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f453c007fd0 tx=0x7f453c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:28.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.407+0000 7f45367fc700 1 -- 172.21.15.124:0/2351870524 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45380541a0 con 0x7f454015c6d0 2023-10-06T04:44:28.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.596+0000 7f45483ff700 1 -- 172.21.15.124:0/2351870524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45400cbc30 con 0x7f454015c6d0 2023-10-06T04:44:28.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.597+0000 7f45367fc700 1 -- 172.21.15.124:0/2351870524 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17023 (secure 0 0 0) 0x7f45380577c0 con 0x7f454015c6d0 2023-10-06T04:44:28.599 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:28.599 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":21,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:27.634964+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:28.601 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:44:28.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 -- 172.21.15.124:0/2351870524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4524066f30 msgr2=0x7f45240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4524066f30 0x7f45240693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f453c007fd0 tx=0x7f453c009040 comp rx=0 tx=0).stop 2023-10-06T04:44:28.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 -- 172.21.15.124:0/2351870524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f454015c6d0 msgr2=0x7f45401525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f454015c6d0 0x7f45401525d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4540088b90 tx=0x7f4538019000 comp rx=0 tx=0).stop 2023-10-06T04:44:28.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 -- 172.21.15.124:0/2351870524 shutdown_connections 2023-10-06T04:44:28.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f454015c6d0 0x7f45401525d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4524066f30 0x7f45240693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45400cd380 0x7f454015ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 --2- 172.21.15.124:0/2351870524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f454015a750 0x7f454015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 -- 172.21.15.124:0/2351870524 >> 172.21.15.124:0/2351870524 conn(0x7f4540099710 msgr2=0x7f45400ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:28.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 -- 172.21.15.124:0/2351870524 shutdown_connections 2023-10-06T04:44:28.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.600+0000 7f45483ff700 1 -- 172.21.15.124:0/2351870524 wait complete. 2023-10-06T04:44:28.607 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:44:28.619 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:28.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.848+0000 7f618a3ff700 1 Processor -- start 2023-10-06T04:44:28.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.848+0000 7f618a3ff700 1 -- start start 2023-10-06T04:44:28.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.849+0000 7f618a3ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f61841573e0 0x7f61841577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.849+0000 7f618a3ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f61840a6c60 0x7f6184069a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.849+0000 7f618a3ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61840ab910 con 0x7f6184069fb0 2023-10-06T04:44:28.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.849+0000 7f618a3ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61840abbf0 con 0x7f61840a6c60 2023-10-06T04:44:28.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.849+0000 7f618a3ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618406a4a0 con 0x7f61841573e0 2023-10-06T04:44:28.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.850+0000 7f61837fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f61840a6c60 0x7f6184069a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.850+0000 7f61837fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f61840a6c60 0x7f6184069a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59136/0 (socket says 172.21.15.124:59136) 2023-10-06T04:44:28.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.850+0000 7f61837fe700 1 -- 172.21.15.124:0/2500474613 learned_addr learned my addr 172.21.15.124:0/2500474613 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:28.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.850+0000 7f6183fff700 1 --2- 172.21.15.124:0/2500474613 >> v2:172.21.15.158:3300/0 conn(0x7f61841573e0 0x7f61841577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.850+0000 7f61837fe700 1 -- 172.21.15.124:0/2500474613 >> v2:172.21.15.158:3300/0 conn(0x7f61841573e0 msgr2=0x7f61841577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:28.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.850+0000 7f61837fe700 1 --2- 172.21.15.124:0/2500474613 >> v2:172.21.15.158:3300/0 conn(0x7f61841573e0 0x7f61841577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.850+0000 7f61837fe700 1 -- 172.21.15.124:0/2500474613 >> v1:172.21.15.158:6789/0 conn(0x7f6184069fb0 legacy=0x7f61840ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.850+0000 7f61837fe700 1 -- 172.21.15.124:0/2500474613 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618406a780 con 0x7f61840a6c60 2023-10-06T04:44:28.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.850+0000 7f61837fe700 1 --2- 172.21.15.124:0/2500474613 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61840a6c60 0x7f6184069a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6184071270 tx=0x7f6178009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ec30f96b57e3c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:28.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.850+0000 7f6182ffd700 1 -- 172.21.15.124:0/2500474613 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617800b860 con 0x7f61840a6c60 2023-10-06T04:44:28.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.851+0000 7f6182ffd700 1 -- 172.21.15.124:0/2500474613 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617800b9c0 con 0x7f61840a6c60 2023-10-06T04:44:28.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.851+0000 7f6182ffd700 1 -- 172.21.15.124:0/2500474613 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617800bd60 con 0x7f61840a6c60 2023-10-06T04:44:28.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.851+0000 7f618a3ff700 1 -- 172.21.15.124:0/2500474613 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61840a6c60 msgr2=0x7f6184069a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.851+0000 7f618a3ff700 1 --2- 172.21.15.124:0/2500474613 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61840a6c60 0x7f6184069a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6184071270 tx=0x7f6178009250 comp rx=0 tx=0).stop 2023-10-06T04:44:28.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.851+0000 7f618a3ff700 1 -- 172.21.15.124:0/2500474613 shutdown_connections 2023-10-06T04:44:28.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.851+0000 7f618a3ff700 1 --2- 172.21.15.124:0/2500474613 >> v2:172.21.15.158:3300/0 conn(0x7f61841573e0 0x7f61841577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.851+0000 7f618a3ff700 1 --2- 172.21.15.124:0/2500474613 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61840a6c60 0x7f6184069a70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.851+0000 7f618a3ff700 1 -- 172.21.15.124:0/2500474613 >> 172.21.15.124:0/2500474613 conn(0x7f61840cc050 msgr2=0x7f61840cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:28.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.851+0000 7f618a3ff700 1 -- 172.21.15.124:0/2500474613 shutdown_connections 2023-10-06T04:44:28.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.851+0000 7f618a3ff700 1 -- 172.21.15.124:0/2500474613 wait complete. 2023-10-06T04:44:28.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.853+0000 7f618a3ff700 1 Processor -- start 2023-10-06T04:44:28.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.853+0000 7f618a3ff700 1 -- start start 2023-10-06T04:44:28.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f618a3ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6184069fb0 0x7f6184169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f618a3ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61841573e0 0x7f61840a7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f618a3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61840a7580 0x7f618406d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f618a3ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61840a7a20 con 0x7f6184069fb0 2023-10-06T04:44:28.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f618a3ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61840a8f50 con 0x7f61841573e0 2023-10-06T04:44:28.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f618a3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618416a3b0 con 0x7f61840a7580 2023-10-06T04:44:28.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f6183fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6184069fb0 0x7f6184169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f6183fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6184069fb0 0x7f6184169e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59140/0 (socket says 172.21.15.124:59140) 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f6183fff700 1 -- 172.21.15.124:0/2758888309 learned_addr learned my addr 172.21.15.124:0/2758888309 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f61837fe700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61841573e0 0x7f61840a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f618899c700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61840a7580 0x7f618406d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f6183fff700 1 -- 172.21.15.124:0/2758888309 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61840a7580 msgr2=0x7f618406d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f6183fff700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61840a7580 0x7f618406d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f6183fff700 1 -- 172.21.15.124:0/2758888309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61841573e0 msgr2=0x7f61840a7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f6183fff700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61841573e0 0x7f61840a7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f6183fff700 1 -- 172.21.15.124:0/2758888309 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61780094f0 con 0x7f6184069fb0 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f61837fe700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61841573e0 0x7f61840a7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:28.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.855+0000 7f6183fff700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6184069fb0 0x7f6184169e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f617400d860 tx=0x7f6174008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.856+0000 7f616bfff700 1 -- 172.21.15.124:0/2758888309 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174009610 con 0x7f6184069fb0 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.856+0000 7f616bfff700 1 -- 172.21.15.124:0/2758888309 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6174009770 con 0x7f6184069fb0 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.856+0000 7f618a3ff700 1 -- 172.21.15.124:0/2758888309 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618406e1a0 con 0x7f6184069fb0 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.856+0000 7f616bfff700 1 -- 172.21.15.124:0/2758888309 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174009b30 con 0x7f6184069fb0 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.856+0000 7f618a3ff700 1 -- 172.21.15.124:0/2758888309 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618406e760 con 0x7f6184069fb0 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.857+0000 7f618a3ff700 1 -- 172.21.15.124:0/2758888309 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61840717a0 con 0x7f6184069fb0 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.858+0000 7f616bfff700 1 -- 172.21.15.124:0/2758888309 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f617401e460 con 0x7f6184069fb0 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.858+0000 7f616bfff700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6170066f30 0x7f61700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.858+0000 7f616bfff700 1 -- 172.21.15.124:0/2758888309 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6174084cf0 con 0x7f6184069fb0 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.859+0000 7f61837fe700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6170066f30 0x7f61700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.859+0000 7f61837fe700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6170066f30 0x7f61700693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6184071270 tx=0x7f6178017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:28.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:28.862+0000 7f616bfff700 1 -- 172.21.15.124:0/2758888309 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6174089070 con 0x7f6184069fb0 2023-10-06T04:44:29.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.056+0000 7f618a3ff700 1 -- 172.21.15.124:0/2758888309 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f618406ae20 con 0x7f6184069fb0 2023-10-06T04:44:29.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.057+0000 7f616bfff700 1 -- 172.21.15.124:0/2758888309 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17023 (secure 0 0 0) 0x7f6174051e00 con 0x7f6184069fb0 2023-10-06T04:44:29.059 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:29.059 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":21,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:27.634964+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:29.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 -- 172.21.15.124:0/2758888309 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6170066f30 msgr2=0x7f61700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6170066f30 0x7f61700693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6184071270 tx=0x7f6178017000 comp rx=0 tx=0).stop 2023-10-06T04:44:29.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 -- 172.21.15.124:0/2758888309 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6184069fb0 msgr2=0x7f6184169e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6184069fb0 0x7f6184169e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f617400d860 tx=0x7f6174008040 comp rx=0 tx=0).stop 2023-10-06T04:44:29.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 -- 172.21.15.124:0/2758888309 shutdown_connections 2023-10-06T04:44:29.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6170066f30 0x7f61700693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61840a7580 0x7f618406d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6184069fb0 0x7f6184169e70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 --2- 172.21.15.124:0/2758888309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61841573e0 0x7f61840a7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 -- 172.21.15.124:0/2758888309 >> 172.21.15.124:0/2758888309 conn(0x7f61840cc050 msgr2=0x7f61840aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:29.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.059+0000 7f618a3ff700 1 -- 172.21.15.124:0/2758888309 shutdown_connections 2023-10-06T04:44:29.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.060+0000 7f618a3ff700 1 -- 172.21.15.124:0/2758888309 wait complete. 2023-10-06T04:44:29.078 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:44:29.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.273+0000 7f5991bff700 1 Processor -- start 2023-10-06T04:44:29.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.273+0000 7f5991bff700 1 -- start start 2023-10-06T04:44:29.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.274+0000 7f5991bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c157700 0x7f598c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.274+0000 7f5991bff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f598c06a3d0 0x7f598c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.275+0000 7f5991bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c157ad0 con 0x7f598c0694c0 2023-10-06T04:44:29.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.275+0000 7f5991bff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c06db30 con 0x7f598c06a3d0 2023-10-06T04:44:29.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.275+0000 7f5991bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c06de10 con 0x7f598c157700 2023-10-06T04:44:29.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.275+0000 7f598affd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f598c06a3d0 0x7f598c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.275+0000 7f598b7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c157700 0x7f598c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.275+0000 7f598b7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c157700 0x7f598c06d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:51094/0 (socket says 172.21.15.124:51094) 2023-10-06T04:44:29.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.275+0000 7f598b7fe700 1 -- 172.21.15.124:0/1229338637 learned_addr learned my addr 172.21.15.124:0/1229338637 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:29.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.275+0000 7f598affd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f598c06a3d0 0x7f598c0aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:51378/0 (socket says 172.21.15.124:51378) 2023-10-06T04:44:29.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.276+0000 7f598affd700 1 -- 172.21.15.124:0/1229338637 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c157700 msgr2=0x7f598c06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:29.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.276+0000 7f598affd700 1 --2- 172.21.15.124:0/1229338637 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c157700 0x7f598c06d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.276+0000 7f598affd700 1 -- 172.21.15.124:0/1229338637 >> v1:172.21.15.158:6789/0 conn(0x7f598c0694c0 legacy=0x7f598c06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.276+0000 7f598affd700 1 -- 172.21.15.124:0/1229338637 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c06e0f0 con 0x7f598c06a3d0 2023-10-06T04:44:29.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.276+0000 7f598a7fc700 1 -- 172.21.15.124:0/1229338637 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847585069 0 0) 0x7f598c157ad0 con 0x7f598c0694c0 2023-10-06T04:44:29.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.276+0000 7f598affd700 1 --2- 172.21.15.124:0/1229338637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f598c06a3d0 0x7f598c0aede0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59800098e0 tx=0x7f59800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27da4f6dbbc0aa54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:29.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.276+0000 7f598a7fc700 1 -- 172.21.15.124:0/1229338637 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598000b640 con 0x7f598c06a3d0 2023-10-06T04:44:29.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.276+0000 7f598a7fc700 1 -- 172.21.15.124:0/1229338637 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598000b7a0 con 0x7f598c06a3d0 2023-10-06T04:44:29.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.276+0000 7f598a7fc700 1 -- 172.21.15.124:0/1229338637 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598000bb40 con 0x7f598c06a3d0 2023-10-06T04:44:29.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.277+0000 7f5991bff700 1 -- 172.21.15.124:0/1229338637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f598c06a3d0 msgr2=0x7f598c0aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.277+0000 7f5991bff700 1 --2- 172.21.15.124:0/1229338637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f598c06a3d0 0x7f598c0aede0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59800098e0 tx=0x7f59800091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.277+0000 7f5991bff700 1 -- 172.21.15.124:0/1229338637 shutdown_connections 2023-10-06T04:44:29.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.277+0000 7f5991bff700 1 --2- 172.21.15.124:0/1229338637 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c157700 0x7f598c06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.277+0000 7f5991bff700 1 --2- 172.21.15.124:0/1229338637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f598c06a3d0 0x7f598c0aede0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.277+0000 7f5991bff700 1 -- 172.21.15.124:0/1229338637 >> 172.21.15.124:0/1229338637 conn(0x7f598c0680c0 msgr2=0x7f598c0cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:29.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.277+0000 7f5991bff700 1 -- 172.21.15.124:0/1229338637 shutdown_connections 2023-10-06T04:44:29.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.277+0000 7f5991bff700 1 -- 172.21.15.124:0/1229338637 wait complete. 2023-10-06T04:44:29.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.278+0000 7f5991bff700 1 Processor -- start 2023-10-06T04:44:29.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.278+0000 7f5991bff700 1 -- start start 2023-10-06T04:44:29.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.279+0000 7f5991bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0694c0 0x7f598c1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.279+0000 7f5991bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c06a3d0 0x7f598c158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.279+0000 7f5991bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f598c157700 0x7f598c158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.279+0000 7f5991bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0b0a60 con 0x7f598c0694c0 2023-10-06T04:44:29.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.279+0000 7f5991bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0afe50 con 0x7f598c157700 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.279+0000 7f5991bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0b0130 con 0x7f598c06a3d0 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.279+0000 7f598b7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0694c0 0x7f598c1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f598b7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0694c0 0x7f598c1536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59146/0 (socket says 172.21.15.124:59146) 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f598b7fe700 1 -- 172.21.15.124:0/3453047931 learned_addr learned my addr 172.21.15.124:0/3453047931 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f598affd700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c06a3d0 0x7f598c158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f598bfff700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f598c157700 0x7f598c158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f598b7fe700 1 -- 172.21.15.124:0/3453047931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c06a3d0 msgr2=0x7f598c158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f598b7fe700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c06a3d0 0x7f598c158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f598b7fe700 1 -- 172.21.15.124:0/3453047931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f598c157700 msgr2=0x7f598c158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f598b7fe700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f598c157700 0x7f598c158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f598b7fe700 1 -- 172.21.15.124:0/3453047931 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980009420 con 0x7f598c0694c0 2023-10-06T04:44:29.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f598b7fe700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0694c0 0x7f598c1536c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f597c00e980 tx=0x7f597c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:29.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f59737fe700 1 -- 172.21.15.124:0/3453047931 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c013680 con 0x7f598c0694c0 2023-10-06T04:44:29.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f59737fe700 1 -- 172.21.15.124:0/3453047931 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c0137e0 con 0x7f598c0694c0 2023-10-06T04:44:29.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f59737fe700 1 -- 172.21.15.124:0/3453047931 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c013b60 con 0x7f598c0694c0 2023-10-06T04:44:29.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.280+0000 7f5991bff700 1 -- 172.21.15.124:0/3453047931 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598c0b0410 con 0x7f598c0694c0 2023-10-06T04:44:29.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.281+0000 7f5991bff700 1 -- 172.21.15.124:0/3453047931 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c0aa530 con 0x7f598c0694c0 2023-10-06T04:44:29.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.281+0000 7f5991bff700 1 -- 172.21.15.124:0/3453047931 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598c064850 con 0x7f598c0694c0 2023-10-06T04:44:29.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.282+0000 7f59737fe700 1 -- 172.21.15.124:0/3453047931 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f597c00c400 con 0x7f598c0694c0 2023-10-06T04:44:29.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.283+0000 7f59737fe700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.283+0000 7f59737fe700 1 -- 172.21.15.124:0/3453047931 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f597c084820 con 0x7f598c0694c0 2023-10-06T04:44:29.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.283+0000 7f598affd700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.284+0000 7f598affd700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5978066f30 0x7f59780693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59800093f0 tx=0x7f5980017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:29.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.287+0000 7f59737fe700 1 -- 172.21.15.124:0/3453047931 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f597c055320 con 0x7f598c0694c0 2023-10-06T04:44:29.524 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:29.523+0000 7f5991bff700 1 -- 172.21.15.124:0/3453047931 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f598c04c380 con 0x7f598c0694c0 2023-10-06T04:44:30.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.180+0000 7f59737fe700 1 -- 172.21.15.124:0/3453047931 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f597c054eb0 con 0x7f598c0694c0 2023-10-06T04:44:30.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 -- 172.21.15.124:0/3453047931 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5978066f30 msgr2=0x7f59780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5978066f30 0x7f59780693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59800093f0 tx=0x7f5980017000 comp rx=0 tx=0).stop 2023-10-06T04:44:30.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 -- 172.21.15.124:0/3453047931 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0694c0 msgr2=0x7f598c1536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0694c0 0x7f598c1536c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f597c00e980 tx=0x7f597c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:30.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 -- 172.21.15.124:0/3453047931 shutdown_connections 2023-10-06T04:44:30.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f598c157700 0x7f598c158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0694c0 0x7f598c1536c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 --2- 172.21.15.124:0/3453047931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598c06a3d0 0x7f598c158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 -- 172.21.15.124:0/3453047931 >> 172.21.15.124:0/3453047931 conn(0x7f598c0680c0 msgr2=0x7f598c1553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:30.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 -- 172.21.15.124:0/3453047931 shutdown_connections 2023-10-06T04:44:30.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.183+0000 7f5991bff700 1 -- 172.21.15.124:0/3453047931 wait complete. 2023-10-06T04:44:30.203 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:44:30.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.393+0000 7fe929bff700 1 Processor -- start 2023-10-06T04:44:30.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.393+0000 7fe929bff700 1 -- start start 2023-10-06T04:44:30.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.394+0000 7fe929bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9241592b0 0x7fe9240b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.394+0000 7fe929bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe9240cc780 0x7fe9240ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.394+0000 7fe929bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92415d620 con 0x7fe924159680 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.394+0000 7fe929bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92415d0d0 con 0x7fe9240cc780 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.394+0000 7fe929bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240b2ed0 con 0x7fe9241592b0 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.395+0000 7fe923fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe9240cc780 0x7fe9240ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.395+0000 7fe923fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe9240cc780 0x7fe9240ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59152/0 (socket says 172.21.15.124:59152) 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.395+0000 7fe923fff700 1 -- 172.21.15.124:0/1555695435 learned_addr learned my addr 172.21.15.124:0/1555695435 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.395+0000 7fe9237fe700 1 --2- 172.21.15.124:0/1555695435 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9241592b0 0x7fe9240b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.395+0000 7fe923fff700 1 -- 172.21.15.124:0/1555695435 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9241592b0 msgr2=0x7fe9240b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.395+0000 7fe923fff700 1 --2- 172.21.15.124:0/1555695435 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9241592b0 0x7fe9240b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.395+0000 7fe923fff700 1 -- 172.21.15.124:0/1555695435 >> v1:172.21.15.158:6789/0 conn(0x7fe924159680 legacy=0x7fe92415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.395+0000 7fe923fff700 1 -- 172.21.15.124:0/1555695435 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9240ccc20 con 0x7fe9240cc780 2023-10-06T04:44:30.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.395+0000 7fe923fff700 1 --2- 172.21.15.124:0/1555695435 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 0x7fe9240ccea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009f20 tx=0x7fe91c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e41c9ecc98bfde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:30.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe9227fc700 1 -- 172.21.15.124:0/1555695435 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00e070 con 0x7fe9240cc780 2023-10-06T04:44:30.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe9227fc700 1 -- 172.21.15.124:0/1555695435 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c00ba80 con 0x7fe9240cc780 2023-10-06T04:44:30.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe9227fc700 1 -- 172.21.15.124:0/1555695435 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0092e0 con 0x7fe9240cc780 2023-10-06T04:44:30.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe929bff700 1 -- 172.21.15.124:0/1555695435 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 msgr2=0x7fe9240ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe929bff700 1 --2- 172.21.15.124:0/1555695435 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 0x7fe9240ccea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009f20 tx=0x7fe91c009840 comp rx=0 tx=0).stop 2023-10-06T04:44:30.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe929bff700 1 -- 172.21.15.124:0/1555695435 shutdown_connections 2023-10-06T04:44:30.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe929bff700 1 --2- 172.21.15.124:0/1555695435 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 0x7fe9240ccea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe929bff700 1 --2- 172.21.15.124:0/1555695435 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9241592b0 0x7fe9240b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe929bff700 1 -- 172.21.15.124:0/1555695435 >> 172.21.15.124:0/1555695435 conn(0x7fe92406ed20 msgr2=0x7fe92406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:30.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe929bff700 1 -- 172.21.15.124:0/1555695435 shutdown_connections 2023-10-06T04:44:30.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.396+0000 7fe929bff700 1 -- 172.21.15.124:0/1555695435 wait complete. 2023-10-06T04:44:30.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.398+0000 7fe929bff700 1 Processor -- start 2023-10-06T04:44:30.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.398+0000 7fe929bff700 1 -- start start 2023-10-06T04:44:30.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe929bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 0x7fe924152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe929bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9241592b0 0x7fe9240c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe929bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe924159680 0x7fe9240d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe929bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92415b8d0 con 0x7fe9240cc780 2023-10-06T04:44:30.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe929bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240c79f0 con 0x7fe9241592b0 2023-10-06T04:44:30.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe929bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240d0ec0 con 0x7fe924159680 2023-10-06T04:44:30.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe9237fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 0x7fe924152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe9237fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 0x7fe924152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59160/0 (socket says 172.21.15.124:59160) 2023-10-06T04:44:30.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe9237fe700 1 -- 172.21.15.124:0/361130113 learned_addr learned my addr 172.21.15.124:0/361130113 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:30.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe922ffd700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9241592b0 0x7fe9240c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe923fff700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe924159680 0x7fe9240d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe9237fe700 1 -- 172.21.15.124:0/361130113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe924159680 msgr2=0x7fe9240d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe9237fe700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe924159680 0x7fe9240d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe9237fe700 1 -- 172.21.15.124:0/361130113 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9241592b0 msgr2=0x7fe9240c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe9237fe700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9241592b0 0x7fe9240c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe9237fe700 1 -- 172.21.15.124:0/361130113 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c009ae0 con 0x7fe9240cc780 2023-10-06T04:44:30.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe922ffd700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9241592b0 0x7fe9240c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:30.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.399+0000 7fe923fff700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe924159680 0x7fe9240d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:30.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.400+0000 7fe9237fe700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 0x7fe924152730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe91400d8c0 tx=0x7fe914008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:30.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.400+0000 7fe90b7fe700 1 -- 172.21.15.124:0/361130113 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91400de60 con 0x7fe9240cc780 2023-10-06T04:44:30.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.400+0000 7fe90b7fe700 1 -- 172.21.15.124:0/361130113 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91400b780 con 0x7fe9240cc780 2023-10-06T04:44:30.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.400+0000 7fe929bff700 1 -- 172.21.15.124:0/361130113 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92415afa0 con 0x7fe9240cc780 2023-10-06T04:44:30.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.400+0000 7fe90b7fe700 1 -- 172.21.15.124:0/361130113 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91400bb20 con 0x7fe9240cc780 2023-10-06T04:44:30.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.400+0000 7fe929bff700 1 -- 172.21.15.124:0/361130113 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92415b560 con 0x7fe9240cc780 2023-10-06T04:44:30.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.401+0000 7fe929bff700 1 -- 172.21.15.124:0/361130113 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92415bbb0 con 0x7fe9240cc780 2023-10-06T04:44:30.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.402+0000 7fe90b7fe700 1 -- 172.21.15.124:0/361130113 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe91401e460 con 0x7fe9240cc780 2023-10-06T04:44:30.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.402+0000 7fe90b7fe700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe910066f30 0x7fe9100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.403+0000 7fe90b7fe700 1 -- 172.21.15.124:0/361130113 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe914084de0 con 0x7fe9240cc780 2023-10-06T04:44:30.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.403+0000 7fe922ffd700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe910066f30 0x7fe9100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.403+0000 7fe922ffd700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe910066f30 0x7fe9100693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9240ce1f0 tx=0x7fe918009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:30.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.407+0000 7fe90b7fe700 1 -- 172.21.15.124:0/361130113 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe914051e50 con 0x7fe9240cc780 2023-10-06T04:44:30.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:30.639+0000 7fe929bff700 1 -- 172.21.15.124:0/361130113 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe92404c380 con 0x7fe9240cc780 2023-10-06T04:44:31.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.184+0000 7fe90b7fe700 1 -- 172.21.15.124:0/361130113 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe914055470 con 0x7fe9240cc780 2023-10-06T04:44:31.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 -- 172.21.15.124:0/361130113 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe910066f30 msgr2=0x7fe9100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe910066f30 0x7fe9100693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9240ce1f0 tx=0x7fe918009040 comp rx=0 tx=0).stop 2023-10-06T04:44:31.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 -- 172.21.15.124:0/361130113 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 msgr2=0x7fe924152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 0x7fe924152730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe91400d8c0 tx=0x7fe914008040 comp rx=0 tx=0).stop 2023-10-06T04:44:31.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 -- 172.21.15.124:0/361130113 shutdown_connections 2023-10-06T04:44:31.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe910066f30 0x7fe9100693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe924159680 0x7fe9240d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9240cc780 0x7fe924152730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 --2- 172.21.15.124:0/361130113 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9241592b0 0x7fe9240c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 -- 172.21.15.124:0/361130113 >> 172.21.15.124:0/361130113 conn(0x7fe92406ed20 msgr2=0x7fe9240b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:31.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 -- 172.21.15.124:0/361130113 shutdown_connections 2023-10-06T04:44:31.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.187+0000 7fe929bff700 1 -- 172.21.15.124:0/361130113 wait complete. 2023-10-06T04:44:31.207 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:31.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.395+0000 7f15b23ff700 1 Processor -- start 2023-10-06T04:44:31.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.395+0000 7f15b23ff700 1 -- start start 2023-10-06T04:44:31.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.396+0000 7f15b23ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f15ac0ccbb0 0x7f15ac0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15b23ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0cf6b0 con 0x7f15ac0ce450 2023-10-06T04:44:31.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15b23ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0ceaa0 con 0x7f15ac0cdfe0 2023-10-06T04:44:31.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15b23ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac0ce8b0 con 0x7f15ac0ccbb0 2023-10-06T04:44:31.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15b099c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f15ac0ce450 0x7f15ac0ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:46552/0 (socket says 172.21.15.124:46552) 2023-10-06T04:44:31.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15b099c700 1 -- 172.21.15.124:0/2822701819 learned_addr learned my addr 172.21.15.124:0/2822701819 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:31.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15abfff700 1 --2- 172.21.15.124:0/2822701819 >> v2:172.21.15.158:3300/0 conn(0x7f15ac0ccbb0 0x7f15ac0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577435787 0 0) 0x7f15ac0cf6b0 con 0x7f15ac0ce450 2023-10-06T04:44:31.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1594003570 con 0x7f15ac0ce450 2023-10-06T04:44:31.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559439852 0 0) 0x7f1594003570 con 0x7f15ac0ce450 2023-10-06T04:44:31.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 >> v2:172.21.15.158:3300/0 conn(0x7f15ac0ccbb0 msgr2=0x7f15ac0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:31.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15aaffd700 1 --2- 172.21.15.124:0/2822701819 >> v2:172.21.15.158:3300/0 conn(0x7f15ac0ccbb0 0x7f15ac0cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 >> v1:172.21.15.158:6789/0 conn(0x7f15ac0cdfe0 legacy=0x7f15ac0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.397+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0ced80 con 0x7f15ac0ce450 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f15a40017f0 con 0x7f15ac0ce450 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 >> v1:172.21.15.124:6789/0 conn(0x7f15ac0ce450 legacy=0x7f15ac0ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15aaffd700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1594003a60 0x7f1594003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15aaffd700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f1594004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15aaffd700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15940051c0 0x7f159400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159400c0a0 con 0x7f1594004810 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159400c210 con 0x7f15940051c0 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159400c3d0 con 0x7f1594003a60 2023-10-06T04:44:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15ab7fe700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f1594004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15abfff700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1594003a60 0x7f1594003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15b099c700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15940051c0 0x7f159400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15ab7fe700 1 -- 172.21.15.124:0/2822701819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1594003a60 msgr2=0x7f1594003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15ab7fe700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1594003a60 0x7f1594003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15ab7fe700 1 -- 172.21.15.124:0/2822701819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15940051c0 msgr2=0x7f159400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15ab7fe700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15940051c0 0x7f159400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15ab7fe700 1 -- 172.21.15.124:0/2822701819 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1594003570 con 0x7f1594004810 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15b099c700 1 -- 172.21.15.124:0/2822701819 reap_dead start 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.398+0000 7f15ab7fe700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f1594004c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15a00018b0 tx=0x7f15a0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78328da49d19e296 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.399+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0012420 con 0x7f1594004810 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.399+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a00125a0 con 0x7f1594004810 2023-10-06T04:44:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.399+0000 7f15aaffd700 1 -- 172.21.15.124:0/2822701819 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0012960 con 0x7f1594004810 2023-10-06T04:44:31.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.399+0000 7f15b23ff700 1 -- 172.21.15.124:0/2822701819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 msgr2=0x7f1594004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.399+0000 7f15b23ff700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f1594004c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15a00018b0 tx=0x7f15a0007d30 comp rx=0 tx=0).stop 2023-10-06T04:44:31.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.399+0000 7f15b23ff700 1 -- 172.21.15.124:0/2822701819 shutdown_connections 2023-10-06T04:44:31.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.399+0000 7f15b23ff700 1 --2- 172.21.15.124:0/2822701819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f1594004c80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.399+0000 7f15b23ff700 1 -- 172.21.15.124:0/2822701819 >> 172.21.15.124:0/2822701819 conn(0x7f15ac099710 msgr2=0x7f15ac06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:31.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.399+0000 7f15b23ff700 1 -- 172.21.15.124:0/2822701819 shutdown_connections 2023-10-06T04:44:31.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.399+0000 7f15b23ff700 1 -- 172.21.15.124:0/2822701819 wait complete. 2023-10-06T04:44:31.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.401+0000 7f15b23ff700 1 Processor -- start 2023-10-06T04:44:31.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.402+0000 7f15b23ff700 1 -- start start 2023-10-06T04:44:31.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15b23ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f15ac0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15b23ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15ac0c7e00 0x7f15ac153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15b23ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15ac1536d0 0x7f15ac158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15b23ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac16ae60 con 0x7f1594004810 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15b23ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac16b140 con 0x7f15ac0c7e00 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15b23ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac157a00 con 0x7f15ac1536d0 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15abfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f15ac0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15abfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f15ac0c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59166/0 (socket says 172.21.15.124:59166) 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15abfff700 1 -- 172.21.15.124:0/679283895 learned_addr learned my addr 172.21.15.124:0/679283895 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15b099c700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15ac1536d0 0x7f15ac158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15abfff700 1 -- 172.21.15.124:0/679283895 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15ac1536d0 msgr2=0x7f15ac158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15abfff700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15ac1536d0 0x7f15ac158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15abfff700 1 -- 172.21.15.124:0/679283895 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15ac0c7e00 msgr2=0x7f15ac153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15abfff700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15ac0c7e00 0x7f15ac153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15abfff700 1 -- 172.21.15.124:0/679283895 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac157ce0 con 0x7f1594004810 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.403+0000 7f15b099c700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15ac1536d0 0x7f15ac158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.404+0000 7f15abfff700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f15ac0c5f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f159c011a10 tx=0x7f159c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.404+0000 7f1593fff700 1 -- 172.21.15.124:0/679283895 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00f940 con 0x7f1594004810 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.404+0000 7f1593fff700 1 -- 172.21.15.124:0/679283895 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c00faa0 con 0x7f1594004810 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.404+0000 7f15b23ff700 1 -- 172.21.15.124:0/679283895 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac1576d0 con 0x7f1594004810 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.404+0000 7f1593fff700 1 -- 172.21.15.124:0/679283895 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00fe20 con 0x7f1594004810 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.404+0000 7f15b23ff700 1 -- 172.21.15.124:0/679283895 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac16aab0 con 0x7f1594004810 2023-10-06T04:44:31.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.405+0000 7f15b23ff700 1 -- 172.21.15.124:0/679283895 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac157ed0 con 0x7f1594004810 2023-10-06T04:44:31.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.406+0000 7f1593fff700 1 -- 172.21.15.124:0/679283895 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f159c014650 con 0x7f1594004810 2023-10-06T04:44:31.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.406+0000 7f1593fff700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1598066f60 0x7f1598069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.407+0000 7f1593fff700 1 -- 172.21.15.124:0/679283895 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f159c018030 con 0x7f1594004810 2023-10-06T04:44:31.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.407+0000 7f15ab7fe700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1598066f60 0x7f1598069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.407+0000 7f15ab7fe700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1598066f60 0x7f1598069410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0b6120 tx=0x7f15a0015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.410+0000 7f1593fff700 1 -- 172.21.15.124:0/679283895 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f159c0521c0 con 0x7f1594004810 2023-10-06T04:44:31.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.645+0000 7f15b23ff700 1 -- 172.21.15.124:0/679283895 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15ac0717a0 con 0x7f1594004810 2023-10-06T04:44:31.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.646+0000 7f1593fff700 1 -- 172.21.15.124:0/679283895 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f159c022090 con 0x7f1594004810 2023-10-06T04:44:31.647 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:31.647 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/3828511424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":3828511424},{"type":"v1","addr":"172.21.15.124:6836","nonce":3828511424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/1252041103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1252041103},{"type":"v1","addr":"172.21.15.158:6834","nonce":1252041103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/978440229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":978440229},{"type":"v1","addr":"172.21.15.124:6837","nonce":978440229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:27.635332+0000","modified":"2023-10-06T04:44:31.182630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6835/1693475602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":1693475602},{"type":"v1","addr":"172.21.15.158:6835","nonce":1693475602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:44:31.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 -- 172.21.15.124:0/679283895 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1598066f60 msgr2=0x7f1598069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1598066f60 0x7f1598069410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0b6120 tx=0x7f15a0015000 comp rx=0 tx=0).stop 2023-10-06T04:44:31.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 -- 172.21.15.124:0/679283895 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 msgr2=0x7f15ac0c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f15ac0c5f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f159c011a10 tx=0x7f159c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 -- 172.21.15.124:0/679283895 shutdown_connections 2023-10-06T04:44:31.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1598066f60 0x7f1598069410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15ac1536d0 0x7f15ac158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1594004810 0x7f15ac0c5f20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 --2- 172.21.15.124:0/679283895 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15ac0c7e00 0x7f15ac153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 -- 172.21.15.124:0/679283895 >> 172.21.15.124:0/679283895 conn(0x7f15ac099710 msgr2=0x7f15ac0aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:31.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 -- 172.21.15.124:0/679283895 shutdown_connections 2023-10-06T04:44:31.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.648+0000 7f15b23ff700 1 -- 172.21.15.124:0/679283895 wait complete. 2023-10-06T04:44:31.651 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2023-10-06T04:44:31.667 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:31.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.855+0000 7f9f9cfff700 1 Processor -- start 2023-10-06T04:44:31.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.855+0000 7f9f9cfff700 1 -- start start 2023-10-06T04:44:31.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f9cfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9f980cb250 0x7f9f981591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f9cfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f98159710 0x7f9f980afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f9cfff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f98159b90 con 0x7f9f980cae80 2023-10-06T04:44:31.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f9cfff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f980cd430 con 0x7f9f980cb250 2023-10-06T04:44:31.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f9cfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980c1d10 con 0x7f9f98159710 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f95d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9f980cb250 0x7f9f981591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f95d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9f980cb250 0x7f9f981591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59178/0 (socket says 172.21.15.124:59178) 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f95d9b700 1 -- 172.21.15.124:0/2970290305 learned_addr learned my addr 172.21.15.124:0/2970290305 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f96d9d700 1 --2- 172.21.15.124:0/2970290305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f98159710 0x7f9f980afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f95d9b700 1 -- 172.21.15.124:0/2970290305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f98159710 msgr2=0x7f9f980afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f95d9b700 1 --2- 172.21.15.124:0/2970290305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f98159710 0x7f9f980afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f95d9b700 1 -- 172.21.15.124:0/2970290305 >> v1:172.21.15.158:6789/0 conn(0x7f9f980cae80 legacy=0x7f9f980cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.857+0000 7f9f95d9b700 1 -- 172.21.15.124:0/2970290305 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980688a0 con 0x7f9f980cb250 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.858+0000 7f9f95d9b700 1 --2- 172.21.15.124:0/2970290305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cb250 0x7f9f981591d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0099b0 tx=0x7f9f8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309d407a85740813 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.858+0000 7f9f9559a700 1 -- 172.21.15.124:0/2970290305 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c009ea0 con 0x7f9f980cb250 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.858+0000 7f9f9559a700 1 -- 172.21.15.124:0/2970290305 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c00b860 con 0x7f9f980cb250 2023-10-06T04:44:31.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.858+0000 7f9f9559a700 1 -- 172.21.15.124:0/2970290305 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c00bc00 con 0x7f9f980cb250 2023-10-06T04:44:31.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.858+0000 7f9f9cfff700 1 -- 172.21.15.124:0/2970290305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cb250 msgr2=0x7f9f981591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.858+0000 7f9f9cfff700 1 --2- 172.21.15.124:0/2970290305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cb250 0x7f9f981591d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0099b0 tx=0x7f9f8c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:31.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.859+0000 7f9f9cfff700 1 -- 172.21.15.124:0/2970290305 shutdown_connections 2023-10-06T04:44:31.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.859+0000 7f9f9cfff700 1 --2- 172.21.15.124:0/2970290305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f98159710 0x7f9f980afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.859+0000 7f9f9cfff700 1 --2- 172.21.15.124:0/2970290305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cb250 0x7f9f981591d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.859+0000 7f9f9cfff700 1 -- 172.21.15.124:0/2970290305 >> 172.21.15.124:0/2970290305 conn(0x7f9f980974f0 msgr2=0x7f9f980639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:31.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.859+0000 7f9f9cfff700 1 -- 172.21.15.124:0/2970290305 shutdown_connections 2023-10-06T04:44:31.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.859+0000 7f9f9cfff700 1 -- 172.21.15.124:0/2970290305 wait complete. 2023-10-06T04:44:31.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.860+0000 7f9f9cfff700 1 Processor -- start 2023-10-06T04:44:31.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.860+0000 7f9f9cfff700 1 -- start start 2023-10-06T04:44:31.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f9cfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cae80 0x7f9f98158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f9cfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f980cb250 0x7f9f980b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f9cfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f98159710 0x7f9f980b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f9cfff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98169570 con 0x7f9f980cae80 2023-10-06T04:44:31.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f9cfff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980b41e0 con 0x7f9f980cb250 2023-10-06T04:44:31.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f9cfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980b3940 con 0x7f9f98159710 2023-10-06T04:44:31.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f9659c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cae80 0x7f9f98158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f9659c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cae80 0x7f9f98158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59190/0 (socket says 172.21.15.124:59190) 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f9659c700 1 -- 172.21.15.124:0/550089708 learned_addr learned my addr 172.21.15.124:0/550089708 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f96d9d700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f98159710 0x7f9f980b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.861+0000 7f9f95d9b700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f980cb250 0x7f9f980b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f9659c700 1 -- 172.21.15.124:0/550089708 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f98159710 msgr2=0x7f9f980b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f9659c700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f98159710 0x7f9f980b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f9659c700 1 -- 172.21.15.124:0/550089708 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f980cb250 msgr2=0x7f9f980b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f9659c700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f980cb250 0x7f9f980b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f9659c700 1 -- 172.21.15.124:0/550089708 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0094f0 con 0x7f9f980cae80 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f9659c700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cae80 0x7f9f98158970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c590 tx=0x7f9f8800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f867fc700 1 -- 172.21.15.124:0/550089708 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88011590 con 0x7f9f980cae80 2023-10-06T04:44:31.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f867fc700 1 -- 172.21.15.124:0/550089708 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f88011710 con 0x7f9f980cae80 2023-10-06T04:44:31.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f867fc700 1 -- 172.21.15.124:0/550089708 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88011ad0 con 0x7f9f980cae80 2023-10-06T04:44:31.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f9cfff700 1 -- 172.21.15.124:0/550089708 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f980b3c20 con 0x7f9f980cae80 2023-10-06T04:44:31.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.862+0000 7f9f9cfff700 1 -- 172.21.15.124:0/550089708 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f98169750 con 0x7f9f980cae80 2023-10-06T04:44:31.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.863+0000 7f9f9cfff700 1 -- 172.21.15.124:0/550089708 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f980717a0 con 0x7f9f980cae80 2023-10-06T04:44:31.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.864+0000 7f9f867fc700 1 -- 172.21.15.124:0/550089708 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f8801b3b0 con 0x7f9f980cae80 2023-10-06T04:44:31.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.865+0000 7f9f867fc700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9f78066f30 0x7f9f780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.865+0000 7f9f867fc700 1 -- 172.21.15.124:0/550089708 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9f88083b40 con 0x7f9f980cae80 2023-10-06T04:44:31.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.865+0000 7f9f95d9b700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9f78066f30 0x7f9f780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.866+0000 7f9f95d9b700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9f78066f30 0x7f9f780693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0099b0 tx=0x7f9f8c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:31.869+0000 7f9f867fc700 1 -- 172.21.15.124:0/550089708 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f88050bb0 con 0x7f9f980cae80 2023-10-06T04:44:32.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.069+0000 7f9f9cfff700 1 -- 172.21.15.124:0/550089708 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f98068b80 con 0x7f9f980cae80 2023-10-06T04:44:32.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.070+0000 7f9f867fc700 1 -- 172.21.15.124:0/550089708 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f9f88017070 con 0x7f9f980cae80 2023-10-06T04:44:32.072 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:32.072 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:32.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 -- 172.21.15.124:0/550089708 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9f78066f30 msgr2=0x7f9f780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9f78066f30 0x7f9f780693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0099b0 tx=0x7f9f8c017000 comp rx=0 tx=0).stop 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 -- 172.21.15.124:0/550089708 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cae80 msgr2=0x7f9f98158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cae80 0x7f9f98158970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c590 tx=0x7f9f8800c8a0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 -- 172.21.15.124:0/550089708 shutdown_connections 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9f78066f30 0x7f9f780693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f98159710 0x7f9f980b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f980cae80 0x7f9f98158970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 --2- 172.21.15.124:0/550089708 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f980cb250 0x7f9f980b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 -- 172.21.15.124:0/550089708 >> 172.21.15.124:0/550089708 conn(0x7f9f980974f0 msgr2=0x7f9f98070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 -- 172.21.15.124:0/550089708 shutdown_connections 2023-10-06T04:44:32.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.073+0000 7f9f9cfff700 1 -- 172.21.15.124:0/550089708 wait complete. 2023-10-06T04:44:32.092 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:44:32.092 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:44:32.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.283+0000 7f5b191ff700 1 Processor -- start 2023-10-06T04:44:32.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.283+0000 7f5b191ff700 1 -- start start 2023-10-06T04:44:32.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.284+0000 7f5b191ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5b140cae80 0x7f5b140cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.284+0000 7f5b191ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5b141598e0 0x7f5b140afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b191ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b140c1d10 con 0x7f5b140ccec0 2023-10-06T04:44:32.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b191ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b140cd430 con 0x7f5b140cae80 2023-10-06T04:44:32.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b191ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b140688a0 con 0x7f5b141598e0 2023-10-06T04:44:32.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b12d9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5b140cae80 0x7f5b140cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b12d9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5b140cae80 0x7f5b140cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59196/0 (socket says 172.21.15.124:59196) 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b12d9d700 1 -- 172.21.15.124:0/553362157 learned_addr learned my addr 172.21.15.124:0/553362157 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b1359e700 1 --2- 172.21.15.124:0/553362157 >> v2:172.21.15.158:3300/0 conn(0x7f5b141598e0 0x7f5b140afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b12d9d700 1 -- 172.21.15.124:0/553362157 >> v2:172.21.15.158:3300/0 conn(0x7f5b141598e0 msgr2=0x7f5b140afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b12d9d700 1 --2- 172.21.15.124:0/553362157 >> v2:172.21.15.158:3300/0 conn(0x7f5b141598e0 0x7f5b140afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b12d9d700 1 -- 172.21.15.124:0/553362157 >> v1:172.21.15.158:6789/0 conn(0x7f5b140ccec0 legacy=0x7f5b141591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b12d9d700 1 -- 172.21.15.124:0/553362157 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14068b80 con 0x7f5b140cae80 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b1359e700 1 --2- 172.21.15.124:0/553362157 >> v2:172.21.15.158:3300/0 conn(0x7f5b141598e0 0x7f5b140afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.285+0000 7f5b12d9d700 1 --2- 172.21.15.124:0/553362157 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b140cae80 0x7f5b140cc980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b140c1ca0 tx=0x7f5b04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681ac4c04a6cd287 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b11d9b700 1 -- 172.21.15.124:0/553362157 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400b820 con 0x7f5b140cae80 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b11d9b700 1 -- 172.21.15.124:0/553362157 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0400b980 con 0x7f5b140cae80 2023-10-06T04:44:32.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b11d9b700 1 -- 172.21.15.124:0/553362157 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400bd20 con 0x7f5b140cae80 2023-10-06T04:44:32.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b191ff700 1 -- 172.21.15.124:0/553362157 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b140cae80 msgr2=0x7f5b140cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b191ff700 1 --2- 172.21.15.124:0/553362157 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b140cae80 0x7f5b140cc980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b140c1ca0 tx=0x7f5b04009250 comp rx=0 tx=0).stop 2023-10-06T04:44:32.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b191ff700 1 -- 172.21.15.124:0/553362157 shutdown_connections 2023-10-06T04:44:32.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b191ff700 1 --2- 172.21.15.124:0/553362157 >> v2:172.21.15.158:3300/0 conn(0x7f5b141598e0 0x7f5b140afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b191ff700 1 --2- 172.21.15.124:0/553362157 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b140cae80 0x7f5b140cc980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b191ff700 1 -- 172.21.15.124:0/553362157 >> 172.21.15.124:0/553362157 conn(0x7f5b140974f0 msgr2=0x7f5b140639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b191ff700 1 -- 172.21.15.124:0/553362157 shutdown_connections 2023-10-06T04:44:32.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.286+0000 7f5b191ff700 1 -- 172.21.15.124:0/553362157 wait complete. 2023-10-06T04:44:32.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.288+0000 7f5b191ff700 1 Processor -- start 2023-10-06T04:44:32.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.288+0000 7f5b191ff700 1 -- start start 2023-10-06T04:44:32.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b191ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5b140cae80 0x7f5b141586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b191ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b140ccec0 0x7f5b1406ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b191ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b141598e0 0x7f5b1406cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b191ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b140c7f90 con 0x7f5b141598e0 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b191ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b140c8420 con 0x7f5b140ccec0 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b191ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b140c7380 con 0x7f5b140cae80 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b1359e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b141598e0 0x7f5b1406cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b1359e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b141598e0 0x7f5b1406cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59202/0 (socket says 172.21.15.124:59202) 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b1359e700 1 -- 172.21.15.124:0/1280853155 learned_addr learned my addr 172.21.15.124:0/1280853155 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b12d9d700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5b140cae80 0x7f5b141586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b1259c700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b140ccec0 0x7f5b1406ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b1359e700 1 -- 172.21.15.124:0/1280853155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5b140cae80 msgr2=0x7f5b141586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b1359e700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5b140cae80 0x7f5b141586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b1359e700 1 -- 172.21.15.124:0/1280853155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b140ccec0 msgr2=0x7f5b1406ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b1359e700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b140ccec0 0x7f5b1406ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b1359e700 1 -- 172.21.15.124:0/1280853155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b040094f0 con 0x7f5b141598e0 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b1259c700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b140ccec0 0x7f5b1406ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.289+0000 7f5b12d9d700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5b140cae80 0x7f5b141586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.290+0000 7f5b1359e700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b141598e0 0x7f5b1406cf60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009fc0 tx=0x7f5b0c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.290+0000 7f5afaffd700 1 -- 172.21.15.124:0/1280853155 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00dd40 con 0x7f5b141598e0 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.290+0000 7f5afaffd700 1 -- 172.21.15.124:0/1280853155 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c00f040 con 0x7f5b141598e0 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.290+0000 7f5b191ff700 1 -- 172.21.15.124:0/1280853155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b140c7660 con 0x7f5b141598e0 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.290+0000 7f5afaffd700 1 -- 172.21.15.124:0/1280853155 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c015690 con 0x7f5b141598e0 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.290+0000 7f5b191ff700 1 -- 172.21.15.124:0/1280853155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b140c7c20 con 0x7f5b141598e0 2023-10-06T04:44:32.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.291+0000 7f5b191ff700 1 -- 172.21.15.124:0/1280853155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b140c8100 con 0x7f5b141598e0 2023-10-06T04:44:32.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.292+0000 7f5afaffd700 1 -- 172.21.15.124:0/1280853155 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b0c01e3b0 con 0x7f5b141598e0 2023-10-06T04:44:32.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.293+0000 7f5afaffd700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5b00066f30 0x7f5b000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.293+0000 7f5afaffd700 1 -- 172.21.15.124:0/1280853155 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5b0c084c90 con 0x7f5b141598e0 2023-10-06T04:44:32.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.293+0000 7f5b12d9d700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5b00066f30 0x7f5b000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.294+0000 7f5b12d9d700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5b00066f30 0x7f5b000693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b140c1ca0 tx=0x7f5b04016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.297+0000 7f5afaffd700 1 -- 172.21.15.124:0/1280853155 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b0c051d00 con 0x7f5b141598e0 2023-10-06T04:44:32.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.482+0000 7f5b191ff700 1 -- 172.21.15.124:0/1280853155 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b140717a0 con 0x7f5b00066f30 2023-10-06T04:44:32.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.492+0000 7f5afaffd700 1 -- 172.21.15.124:0/1280853155 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286809 (secure 0 0 0) 0x7f5b140717a0 con 0x7f5b00066f30 2023-10-06T04:44:32.497 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:32.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 -- 172.21.15.124:0/1280853155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5b00066f30 msgr2=0x7f5b000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5b00066f30 0x7f5b000693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b140c1ca0 tx=0x7f5b04016000 comp rx=0 tx=0).stop 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 -- 172.21.15.124:0/1280853155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b141598e0 msgr2=0x7f5b1406cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b141598e0 0x7f5b1406cf60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009fc0 tx=0x7f5b0c0099b0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 -- 172.21.15.124:0/1280853155 shutdown_connections 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b141598e0 0x7f5b1406cf60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5b00066f30 0x7f5b000693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5b140cae80 0x7f5b141586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 --2- 172.21.15.124:0/1280853155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b140ccec0 0x7f5b1406ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 -- 172.21.15.124:0/1280853155 >> 172.21.15.124:0/1280853155 conn(0x7f5b140974f0 msgr2=0x7f5b1406bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 -- 172.21.15.124:0/1280853155 shutdown_connections 2023-10-06T04:44:32.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.496+0000 7f5b191ff700 1 -- 172.21.15.124:0/1280853155 wait complete. 2023-10-06T04:44:32.501 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:44:32.515 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-06T04:44:31.907880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381172,"kb_used_data":2868,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593548,"statfs":{"total":773094113280,"available":770655793152,"internally_reserved":0,"allocated":2936832,"data_stored":1783508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.765803"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173422+0000","last_change":"2023-10-06T04:44:28.173422+0000","last_active":"2023-10-06T04:44:28.173422+0000","last_peered":"2023-10-06T04:44:28.173422+0000","last_clean":"2023-10-06T04:44:28.173422+0000","last_became_active":"2023-10-06T04:44:28.172872+0000","last_became_peered":"2023-10-06T04:44:28.172872+0000","last_unstale":"2023-10-06T04:44:28.173422+0000","last_undegraded":"2023-10-06T04:44:28.173422+0000","last_fullsized":"2023-10-06T04:44:28.173422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:26.020254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.166093+0000","last_change":"2023-10-06T04:44:28.166093+0000","last_active":"2023-10-06T04:44:28.166093+0000","last_peered":"2023-10-06T04:44:28.166093+0000","last_clean":"2023-10-06T04:44:28.166093+0000","last_became_active":"2023-10-06T04:44:28.165832+0000","last_became_peered":"2023-10-06T04:44:28.165832+0000","last_unstale":"2023-10-06T04:44:28.166093+0000","last_undegraded":"2023-10-06T04:44:28.166093+0000","last_fullsized":"2023-10-06T04:44:28.166093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:20.325293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181890+0000","last_change":"2023-10-06T04:44:28.181890+0000","last_active":"2023-10-06T04:44:28.181890+0000","last_peered":"2023-10-06T04:44:28.181890+0000","last_clean":"2023-10-06T04:44:28.181890+0000","last_became_active":"2023-10-06T04:44:28.181525+0000","last_became_peered":"2023-10-06T04:44:28.181525+0000","last_unstale":"2023-10-06T04:44:28.181890+0000","last_undegraded":"2023-10-06T04:44:28.181890+0000","last_fullsized":"2023-10-06T04:44:28.181890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:10.808836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175818+0000","last_change":"2023-10-06T04:44:28.175818+0000","last_active":"2023-10-06T04:44:28.175818+0000","last_peered":"2023-10-06T04:44:28.175818+0000","last_clean":"2023-10-06T04:44:28.175818+0000","last_became_active":"2023-10-06T04:44:28.175535+0000","last_became_peered":"2023-10-06T04:44:28.175535+0000","last_unstale":"2023-10-06T04:44:28.175818+0000","last_undegraded":"2023-10-06T04:44:28.175818+0000","last_fullsized":"2023-10-06T04:44:28.175818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:54.215039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181590+0000","last_change":"2023-10-06T04:44:28.181590+0000","last_active":"2023-10-06T04:44:28.181590+0000","last_peered":"2023-10-06T04:44:28.181590+0000","last_clean":"2023-10-06T04:44:28.181590+0000","last_became_active":"2023-10-06T04:44:28.181326+0000","last_became_peered":"2023-10-06T04:44:28.181326+0000","last_unstale":"2023-10-06T04:44:28.181590+0000","last_undegraded":"2023-10-06T04:44:28.181590+0000","last_fullsized":"2023-10-06T04:44:28.181590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:22.042195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.180417+0000","last_change":"2023-10-06T04:44:28.180417+0000","last_active":"2023-10-06T04:44:28.180417+0000","last_peered":"2023-10-06T04:44:28.180417+0000","last_clean":"2023-10-06T04:44:28.180417+0000","last_became_active":"2023-10-06T04:44:28.179929+0000","last_became_peered":"2023-10-06T04:44:28.179929+0000","last_unstale":"2023-10-06T04:44:28.180417+0000","last_undegraded":"2023-10-06T04:44:28.180417+0000","last_fullsized":"2023-10-06T04:44:28.180417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:37.525707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.178946+0000","last_change":"2023-10-06T04:44:28.178946+0000","last_active":"2023-10-06T04:44:28.178946+0000","last_peered":"2023-10-06T04:44:28.178946+0000","last_clean":"2023-10-06T04:44:28.178946+0000","last_became_active":"2023-10-06T04:44:28.178304+0000","last_became_peered":"2023-10-06T04:44:28.178304+0000","last_unstale":"2023-10-06T04:44:28.178946+0000","last_undegraded":"2023-10-06T04:44:28.178946+0000","last_fullsized":"2023-10-06T04:44:28.178946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.327276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175157+0000","last_change":"2023-10-06T04:44:28.175157+0000","last_active":"2023-10-06T04:44:28.175157+0000","last_peered":"2023-10-06T04:44:28.175157+0000","last_clean":"2023-10-06T04:44:28.175157+0000","last_became_active":"2023-10-06T04:44:28.174893+0000","last_became_peered":"2023-10-06T04:44:28.174893+0000","last_unstale":"2023-10-06T04:44:28.175157+0000","last_undegraded":"2023-10-06T04:44:28.175157+0000","last_fullsized":"2023-10-06T04:44:28.175157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.047230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.172925+0000","last_change":"2023-10-06T04:44:28.172925+0000","last_active":"2023-10-06T04:44:28.172925+0000","last_peered":"2023-10-06T04:44:28.172925+0000","last_clean":"2023-10-06T04:44:28.172925+0000","last_became_active":"2023-10-06T04:44:28.172656+0000","last_became_peered":"2023-10-06T04:44:28.172656+0000","last_unstale":"2023-10-06T04:44:28.172925+0000","last_undegraded":"2023-10-06T04:44:28.172925+0000","last_fullsized":"2023-10-06T04:44:28.172925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:58.202199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.162650+0000","last_change":"2023-10-06T04:44:28.162650+0000","last_active":"2023-10-06T04:44:28.162650+0000","last_peered":"2023-10-06T04:44:28.162650+0000","last_clean":"2023-10-06T04:44:28.162650+0000","last_became_active":"2023-10-06T04:44:28.162164+0000","last_became_peered":"2023-10-06T04:44:28.162164+0000","last_unstale":"2023-10-06T04:44:28.162650+0000","last_undegraded":"2023-10-06T04:44:28.162650+0000","last_fullsized":"2023-10-06T04:44:28.162650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174246+0000","last_change":"2023-10-06T04:44:28.174246+0000","last_active":"2023-10-06T04:44:28.174246+0000","last_peered":"2023-10-06T04:44:28.174246+0000","last_clean":"2023-10-06T04:44:28.174246+0000","last_became_active":"2023-10-06T04:44:28.173913+0000","last_became_peered":"2023-10-06T04:44:28.173913+0000","last_unstale":"2023-10-06T04:44:28.174246+0000","last_undegraded":"2023-10-06T04:44:28.174246+0000","last_fullsized":"2023-10-06T04:44:28.174246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175653+0000","last_change":"2023-10-06T04:44:28.175653+0000","last_active":"2023-10-06T04:44:28.175653+0000","last_peered":"2023-10-06T04:44:28.175653+0000","last_clean":"2023-10-06T04:44:28.175653+0000","last_became_active":"2023-10-06T04:44:28.175322+0000","last_became_peered":"2023-10-06T04:44:28.175322+0000","last_unstale":"2023-10-06T04:44:28.175653+0000","last_undegraded":"2023-10-06T04:44:28.175653+0000","last_fullsized":"2023-10-06T04:44:28.175653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:45.455338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173340+0000","last_change":"2023-10-06T04:44:28.173340+0000","last_active":"2023-10-06T04:44:28.173340+0000","last_peered":"2023-10-06T04:44:28.173340+0000","last_clean":"2023-10-06T04:44:28.173340+0000","last_became_active":"2023-10-06T04:44:28.173003+0000","last_became_peered":"2023-10-06T04:44:28.173003+0000","last_unstale":"2023-10-06T04:44:28.173340+0000","last_undegraded":"2023-10-06T04:44:28.173340+0000","last_fullsized":"2023-10-06T04:44:28.173340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:33.543547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.164616+0000","last_change":"2023-10-06T04:44:28.164616+0000","last_active":"2023-10-06T04:44:28.164616+0000","last_peered":"2023-10-06T04:44:28.164616+0000","last_clean":"2023-10-06T04:44:28.164616+0000","last_became_active":"2023-10-06T04:44:28.164191+0000","last_became_peered":"2023-10-06T04:44:28.164191+0000","last_unstale":"2023-10-06T04:44:28.164616+0000","last_undegraded":"2023-10-06T04:44:28.164616+0000","last_fullsized":"2023-10-06T04:44:28.164616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:59.257080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.179115+0000","last_change":"2023-10-06T04:44:28.179115+0000","last_active":"2023-10-06T04:44:28.179115+0000","last_peered":"2023-10-06T04:44:28.179115+0000","last_clean":"2023-10-06T04:44:28.179115+0000","last_became_active":"2023-10-06T04:44:28.178643+0000","last_became_peered":"2023-10-06T04:44:28.178643+0000","last_unstale":"2023-10-06T04:44:28.179115+0000","last_undegraded":"2023-10-06T04:44:28.179115+0000","last_fullsized":"2023-10-06T04:44:28.179115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.180012+0000","last_change":"2023-10-06T04:44:28.180012+0000","last_active":"2023-10-06T04:44:28.180012+0000","last_peered":"2023-10-06T04:44:28.180012+0000","last_clean":"2023-10-06T04:44:28.180012+0000","last_became_active":"2023-10-06T04:44:28.179719+0000","last_became_peered":"2023-10-06T04:44:28.179719+0000","last_unstale":"2023-10-06T04:44:28.180012+0000","last_undegraded":"2023-10-06T04:44:28.180012+0000","last_fullsized":"2023-10-06T04:44:28.180012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.765680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.172407+0000","last_change":"2023-10-06T04:44:28.172407+0000","last_active":"2023-10-06T04:44:28.172407+0000","last_peered":"2023-10-06T04:44:28.172407+0000","last_clean":"2023-10-06T04:44:28.172407+0000","last_became_active":"2023-10-06T04:44:28.172144+0000","last_became_peered":"2023-10-06T04:44:28.172144+0000","last_unstale":"2023-10-06T04:44:28.172407+0000","last_undegraded":"2023-10-06T04:44:28.172407+0000","last_fullsized":"2023-10-06T04:44:28.172407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:30.261730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175526+0000","last_change":"2023-10-06T04:44:28.175526+0000","last_active":"2023-10-06T04:44:28.175526+0000","last_peered":"2023-10-06T04:44:28.175526+0000","last_clean":"2023-10-06T04:44:28.175526+0000","last_became_active":"2023-10-06T04:44:28.174982+0000","last_became_peered":"2023-10-06T04:44:28.174982+0000","last_unstale":"2023-10-06T04:44:28.175526+0000","last_undegraded":"2023-10-06T04:44:28.175526+0000","last_fullsized":"2023-10-06T04:44:28.175526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:44.708051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.165012+0000","last_change":"2023-10-06T04:44:28.165012+0000","last_active":"2023-10-06T04:44:28.165012+0000","last_peered":"2023-10-06T04:44:28.165012+0000","last_clean":"2023-10-06T04:44:28.165012+0000","last_became_active":"2023-10-06T04:44:28.164574+0000","last_became_peered":"2023-10-06T04:44:28.164574+0000","last_unstale":"2023-10-06T04:44:28.165012+0000","last_undegraded":"2023-10-06T04:44:28.165012+0000","last_fullsized":"2023-10-06T04:44:28.165012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:29.304110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.178396+0000","last_change":"2023-10-06T04:44:28.178396+0000","last_active":"2023-10-06T04:44:28.178396+0000","last_peered":"2023-10-06T04:44:28.178396+0000","last_clean":"2023-10-06T04:44:28.178396+0000","last_became_active":"2023-10-06T04:44:28.178046+0000","last_became_peered":"2023-10-06T04:44:28.178046+0000","last_unstale":"2023-10-06T04:44:28.178396+0000","last_undegraded":"2023-10-06T04:44:28.178396+0000","last_fullsized":"2023-10-06T04:44:28.178396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:06.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182289+0000","last_change":"2023-10-06T04:44:28.182289+0000","last_active":"2023-10-06T04:44:28.182289+0000","last_peered":"2023-10-06T04:44:28.182289+0000","last_clean":"2023-10-06T04:44:28.182289+0000","last_became_active":"2023-10-06T04:44:28.181655+0000","last_became_peered":"2023-10-06T04:44:28.181655+0000","last_unstale":"2023-10-06T04:44:28.182289+0000","last_undegraded":"2023-10-06T04:44:28.182289+0000","last_fullsized":"2023-10-06T04:44:28.182289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:20.325293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.166193+0000","last_change":"2023-10-06T04:44:28.166193+0000","last_active":"2023-10-06T04:44:28.166193+0000","last_peered":"2023-10-06T04:44:28.166193+0000","last_clean":"2023-10-06T04:44:28.166193+0000","last_became_active":"2023-10-06T04:44:28.165254+0000","last_became_peered":"2023-10-06T04:44:28.165254+0000","last_unstale":"2023-10-06T04:44:28.166193+0000","last_undegraded":"2023-10-06T04:44:28.166193+0000","last_fullsized":"2023-10-06T04:44:28.166193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.526003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.172488+0000","last_change":"2023-10-06T04:44:28.172488+0000","last_active":"2023-10-06T04:44:28.172488+0000","last_peered":"2023-10-06T04:44:28.172488+0000","last_clean":"2023-10-06T04:44:28.172488+0000","last_became_active":"2023-10-06T04:44:28.172052+0000","last_became_peered":"2023-10-06T04:44:28.172052+0000","last_unstale":"2023-10-06T04:44:28.172488+0000","last_undegraded":"2023-10-06T04:44:28.172488+0000","last_fullsized":"2023-10-06T04:44:28.172488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:25.165826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.188043+0000","last_change":"2023-10-06T04:44:28.188043+0000","last_active":"2023-10-06T04:44:28.188043+0000","last_peered":"2023-10-06T04:44:28.188043+0000","last_clean":"2023-10-06T04:44:28.188043+0000","last_became_active":"2023-10-06T04:44:28.187730+0000","last_became_peered":"2023-10-06T04:44:28.187730+0000","last_unstale":"2023-10-06T04:44:28.188043+0000","last_undegraded":"2023-10-06T04:44:28.188043+0000","last_fullsized":"2023-10-06T04:44:28.188043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.165414+0000","last_change":"2023-10-06T04:44:28.165414+0000","last_active":"2023-10-06T04:44:28.165414+0000","last_peered":"2023-10-06T04:44:28.165414+0000","last_clean":"2023-10-06T04:44:28.165414+0000","last_became_active":"2023-10-06T04:44:28.165101+0000","last_became_peered":"2023-10-06T04:44:28.165101+0000","last_unstale":"2023-10-06T04:44:28.165414+0000","last_undegraded":"2023-10-06T04:44:28.165414+0000","last_fullsized":"2023-10-06T04:44:28.165414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.526003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.168938+0000","last_change":"2023-10-06T04:44:28.168938+0000","last_active":"2023-10-06T04:44:28.168938+0000","last_peered":"2023-10-06T04:44:28.168938+0000","last_clean":"2023-10-06T04:44:28.168938+0000","last_became_active":"2023-10-06T04:44:28.168679+0000","last_became_peered":"2023-10-06T04:44:28.168679+0000","last_unstale":"2023-10-06T04:44:28.168938+0000","last_undegraded":"2023-10-06T04:44:28.168938+0000","last_fullsized":"2023-10-06T04:44:28.168938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:35:22.562710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.169001+0000","last_change":"2023-10-06T04:44:28.169001+0000","last_active":"2023-10-06T04:44:28.169001+0000","last_peered":"2023-10-06T04:44:28.169001+0000","last_clean":"2023-10-06T04:44:28.169001+0000","last_became_active":"2023-10-06T04:44:28.168663+0000","last_became_peered":"2023-10-06T04:44:28.168663+0000","last_unstale":"2023-10-06T04:44:28.169001+0000","last_undegraded":"2023-10-06T04:44:28.169001+0000","last_fullsized":"2023-10-06T04:44:28.169001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:18.824278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.159327+0000","last_change":"2023-10-06T04:44:27.176063+0000","last_active":"2023-10-06T04:44:28.159327+0000","last_peered":"2023-10-06T04:44:28.159327+0000","last_clean":"2023-10-06T04:44:28.159327+0000","last_became_active":"2023-10-06T04:44:27.175663+0000","last_became_peered":"2023-10-06T04:44:27.175663+0000","last_unstale":"2023-10-06T04:44:28.159327+0000","last_undegraded":"2023-10-06T04:44:28.159327+0000","last_fullsized":"2023-10-06T04:44:28.159327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.171391+0000","last_change":"2023-10-06T04:44:28.171391+0000","last_active":"2023-10-06T04:44:28.171391+0000","last_peered":"2023-10-06T04:44:28.171391+0000","last_clean":"2023-10-06T04:44:28.171391+0000","last_became_active":"2023-10-06T04:44:28.171117+0000","last_became_peered":"2023-10-06T04:44:28.171117+0000","last_unstale":"2023-10-06T04:44:28.171391+0000","last_undegraded":"2023-10-06T04:44:28.171391+0000","last_fullsized":"2023-10-06T04:44:28.171391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:06.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.178967+0000","last_change":"2023-10-06T04:44:27.175499+0000","last_active":"2023-10-06T04:44:27.178967+0000","last_peered":"2023-10-06T04:44:27.178967+0000","last_clean":"2023-10-06T04:44:27.178967+0000","last_became_active":"2023-10-06T04:44:27.175181+0000","last_became_peered":"2023-10-06T04:44:27.175181+0000","last_unstale":"2023-10-06T04:44:27.178967+0000","last_undegraded":"2023-10-06T04:44:27.178967+0000","last_fullsized":"2023-10-06T04:44:27.178967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:18.613164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.171657+0000","last_change":"2023-10-06T04:44:28.171657+0000","last_active":"2023-10-06T04:44:28.171657+0000","last_peered":"2023-10-06T04:44:28.171657+0000","last_clean":"2023-10-06T04:44:28.171657+0000","last_became_active":"2023-10-06T04:44:28.171374+0000","last_became_peered":"2023-10-06T04:44:28.171374+0000","last_unstale":"2023-10-06T04:44:28.171657+0000","last_undegraded":"2023-10-06T04:44:28.171657+0000","last_fullsized":"2023-10-06T04:44:28.171657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:10.149033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.162483+0000","last_change":"2023-10-06T04:44:27.160189+0000","last_active":"2023-10-06T04:44:27.162483+0000","last_peered":"2023-10-06T04:44:27.162483+0000","last_clean":"2023-10-06T04:44:27.162483+0000","last_became_active":"2023-10-06T04:44:27.159913+0000","last_became_peered":"2023-10-06T04:44:27.159913+0000","last_unstale":"2023-10-06T04:44:27.162483+0000","last_undegraded":"2023-10-06T04:44:27.162483+0000","last_fullsized":"2023-10-06T04:44:27.162483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:31.797194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.169511+0000","last_change":"2023-10-06T04:44:28.169511+0000","last_active":"2023-10-06T04:44:28.169511+0000","last_peered":"2023-10-06T04:44:28.169511+0000","last_clean":"2023-10-06T04:44:28.169511+0000","last_became_active":"2023-10-06T04:44:28.169196+0000","last_became_peered":"2023-10-06T04:44:28.169196+0000","last_unstale":"2023-10-06T04:44:28.169511+0000","last_undegraded":"2023-10-06T04:44:28.169511+0000","last_fullsized":"2023-10-06T04:44:28.169511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:14.693541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.171791+0000","last_change":"2023-10-06T04:44:27.165250+0000","last_active":"2023-10-06T04:44:27.171791+0000","last_peered":"2023-10-06T04:44:27.171791+0000","last_clean":"2023-10-06T04:44:27.171791+0000","last_became_active":"2023-10-06T04:44:27.164945+0000","last_became_peered":"2023-10-06T04:44:27.164945+0000","last_unstale":"2023-10-06T04:44:27.171791+0000","last_undegraded":"2023-10-06T04:44:27.171791+0000","last_fullsized":"2023-10-06T04:44:27.171791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:25.014932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.178132+0000","last_change":"2023-10-06T04:44:28.178132+0000","last_active":"2023-10-06T04:44:28.178132+0000","last_peered":"2023-10-06T04:44:28.178132+0000","last_clean":"2023-10-06T04:44:28.178132+0000","last_became_active":"2023-10-06T04:44:28.177887+0000","last_became_peered":"2023-10-06T04:44:28.177887+0000","last_unstale":"2023-10-06T04:44:28.178132+0000","last_undegraded":"2023-10-06T04:44:28.178132+0000","last_fullsized":"2023-10-06T04:44:28.178132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:05.030988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.178069+0000","last_change":"2023-10-06T04:44:27.175489+0000","last_active":"2023-10-06T04:44:27.178069+0000","last_peered":"2023-10-06T04:44:27.178069+0000","last_clean":"2023-10-06T04:44:27.178069+0000","last_became_active":"2023-10-06T04:44:27.175091+0000","last_became_peered":"2023-10-06T04:44:27.175091+0000","last_unstale":"2023-10-06T04:44:27.178069+0000","last_undegraded":"2023-10-06T04:44:27.178069+0000","last_fullsized":"2023-10-06T04:44:27.178069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175583+0000","last_change":"2023-10-06T04:44:28.175583+0000","last_active":"2023-10-06T04:44:28.175583+0000","last_peered":"2023-10-06T04:44:28.175583+0000","last_clean":"2023-10-06T04:44:28.175583+0000","last_became_active":"2023-10-06T04:44:28.174168+0000","last_became_peered":"2023-10-06T04:44:28.174168+0000","last_unstale":"2023-10-06T04:44:28.175583+0000","last_undegraded":"2023-10-06T04:44:28.175583+0000","last_fullsized":"2023-10-06T04:44:28.175583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:13.248204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194244+0000","last_change":"2023-10-06T04:44:27.173497+0000","last_active":"2023-10-06T04:44:28.194244+0000","last_peered":"2023-10-06T04:44:28.194244+0000","last_clean":"2023-10-06T04:44:28.194244+0000","last_became_active":"2023-10-06T04:44:27.173266+0000","last_became_peered":"2023-10-06T04:44:27.173266+0000","last_unstale":"2023-10-06T04:44:28.194244+0000","last_undegraded":"2023-10-06T04:44:28.194244+0000","last_fullsized":"2023-10-06T04:44:28.194244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:25.287936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.164074+0000","last_change":"2023-10-06T04:44:28.164074+0000","last_active":"2023-10-06T04:44:28.164074+0000","last_peered":"2023-10-06T04:44:28.164074+0000","last_clean":"2023-10-06T04:44:28.164074+0000","last_became_active":"2023-10-06T04:44:28.163794+0000","last_became_peered":"2023-10-06T04:44:28.163794+0000","last_unstale":"2023-10-06T04:44:28.164074+0000","last_undegraded":"2023-10-06T04:44:28.164074+0000","last_fullsized":"2023-10-06T04:44:28.164074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:00.867338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194439+0000","last_change":"2023-10-06T04:44:27.174376+0000","last_active":"2023-10-06T04:44:28.194439+0000","last_peered":"2023-10-06T04:44:28.194439+0000","last_clean":"2023-10-06T04:44:28.194439+0000","last_became_active":"2023-10-06T04:44:27.172580+0000","last_became_peered":"2023-10-06T04:44:27.172580+0000","last_unstale":"2023-10-06T04:44:28.194439+0000","last_undegraded":"2023-10-06T04:44:28.194439+0000","last_fullsized":"2023-10-06T04:44:28.194439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:18.718435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176191+0000","last_change":"2023-10-06T04:44:28.176191+0000","last_active":"2023-10-06T04:44:28.176191+0000","last_peered":"2023-10-06T04:44:28.176191+0000","last_clean":"2023-10-06T04:44:28.176191+0000","last_became_active":"2023-10-06T04:44:28.175904+0000","last_became_peered":"2023-10-06T04:44:28.175904+0000","last_unstale":"2023-10-06T04:44:28.176191+0000","last_undegraded":"2023-10-06T04:44:28.176191+0000","last_fullsized":"2023-10-06T04:44:28.176191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:02.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.193877+0000","last_change":"2023-10-06T04:44:27.176572+0000","last_active":"2023-10-06T04:44:28.193877+0000","last_peered":"2023-10-06T04:44:28.193877+0000","last_clean":"2023-10-06T04:44:28.193877+0000","last_became_active":"2023-10-06T04:44:27.176184+0000","last_became_peered":"2023-10-06T04:44:27.176184+0000","last_unstale":"2023-10-06T04:44:28.193877+0000","last_undegraded":"2023-10-06T04:44:28.193877+0000","last_fullsized":"2023-10-06T04:44:28.193877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:42.805321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.179767+0000","last_change":"2023-10-06T04:44:28.179767+0000","last_active":"2023-10-06T04:44:28.179767+0000","last_peered":"2023-10-06T04:44:28.179767+0000","last_clean":"2023-10-06T04:44:28.179767+0000","last_became_active":"2023-10-06T04:44:28.178145+0000","last_became_peered":"2023-10-06T04:44:28.178145+0000","last_unstale":"2023-10-06T04:44:28.179767+0000","last_undegraded":"2023-10-06T04:44:28.179767+0000","last_fullsized":"2023-10-06T04:44:28.179767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.765680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.172419+0000","last_change":"2023-10-06T04:44:27.169868+0000","last_active":"2023-10-06T04:44:27.172419+0000","last_peered":"2023-10-06T04:44:27.172419+0000","last_clean":"2023-10-06T04:44:27.172419+0000","last_became_active":"2023-10-06T04:44:27.169616+0000","last_became_peered":"2023-10-06T04:44:27.169616+0000","last_unstale":"2023-10-06T04:44:27.172419+0000","last_undegraded":"2023-10-06T04:44:27.172419+0000","last_fullsized":"2023-10-06T04:44:27.172419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:56.308717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.168629+0000","last_change":"2023-10-06T04:44:28.168629+0000","last_active":"2023-10-06T04:44:28.168629+0000","last_peered":"2023-10-06T04:44:28.168629+0000","last_clean":"2023-10-06T04:44:28.168629+0000","last_became_active":"2023-10-06T04:44:28.168374+0000","last_became_peered":"2023-10-06T04:44:28.168374+0000","last_unstale":"2023-10-06T04:44:28.168629+0000","last_undegraded":"2023-10-06T04:44:28.168629+0000","last_fullsized":"2023-10-06T04:44:28.168629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.176999+0000","last_change":"2023-10-06T04:44:27.175001+0000","last_active":"2023-10-06T04:44:27.176999+0000","last_peered":"2023-10-06T04:44:27.176999+0000","last_clean":"2023-10-06T04:44:27.176999+0000","last_became_active":"2023-10-06T04:44:27.174715+0000","last_became_peered":"2023-10-06T04:44:27.174715+0000","last_unstale":"2023-10-06T04:44:27.176999+0000","last_undegraded":"2023-10-06T04:44:27.176999+0000","last_fullsized":"2023-10-06T04:44:27.176999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:16.760012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181610+0000","last_change":"2023-10-06T04:44:28.181610+0000","last_active":"2023-10-06T04:44:28.181610+0000","last_peered":"2023-10-06T04:44:28.181610+0000","last_clean":"2023-10-06T04:44:28.181610+0000","last_became_active":"2023-10-06T04:44:28.180610+0000","last_became_peered":"2023-10-06T04:44:28.180610+0000","last_unstale":"2023-10-06T04:44:28.181610+0000","last_undegraded":"2023-10-06T04:44:28.181610+0000","last_fullsized":"2023-10-06T04:44:28.181610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:15.790501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.191144+0000","last_change":"2023-10-06T04:44:27.162747+0000","last_active":"2023-10-06T04:44:28.191144+0000","last_peered":"2023-10-06T04:44:28.191144+0000","last_clean":"2023-10-06T04:44:28.191144+0000","last_became_active":"2023-10-06T04:44:27.162395+0000","last_became_peered":"2023-10-06T04:44:27.162395+0000","last_unstale":"2023-10-06T04:44:28.191144+0000","last_undegraded":"2023-10-06T04:44:28.191144+0000","last_fullsized":"2023-10-06T04:44:28.191144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175866+0000","last_change":"2023-10-06T04:44:28.175866+0000","last_active":"2023-10-06T04:44:28.175866+0000","last_peered":"2023-10-06T04:44:28.175866+0000","last_clean":"2023-10-06T04:44:28.175866+0000","last_became_active":"2023-10-06T04:44:28.174850+0000","last_became_peered":"2023-10-06T04:44:28.174850+0000","last_unstale":"2023-10-06T04:44:28.175866+0000","last_undegraded":"2023-10-06T04:44:28.175866+0000","last_fullsized":"2023-10-06T04:44:28.175866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:44.943378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.160051+0000","last_change":"2023-10-06T04:44:27.171420+0000","last_active":"2023-10-06T04:44:28.160051+0000","last_peered":"2023-10-06T04:44:28.160051+0000","last_clean":"2023-10-06T04:44:28.160051+0000","last_became_active":"2023-10-06T04:44:27.170321+0000","last_became_peered":"2023-10-06T04:44:27.170321+0000","last_unstale":"2023-10-06T04:44:28.160051+0000","last_undegraded":"2023-10-06T04:44:28.160051+0000","last_fullsized":"2023-10-06T04:44:28.160051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.167916+0000","last_change":"2023-10-06T04:44:28.167916+0000","last_active":"2023-10-06T04:44:28.167916+0000","last_peered":"2023-10-06T04:44:28.167916+0000","last_clean":"2023-10-06T04:44:28.167916+0000","last_became_active":"2023-10-06T04:44:28.167567+0000","last_became_peered":"2023-10-06T04:44:28.167567+0000","last_unstale":"2023-10-06T04:44:28.167916+0000","last_undegraded":"2023-10-06T04:44:28.167916+0000","last_fullsized":"2023-10-06T04:44:28.167916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.327276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194029+0000","last_change":"2023-10-06T04:44:27.171251+0000","last_active":"2023-10-06T04:44:28.194029+0000","last_peered":"2023-10-06T04:44:28.194029+0000","last_clean":"2023-10-06T04:44:28.194029+0000","last_became_active":"2023-10-06T04:44:27.170918+0000","last_became_peered":"2023-10-06T04:44:27.170918+0000","last_unstale":"2023-10-06T04:44:28.194029+0000","last_undegraded":"2023-10-06T04:44:28.194029+0000","last_fullsized":"2023-10-06T04:44:28.194029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:31.797194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173878+0000","last_change":"2023-10-06T04:44:28.173878+0000","last_active":"2023-10-06T04:44:28.173878+0000","last_peered":"2023-10-06T04:44:28.173878+0000","last_clean":"2023-10-06T04:44:28.173878+0000","last_became_active":"2023-10-06T04:44:28.173437+0000","last_became_peered":"2023-10-06T04:44:28.173437+0000","last_unstale":"2023-10-06T04:44:28.173878+0000","last_undegraded":"2023-10-06T04:44:28.173878+0000","last_fullsized":"2023-10-06T04:44:28.173878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:13.338361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.162495+0000","last_change":"2023-10-06T04:44:27.176907+0000","last_active":"2023-10-06T04:44:28.162495+0000","last_peered":"2023-10-06T04:44:28.162495+0000","last_clean":"2023-10-06T04:44:28.162495+0000","last_became_active":"2023-10-06T04:44:27.176591+0000","last_became_peered":"2023-10-06T04:44:27.176591+0000","last_unstale":"2023-10-06T04:44:28.162495+0000","last_undegraded":"2023-10-06T04:44:28.162495+0000","last_fullsized":"2023-10-06T04:44:28.162495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:48.634872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170672+0000","last_change":"2023-10-06T04:44:28.170672+0000","last_active":"2023-10-06T04:44:28.170672+0000","last_peered":"2023-10-06T04:44:28.170672+0000","last_clean":"2023-10-06T04:44:28.170672+0000","last_became_active":"2023-10-06T04:44:28.170212+0000","last_became_peered":"2023-10-06T04:44:28.170212+0000","last_unstale":"2023-10-06T04:44:28.170672+0000","last_undegraded":"2023-10-06T04:44:28.170672+0000","last_fullsized":"2023-10-06T04:44:28.170672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.175000+0000","last_change":"2023-10-06T04:44:27.166881+0000","last_active":"2023-10-06T04:44:27.175000+0000","last_peered":"2023-10-06T04:44:27.175000+0000","last_clean":"2023-10-06T04:44:27.175000+0000","last_became_active":"2023-10-06T04:44:27.166606+0000","last_became_peered":"2023-10-06T04:44:27.166606+0000","last_unstale":"2023-10-06T04:44:27.175000+0000","last_undegraded":"2023-10-06T04:44:27.175000+0000","last_fullsized":"2023-10-06T04:44:27.175000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:01.501146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.167261+0000","last_change":"2023-10-06T04:44:28.167261+0000","last_active":"2023-10-06T04:44:28.167261+0000","last_peered":"2023-10-06T04:44:28.167261+0000","last_clean":"2023-10-06T04:44:28.167261+0000","last_became_active":"2023-10-06T04:44:28.167017+0000","last_became_peered":"2023-10-06T04:44:28.167017+0000","last_unstale":"2023-10-06T04:44:28.167261+0000","last_undegraded":"2023-10-06T04:44:28.167261+0000","last_fullsized":"2023-10-06T04:44:28.167261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:37.963273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.185874+0000","last_change":"2023-10-06T04:44:27.169708+0000","last_active":"2023-10-06T04:44:28.185874+0000","last_peered":"2023-10-06T04:44:28.185874+0000","last_clean":"2023-10-06T04:44:28.185874+0000","last_became_active":"2023-10-06T04:44:27.169446+0000","last_became_peered":"2023-10-06T04:44:27.169446+0000","last_unstale":"2023-10-06T04:44:28.185874+0000","last_undegraded":"2023-10-06T04:44:28.185874+0000","last_fullsized":"2023-10-06T04:44:28.185874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:42.805321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182653+0000","last_change":"2023-10-06T04:44:28.182653+0000","last_active":"2023-10-06T04:44:28.182653+0000","last_peered":"2023-10-06T04:44:28.182653+0000","last_clean":"2023-10-06T04:44:28.182653+0000","last_became_active":"2023-10-06T04:44:28.182103+0000","last_became_peered":"2023-10-06T04:44:28.182103+0000","last_unstale":"2023-10-06T04:44:28.182653+0000","last_undegraded":"2023-10-06T04:44:28.182653+0000","last_fullsized":"2023-10-06T04:44:28.182653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:13.248204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.176281+0000","last_change":"2023-10-06T04:44:27.173805+0000","last_active":"2023-10-06T04:44:27.176281+0000","last_peered":"2023-10-06T04:44:27.176281+0000","last_clean":"2023-10-06T04:44:27.176281+0000","last_became_active":"2023-10-06T04:44:27.173356+0000","last_became_peered":"2023-10-06T04:44:27.173356+0000","last_unstale":"2023-10-06T04:44:27.176281+0000","last_undegraded":"2023-10-06T04:44:27.176281+0000","last_fullsized":"2023-10-06T04:44:27.176281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174085+0000","last_change":"2023-10-06T04:44:28.174085+0000","last_active":"2023-10-06T04:44:28.174085+0000","last_peered":"2023-10-06T04:44:28.174085+0000","last_clean":"2023-10-06T04:44:28.174085+0000","last_became_active":"2023-10-06T04:44:28.173252+0000","last_became_peered":"2023-10-06T04:44:28.173252+0000","last_unstale":"2023-10-06T04:44:28.174085+0000","last_undegraded":"2023-10-06T04:44:28.174085+0000","last_fullsized":"2023-10-06T04:44:28.174085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:44.943378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.179334+0000","last_change":"2023-10-06T04:44:27.173971+0000","last_active":"2023-10-06T04:44:27.179334+0000","last_peered":"2023-10-06T04:44:27.179334+0000","last_clean":"2023-10-06T04:44:27.179334+0000","last_became_active":"2023-10-06T04:44:27.173624+0000","last_became_peered":"2023-10-06T04:44:27.173624+0000","last_unstale":"2023-10-06T04:44:27.179334+0000","last_undegraded":"2023-10-06T04:44:27.179334+0000","last_fullsized":"2023-10-06T04:44:27.179334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:59.033178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175781+0000","last_change":"2023-10-06T04:44:28.175781+0000","last_active":"2023-10-06T04:44:28.175781+0000","last_peered":"2023-10-06T04:44:28.175781+0000","last_clean":"2023-10-06T04:44:28.175781+0000","last_became_active":"2023-10-06T04:44:28.174281+0000","last_became_peered":"2023-10-06T04:44:28.174281+0000","last_unstale":"2023-10-06T04:44:28.175781+0000","last_undegraded":"2023-10-06T04:44:28.175781+0000","last_fullsized":"2023-10-06T04:44:28.175781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:58.131405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.176743+0000","last_change":"2023-10-06T04:44:27.175348+0000","last_active":"2023-10-06T04:44:27.176743+0000","last_peered":"2023-10-06T04:44:27.176743+0000","last_clean":"2023-10-06T04:44:27.176743+0000","last_became_active":"2023-10-06T04:44:27.175051+0000","last_became_peered":"2023-10-06T04:44:27.175051+0000","last_unstale":"2023-10-06T04:44:27.176743+0000","last_undegraded":"2023-10-06T04:44:27.176743+0000","last_fullsized":"2023-10-06T04:44:27.176743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:16.760012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177266+0000","last_change":"2023-10-06T04:44:28.177266+0000","last_active":"2023-10-06T04:44:28.177266+0000","last_peered":"2023-10-06T04:44:28.177266+0000","last_clean":"2023-10-06T04:44:28.177266+0000","last_became_active":"2023-10-06T04:44:28.176965+0000","last_became_peered":"2023-10-06T04:44:28.176965+0000","last_unstale":"2023-10-06T04:44:28.177266+0000","last_undegraded":"2023-10-06T04:44:28.177266+0000","last_fullsized":"2023-10-06T04:44:28.177266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:37.963273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184180+0000","last_change":"2023-10-06T04:44:27.172020+0000","last_active":"2023-10-06T04:44:28.184180+0000","last_peered":"2023-10-06T04:44:28.184180+0000","last_clean":"2023-10-06T04:44:28.184180+0000","last_became_active":"2023-10-06T04:44:27.171708+0000","last_became_peered":"2023-10-06T04:44:27.171708+0000","last_unstale":"2023-10-06T04:44:28.184180+0000","last_undegraded":"2023-10-06T04:44:28.184180+0000","last_fullsized":"2023-10-06T04:44:28.184180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.165960+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:44:27.165960+0000","last_peered":"2023-10-06T04:44:27.165960+0000","last_clean":"2023-10-06T04:44:27.165960+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:44:27.165960+0000","last_undegraded":"2023-10-06T04:44:27.165960+0000","last_fullsized":"2023-10-06T04:44:27.165960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177250+0000","last_change":"2023-10-06T04:44:28.177250+0000","last_active":"2023-10-06T04:44:28.177250+0000","last_peered":"2023-10-06T04:44:28.177250+0000","last_clean":"2023-10-06T04:44:28.177250+0000","last_became_active":"2023-10-06T04:44:28.174266+0000","last_became_peered":"2023-10-06T04:44:28.174266+0000","last_unstale":"2023-10-06T04:44:28.177250+0000","last_undegraded":"2023-10-06T04:44:28.177250+0000","last_fullsized":"2023-10-06T04:44:28.177250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:58.131405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.161207+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:44:27.161207+0000","last_peered":"2023-10-06T04:44:27.161207+0000","last_clean":"2023-10-06T04:44:27.161207+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:44:27.161207+0000","last_undegraded":"2023-10-06T04:44:27.161207+0000","last_fullsized":"2023-10-06T04:44:27.161207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.171984+0000","last_change":"2023-10-06T04:44:27.167851+0000","last_active":"2023-10-06T04:44:27.171984+0000","last_peered":"2023-10-06T04:44:27.171984+0000","last_clean":"2023-10-06T04:44:27.171984+0000","last_became_active":"2023-10-06T04:44:27.167572+0000","last_became_peered":"2023-10-06T04:44:27.167572+0000","last_unstale":"2023-10-06T04:44:27.171984+0000","last_undegraded":"2023-10-06T04:44:27.171984+0000","last_fullsized":"2023-10-06T04:44:27.171984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:28.298788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177734+0000","last_change":"2023-10-06T04:44:28.177734+0000","last_active":"2023-10-06T04:44:28.177734+0000","last_peered":"2023-10-06T04:44:28.177734+0000","last_clean":"2023-10-06T04:44:28.177734+0000","last_became_active":"2023-10-06T04:44:28.173936+0000","last_became_peered":"2023-10-06T04:44:28.173936+0000","last_unstale":"2023-10-06T04:44:28.177734+0000","last_undegraded":"2023-10-06T04:44:28.177734+0000","last_fullsized":"2023-10-06T04:44:28.177734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:31.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.157997+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:44:27.157997+0000","last_peered":"2023-10-06T04:44:27.157997+0000","last_clean":"2023-10-06T04:44:27.157997+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:44:27.157997+0000","last_undegraded":"2023-10-06T04:44:27.157997+0000","last_fullsized":"2023-10-06T04:44:27.157997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":162,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.159828+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:44:27.159828+0000","last_peered":"2023-10-06T04:44:27.159828+0000","last_clean":"2023-10-06T04:44:27.159828+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:44:27.159828+0000","last_undegraded":"2023-10-06T04:44:27.159828+0000","last_fullsized":"2023-10-06T04:44:27.159828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.174816+0000","last_change":"2023-10-06T04:44:27.171258+0000","last_active":"2023-10-06T04:44:27.174816+0000","last_peered":"2023-10-06T04:44:27.174816+0000","last_clean":"2023-10-06T04:44:27.174816+0000","last_became_active":"2023-10-06T04:44:27.170923+0000","last_became_peered":"2023-10-06T04:44:27.170923+0000","last_unstale":"2023-10-06T04:44:27.174816+0000","last_undegraded":"2023-10-06T04:44:27.174816+0000","last_fullsized":"2023-10-06T04:44:27.174816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:18.613164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.160968+0000","last_change":"2023-10-06T04:44:28.160968+0000","last_active":"2023-10-06T04:44:28.160968+0000","last_peered":"2023-10-06T04:44:28.160968+0000","last_clean":"2023-10-06T04:44:28.160968+0000","last_became_active":"2023-10-06T04:44:28.160710+0000","last_became_peered":"2023-10-06T04:44:28.160710+0000","last_unstale":"2023-10-06T04:44:28.160968+0000","last_undegraded":"2023-10-06T04:44:28.160968+0000","last_fullsized":"2023-10-06T04:44:28.160968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:16.179899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.157840+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:44:27.157840+0000","last_peered":"2023-10-06T04:44:27.157840+0000","last_clean":"2023-10-06T04:44:27.157840+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:44:27.157840+0000","last_undegraded":"2023-10-06T04:44:27.157840+0000","last_fullsized":"2023-10-06T04:44:27.157840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.171713+0000","last_change":"2023-10-06T04:44:27.164147+0000","last_active":"2023-10-06T04:44:27.171713+0000","last_peered":"2023-10-06T04:44:27.171713+0000","last_clean":"2023-10-06T04:44:27.171713+0000","last_became_active":"2023-10-06T04:44:27.163860+0000","last_became_peered":"2023-10-06T04:44:27.163860+0000","last_unstale":"2023-10-06T04:44:27.171713+0000","last_undegraded":"2023-10-06T04:44:27.171713+0000","last_fullsized":"2023-10-06T04:44:27.171713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:11.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.162519+0000","last_change":"2023-10-06T04:44:28.162519+0000","last_active":"2023-10-06T04:44:28.162519+0000","last_peered":"2023-10-06T04:44:28.162519+0000","last_clean":"2023-10-06T04:44:28.162519+0000","last_became_active":"2023-10-06T04:44:28.162231+0000","last_became_peered":"2023-10-06T04:44:28.162231+0000","last_unstale":"2023-10-06T04:44:28.162519+0000","last_undegraded":"2023-10-06T04:44:28.162519+0000","last_fullsized":"2023-10-06T04:44:28.162519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:37.642261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.159938+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:44:27.159938+0000","last_peered":"2023-10-06T04:44:27.159938+0000","last_clean":"2023-10-06T04:44:27.159938+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:44:27.159938+0000","last_undegraded":"2023-10-06T04:44:27.159938+0000","last_fullsized":"2023-10-06T04:44:27.159938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.174384+0000","last_change":"2023-10-06T04:44:27.170762+0000","last_active":"2023-10-06T04:44:27.174384+0000","last_peered":"2023-10-06T04:44:27.174384+0000","last_clean":"2023-10-06T04:44:27.174384+0000","last_became_active":"2023-10-06T04:44:27.170417+0000","last_became_peered":"2023-10-06T04:44:27.170417+0000","last_unstale":"2023-10-06T04:44:27.174384+0000","last_undegraded":"2023-10-06T04:44:27.174384+0000","last_fullsized":"2023-10-06T04:44:27.174384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:01.501146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177577+0000","last_change":"2023-10-06T04:44:28.177577+0000","last_active":"2023-10-06T04:44:28.177577+0000","last_peered":"2023-10-06T04:44:28.177577+0000","last_clean":"2023-10-06T04:44:28.177577+0000","last_became_active":"2023-10-06T04:44:28.176998+0000","last_became_peered":"2023-10-06T04:44:28.176998+0000","last_unstale":"2023-10-06T04:44:28.177577+0000","last_undegraded":"2023-10-06T04:44:28.177577+0000","last_fullsized":"2023-10-06T04:44:28.177577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.047230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.158365+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:44:27.158365+0000","last_peered":"2023-10-06T04:44:27.158365+0000","last_clean":"2023-10-06T04:44:27.158365+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:44:27.158365+0000","last_undegraded":"2023-10-06T04:44:27.158365+0000","last_fullsized":"2023-10-06T04:44:27.158365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.179386+0000","last_change":"2023-10-06T04:44:27.174609+0000","last_active":"2023-10-06T04:44:27.179386+0000","last_peered":"2023-10-06T04:44:27.179386+0000","last_clean":"2023-10-06T04:44:27.179386+0000","last_became_active":"2023-10-06T04:44:27.173130+0000","last_became_peered":"2023-10-06T04:44:27.173130+0000","last_unstale":"2023-10-06T04:44:27.179386+0000","last_undegraded":"2023-10-06T04:44:27.179386+0000","last_fullsized":"2023-10-06T04:44:27.179386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.166656+0000","last_change":"2023-10-06T04:44:28.166656+0000","last_active":"2023-10-06T04:44:28.166656+0000","last_peered":"2023-10-06T04:44:28.166656+0000","last_clean":"2023-10-06T04:44:28.166656+0000","last_became_active":"2023-10-06T04:44:28.166293+0000","last_became_peered":"2023-10-06T04:44:28.166293+0000","last_unstale":"2023-10-06T04:44:28.166656+0000","last_undegraded":"2023-10-06T04:44:28.166656+0000","last_fullsized":"2023-10-06T04:44:28.166656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:39.049512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.154355+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:44:27.154355+0000","last_peered":"2023-10-06T04:44:27.154355+0000","last_clean":"2023-10-06T04:44:27.154355+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:44:27.154355+0000","last_undegraded":"2023-10-06T04:44:27.154355+0000","last_fullsized":"2023-10-06T04:44:27.154355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.174614+0000","last_change":"2023-10-06T04:44:27.173242+0000","last_active":"2023-10-06T04:44:27.174614+0000","last_peered":"2023-10-06T04:44:27.174614+0000","last_clean":"2023-10-06T04:44:27.174614+0000","last_became_active":"2023-10-06T04:44:27.172919+0000","last_became_peered":"2023-10-06T04:44:27.172919+0000","last_unstale":"2023-10-06T04:44:27.174614+0000","last_undegraded":"2023-10-06T04:44:27.174614+0000","last_fullsized":"2023-10-06T04:44:27.174614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:56.308717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.169044+0000","last_change":"2023-10-06T04:44:28.169044+0000","last_active":"2023-10-06T04:44:28.169044+0000","last_peered":"2023-10-06T04:44:28.169044+0000","last_clean":"2023-10-06T04:44:28.169044+0000","last_became_active":"2023-10-06T04:44:28.168793+0000","last_became_peered":"2023-10-06T04:44:28.168793+0000","last_unstale":"2023-10-06T04:44:28.169044+0000","last_undegraded":"2023-10-06T04:44:28.169044+0000","last_fullsized":"2023-10-06T04:44:28.169044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:38.672585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.157688+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:44:27.157688+0000","last_peered":"2023-10-06T04:44:27.157688+0000","last_clean":"2023-10-06T04:44:27.157688+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:44:27.157688+0000","last_undegraded":"2023-10-06T04:44:27.157688+0000","last_fullsized":"2023-10-06T04:44:27.157688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.170868+0000","last_change":"2023-10-06T04:44:27.164715+0000","last_active":"2023-10-06T04:44:27.170868+0000","last_peered":"2023-10-06T04:44:27.170868+0000","last_clean":"2023-10-06T04:44:27.170868+0000","last_became_active":"2023-10-06T04:44:27.164441+0000","last_became_peered":"2023-10-06T04:44:27.164441+0000","last_unstale":"2023-10-06T04:44:27.170868+0000","last_undegraded":"2023-10-06T04:44:27.170868+0000","last_fullsized":"2023-10-06T04:44:27.170868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.163762+0000","last_change":"2023-10-06T04:44:28.163762+0000","last_active":"2023-10-06T04:44:28.163762+0000","last_peered":"2023-10-06T04:44:28.163762+0000","last_clean":"2023-10-06T04:44:28.163762+0000","last_became_active":"2023-10-06T04:44:28.162829+0000","last_became_peered":"2023-10-06T04:44:28.162829+0000","last_unstale":"2023-10-06T04:44:28.163762+0000","last_undegraded":"2023-10-06T04:44:28.163762+0000","last_fullsized":"2023-10-06T04:44:28.163762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:47.764193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.158253+0000","last_change":"2023-10-06T04:44:27.173098+0000","last_active":"2023-10-06T04:44:28.158253+0000","last_peered":"2023-10-06T04:44:28.158253+0000","last_clean":"2023-10-06T04:44:28.158253+0000","last_became_active":"2023-10-06T04:44:27.172825+0000","last_became_peered":"2023-10-06T04:44:27.172825+0000","last_unstale":"2023-10-06T04:44:28.158253+0000","last_undegraded":"2023-10-06T04:44:28.158253+0000","last_fullsized":"2023-10-06T04:44:28.158253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:11.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.165992+0000","last_change":"2023-10-06T04:44:28.165992+0000","last_active":"2023-10-06T04:44:28.165992+0000","last_peered":"2023-10-06T04:44:28.165992+0000","last_clean":"2023-10-06T04:44:28.165992+0000","last_became_active":"2023-10-06T04:44:28.165719+0000","last_became_peered":"2023-10-06T04:44:28.165719+0000","last_unstale":"2023-10-06T04:44:28.165992+0000","last_undegraded":"2023-10-06T04:44:28.165992+0000","last_fullsized":"2023-10-06T04:44:28.165992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:12.681182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.186637+0000","last_change":"2023-10-06T04:44:27.168462+0000","last_active":"2023-10-06T04:44:28.186637+0000","last_peered":"2023-10-06T04:44:28.186637+0000","last_clean":"2023-10-06T04:44:28.186637+0000","last_became_active":"2023-10-06T04:44:27.167211+0000","last_became_peered":"2023-10-06T04:44:27.167211+0000","last_unstale":"2023-10-06T04:44:28.186637+0000","last_undegraded":"2023-10-06T04:44:28.186637+0000","last_fullsized":"2023-10-06T04:44:28.186637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:18.718435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181846+0000","last_change":"2023-10-06T04:44:28.181846+0000","last_active":"2023-10-06T04:44:28.181846+0000","last_peered":"2023-10-06T04:44:28.181846+0000","last_clean":"2023-10-06T04:44:28.181846+0000","last_became_active":"2023-10-06T04:44:28.181641+0000","last_became_peered":"2023-10-06T04:44:28.181641+0000","last_unstale":"2023-10-06T04:44:28.181846+0000","last_undegraded":"2023-10-06T04:44:28.181846+0000","last_fullsized":"2023-10-06T04:44:28.181846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:01.432720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.185461+0000","last_change":"2023-10-06T04:44:27.168466+0000","last_active":"2023-10-06T04:44:28.185461+0000","last_peered":"2023-10-06T04:44:28.185461+0000","last_clean":"2023-10-06T04:44:28.185461+0000","last_became_active":"2023-10-06T04:44:27.167928+0000","last_became_peered":"2023-10-06T04:44:27.167928+0000","last_unstale":"2023-10-06T04:44:28.185461+0000","last_undegraded":"2023-10-06T04:44:28.185461+0000","last_fullsized":"2023-10-06T04:44:28.185461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181253+0000","last_change":"2023-10-06T04:44:28.181253+0000","last_active":"2023-10-06T04:44:28.181253+0000","last_peered":"2023-10-06T04:44:28.181253+0000","last_clean":"2023-10-06T04:44:28.181253+0000","last_became_active":"2023-10-06T04:44:28.181011+0000","last_became_peered":"2023-10-06T04:44:28.181011+0000","last_unstale":"2023-10-06T04:44:28.181253+0000","last_undegraded":"2023-10-06T04:44:28.181253+0000","last_fullsized":"2023-10-06T04:44:28.181253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:12.890746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.156419+0000","last_change":"2023-10-06T04:44:27.164196+0000","last_active":"2023-10-06T04:44:28.156419+0000","last_peered":"2023-10-06T04:44:28.156419+0000","last_clean":"2023-10-06T04:44:28.156419+0000","last_became_active":"2023-10-06T04:44:27.163920+0000","last_became_peered":"2023-10-06T04:44:27.163920+0000","last_unstale":"2023-10-06T04:44:28.156419+0000","last_undegraded":"2023-10-06T04:44:28.156419+0000","last_fullsized":"2023-10-06T04:44:28.156419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:25.287936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.172288+0000","last_change":"2023-10-06T04:44:28.172288+0000","last_active":"2023-10-06T04:44:28.172288+0000","last_peered":"2023-10-06T04:44:28.172288+0000","last_clean":"2023-10-06T04:44:28.172288+0000","last_became_active":"2023-10-06T04:44:28.171740+0000","last_became_peered":"2023-10-06T04:44:28.171740+0000","last_unstale":"2023-10-06T04:44:28.172288+0000","last_undegraded":"2023-10-06T04:44:28.172288+0000","last_fullsized":"2023-10-06T04:44:28.172288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:18.824278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187797+0000","last_change":"2023-10-06T04:44:27.167494+0000","last_active":"2023-10-06T04:44:28.187797+0000","last_peered":"2023-10-06T04:44:28.187797+0000","last_clean":"2023-10-06T04:44:28.187797+0000","last_became_active":"2023-10-06T04:44:27.167155+0000","last_became_peered":"2023-10-06T04:44:27.167155+0000","last_unstale":"2023-10-06T04:44:28.187797+0000","last_undegraded":"2023-10-06T04:44:28.187797+0000","last_fullsized":"2023-10-06T04:44:28.187797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:32.538225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173948+0000","last_change":"2023-10-06T04:44:28.173948+0000","last_active":"2023-10-06T04:44:28.173948+0000","last_peered":"2023-10-06T04:44:28.173948+0000","last_clean":"2023-10-06T04:44:28.173948+0000","last_became_active":"2023-10-06T04:44:28.173514+0000","last_became_peered":"2023-10-06T04:44:28.173514+0000","last_unstale":"2023-10-06T04:44:28.173948+0000","last_undegraded":"2023-10-06T04:44:28.173948+0000","last_fullsized":"2023-10-06T04:44:28.173948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:05.030988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173994+0000","last_change":"2023-10-06T04:44:28.173994+0000","last_active":"2023-10-06T04:44:28.173994+0000","last_peered":"2023-10-06T04:44:28.173994+0000","last_clean":"2023-10-06T04:44:28.173994+0000","last_became_active":"2023-10-06T04:44:28.173726+0000","last_became_peered":"2023-10-06T04:44:28.173726+0000","last_unstale":"2023-10-06T04:44:28.173994+0000","last_undegraded":"2023-10-06T04:44:28.173994+0000","last_fullsized":"2023-10-06T04:44:28.173994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:11.893905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176890+0000","last_change":"2023-10-06T04:44:28.176890+0000","last_active":"2023-10-06T04:44:28.176890+0000","last_peered":"2023-10-06T04:44:28.176890+0000","last_clean":"2023-10-06T04:44:28.176890+0000","last_became_active":"2023-10-06T04:44:28.174436+0000","last_became_peered":"2023-10-06T04:44:28.174436+0000","last_unstale":"2023-10-06T04:44:28.176890+0000","last_undegraded":"2023-10-06T04:44:28.176890+0000","last_fullsized":"2023-10-06T04:44:28.176890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:44.708051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176267+0000","last_change":"2023-10-06T04:44:28.176267+0000","last_active":"2023-10-06T04:44:28.176267+0000","last_peered":"2023-10-06T04:44:28.176267+0000","last_clean":"2023-10-06T04:44:28.176267+0000","last_became_active":"2023-10-06T04:44:28.175988+0000","last_became_peered":"2023-10-06T04:44:28.175988+0000","last_unstale":"2023-10-06T04:44:28.176267+0000","last_undegraded":"2023-10-06T04:44:28.176267+0000","last_fullsized":"2023-10-06T04:44:28.176267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:17.605122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174588+0000","last_change":"2023-10-06T04:44:28.174588+0000","last_active":"2023-10-06T04:44:28.174588+0000","last_peered":"2023-10-06T04:44:28.174588+0000","last_clean":"2023-10-06T04:44:28.174588+0000","last_became_active":"2023-10-06T04:44:28.174023+0000","last_became_peered":"2023-10-06T04:44:28.174023+0000","last_unstale":"2023-10-06T04:44:28.174588+0000","last_undegraded":"2023-10-06T04:44:28.174588+0000","last_fullsized":"2023-10-06T04:44:28.174588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:02.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.164700+0000","last_change":"2023-10-06T04:44:28.164700+0000","last_active":"2023-10-06T04:44:28.164700+0000","last_peered":"2023-10-06T04:44:28.164700+0000","last_clean":"2023-10-06T04:44:28.164700+0000","last_became_active":"2023-10-06T04:44:28.164337+0000","last_became_peered":"2023-10-06T04:44:28.164337+0000","last_unstale":"2023-10-06T04:44:28.164700+0000","last_undegraded":"2023-10-06T04:44:28.164700+0000","last_fullsized":"2023-10-06T04:44:28.164700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:15.790501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298104,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073736,"statfs":{"total":96636764160,"available":96331505664,"internally_reserved":0,"allocated":835584,"data_stored":667089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":665337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:44:32.523 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:44:32.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.743+0000 7f41b33ff700 1 Processor -- start 2023-10-06T04:44:32.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.743+0000 7f41b33ff700 1 -- start start 2023-10-06T04:44:32.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b33ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41ac15a750 0x7f41ac0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b33ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f41ac0cd1b0 0x7f41ac0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b33ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f41ac0cb1a0 0x7f41ac15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b33ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac0cbf10 con 0x7f41ac0cb1a0 2023-10-06T04:44:32.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b33ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac15b230 con 0x7f41ac0cd1b0 2023-10-06T04:44:32.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b33ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0cd620 con 0x7f41ac15a750 2023-10-06T04:44:32.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b199c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f41ac0cb1a0 0x7f41ac15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b119b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41ac15a750 0x7f41ac0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b199c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f41ac0cb1a0 0x7f41ac15b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59214/0 (socket says 172.21.15.124:59214) 2023-10-06T04:44:32.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b199c700 1 -- 172.21.15.124:0/2795926372 learned_addr learned my addr 172.21.15.124:0/2795926372 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:32.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b099a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f41ac0cd1b0 0x7f41ac0cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b199c700 1 -- 172.21.15.124:0/2795926372 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41ac15a750 msgr2=0x7f41ac0ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b199c700 1 --2- 172.21.15.124:0/2795926372 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41ac15a750 0x7f41ac0ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b199c700 1 -- 172.21.15.124:0/2795926372 >> v2:172.21.15.158:3300/0 conn(0x7f41ac0cd1b0 msgr2=0x7f41ac0cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b199c700 1 --2- 172.21.15.124:0/2795926372 >> v2:172.21.15.158:3300/0 conn(0x7f41ac0cd1b0 0x7f41ac0cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.745+0000 7f41b199c700 1 -- 172.21.15.124:0/2795926372 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac0cb950 con 0x7f41ac0cb1a0 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.746+0000 7f41b199c700 1 --2- 172.21.15.124:0/2795926372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac0cb1a0 0x7f41ac15b6c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41ac088bc0 tx=0x7f41a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b718c9cc9d44d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.746+0000 7f41a3fff700 1 -- 172.21.15.124:0/2795926372 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400e070 con 0x7f41ac0cb1a0 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.746+0000 7f41a3fff700 1 -- 172.21.15.124:0/2795926372 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a400b970 con 0x7f41ac0cb1a0 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.746+0000 7f41a3fff700 1 -- 172.21.15.124:0/2795926372 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a40092e0 con 0x7f41ac0cb1a0 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.747+0000 7f41b33ff700 1 -- 172.21.15.124:0/2795926372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac0cb1a0 msgr2=0x7f41ac15b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.747+0000 7f41b33ff700 1 --2- 172.21.15.124:0/2795926372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac0cb1a0 0x7f41ac15b6c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41ac088bc0 tx=0x7f41a4009840 comp rx=0 tx=0).stop 2023-10-06T04:44:32.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.747+0000 7f41b33ff700 1 -- 172.21.15.124:0/2795926372 shutdown_connections 2023-10-06T04:44:32.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.747+0000 7f41b33ff700 1 --2- 172.21.15.124:0/2795926372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac0cb1a0 0x7f41ac15b6c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.747+0000 7f41b33ff700 1 --2- 172.21.15.124:0/2795926372 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41ac15a750 0x7f41ac0ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.747+0000 7f41b33ff700 1 --2- 172.21.15.124:0/2795926372 >> v2:172.21.15.158:3300/0 conn(0x7f41ac0cd1b0 0x7f41ac0cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.747+0000 7f41b33ff700 1 -- 172.21.15.124:0/2795926372 >> 172.21.15.124:0/2795926372 conn(0x7f41ac099710 msgr2=0x7f41ac06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.747+0000 7f41b33ff700 1 -- 172.21.15.124:0/2795926372 shutdown_connections 2023-10-06T04:44:32.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.747+0000 7f41b33ff700 1 -- 172.21.15.124:0/2795926372 wait complete. 2023-10-06T04:44:32.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.748+0000 7f41b33ff700 1 Processor -- start 2023-10-06T04:44:32.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.749+0000 7f41b33ff700 1 -- start start 2023-10-06T04:44:32.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.749+0000 7f41b33ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41ac0cb1a0 0x7f41ac0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.749+0000 7f41b33ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41ac0cd1b0 0x7f41ac0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.749+0000 7f41b33ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac15a750 0x7f41ac154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.749+0000 7f41b33ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0c4c30 con 0x7f41ac15a750 2023-10-06T04:44:32.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.749+0000 7f41b33ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0c4ee0 con 0x7f41ac0cd1b0 2023-10-06T04:44:32.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.750+0000 7f41b33ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0c51c0 con 0x7f41ac0cb1a0 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.750+0000 7f41b199c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac15a750 0x7f41ac154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.750+0000 7f41b199c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac15a750 0x7f41ac154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59218/0 (socket says 172.21.15.124:59218) 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.750+0000 7f41b199c700 1 -- 172.21.15.124:0/768432675 learned_addr learned my addr 172.21.15.124:0/768432675 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.750+0000 7f41b199c700 1 -- 172.21.15.124:0/768432675 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41ac0cb1a0 msgr2=0x7f41ac0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.750+0000 7f41b199c700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41ac0cb1a0 0x7f41ac0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.750+0000 7f41b199c700 1 -- 172.21.15.124:0/768432675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41ac0cd1b0 msgr2=0x7f41ac0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.750+0000 7f41b199c700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41ac0cd1b0 0x7f41ac0c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.750+0000 7f41b199c700 1 -- 172.21.15.124:0/768432675 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4009ae0 con 0x7f41ac15a750 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.750+0000 7f41b199c700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac15a750 0x7f41ac154250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41ac088b90 tx=0x7f41a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.751+0000 7f41a17fa700 1 -- 172.21.15.124:0/768432675 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4008b80 con 0x7f41ac15a750 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.751+0000 7f41a17fa700 1 -- 172.21.15.124:0/768432675 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4008ce0 con 0x7f41ac15a750 2023-10-06T04:44:32.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.751+0000 7f41a17fa700 1 -- 172.21.15.124:0/768432675 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a40256b0 con 0x7f41ac15a750 2023-10-06T04:44:32.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.751+0000 7f41b33ff700 1 -- 172.21.15.124:0/768432675 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac0c54a0 con 0x7f41ac15a750 2023-10-06T04:44:32.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.751+0000 7f41b33ff700 1 -- 172.21.15.124:0/768432675 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ac0c5a60 con 0x7f41ac15a750 2023-10-06T04:44:32.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.752+0000 7f41b33ff700 1 -- 172.21.15.124:0/768432675 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ac0717a0 con 0x7f41ac15a750 2023-10-06T04:44:32.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.753+0000 7f41a17fa700 1 -- 172.21.15.124:0/768432675 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41a4003040 con 0x7f41ac15a750 2023-10-06T04:44:32.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.753+0000 7f41a17fa700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4190066f30 0x7f41900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.754+0000 7f41a17fa700 1 -- 172.21.15.124:0/768432675 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f41a4085c50 con 0x7f41ac15a750 2023-10-06T04:44:32.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.754+0000 7f41b119b700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4190066f30 0x7f41900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.754+0000 7f41b119b700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4190066f30 0x7f41900693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009b10 tx=0x7f41a80091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.758+0000 7f41a17fa700 1 -- 172.21.15.124:0/768432675 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41a4052d70 con 0x7f41ac15a750 2023-10-06T04:44:32.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.944+0000 7f41b33ff700 1 -- 172.21.15.124:0/768432675 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41ac0cbc30 con 0x7f4190066f30 2023-10-06T04:44:32.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.952+0000 7f41a17fa700 1 -- 172.21.15.124:0/768432675 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286809 (secure 0 0 0) 0x7f41ac0cbc30 con 0x7f4190066f30 2023-10-06T04:44:32.958 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:32.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.956+0000 7f41b33ff700 1 -- 172.21.15.124:0/768432675 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4190066f30 msgr2=0x7f41900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.956+0000 7f41b33ff700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4190066f30 0x7f41900693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009b10 tx=0x7f41a80091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.956+0000 7f41b33ff700 1 -- 172.21.15.124:0/768432675 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac15a750 msgr2=0x7f41ac154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.956+0000 7f41b33ff700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac15a750 0x7f41ac154250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41ac088b90 tx=0x7f41a4018000 comp rx=0 tx=0).stop 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.956+0000 7f41b33ff700 1 -- 172.21.15.124:0/768432675 shutdown_connections 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.956+0000 7f41b33ff700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41ac15a750 0x7f41ac154250 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.956+0000 7f41b33ff700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4190066f30 0x7f41900693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.956+0000 7f41b33ff700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41ac0cb1a0 0x7f41ac0c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.956+0000 7f41b33ff700 1 --2- 172.21.15.124:0/768432675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41ac0cd1b0 0x7f41ac0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.956+0000 7f41b33ff700 1 -- 172.21.15.124:0/768432675 >> 172.21.15.124:0/768432675 conn(0x7f41ac099710 msgr2=0x7f41ac15c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.957+0000 7f41b33ff700 1 -- 172.21.15.124:0/768432675 shutdown_connections 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:32.957+0000 7f41b33ff700 1 -- 172.21.15.124:0/768432675 wait complete. 2023-10-06T04:44:32.961 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:44:32.976 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-06T04:44:31.907880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381172,"kb_used_data":2868,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593548,"statfs":{"total":773094113280,"available":770655793152,"internally_reserved":0,"allocated":2936832,"data_stored":1783508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.765803"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173422+0000","last_change":"2023-10-06T04:44:28.173422+0000","last_active":"2023-10-06T04:44:28.173422+0000","last_peered":"2023-10-06T04:44:28.173422+0000","last_clean":"2023-10-06T04:44:28.173422+0000","last_became_active":"2023-10-06T04:44:28.172872+0000","last_became_peered":"2023-10-06T04:44:28.172872+0000","last_unstale":"2023-10-06T04:44:28.173422+0000","last_undegraded":"2023-10-06T04:44:28.173422+0000","last_fullsized":"2023-10-06T04:44:28.173422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:26.020254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.166093+0000","last_change":"2023-10-06T04:44:28.166093+0000","last_active":"2023-10-06T04:44:28.166093+0000","last_peered":"2023-10-06T04:44:28.166093+0000","last_clean":"2023-10-06T04:44:28.166093+0000","last_became_active":"2023-10-06T04:44:28.165832+0000","last_became_peered":"2023-10-06T04:44:28.165832+0000","last_unstale":"2023-10-06T04:44:28.166093+0000","last_undegraded":"2023-10-06T04:44:28.166093+0000","last_fullsized":"2023-10-06T04:44:28.166093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:20.325293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181890+0000","last_change":"2023-10-06T04:44:28.181890+0000","last_active":"2023-10-06T04:44:28.181890+0000","last_peered":"2023-10-06T04:44:28.181890+0000","last_clean":"2023-10-06T04:44:28.181890+0000","last_became_active":"2023-10-06T04:44:28.181525+0000","last_became_peered":"2023-10-06T04:44:28.181525+0000","last_unstale":"2023-10-06T04:44:28.181890+0000","last_undegraded":"2023-10-06T04:44:28.181890+0000","last_fullsized":"2023-10-06T04:44:28.181890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:10.808836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175818+0000","last_change":"2023-10-06T04:44:28.175818+0000","last_active":"2023-10-06T04:44:28.175818+0000","last_peered":"2023-10-06T04:44:28.175818+0000","last_clean":"2023-10-06T04:44:28.175818+0000","last_became_active":"2023-10-06T04:44:28.175535+0000","last_became_peered":"2023-10-06T04:44:28.175535+0000","last_unstale":"2023-10-06T04:44:28.175818+0000","last_undegraded":"2023-10-06T04:44:28.175818+0000","last_fullsized":"2023-10-06T04:44:28.175818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:54.215039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181590+0000","last_change":"2023-10-06T04:44:28.181590+0000","last_active":"2023-10-06T04:44:28.181590+0000","last_peered":"2023-10-06T04:44:28.181590+0000","last_clean":"2023-10-06T04:44:28.181590+0000","last_became_active":"2023-10-06T04:44:28.181326+0000","last_became_peered":"2023-10-06T04:44:28.181326+0000","last_unstale":"2023-10-06T04:44:28.181590+0000","last_undegraded":"2023-10-06T04:44:28.181590+0000","last_fullsized":"2023-10-06T04:44:28.181590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:22.042195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.180417+0000","last_change":"2023-10-06T04:44:28.180417+0000","last_active":"2023-10-06T04:44:28.180417+0000","last_peered":"2023-10-06T04:44:28.180417+0000","last_clean":"2023-10-06T04:44:28.180417+0000","last_became_active":"2023-10-06T04:44:28.179929+0000","last_became_peered":"2023-10-06T04:44:28.179929+0000","last_unstale":"2023-10-06T04:44:28.180417+0000","last_undegraded":"2023-10-06T04:44:28.180417+0000","last_fullsized":"2023-10-06T04:44:28.180417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:37.525707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.178946+0000","last_change":"2023-10-06T04:44:28.178946+0000","last_active":"2023-10-06T04:44:28.178946+0000","last_peered":"2023-10-06T04:44:28.178946+0000","last_clean":"2023-10-06T04:44:28.178946+0000","last_became_active":"2023-10-06T04:44:28.178304+0000","last_became_peered":"2023-10-06T04:44:28.178304+0000","last_unstale":"2023-10-06T04:44:28.178946+0000","last_undegraded":"2023-10-06T04:44:28.178946+0000","last_fullsized":"2023-10-06T04:44:28.178946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.327276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175157+0000","last_change":"2023-10-06T04:44:28.175157+0000","last_active":"2023-10-06T04:44:28.175157+0000","last_peered":"2023-10-06T04:44:28.175157+0000","last_clean":"2023-10-06T04:44:28.175157+0000","last_became_active":"2023-10-06T04:44:28.174893+0000","last_became_peered":"2023-10-06T04:44:28.174893+0000","last_unstale":"2023-10-06T04:44:28.175157+0000","last_undegraded":"2023-10-06T04:44:28.175157+0000","last_fullsized":"2023-10-06T04:44:28.175157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.047230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.172925+0000","last_change":"2023-10-06T04:44:28.172925+0000","last_active":"2023-10-06T04:44:28.172925+0000","last_peered":"2023-10-06T04:44:28.172925+0000","last_clean":"2023-10-06T04:44:28.172925+0000","last_became_active":"2023-10-06T04:44:28.172656+0000","last_became_peered":"2023-10-06T04:44:28.172656+0000","last_unstale":"2023-10-06T04:44:28.172925+0000","last_undegraded":"2023-10-06T04:44:28.172925+0000","last_fullsized":"2023-10-06T04:44:28.172925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:58.202199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.162650+0000","last_change":"2023-10-06T04:44:28.162650+0000","last_active":"2023-10-06T04:44:28.162650+0000","last_peered":"2023-10-06T04:44:28.162650+0000","last_clean":"2023-10-06T04:44:28.162650+0000","last_became_active":"2023-10-06T04:44:28.162164+0000","last_became_peered":"2023-10-06T04:44:28.162164+0000","last_unstale":"2023-10-06T04:44:28.162650+0000","last_undegraded":"2023-10-06T04:44:28.162650+0000","last_fullsized":"2023-10-06T04:44:28.162650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174246+0000","last_change":"2023-10-06T04:44:28.174246+0000","last_active":"2023-10-06T04:44:28.174246+0000","last_peered":"2023-10-06T04:44:28.174246+0000","last_clean":"2023-10-06T04:44:28.174246+0000","last_became_active":"2023-10-06T04:44:28.173913+0000","last_became_peered":"2023-10-06T04:44:28.173913+0000","last_unstale":"2023-10-06T04:44:28.174246+0000","last_undegraded":"2023-10-06T04:44:28.174246+0000","last_fullsized":"2023-10-06T04:44:28.174246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175653+0000","last_change":"2023-10-06T04:44:28.175653+0000","last_active":"2023-10-06T04:44:28.175653+0000","last_peered":"2023-10-06T04:44:28.175653+0000","last_clean":"2023-10-06T04:44:28.175653+0000","last_became_active":"2023-10-06T04:44:28.175322+0000","last_became_peered":"2023-10-06T04:44:28.175322+0000","last_unstale":"2023-10-06T04:44:28.175653+0000","last_undegraded":"2023-10-06T04:44:28.175653+0000","last_fullsized":"2023-10-06T04:44:28.175653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:45.455338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173340+0000","last_change":"2023-10-06T04:44:28.173340+0000","last_active":"2023-10-06T04:44:28.173340+0000","last_peered":"2023-10-06T04:44:28.173340+0000","last_clean":"2023-10-06T04:44:28.173340+0000","last_became_active":"2023-10-06T04:44:28.173003+0000","last_became_peered":"2023-10-06T04:44:28.173003+0000","last_unstale":"2023-10-06T04:44:28.173340+0000","last_undegraded":"2023-10-06T04:44:28.173340+0000","last_fullsized":"2023-10-06T04:44:28.173340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:33.543547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.164616+0000","last_change":"2023-10-06T04:44:28.164616+0000","last_active":"2023-10-06T04:44:28.164616+0000","last_peered":"2023-10-06T04:44:28.164616+0000","last_clean":"2023-10-06T04:44:28.164616+0000","last_became_active":"2023-10-06T04:44:28.164191+0000","last_became_peered":"2023-10-06T04:44:28.164191+0000","last_unstale":"2023-10-06T04:44:28.164616+0000","last_undegraded":"2023-10-06T04:44:28.164616+0000","last_fullsized":"2023-10-06T04:44:28.164616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:59.257080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.179115+0000","last_change":"2023-10-06T04:44:28.179115+0000","last_active":"2023-10-06T04:44:28.179115+0000","last_peered":"2023-10-06T04:44:28.179115+0000","last_clean":"2023-10-06T04:44:28.179115+0000","last_became_active":"2023-10-06T04:44:28.178643+0000","last_became_peered":"2023-10-06T04:44:28.178643+0000","last_unstale":"2023-10-06T04:44:28.179115+0000","last_undegraded":"2023-10-06T04:44:28.179115+0000","last_fullsized":"2023-10-06T04:44:28.179115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.180012+0000","last_change":"2023-10-06T04:44:28.180012+0000","last_active":"2023-10-06T04:44:28.180012+0000","last_peered":"2023-10-06T04:44:28.180012+0000","last_clean":"2023-10-06T04:44:28.180012+0000","last_became_active":"2023-10-06T04:44:28.179719+0000","last_became_peered":"2023-10-06T04:44:28.179719+0000","last_unstale":"2023-10-06T04:44:28.180012+0000","last_undegraded":"2023-10-06T04:44:28.180012+0000","last_fullsized":"2023-10-06T04:44:28.180012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.765680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.172407+0000","last_change":"2023-10-06T04:44:28.172407+0000","last_active":"2023-10-06T04:44:28.172407+0000","last_peered":"2023-10-06T04:44:28.172407+0000","last_clean":"2023-10-06T04:44:28.172407+0000","last_became_active":"2023-10-06T04:44:28.172144+0000","last_became_peered":"2023-10-06T04:44:28.172144+0000","last_unstale":"2023-10-06T04:44:28.172407+0000","last_undegraded":"2023-10-06T04:44:28.172407+0000","last_fullsized":"2023-10-06T04:44:28.172407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:30.261730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175526+0000","last_change":"2023-10-06T04:44:28.175526+0000","last_active":"2023-10-06T04:44:28.175526+0000","last_peered":"2023-10-06T04:44:28.175526+0000","last_clean":"2023-10-06T04:44:28.175526+0000","last_became_active":"2023-10-06T04:44:28.174982+0000","last_became_peered":"2023-10-06T04:44:28.174982+0000","last_unstale":"2023-10-06T04:44:28.175526+0000","last_undegraded":"2023-10-06T04:44:28.175526+0000","last_fullsized":"2023-10-06T04:44:28.175526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:44.708051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.165012+0000","last_change":"2023-10-06T04:44:28.165012+0000","last_active":"2023-10-06T04:44:28.165012+0000","last_peered":"2023-10-06T04:44:28.165012+0000","last_clean":"2023-10-06T04:44:28.165012+0000","last_became_active":"2023-10-06T04:44:28.164574+0000","last_became_peered":"2023-10-06T04:44:28.164574+0000","last_unstale":"2023-10-06T04:44:28.165012+0000","last_undegraded":"2023-10-06T04:44:28.165012+0000","last_fullsized":"2023-10-06T04:44:28.165012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:29.304110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.178396+0000","last_change":"2023-10-06T04:44:28.178396+0000","last_active":"2023-10-06T04:44:28.178396+0000","last_peered":"2023-10-06T04:44:28.178396+0000","last_clean":"2023-10-06T04:44:28.178396+0000","last_became_active":"2023-10-06T04:44:28.178046+0000","last_became_peered":"2023-10-06T04:44:28.178046+0000","last_unstale":"2023-10-06T04:44:28.178396+0000","last_undegraded":"2023-10-06T04:44:28.178396+0000","last_fullsized":"2023-10-06T04:44:28.178396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:06.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182289+0000","last_change":"2023-10-06T04:44:28.182289+0000","last_active":"2023-10-06T04:44:28.182289+0000","last_peered":"2023-10-06T04:44:28.182289+0000","last_clean":"2023-10-06T04:44:28.182289+0000","last_became_active":"2023-10-06T04:44:28.181655+0000","last_became_peered":"2023-10-06T04:44:28.181655+0000","last_unstale":"2023-10-06T04:44:28.182289+0000","last_undegraded":"2023-10-06T04:44:28.182289+0000","last_fullsized":"2023-10-06T04:44:28.182289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:20.325293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.166193+0000","last_change":"2023-10-06T04:44:28.166193+0000","last_active":"2023-10-06T04:44:28.166193+0000","last_peered":"2023-10-06T04:44:28.166193+0000","last_clean":"2023-10-06T04:44:28.166193+0000","last_became_active":"2023-10-06T04:44:28.165254+0000","last_became_peered":"2023-10-06T04:44:28.165254+0000","last_unstale":"2023-10-06T04:44:28.166193+0000","last_undegraded":"2023-10-06T04:44:28.166193+0000","last_fullsized":"2023-10-06T04:44:28.166193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.526003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.172488+0000","last_change":"2023-10-06T04:44:28.172488+0000","last_active":"2023-10-06T04:44:28.172488+0000","last_peered":"2023-10-06T04:44:28.172488+0000","last_clean":"2023-10-06T04:44:28.172488+0000","last_became_active":"2023-10-06T04:44:28.172052+0000","last_became_peered":"2023-10-06T04:44:28.172052+0000","last_unstale":"2023-10-06T04:44:28.172488+0000","last_undegraded":"2023-10-06T04:44:28.172488+0000","last_fullsized":"2023-10-06T04:44:28.172488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:25.165826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.188043+0000","last_change":"2023-10-06T04:44:28.188043+0000","last_active":"2023-10-06T04:44:28.188043+0000","last_peered":"2023-10-06T04:44:28.188043+0000","last_clean":"2023-10-06T04:44:28.188043+0000","last_became_active":"2023-10-06T04:44:28.187730+0000","last_became_peered":"2023-10-06T04:44:28.187730+0000","last_unstale":"2023-10-06T04:44:28.188043+0000","last_undegraded":"2023-10-06T04:44:28.188043+0000","last_fullsized":"2023-10-06T04:44:28.188043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.165414+0000","last_change":"2023-10-06T04:44:28.165414+0000","last_active":"2023-10-06T04:44:28.165414+0000","last_peered":"2023-10-06T04:44:28.165414+0000","last_clean":"2023-10-06T04:44:28.165414+0000","last_became_active":"2023-10-06T04:44:28.165101+0000","last_became_peered":"2023-10-06T04:44:28.165101+0000","last_unstale":"2023-10-06T04:44:28.165414+0000","last_undegraded":"2023-10-06T04:44:28.165414+0000","last_fullsized":"2023-10-06T04:44:28.165414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.526003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.168938+0000","last_change":"2023-10-06T04:44:28.168938+0000","last_active":"2023-10-06T04:44:28.168938+0000","last_peered":"2023-10-06T04:44:28.168938+0000","last_clean":"2023-10-06T04:44:28.168938+0000","last_became_active":"2023-10-06T04:44:28.168679+0000","last_became_peered":"2023-10-06T04:44:28.168679+0000","last_unstale":"2023-10-06T04:44:28.168938+0000","last_undegraded":"2023-10-06T04:44:28.168938+0000","last_fullsized":"2023-10-06T04:44:28.168938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:35:22.562710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.169001+0000","last_change":"2023-10-06T04:44:28.169001+0000","last_active":"2023-10-06T04:44:28.169001+0000","last_peered":"2023-10-06T04:44:28.169001+0000","last_clean":"2023-10-06T04:44:28.169001+0000","last_became_active":"2023-10-06T04:44:28.168663+0000","last_became_peered":"2023-10-06T04:44:28.168663+0000","last_unstale":"2023-10-06T04:44:28.169001+0000","last_undegraded":"2023-10-06T04:44:28.169001+0000","last_fullsized":"2023-10-06T04:44:28.169001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:18.824278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.159327+0000","last_change":"2023-10-06T04:44:27.176063+0000","last_active":"2023-10-06T04:44:28.159327+0000","last_peered":"2023-10-06T04:44:28.159327+0000","last_clean":"2023-10-06T04:44:28.159327+0000","last_became_active":"2023-10-06T04:44:27.175663+0000","last_became_peered":"2023-10-06T04:44:27.175663+0000","last_unstale":"2023-10-06T04:44:28.159327+0000","last_undegraded":"2023-10-06T04:44:28.159327+0000","last_fullsized":"2023-10-06T04:44:28.159327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.171391+0000","last_change":"2023-10-06T04:44:28.171391+0000","last_active":"2023-10-06T04:44:28.171391+0000","last_peered":"2023-10-06T04:44:28.171391+0000","last_clean":"2023-10-06T04:44:28.171391+0000","last_became_active":"2023-10-06T04:44:28.171117+0000","last_became_peered":"2023-10-06T04:44:28.171117+0000","last_unstale":"2023-10-06T04:44:28.171391+0000","last_undegraded":"2023-10-06T04:44:28.171391+0000","last_fullsized":"2023-10-06T04:44:28.171391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:06.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.178967+0000","last_change":"2023-10-06T04:44:27.175499+0000","last_active":"2023-10-06T04:44:27.178967+0000","last_peered":"2023-10-06T04:44:27.178967+0000","last_clean":"2023-10-06T04:44:27.178967+0000","last_became_active":"2023-10-06T04:44:27.175181+0000","last_became_peered":"2023-10-06T04:44:27.175181+0000","last_unstale":"2023-10-06T04:44:27.178967+0000","last_undegraded":"2023-10-06T04:44:27.178967+0000","last_fullsized":"2023-10-06T04:44:27.178967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:18.613164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.171657+0000","last_change":"2023-10-06T04:44:28.171657+0000","last_active":"2023-10-06T04:44:28.171657+0000","last_peered":"2023-10-06T04:44:28.171657+0000","last_clean":"2023-10-06T04:44:28.171657+0000","last_became_active":"2023-10-06T04:44:28.171374+0000","last_became_peered":"2023-10-06T04:44:28.171374+0000","last_unstale":"2023-10-06T04:44:28.171657+0000","last_undegraded":"2023-10-06T04:44:28.171657+0000","last_fullsized":"2023-10-06T04:44:28.171657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:10.149033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.162483+0000","last_change":"2023-10-06T04:44:27.160189+0000","last_active":"2023-10-06T04:44:27.162483+0000","last_peered":"2023-10-06T04:44:27.162483+0000","last_clean":"2023-10-06T04:44:27.162483+0000","last_became_active":"2023-10-06T04:44:27.159913+0000","last_became_peered":"2023-10-06T04:44:27.159913+0000","last_unstale":"2023-10-06T04:44:27.162483+0000","last_undegraded":"2023-10-06T04:44:27.162483+0000","last_fullsized":"2023-10-06T04:44:27.162483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:31.797194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.169511+0000","last_change":"2023-10-06T04:44:28.169511+0000","last_active":"2023-10-06T04:44:28.169511+0000","last_peered":"2023-10-06T04:44:28.169511+0000","last_clean":"2023-10-06T04:44:28.169511+0000","last_became_active":"2023-10-06T04:44:28.169196+0000","last_became_peered":"2023-10-06T04:44:28.169196+0000","last_unstale":"2023-10-06T04:44:28.169511+0000","last_undegraded":"2023-10-06T04:44:28.169511+0000","last_fullsized":"2023-10-06T04:44:28.169511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:14.693541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.171791+0000","last_change":"2023-10-06T04:44:27.165250+0000","last_active":"2023-10-06T04:44:27.171791+0000","last_peered":"2023-10-06T04:44:27.171791+0000","last_clean":"2023-10-06T04:44:27.171791+0000","last_became_active":"2023-10-06T04:44:27.164945+0000","last_became_peered":"2023-10-06T04:44:27.164945+0000","last_unstale":"2023-10-06T04:44:27.171791+0000","last_undegraded":"2023-10-06T04:44:27.171791+0000","last_fullsized":"2023-10-06T04:44:27.171791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:25.014932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.178132+0000","last_change":"2023-10-06T04:44:28.178132+0000","last_active":"2023-10-06T04:44:28.178132+0000","last_peered":"2023-10-06T04:44:28.178132+0000","last_clean":"2023-10-06T04:44:28.178132+0000","last_became_active":"2023-10-06T04:44:28.177887+0000","last_became_peered":"2023-10-06T04:44:28.177887+0000","last_unstale":"2023-10-06T04:44:28.178132+0000","last_undegraded":"2023-10-06T04:44:28.178132+0000","last_fullsized":"2023-10-06T04:44:28.178132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:05.030988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.178069+0000","last_change":"2023-10-06T04:44:27.175489+0000","last_active":"2023-10-06T04:44:27.178069+0000","last_peered":"2023-10-06T04:44:27.178069+0000","last_clean":"2023-10-06T04:44:27.178069+0000","last_became_active":"2023-10-06T04:44:27.175091+0000","last_became_peered":"2023-10-06T04:44:27.175091+0000","last_unstale":"2023-10-06T04:44:27.178069+0000","last_undegraded":"2023-10-06T04:44:27.178069+0000","last_fullsized":"2023-10-06T04:44:27.178069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175583+0000","last_change":"2023-10-06T04:44:28.175583+0000","last_active":"2023-10-06T04:44:28.175583+0000","last_peered":"2023-10-06T04:44:28.175583+0000","last_clean":"2023-10-06T04:44:28.175583+0000","last_became_active":"2023-10-06T04:44:28.174168+0000","last_became_peered":"2023-10-06T04:44:28.174168+0000","last_unstale":"2023-10-06T04:44:28.175583+0000","last_undegraded":"2023-10-06T04:44:28.175583+0000","last_fullsized":"2023-10-06T04:44:28.175583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:13.248204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194244+0000","last_change":"2023-10-06T04:44:27.173497+0000","last_active":"2023-10-06T04:44:28.194244+0000","last_peered":"2023-10-06T04:44:28.194244+0000","last_clean":"2023-10-06T04:44:28.194244+0000","last_became_active":"2023-10-06T04:44:27.173266+0000","last_became_peered":"2023-10-06T04:44:27.173266+0000","last_unstale":"2023-10-06T04:44:28.194244+0000","last_undegraded":"2023-10-06T04:44:28.194244+0000","last_fullsized":"2023-10-06T04:44:28.194244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:25.287936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.164074+0000","last_change":"2023-10-06T04:44:28.164074+0000","last_active":"2023-10-06T04:44:28.164074+0000","last_peered":"2023-10-06T04:44:28.164074+0000","last_clean":"2023-10-06T04:44:28.164074+0000","last_became_active":"2023-10-06T04:44:28.163794+0000","last_became_peered":"2023-10-06T04:44:28.163794+0000","last_unstale":"2023-10-06T04:44:28.164074+0000","last_undegraded":"2023-10-06T04:44:28.164074+0000","last_fullsized":"2023-10-06T04:44:28.164074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:00.867338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194439+0000","last_change":"2023-10-06T04:44:27.174376+0000","last_active":"2023-10-06T04:44:28.194439+0000","last_peered":"2023-10-06T04:44:28.194439+0000","last_clean":"2023-10-06T04:44:28.194439+0000","last_became_active":"2023-10-06T04:44:27.172580+0000","last_became_peered":"2023-10-06T04:44:27.172580+0000","last_unstale":"2023-10-06T04:44:28.194439+0000","last_undegraded":"2023-10-06T04:44:28.194439+0000","last_fullsized":"2023-10-06T04:44:28.194439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:18.718435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176191+0000","last_change":"2023-10-06T04:44:28.176191+0000","last_active":"2023-10-06T04:44:28.176191+0000","last_peered":"2023-10-06T04:44:28.176191+0000","last_clean":"2023-10-06T04:44:28.176191+0000","last_became_active":"2023-10-06T04:44:28.175904+0000","last_became_peered":"2023-10-06T04:44:28.175904+0000","last_unstale":"2023-10-06T04:44:28.176191+0000","last_undegraded":"2023-10-06T04:44:28.176191+0000","last_fullsized":"2023-10-06T04:44:28.176191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:02.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.193877+0000","last_change":"2023-10-06T04:44:27.176572+0000","last_active":"2023-10-06T04:44:28.193877+0000","last_peered":"2023-10-06T04:44:28.193877+0000","last_clean":"2023-10-06T04:44:28.193877+0000","last_became_active":"2023-10-06T04:44:27.176184+0000","last_became_peered":"2023-10-06T04:44:27.176184+0000","last_unstale":"2023-10-06T04:44:28.193877+0000","last_undegraded":"2023-10-06T04:44:28.193877+0000","last_fullsized":"2023-10-06T04:44:28.193877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:42.805321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.179767+0000","last_change":"2023-10-06T04:44:28.179767+0000","last_active":"2023-10-06T04:44:28.179767+0000","last_peered":"2023-10-06T04:44:28.179767+0000","last_clean":"2023-10-06T04:44:28.179767+0000","last_became_active":"2023-10-06T04:44:28.178145+0000","last_became_peered":"2023-10-06T04:44:28.178145+0000","last_unstale":"2023-10-06T04:44:28.179767+0000","last_undegraded":"2023-10-06T04:44:28.179767+0000","last_fullsized":"2023-10-06T04:44:28.179767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.765680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.172419+0000","last_change":"2023-10-06T04:44:27.169868+0000","last_active":"2023-10-06T04:44:27.172419+0000","last_peered":"2023-10-06T04:44:27.172419+0000","last_clean":"2023-10-06T04:44:27.172419+0000","last_became_active":"2023-10-06T04:44:27.169616+0000","last_became_peered":"2023-10-06T04:44:27.169616+0000","last_unstale":"2023-10-06T04:44:27.172419+0000","last_undegraded":"2023-10-06T04:44:27.172419+0000","last_fullsized":"2023-10-06T04:44:27.172419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:56.308717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.168629+0000","last_change":"2023-10-06T04:44:28.168629+0000","last_active":"2023-10-06T04:44:28.168629+0000","last_peered":"2023-10-06T04:44:28.168629+0000","last_clean":"2023-10-06T04:44:28.168629+0000","last_became_active":"2023-10-06T04:44:28.168374+0000","last_became_peered":"2023-10-06T04:44:28.168374+0000","last_unstale":"2023-10-06T04:44:28.168629+0000","last_undegraded":"2023-10-06T04:44:28.168629+0000","last_fullsized":"2023-10-06T04:44:28.168629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.176999+0000","last_change":"2023-10-06T04:44:27.175001+0000","last_active":"2023-10-06T04:44:27.176999+0000","last_peered":"2023-10-06T04:44:27.176999+0000","last_clean":"2023-10-06T04:44:27.176999+0000","last_became_active":"2023-10-06T04:44:27.174715+0000","last_became_peered":"2023-10-06T04:44:27.174715+0000","last_unstale":"2023-10-06T04:44:27.176999+0000","last_undegraded":"2023-10-06T04:44:27.176999+0000","last_fullsized":"2023-10-06T04:44:27.176999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:16.760012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181610+0000","last_change":"2023-10-06T04:44:28.181610+0000","last_active":"2023-10-06T04:44:28.181610+0000","last_peered":"2023-10-06T04:44:28.181610+0000","last_clean":"2023-10-06T04:44:28.181610+0000","last_became_active":"2023-10-06T04:44:28.180610+0000","last_became_peered":"2023-10-06T04:44:28.180610+0000","last_unstale":"2023-10-06T04:44:28.181610+0000","last_undegraded":"2023-10-06T04:44:28.181610+0000","last_fullsized":"2023-10-06T04:44:28.181610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:15.790501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.191144+0000","last_change":"2023-10-06T04:44:27.162747+0000","last_active":"2023-10-06T04:44:28.191144+0000","last_peered":"2023-10-06T04:44:28.191144+0000","last_clean":"2023-10-06T04:44:28.191144+0000","last_became_active":"2023-10-06T04:44:27.162395+0000","last_became_peered":"2023-10-06T04:44:27.162395+0000","last_unstale":"2023-10-06T04:44:28.191144+0000","last_undegraded":"2023-10-06T04:44:28.191144+0000","last_fullsized":"2023-10-06T04:44:28.191144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175866+0000","last_change":"2023-10-06T04:44:28.175866+0000","last_active":"2023-10-06T04:44:28.175866+0000","last_peered":"2023-10-06T04:44:28.175866+0000","last_clean":"2023-10-06T04:44:28.175866+0000","last_became_active":"2023-10-06T04:44:28.174850+0000","last_became_peered":"2023-10-06T04:44:28.174850+0000","last_unstale":"2023-10-06T04:44:28.175866+0000","last_undegraded":"2023-10-06T04:44:28.175866+0000","last_fullsized":"2023-10-06T04:44:28.175866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:44.943378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.160051+0000","last_change":"2023-10-06T04:44:27.171420+0000","last_active":"2023-10-06T04:44:28.160051+0000","last_peered":"2023-10-06T04:44:28.160051+0000","last_clean":"2023-10-06T04:44:28.160051+0000","last_became_active":"2023-10-06T04:44:27.170321+0000","last_became_peered":"2023-10-06T04:44:27.170321+0000","last_unstale":"2023-10-06T04:44:28.160051+0000","last_undegraded":"2023-10-06T04:44:28.160051+0000","last_fullsized":"2023-10-06T04:44:28.160051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.167916+0000","last_change":"2023-10-06T04:44:28.167916+0000","last_active":"2023-10-06T04:44:28.167916+0000","last_peered":"2023-10-06T04:44:28.167916+0000","last_clean":"2023-10-06T04:44:28.167916+0000","last_became_active":"2023-10-06T04:44:28.167567+0000","last_became_peered":"2023-10-06T04:44:28.167567+0000","last_unstale":"2023-10-06T04:44:28.167916+0000","last_undegraded":"2023-10-06T04:44:28.167916+0000","last_fullsized":"2023-10-06T04:44:28.167916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.327276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194029+0000","last_change":"2023-10-06T04:44:27.171251+0000","last_active":"2023-10-06T04:44:28.194029+0000","last_peered":"2023-10-06T04:44:28.194029+0000","last_clean":"2023-10-06T04:44:28.194029+0000","last_became_active":"2023-10-06T04:44:27.170918+0000","last_became_peered":"2023-10-06T04:44:27.170918+0000","last_unstale":"2023-10-06T04:44:28.194029+0000","last_undegraded":"2023-10-06T04:44:28.194029+0000","last_fullsized":"2023-10-06T04:44:28.194029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:31.797194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173878+0000","last_change":"2023-10-06T04:44:28.173878+0000","last_active":"2023-10-06T04:44:28.173878+0000","last_peered":"2023-10-06T04:44:28.173878+0000","last_clean":"2023-10-06T04:44:28.173878+0000","last_became_active":"2023-10-06T04:44:28.173437+0000","last_became_peered":"2023-10-06T04:44:28.173437+0000","last_unstale":"2023-10-06T04:44:28.173878+0000","last_undegraded":"2023-10-06T04:44:28.173878+0000","last_fullsized":"2023-10-06T04:44:28.173878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:13.338361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.162495+0000","last_change":"2023-10-06T04:44:27.176907+0000","last_active":"2023-10-06T04:44:28.162495+0000","last_peered":"2023-10-06T04:44:28.162495+0000","last_clean":"2023-10-06T04:44:28.162495+0000","last_became_active":"2023-10-06T04:44:27.176591+0000","last_became_peered":"2023-10-06T04:44:27.176591+0000","last_unstale":"2023-10-06T04:44:28.162495+0000","last_undegraded":"2023-10-06T04:44:28.162495+0000","last_fullsized":"2023-10-06T04:44:28.162495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:48.634872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170672+0000","last_change":"2023-10-06T04:44:28.170672+0000","last_active":"2023-10-06T04:44:28.170672+0000","last_peered":"2023-10-06T04:44:28.170672+0000","last_clean":"2023-10-06T04:44:28.170672+0000","last_became_active":"2023-10-06T04:44:28.170212+0000","last_became_peered":"2023-10-06T04:44:28.170212+0000","last_unstale":"2023-10-06T04:44:28.170672+0000","last_undegraded":"2023-10-06T04:44:28.170672+0000","last_fullsized":"2023-10-06T04:44:28.170672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.175000+0000","last_change":"2023-10-06T04:44:27.166881+0000","last_active":"2023-10-06T04:44:27.175000+0000","last_peered":"2023-10-06T04:44:27.175000+0000","last_clean":"2023-10-06T04:44:27.175000+0000","last_became_active":"2023-10-06T04:44:27.166606+0000","last_became_peered":"2023-10-06T04:44:27.166606+0000","last_unstale":"2023-10-06T04:44:27.175000+0000","last_undegraded":"2023-10-06T04:44:27.175000+0000","last_fullsized":"2023-10-06T04:44:27.175000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:01.501146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.167261+0000","last_change":"2023-10-06T04:44:28.167261+0000","last_active":"2023-10-06T04:44:28.167261+0000","last_peered":"2023-10-06T04:44:28.167261+0000","last_clean":"2023-10-06T04:44:28.167261+0000","last_became_active":"2023-10-06T04:44:28.167017+0000","last_became_peered":"2023-10-06T04:44:28.167017+0000","last_unstale":"2023-10-06T04:44:28.167261+0000","last_undegraded":"2023-10-06T04:44:28.167261+0000","last_fullsized":"2023-10-06T04:44:28.167261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:37.963273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.185874+0000","last_change":"2023-10-06T04:44:27.169708+0000","last_active":"2023-10-06T04:44:28.185874+0000","last_peered":"2023-10-06T04:44:28.185874+0000","last_clean":"2023-10-06T04:44:28.185874+0000","last_became_active":"2023-10-06T04:44:27.169446+0000","last_became_peered":"2023-10-06T04:44:27.169446+0000","last_unstale":"2023-10-06T04:44:28.185874+0000","last_undegraded":"2023-10-06T04:44:28.185874+0000","last_fullsized":"2023-10-06T04:44:28.185874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:42.805321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182653+0000","last_change":"2023-10-06T04:44:28.182653+0000","last_active":"2023-10-06T04:44:28.182653+0000","last_peered":"2023-10-06T04:44:28.182653+0000","last_clean":"2023-10-06T04:44:28.182653+0000","last_became_active":"2023-10-06T04:44:28.182103+0000","last_became_peered":"2023-10-06T04:44:28.182103+0000","last_unstale":"2023-10-06T04:44:28.182653+0000","last_undegraded":"2023-10-06T04:44:28.182653+0000","last_fullsized":"2023-10-06T04:44:28.182653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:13.248204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.176281+0000","last_change":"2023-10-06T04:44:27.173805+0000","last_active":"2023-10-06T04:44:27.176281+0000","last_peered":"2023-10-06T04:44:27.176281+0000","last_clean":"2023-10-06T04:44:27.176281+0000","last_became_active":"2023-10-06T04:44:27.173356+0000","last_became_peered":"2023-10-06T04:44:27.173356+0000","last_unstale":"2023-10-06T04:44:27.176281+0000","last_undegraded":"2023-10-06T04:44:27.176281+0000","last_fullsized":"2023-10-06T04:44:27.176281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174085+0000","last_change":"2023-10-06T04:44:28.174085+0000","last_active":"2023-10-06T04:44:28.174085+0000","last_peered":"2023-10-06T04:44:28.174085+0000","last_clean":"2023-10-06T04:44:28.174085+0000","last_became_active":"2023-10-06T04:44:28.173252+0000","last_became_peered":"2023-10-06T04:44:28.173252+0000","last_unstale":"2023-10-06T04:44:28.174085+0000","last_undegraded":"2023-10-06T04:44:28.174085+0000","last_fullsized":"2023-10-06T04:44:28.174085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:44.943378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.179334+0000","last_change":"2023-10-06T04:44:27.173971+0000","last_active":"2023-10-06T04:44:27.179334+0000","last_peered":"2023-10-06T04:44:27.179334+0000","last_clean":"2023-10-06T04:44:27.179334+0000","last_became_active":"2023-10-06T04:44:27.173624+0000","last_became_peered":"2023-10-06T04:44:27.173624+0000","last_unstale":"2023-10-06T04:44:27.179334+0000","last_undegraded":"2023-10-06T04:44:27.179334+0000","last_fullsized":"2023-10-06T04:44:27.179334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:59.033178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175781+0000","last_change":"2023-10-06T04:44:28.175781+0000","last_active":"2023-10-06T04:44:28.175781+0000","last_peered":"2023-10-06T04:44:28.175781+0000","last_clean":"2023-10-06T04:44:28.175781+0000","last_became_active":"2023-10-06T04:44:28.174281+0000","last_became_peered":"2023-10-06T04:44:28.174281+0000","last_unstale":"2023-10-06T04:44:28.175781+0000","last_undegraded":"2023-10-06T04:44:28.175781+0000","last_fullsized":"2023-10-06T04:44:28.175781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:58.131405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.176743+0000","last_change":"2023-10-06T04:44:27.175348+0000","last_active":"2023-10-06T04:44:27.176743+0000","last_peered":"2023-10-06T04:44:27.176743+0000","last_clean":"2023-10-06T04:44:27.176743+0000","last_became_active":"2023-10-06T04:44:27.175051+0000","last_became_peered":"2023-10-06T04:44:27.175051+0000","last_unstale":"2023-10-06T04:44:27.176743+0000","last_undegraded":"2023-10-06T04:44:27.176743+0000","last_fullsized":"2023-10-06T04:44:27.176743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:16.760012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177266+0000","last_change":"2023-10-06T04:44:28.177266+0000","last_active":"2023-10-06T04:44:28.177266+0000","last_peered":"2023-10-06T04:44:28.177266+0000","last_clean":"2023-10-06T04:44:28.177266+0000","last_became_active":"2023-10-06T04:44:28.176965+0000","last_became_peered":"2023-10-06T04:44:28.176965+0000","last_unstale":"2023-10-06T04:44:28.177266+0000","last_undegraded":"2023-10-06T04:44:28.177266+0000","last_fullsized":"2023-10-06T04:44:28.177266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:37.963273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184180+0000","last_change":"2023-10-06T04:44:27.172020+0000","last_active":"2023-10-06T04:44:28.184180+0000","last_peered":"2023-10-06T04:44:28.184180+0000","last_clean":"2023-10-06T04:44:28.184180+0000","last_became_active":"2023-10-06T04:44:27.171708+0000","last_became_peered":"2023-10-06T04:44:27.171708+0000","last_unstale":"2023-10-06T04:44:28.184180+0000","last_undegraded":"2023-10-06T04:44:28.184180+0000","last_fullsized":"2023-10-06T04:44:28.184180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.165960+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:44:27.165960+0000","last_peered":"2023-10-06T04:44:27.165960+0000","last_clean":"2023-10-06T04:44:27.165960+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:44:27.165960+0000","last_undegraded":"2023-10-06T04:44:27.165960+0000","last_fullsized":"2023-10-06T04:44:27.165960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177250+0000","last_change":"2023-10-06T04:44:28.177250+0000","last_active":"2023-10-06T04:44:28.177250+0000","last_peered":"2023-10-06T04:44:28.177250+0000","last_clean":"2023-10-06T04:44:28.177250+0000","last_became_active":"2023-10-06T04:44:28.174266+0000","last_became_peered":"2023-10-06T04:44:28.174266+0000","last_unstale":"2023-10-06T04:44:28.177250+0000","last_undegraded":"2023-10-06T04:44:28.177250+0000","last_fullsized":"2023-10-06T04:44:28.177250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:58.131405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.161207+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:44:27.161207+0000","last_peered":"2023-10-06T04:44:27.161207+0000","last_clean":"2023-10-06T04:44:27.161207+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:44:27.161207+0000","last_undegraded":"2023-10-06T04:44:27.161207+0000","last_fullsized":"2023-10-06T04:44:27.161207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.171984+0000","last_change":"2023-10-06T04:44:27.167851+0000","last_active":"2023-10-06T04:44:27.171984+0000","last_peered":"2023-10-06T04:44:27.171984+0000","last_clean":"2023-10-06T04:44:27.171984+0000","last_became_active":"2023-10-06T04:44:27.167572+0000","last_became_peered":"2023-10-06T04:44:27.167572+0000","last_unstale":"2023-10-06T04:44:27.171984+0000","last_undegraded":"2023-10-06T04:44:27.171984+0000","last_fullsized":"2023-10-06T04:44:27.171984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:28.298788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177734+0000","last_change":"2023-10-06T04:44:28.177734+0000","last_active":"2023-10-06T04:44:28.177734+0000","last_peered":"2023-10-06T04:44:28.177734+0000","last_clean":"2023-10-06T04:44:28.177734+0000","last_became_active":"2023-10-06T04:44:28.173936+0000","last_became_peered":"2023-10-06T04:44:28.173936+0000","last_unstale":"2023-10-06T04:44:28.177734+0000","last_undegraded":"2023-10-06T04:44:28.177734+0000","last_fullsized":"2023-10-06T04:44:28.177734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:31.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.157997+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:44:27.157997+0000","last_peered":"2023-10-06T04:44:27.157997+0000","last_clean":"2023-10-06T04:44:27.157997+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:44:27.157997+0000","last_undegraded":"2023-10-06T04:44:27.157997+0000","last_fullsized":"2023-10-06T04:44:27.157997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":162,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.159828+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:44:27.159828+0000","last_peered":"2023-10-06T04:44:27.159828+0000","last_clean":"2023-10-06T04:44:27.159828+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:44:27.159828+0000","last_undegraded":"2023-10-06T04:44:27.159828+0000","last_fullsized":"2023-10-06T04:44:27.159828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.174816+0000","last_change":"2023-10-06T04:44:27.171258+0000","last_active":"2023-10-06T04:44:27.174816+0000","last_peered":"2023-10-06T04:44:27.174816+0000","last_clean":"2023-10-06T04:44:27.174816+0000","last_became_active":"2023-10-06T04:44:27.170923+0000","last_became_peered":"2023-10-06T04:44:27.170923+0000","last_unstale":"2023-10-06T04:44:27.174816+0000","last_undegraded":"2023-10-06T04:44:27.174816+0000","last_fullsized":"2023-10-06T04:44:27.174816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:18.613164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.160968+0000","last_change":"2023-10-06T04:44:28.160968+0000","last_active":"2023-10-06T04:44:28.160968+0000","last_peered":"2023-10-06T04:44:28.160968+0000","last_clean":"2023-10-06T04:44:28.160968+0000","last_became_active":"2023-10-06T04:44:28.160710+0000","last_became_peered":"2023-10-06T04:44:28.160710+0000","last_unstale":"2023-10-06T04:44:28.160968+0000","last_undegraded":"2023-10-06T04:44:28.160968+0000","last_fullsized":"2023-10-06T04:44:28.160968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:16.179899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.157840+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:44:27.157840+0000","last_peered":"2023-10-06T04:44:27.157840+0000","last_clean":"2023-10-06T04:44:27.157840+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:44:27.157840+0000","last_undegraded":"2023-10-06T04:44:27.157840+0000","last_fullsized":"2023-10-06T04:44:27.157840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.171713+0000","last_change":"2023-10-06T04:44:27.164147+0000","last_active":"2023-10-06T04:44:27.171713+0000","last_peered":"2023-10-06T04:44:27.171713+0000","last_clean":"2023-10-06T04:44:27.171713+0000","last_became_active":"2023-10-06T04:44:27.163860+0000","last_became_peered":"2023-10-06T04:44:27.163860+0000","last_unstale":"2023-10-06T04:44:27.171713+0000","last_undegraded":"2023-10-06T04:44:27.171713+0000","last_fullsized":"2023-10-06T04:44:27.171713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:11.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.162519+0000","last_change":"2023-10-06T04:44:28.162519+0000","last_active":"2023-10-06T04:44:28.162519+0000","last_peered":"2023-10-06T04:44:28.162519+0000","last_clean":"2023-10-06T04:44:28.162519+0000","last_became_active":"2023-10-06T04:44:28.162231+0000","last_became_peered":"2023-10-06T04:44:28.162231+0000","last_unstale":"2023-10-06T04:44:28.162519+0000","last_undegraded":"2023-10-06T04:44:28.162519+0000","last_fullsized":"2023-10-06T04:44:28.162519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:37.642261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.159938+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:44:27.159938+0000","last_peered":"2023-10-06T04:44:27.159938+0000","last_clean":"2023-10-06T04:44:27.159938+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:44:27.159938+0000","last_undegraded":"2023-10-06T04:44:27.159938+0000","last_fullsized":"2023-10-06T04:44:27.159938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.174384+0000","last_change":"2023-10-06T04:44:27.170762+0000","last_active":"2023-10-06T04:44:27.174384+0000","last_peered":"2023-10-06T04:44:27.174384+0000","last_clean":"2023-10-06T04:44:27.174384+0000","last_became_active":"2023-10-06T04:44:27.170417+0000","last_became_peered":"2023-10-06T04:44:27.170417+0000","last_unstale":"2023-10-06T04:44:27.174384+0000","last_undegraded":"2023-10-06T04:44:27.174384+0000","last_fullsized":"2023-10-06T04:44:27.174384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:01.501146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177577+0000","last_change":"2023-10-06T04:44:28.177577+0000","last_active":"2023-10-06T04:44:28.177577+0000","last_peered":"2023-10-06T04:44:28.177577+0000","last_clean":"2023-10-06T04:44:28.177577+0000","last_became_active":"2023-10-06T04:44:28.176998+0000","last_became_peered":"2023-10-06T04:44:28.176998+0000","last_unstale":"2023-10-06T04:44:28.177577+0000","last_undegraded":"2023-10-06T04:44:28.177577+0000","last_fullsized":"2023-10-06T04:44:28.177577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.047230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.158365+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:44:27.158365+0000","last_peered":"2023-10-06T04:44:27.158365+0000","last_clean":"2023-10-06T04:44:27.158365+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:44:27.158365+0000","last_undegraded":"2023-10-06T04:44:27.158365+0000","last_fullsized":"2023-10-06T04:44:27.158365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.179386+0000","last_change":"2023-10-06T04:44:27.174609+0000","last_active":"2023-10-06T04:44:27.179386+0000","last_peered":"2023-10-06T04:44:27.179386+0000","last_clean":"2023-10-06T04:44:27.179386+0000","last_became_active":"2023-10-06T04:44:27.173130+0000","last_became_peered":"2023-10-06T04:44:27.173130+0000","last_unstale":"2023-10-06T04:44:27.179386+0000","last_undegraded":"2023-10-06T04:44:27.179386+0000","last_fullsized":"2023-10-06T04:44:27.179386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.166656+0000","last_change":"2023-10-06T04:44:28.166656+0000","last_active":"2023-10-06T04:44:28.166656+0000","last_peered":"2023-10-06T04:44:28.166656+0000","last_clean":"2023-10-06T04:44:28.166656+0000","last_became_active":"2023-10-06T04:44:28.166293+0000","last_became_peered":"2023-10-06T04:44:28.166293+0000","last_unstale":"2023-10-06T04:44:28.166656+0000","last_undegraded":"2023-10-06T04:44:28.166656+0000","last_fullsized":"2023-10-06T04:44:28.166656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:39.049512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.154355+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:44:27.154355+0000","last_peered":"2023-10-06T04:44:27.154355+0000","last_clean":"2023-10-06T04:44:27.154355+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:44:27.154355+0000","last_undegraded":"2023-10-06T04:44:27.154355+0000","last_fullsized":"2023-10-06T04:44:27.154355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.174614+0000","last_change":"2023-10-06T04:44:27.173242+0000","last_active":"2023-10-06T04:44:27.174614+0000","last_peered":"2023-10-06T04:44:27.174614+0000","last_clean":"2023-10-06T04:44:27.174614+0000","last_became_active":"2023-10-06T04:44:27.172919+0000","last_became_peered":"2023-10-06T04:44:27.172919+0000","last_unstale":"2023-10-06T04:44:27.174614+0000","last_undegraded":"2023-10-06T04:44:27.174614+0000","last_fullsized":"2023-10-06T04:44:27.174614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:56.308717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.169044+0000","last_change":"2023-10-06T04:44:28.169044+0000","last_active":"2023-10-06T04:44:28.169044+0000","last_peered":"2023-10-06T04:44:28.169044+0000","last_clean":"2023-10-06T04:44:28.169044+0000","last_became_active":"2023-10-06T04:44:28.168793+0000","last_became_peered":"2023-10-06T04:44:28.168793+0000","last_unstale":"2023-10-06T04:44:28.169044+0000","last_undegraded":"2023-10-06T04:44:28.169044+0000","last_fullsized":"2023-10-06T04:44:28.169044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:38.672585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.157688+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:44:27.157688+0000","last_peered":"2023-10-06T04:44:27.157688+0000","last_clean":"2023-10-06T04:44:27.157688+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:44:27.157688+0000","last_undegraded":"2023-10-06T04:44:27.157688+0000","last_fullsized":"2023-10-06T04:44:27.157688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:44:27.170868+0000","last_change":"2023-10-06T04:44:27.164715+0000","last_active":"2023-10-06T04:44:27.170868+0000","last_peered":"2023-10-06T04:44:27.170868+0000","last_clean":"2023-10-06T04:44:27.170868+0000","last_became_active":"2023-10-06T04:44:27.164441+0000","last_became_peered":"2023-10-06T04:44:27.164441+0000","last_unstale":"2023-10-06T04:44:27.170868+0000","last_undegraded":"2023-10-06T04:44:27.170868+0000","last_fullsized":"2023-10-06T04:44:27.170868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.163762+0000","last_change":"2023-10-06T04:44:28.163762+0000","last_active":"2023-10-06T04:44:28.163762+0000","last_peered":"2023-10-06T04:44:28.163762+0000","last_clean":"2023-10-06T04:44:28.163762+0000","last_became_active":"2023-10-06T04:44:28.162829+0000","last_became_peered":"2023-10-06T04:44:28.162829+0000","last_unstale":"2023-10-06T04:44:28.163762+0000","last_undegraded":"2023-10-06T04:44:28.163762+0000","last_fullsized":"2023-10-06T04:44:28.163762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:47.764193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.158253+0000","last_change":"2023-10-06T04:44:27.173098+0000","last_active":"2023-10-06T04:44:28.158253+0000","last_peered":"2023-10-06T04:44:28.158253+0000","last_clean":"2023-10-06T04:44:28.158253+0000","last_became_active":"2023-10-06T04:44:27.172825+0000","last_became_peered":"2023-10-06T04:44:27.172825+0000","last_unstale":"2023-10-06T04:44:28.158253+0000","last_undegraded":"2023-10-06T04:44:28.158253+0000","last_fullsized":"2023-10-06T04:44:28.158253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:11.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.165992+0000","last_change":"2023-10-06T04:44:28.165992+0000","last_active":"2023-10-06T04:44:28.165992+0000","last_peered":"2023-10-06T04:44:28.165992+0000","last_clean":"2023-10-06T04:44:28.165992+0000","last_became_active":"2023-10-06T04:44:28.165719+0000","last_became_peered":"2023-10-06T04:44:28.165719+0000","last_unstale":"2023-10-06T04:44:28.165992+0000","last_undegraded":"2023-10-06T04:44:28.165992+0000","last_fullsized":"2023-10-06T04:44:28.165992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:12.681182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.186637+0000","last_change":"2023-10-06T04:44:27.168462+0000","last_active":"2023-10-06T04:44:28.186637+0000","last_peered":"2023-10-06T04:44:28.186637+0000","last_clean":"2023-10-06T04:44:28.186637+0000","last_became_active":"2023-10-06T04:44:27.167211+0000","last_became_peered":"2023-10-06T04:44:27.167211+0000","last_unstale":"2023-10-06T04:44:28.186637+0000","last_undegraded":"2023-10-06T04:44:28.186637+0000","last_fullsized":"2023-10-06T04:44:28.186637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:18.718435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181846+0000","last_change":"2023-10-06T04:44:28.181846+0000","last_active":"2023-10-06T04:44:28.181846+0000","last_peered":"2023-10-06T04:44:28.181846+0000","last_clean":"2023-10-06T04:44:28.181846+0000","last_became_active":"2023-10-06T04:44:28.181641+0000","last_became_peered":"2023-10-06T04:44:28.181641+0000","last_unstale":"2023-10-06T04:44:28.181846+0000","last_undegraded":"2023-10-06T04:44:28.181846+0000","last_fullsized":"2023-10-06T04:44:28.181846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:01.432720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.185461+0000","last_change":"2023-10-06T04:44:27.168466+0000","last_active":"2023-10-06T04:44:28.185461+0000","last_peered":"2023-10-06T04:44:28.185461+0000","last_clean":"2023-10-06T04:44:28.185461+0000","last_became_active":"2023-10-06T04:44:27.167928+0000","last_became_peered":"2023-10-06T04:44:27.167928+0000","last_unstale":"2023-10-06T04:44:28.185461+0000","last_undegraded":"2023-10-06T04:44:28.185461+0000","last_fullsized":"2023-10-06T04:44:28.185461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181253+0000","last_change":"2023-10-06T04:44:28.181253+0000","last_active":"2023-10-06T04:44:28.181253+0000","last_peered":"2023-10-06T04:44:28.181253+0000","last_clean":"2023-10-06T04:44:28.181253+0000","last_became_active":"2023-10-06T04:44:28.181011+0000","last_became_peered":"2023-10-06T04:44:28.181011+0000","last_unstale":"2023-10-06T04:44:28.181253+0000","last_undegraded":"2023-10-06T04:44:28.181253+0000","last_fullsized":"2023-10-06T04:44:28.181253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:12.890746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.156419+0000","last_change":"2023-10-06T04:44:27.164196+0000","last_active":"2023-10-06T04:44:28.156419+0000","last_peered":"2023-10-06T04:44:28.156419+0000","last_clean":"2023-10-06T04:44:28.156419+0000","last_became_active":"2023-10-06T04:44:27.163920+0000","last_became_peered":"2023-10-06T04:44:27.163920+0000","last_unstale":"2023-10-06T04:44:28.156419+0000","last_undegraded":"2023-10-06T04:44:28.156419+0000","last_fullsized":"2023-10-06T04:44:28.156419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:25.287936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.172288+0000","last_change":"2023-10-06T04:44:28.172288+0000","last_active":"2023-10-06T04:44:28.172288+0000","last_peered":"2023-10-06T04:44:28.172288+0000","last_clean":"2023-10-06T04:44:28.172288+0000","last_became_active":"2023-10-06T04:44:28.171740+0000","last_became_peered":"2023-10-06T04:44:28.171740+0000","last_unstale":"2023-10-06T04:44:28.172288+0000","last_undegraded":"2023-10-06T04:44:28.172288+0000","last_fullsized":"2023-10-06T04:44:28.172288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:18.824278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187797+0000","last_change":"2023-10-06T04:44:27.167494+0000","last_active":"2023-10-06T04:44:28.187797+0000","last_peered":"2023-10-06T04:44:28.187797+0000","last_clean":"2023-10-06T04:44:28.187797+0000","last_became_active":"2023-10-06T04:44:27.167155+0000","last_became_peered":"2023-10-06T04:44:27.167155+0000","last_unstale":"2023-10-06T04:44:28.187797+0000","last_undegraded":"2023-10-06T04:44:28.187797+0000","last_fullsized":"2023-10-06T04:44:28.187797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:32.538225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173948+0000","last_change":"2023-10-06T04:44:28.173948+0000","last_active":"2023-10-06T04:44:28.173948+0000","last_peered":"2023-10-06T04:44:28.173948+0000","last_clean":"2023-10-06T04:44:28.173948+0000","last_became_active":"2023-10-06T04:44:28.173514+0000","last_became_peered":"2023-10-06T04:44:28.173514+0000","last_unstale":"2023-10-06T04:44:28.173948+0000","last_undegraded":"2023-10-06T04:44:28.173948+0000","last_fullsized":"2023-10-06T04:44:28.173948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:05.030988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173994+0000","last_change":"2023-10-06T04:44:28.173994+0000","last_active":"2023-10-06T04:44:28.173994+0000","last_peered":"2023-10-06T04:44:28.173994+0000","last_clean":"2023-10-06T04:44:28.173994+0000","last_became_active":"2023-10-06T04:44:28.173726+0000","last_became_peered":"2023-10-06T04:44:28.173726+0000","last_unstale":"2023-10-06T04:44:28.173994+0000","last_undegraded":"2023-10-06T04:44:28.173994+0000","last_fullsized":"2023-10-06T04:44:28.173994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:11.893905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176890+0000","last_change":"2023-10-06T04:44:28.176890+0000","last_active":"2023-10-06T04:44:28.176890+0000","last_peered":"2023-10-06T04:44:28.176890+0000","last_clean":"2023-10-06T04:44:28.176890+0000","last_became_active":"2023-10-06T04:44:28.174436+0000","last_became_peered":"2023-10-06T04:44:28.174436+0000","last_unstale":"2023-10-06T04:44:28.176890+0000","last_undegraded":"2023-10-06T04:44:28.176890+0000","last_fullsized":"2023-10-06T04:44:28.176890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:44.708051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176267+0000","last_change":"2023-10-06T04:44:28.176267+0000","last_active":"2023-10-06T04:44:28.176267+0000","last_peered":"2023-10-06T04:44:28.176267+0000","last_clean":"2023-10-06T04:44:28.176267+0000","last_became_active":"2023-10-06T04:44:28.175988+0000","last_became_peered":"2023-10-06T04:44:28.175988+0000","last_unstale":"2023-10-06T04:44:28.176267+0000","last_undegraded":"2023-10-06T04:44:28.176267+0000","last_fullsized":"2023-10-06T04:44:28.176267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:17.605122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174588+0000","last_change":"2023-10-06T04:44:28.174588+0000","last_active":"2023-10-06T04:44:28.174588+0000","last_peered":"2023-10-06T04:44:28.174588+0000","last_clean":"2023-10-06T04:44:28.174588+0000","last_became_active":"2023-10-06T04:44:28.174023+0000","last_became_peered":"2023-10-06T04:44:28.174023+0000","last_unstale":"2023-10-06T04:44:28.174588+0000","last_undegraded":"2023-10-06T04:44:28.174588+0000","last_fullsized":"2023-10-06T04:44:28.174588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:02.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.164700+0000","last_change":"2023-10-06T04:44:28.164700+0000","last_active":"2023-10-06T04:44:28.164700+0000","last_peered":"2023-10-06T04:44:28.164700+0000","last_clean":"2023-10-06T04:44:28.164700+0000","last_became_active":"2023-10-06T04:44:28.164337+0000","last_became_peered":"2023-10-06T04:44:28.164337+0000","last_unstale":"2023-10-06T04:44:28.164700+0000","last_undegraded":"2023-10-06T04:44:28.164700+0000","last_fullsized":"2023-10-06T04:44:28.164700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:15.790501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298104,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073736,"statfs":{"total":96636764160,"available":96331505664,"internally_reserved":0,"allocated":835584,"data_stored":667089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":665337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:44:32.983 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:44:32.983 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T04:44:32.983 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T04:44:32.983 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T04:44:32.984 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T04:44:33.014 INFO:tasks.ceph.mds.b.smithi158.stderr:2023-10-06T04:44:33.013+0000 7fa9c27f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.204+0000 7fab893ff700 1 Processor -- start 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.204+0000 7fab893ff700 1 -- start start 2023-10-06T04:44:33.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.205+0000 7fab893ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab840cdfe0 0x7fab840ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.205+0000 7fab893ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fab840ccf80 0x7fab840cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.205+0000 7fab893ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab840cf6b0 con 0x7fab840ccbb0 2023-10-06T04:44:33.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.205+0000 7fab893ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab840d0250 con 0x7fab840ccf80 2023-10-06T04:44:33.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.205+0000 7fab893ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab840ceaa0 con 0x7fab840cdfe0 2023-10-06T04:44:33.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.205+0000 7fab82ffd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fab840ccbb0 0x7fab840cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36196/0 (socket says 172.21.15.124:36196) 2023-10-06T04:44:33.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.205+0000 7fab82ffd700 1 -- 172.21.15.124:0/1706064596 learned_addr learned my addr 172.21.15.124:0/1706064596 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.205+0000 7fab837fe700 1 --2- 172.21.15.124:0/1706064596 >> v2:172.21.15.124:3300/0 conn(0x7fab840ccf80 0x7fab840cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab827fc700 1 --2- 172.21.15.124:0/1706064596 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab840cdfe0 0x7fab840ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab81ffb700 1 -- 172.21.15.124:0/1706064596 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337543008 0 0) 0x7fab840cf6b0 con 0x7fab840ccbb0 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab81ffb700 1 -- 172.21.15.124:0/1706064596 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab6c003570 con 0x7fab840ccbb0 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab837fe700 1 -- 172.21.15.124:0/1706064596 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab840cdfe0 msgr2=0x7fab840ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab837fe700 1 --2- 172.21.15.124:0/1706064596 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab840cdfe0 0x7fab840ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab837fe700 1 -- 172.21.15.124:0/1706064596 >> v1:172.21.15.124:6789/0 conn(0x7fab840ccbb0 legacy=0x7fab840cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab837fe700 1 -- 172.21.15.124:0/1706064596 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab840ced80 con 0x7fab840ccf80 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab837fe700 1 --2- 172.21.15.124:0/1706064596 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccf80 0x7fab840cd400 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009e60 tx=0x7fab7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b28a27d84fc50a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab81ffb700 1 -- 172.21.15.124:0/1706064596 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c00e070 con 0x7fab840ccf80 2023-10-06T04:44:33.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab81ffb700 1 -- 172.21.15.124:0/1706064596 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c00bab0 con 0x7fab840ccf80 2023-10-06T04:44:33.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.206+0000 7fab81ffb700 1 -- 172.21.15.124:0/1706064596 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c00be70 con 0x7fab840ccf80 2023-10-06T04:44:33.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.207+0000 7fab893ff700 1 -- 172.21.15.124:0/1706064596 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccf80 msgr2=0x7fab840cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.207+0000 7fab893ff700 1 --2- 172.21.15.124:0/1706064596 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccf80 0x7fab840cd400 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009e60 tx=0x7fab7c009780 comp rx=0 tx=0).stop 2023-10-06T04:44:33.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.207+0000 7fab893ff700 1 -- 172.21.15.124:0/1706064596 shutdown_connections 2023-10-06T04:44:33.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.207+0000 7fab893ff700 1 --2- 172.21.15.124:0/1706064596 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccf80 0x7fab840cd400 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.207+0000 7fab893ff700 1 --2- 172.21.15.124:0/1706064596 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab840cdfe0 0x7fab840ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.207+0000 7fab893ff700 1 -- 172.21.15.124:0/1706064596 >> 172.21.15.124:0/1706064596 conn(0x7fab84099710 msgr2=0x7fab8406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:33.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.207+0000 7fab893ff700 1 -- 172.21.15.124:0/1706064596 shutdown_connections 2023-10-06T04:44:33.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.207+0000 7fab893ff700 1 -- 172.21.15.124:0/1706064596 wait complete. 2023-10-06T04:44:33.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.209+0000 7fab893ff700 1 Processor -- start 2023-10-06T04:44:33.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.209+0000 7fab893ff700 1 -- start start 2023-10-06T04:44:33.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.210+0000 7fab893ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccbb0 0x7fab84154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.210+0000 7fab893ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab840ccf80 0x7fab8409c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab893ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab840cdfe0 0x7fab84068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab893ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8409ddf0 con 0x7fab840ccbb0 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab893ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8409d1e0 con 0x7fab840cdfe0 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab893ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8409d4c0 con 0x7fab840ccf80 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab82ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccbb0 0x7fab84154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab82ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccbb0 0x7fab84154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40316/0 (socket says 172.21.15.124:40316) 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab82ffd700 1 -- 172.21.15.124:0/3080480795 learned_addr learned my addr 172.21.15.124:0/3080480795 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab827fc700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab840ccf80 0x7fab8409c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab837fe700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab840cdfe0 0x7fab84068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab82ffd700 1 -- 172.21.15.124:0/3080480795 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab840ccf80 msgr2=0x7fab8409c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab82ffd700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab840ccf80 0x7fab8409c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab82ffd700 1 -- 172.21.15.124:0/3080480795 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab840cdfe0 msgr2=0x7fab84068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab82ffd700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab840cdfe0 0x7fab84068320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab82ffd700 1 -- 172.21.15.124:0/3080480795 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c009a20 con 0x7fab840ccbb0 2023-10-06T04:44:33.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab837fe700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab840cdfe0 0x7fab84068320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:33.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.211+0000 7fab82ffd700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccbb0 0x7fab84154900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c7c0 tx=0x7fab74007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.212+0000 7fab6affd700 1 -- 172.21.15.124:0/3080480795 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74005b30 con 0x7fab840ccbb0 2023-10-06T04:44:33.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.212+0000 7fab6affd700 1 -- 172.21.15.124:0/3080480795 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab74005cb0 con 0x7fab840ccbb0 2023-10-06T04:44:33.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.212+0000 7fab6affd700 1 -- 172.21.15.124:0/3080480795 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74007320 con 0x7fab840ccbb0 2023-10-06T04:44:33.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.212+0000 7fab893ff700 1 -- 172.21.15.124:0/3080480795 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8409d7a0 con 0x7fab840ccbb0 2023-10-06T04:44:33.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.212+0000 7fab893ff700 1 -- 172.21.15.124:0/3080480795 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab84154e40 con 0x7fab840ccbb0 2023-10-06T04:44:33.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.213+0000 7fab893ff700 1 -- 172.21.15.124:0/3080480795 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab840717a0 con 0x7fab840ccbb0 2023-10-06T04:44:33.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.214+0000 7fab6affd700 1 -- 172.21.15.124:0/3080480795 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab7401b3b0 con 0x7fab840ccbb0 2023-10-06T04:44:33.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.215+0000 7fab6affd700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 0x7fab700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.215+0000 7fab6affd700 1 -- 172.21.15.124:0/3080480795 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fab74083ba0 con 0x7fab840ccbb0 2023-10-06T04:44:33.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.215+0000 7fab827fc700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 0x7fab700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.215+0000 7fab827fc700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 0x7fab700693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab84158670 tx=0x7fab780091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.218+0000 7fab6affd700 1 -- 172.21.15.124:0/3080480795 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab74050c90 con 0x7fab840ccbb0 2023-10-06T04:44:33.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.462+0000 7fab893ff700 1 -- 172.21.15.124:0/3080480795 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fab840cf060 con 0x7fab840ccbb0 2023-10-06T04:44:33.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.465+0000 7fab6affd700 1 -- 172.21.15.124:0/3080480795 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163708 (secure 0 0 0) 0x7fab74017020 con 0x7fab840ccbb0 2023-10-06T04:44:33.469 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:33.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 -- 172.21.15.124:0/3080480795 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 msgr2=0x7fab700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 0x7fab700693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab84158670 tx=0x7fab780091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 -- 172.21.15.124:0/3080480795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccbb0 msgr2=0x7fab84154900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccbb0 0x7fab84154900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c7c0 tx=0x7fab74007e00 comp rx=0 tx=0).stop 2023-10-06T04:44:33.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 -- 172.21.15.124:0/3080480795 shutdown_connections 2023-10-06T04:44:33.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab840cdfe0 0x7fab84068320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab840ccbb0 0x7fab84154900 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 0x7fab700693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 --2- 172.21.15.124:0/3080480795 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab840ccf80 0x7fab8409c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 -- 172.21.15.124:0/3080480795 >> 172.21.15.124:0/3080480795 conn(0x7fab84099710 msgr2=0x7fab84069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:33.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 -- 172.21.15.124:0/3080480795 shutdown_connections 2023-10-06T04:44:33.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.468+0000 7fab893ff700 1 -- 172.21.15.124:0/3080480795 wait complete. 2023-10-06T04:44:33.488 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":114528},{"type":"v1","addr":"172.21.15.124:6833","nonce":114528}]},"active_addr":"172.21.15.124:6833/114528","active_change":"2023-10-06T04:44:13.894226+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":3051947981}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":207537572}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":1253856333}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":1287488780}]}]} 2023-10-06T04:44:33.493 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T04:44:33.493 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T04:44:33.494 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:33.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.679+0000 7ff08e5ff700 1 Processor -- start 2023-10-06T04:44:33.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.680+0000 7ff08e5ff700 1 -- start start 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.681+0000 7ff08e5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880cae80 0x7ff0880cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.681+0000 7ff08e5ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff0881598e0 0x7ff0880afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.681+0000 7ff08e5ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0880c1d10 con 0x7ff0880ccec0 2023-10-06T04:44:33.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.681+0000 7ff08e5ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0880cd430 con 0x7ff0881598e0 2023-10-06T04:44:33.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.681+0000 7ff08e5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880688a0 con 0x7ff0880cae80 2023-10-06T04:44:33.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.681+0000 7ff0877fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff0880ccec0 0x7ff0881591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36212/0 (socket says 172.21.15.124:36212) 2023-10-06T04:44:33.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.681+0000 7ff0877fe700 1 -- 172.21.15.124:0/239404480 learned_addr learned my addr 172.21.15.124:0/239404480 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.681+0000 7ff087fff700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880cae80 0x7ff0880cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.681+0000 7ff08cb9c700 1 --2- 172.21.15.124:0/239404480 >> v2:172.21.15.158:3300/0 conn(0x7ff0881598e0 0x7ff0880afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.681+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758563156 0 0) 0x7ff0880c1d10 con 0x7ff0880ccec0 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff070003570 con 0x7ff0880ccec0 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3846683936 0 0) 0x7ff070003570 con 0x7ff0880ccec0 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880cae80 msgr2=0x7ff0880cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880cae80 0x7ff0880cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 >> v2:172.21.15.158:3300/0 conn(0x7ff0881598e0 msgr2=0x7ff0880afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 --2- 172.21.15.124:0/239404480 >> v2:172.21.15.158:3300/0 conn(0x7ff0881598e0 0x7ff0880afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088068b80 con 0x7ff0880ccec0 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7ff07c001470 con 0x7ff0880ccec0 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff08cb9c700 1 --2- 172.21.15.124:0/239404480 >> v2:172.21.15.158:3300/0 conn(0x7ff0881598e0 0x7ff0880afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 >> v1:172.21.15.124:6789/0 conn(0x7ff0880ccec0 legacy=0x7ff0881591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff070003ae0 0x7ff070003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff070004810 0x7ff070004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880cae80 0x7ff0700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880cd430 con 0x7ff070003ae0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880688a0 con 0x7ff070004810 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07000bb10 con 0x7ff0880cae80 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff087fff700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff070003ae0 0x7ff070003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff08cb9c700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880cae80 0x7ff0700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.682+0000 7ff0877fe700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff070004810 0x7ff070004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.683+0000 7ff087fff700 1 -- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880cae80 msgr2=0x7ff0700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.683+0000 7ff087fff700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880cae80 0x7ff0700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.683+0000 7ff087fff700 1 -- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff070004810 msgr2=0x7ff070004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.683+0000 7ff087fff700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff070004810 0x7ff070004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.683+0000 7ff087fff700 1 -- 172.21.15.124:0/239404480 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070003570 con 0x7ff070003ae0 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.683+0000 7ff087fff700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff070003ae0 0x7ff070003ef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff078009c00 tx=0x7ff0780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c1dd9c8674842e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.683+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800e710 con 0x7ff070003ae0 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.683+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07800e870 con 0x7ff070003ae0 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.683+0000 7ff086ffd700 1 -- 172.21.15.124:0/239404480 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800ec30 con 0x7ff070003ae0 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.684+0000 7ff08e5ff700 1 -- 172.21.15.124:0/239404480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff070003ae0 msgr2=0x7ff070003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.684+0000 7ff08e5ff700 1 --2- 172.21.15.124:0/239404480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff070003ae0 0x7ff070003ef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff078009c00 tx=0x7ff0780091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.684+0000 7ff08cb9c700 1 -- 172.21.15.124:0/239404480 reap_dead start 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.684+0000 7ff08e5ff700 1 -- 172.21.15.124:0/239404480 shutdown_connections 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.684+0000 7ff08e5ff700 1 -- 172.21.15.124:0/239404480 >> 172.21.15.124:0/239404480 conn(0x7ff0880974f0 msgr2=0x7ff0880639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.684+0000 7ff08e5ff700 1 -- 172.21.15.124:0/239404480 shutdown_connections 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.684+0000 7ff08e5ff700 1 -- 172.21.15.124:0/239404480 wait complete. 2023-10-06T04:44:33.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.685+0000 7ff08e5ff700 1 Processor -- start 2023-10-06T04:44:33.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.685+0000 7ff08e5ff700 1 -- start start 2023-10-06T04:44:33.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.686+0000 7ff08e5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff070003ae0 0x7ff088158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.686+0000 7ff08e5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880b2170 0x7ff0880b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.686+0000 7ff08e5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0880c30b0 0x7ff0880c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.686+0000 7ff08e5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880c3a60 con 0x7ff0880c30b0 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.686+0000 7ff08e5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b3800 con 0x7ff070003ae0 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.686+0000 7ff08e5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b2bf0 con 0x7ff0880b2170 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff08cb9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0880c30b0 0x7ff0880c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff08cb9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0880c30b0 0x7ff0880c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40320/0 (socket says 172.21.15.124:40320) 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff08cb9c700 1 -- 172.21.15.124:0/907237119 learned_addr learned my addr 172.21.15.124:0/907237119 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff087fff700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff070003ae0 0x7ff088158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff0877fe700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880b2170 0x7ff0880b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff08cb9c700 1 -- 172.21.15.124:0/907237119 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880b2170 msgr2=0x7ff0880b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff08cb9c700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880b2170 0x7ff0880b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff08cb9c700 1 -- 172.21.15.124:0/907237119 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff070003ae0 msgr2=0x7ff088158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff08cb9c700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff070003ae0 0x7ff088158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff08cb9c700 1 -- 172.21.15.124:0/907237119 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0880b2ed0 con 0x7ff0880c30b0 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff08cb9c700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0880c30b0 0x7ff0880c3520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff08815d210 tx=0x7ff08000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff06ffff700 1 -- 172.21.15.124:0/907237119 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08000e040 con 0x7ff0880c30b0 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff06ffff700 1 -- 172.21.15.124:0/907237119 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08000f040 con 0x7ff0880c30b0 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff06ffff700 1 -- 172.21.15.124:0/907237119 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080015430 con 0x7ff0880c30b0 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.687+0000 7ff08e5ff700 1 -- 172.21.15.124:0/907237119 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0880b31b0 con 0x7ff0880c30b0 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.688+0000 7ff08e5ff700 1 -- 172.21.15.124:0/907237119 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08815a510 con 0x7ff0880c30b0 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.688+0000 7ff08e5ff700 1 -- 172.21.15.124:0/907237119 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0880b3970 con 0x7ff0880c30b0 2023-10-06T04:44:33.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.689+0000 7ff06ffff700 1 -- 172.21.15.124:0/907237119 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0800157a0 con 0x7ff0880c30b0 2023-10-06T04:44:33.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.690+0000 7ff06ffff700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff074066f30 0x7ff0740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.690+0000 7ff06ffff700 1 -- 172.21.15.124:0/907237119 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff0800851d0 con 0x7ff0880c30b0 2023-10-06T04:44:33.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.690+0000 7ff087fff700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff074066f30 0x7ff0740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.691+0000 7ff087fff700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff074066f30 0x7ff0740693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0780091e0 tx=0x7ff07801a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.695+0000 7ff06ffff700 1 -- 172.21.15.124:0/907237119 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff080052240 con 0x7ff0880c30b0 2023-10-06T04:44:33.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.885+0000 7ff08e5ff700 1 -- 172.21.15.124:0/907237119 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0880717a0 con 0x7ff0880c30b0 2023-10-06T04:44:33.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.886+0000 7ff06ffff700 1 -- 172.21.15.124:0/907237119 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7ff080055860 con 0x7ff0880c30b0 2023-10-06T04:44:33.889 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:33.889 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:33.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 -- 172.21.15.124:0/907237119 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff074066f30 msgr2=0x7ff0740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff074066f30 0x7ff0740693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0780091e0 tx=0x7ff07801a000 comp rx=0 tx=0).stop 2023-10-06T04:44:33.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 -- 172.21.15.124:0/907237119 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0880c30b0 msgr2=0x7ff0880c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0880c30b0 0x7ff0880c3520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff08815d210 tx=0x7ff08000b040 comp rx=0 tx=0).stop 2023-10-06T04:44:33.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 -- 172.21.15.124:0/907237119 shutdown_connections 2023-10-06T04:44:33.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0880c30b0 0x7ff0880c3520 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff070003ae0 0x7ff088158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff074066f30 0x7ff0740693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 --2- 172.21.15.124:0/907237119 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0880b2170 0x7ff0880b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 -- 172.21.15.124:0/907237119 >> 172.21.15.124:0/907237119 conn(0x7ff0880974f0 msgr2=0x7ff08806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:33.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 -- 172.21.15.124:0/907237119 shutdown_connections 2023-10-06T04:44:33.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:33.889+0000 7ff08e5ff700 1 -- 172.21.15.124:0/907237119 wait complete. 2023-10-06T04:44:33.909 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T04:44:33.909 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:34.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.098+0000 7f9feedff700 1 Processor -- start 2023-10-06T04:44:34.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.098+0000 7f9feedff700 1 -- start start 2023-10-06T04:44:34.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.099+0000 7f9feedff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9fe80ccbb0 0x7f9fe80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.099+0000 7f9feedff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 0x7f9fe80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.099+0000 7f9feedff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe80cf6b0 con 0x7f9fe80ccf80 2023-10-06T04:44:34.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.099+0000 7f9feedff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80cdb10 con 0x7f9fe80ccbb0 2023-10-06T04:44:34.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.099+0000 7f9feedff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80ceaa0 con 0x7f9fe80cdfe0 2023-10-06T04:44:34.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fecb9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9fe80ccbb0 0x7f9fe80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fed39c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f9fe80ccf80 0x7f9fe80cd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36226/0 (socket says 172.21.15.124:36226) 2023-10-06T04:44:34.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fed39c700 1 -- 172.21.15.124:0/3010814907 learned_addr learned my addr 172.21.15.124:0/3010814907 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:34.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fe7fff700 1 --2- 172.21.15.124:0/3010814907 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 0x7f9fe80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fecb9b700 1 -- 172.21.15.124:0/3010814907 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 msgr2=0x7f9fe80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fecb9b700 1 --2- 172.21.15.124:0/3010814907 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 0x7f9fe80ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fecb9b700 1 -- 172.21.15.124:0/3010814907 >> v1:172.21.15.124:6789/0 conn(0x7f9fe80ccf80 legacy=0x7f9fe80cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fecb9b700 1 -- 172.21.15.124:0/3010814907 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80ced80 con 0x7f9fe80ccbb0 2023-10-06T04:44:34.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fe77fe700 1 -- 172.21.15.124:0/3010814907 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390177342 0 0) 0x7f9fe80cf6b0 con 0x7f9fe80ccf80 2023-10-06T04:44:34.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fecb9b700 1 --2- 172.21.15.124:0/3010814907 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccbb0 0x7f9fe80cfb40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0098e0 tx=0x7f9fdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbdc1dcb30f87a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.100+0000 7f9fe77fe700 1 -- 172.21.15.124:0/3010814907 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00b640 con 0x7f9fe80ccbb0 2023-10-06T04:44:34.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.101+0000 7f9fe77fe700 1 -- 172.21.15.124:0/3010814907 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc00b7a0 con 0x7f9fe80ccbb0 2023-10-06T04:44:34.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.101+0000 7f9fe77fe700 1 -- 172.21.15.124:0/3010814907 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00bb40 con 0x7f9fe80ccbb0 2023-10-06T04:44:34.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.101+0000 7f9feedff700 1 -- 172.21.15.124:0/3010814907 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccbb0 msgr2=0x7f9fe80cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.101+0000 7f9feedff700 1 --2- 172.21.15.124:0/3010814907 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccbb0 0x7f9fe80cfb40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0098e0 tx=0x7f9fdc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.101+0000 7f9feedff700 1 -- 172.21.15.124:0/3010814907 shutdown_connections 2023-10-06T04:44:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.101+0000 7f9feedff700 1 --2- 172.21.15.124:0/3010814907 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccbb0 0x7f9fe80cfb40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.101+0000 7f9feedff700 1 --2- 172.21.15.124:0/3010814907 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 0x7f9fe80ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.101+0000 7f9feedff700 1 -- 172.21.15.124:0/3010814907 >> 172.21.15.124:0/3010814907 conn(0x7f9fe8099710 msgr2=0x7f9fe806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.101+0000 7f9feedff700 1 -- 172.21.15.124:0/3010814907 shutdown_connections 2023-10-06T04:44:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.101+0000 7f9feedff700 1 -- 172.21.15.124:0/3010814907 wait complete. 2023-10-06T04:44:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.103+0000 7f9feedff700 1 Processor -- start 2023-10-06T04:44:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.103+0000 7f9feedff700 1 -- start start 2023-10-06T04:44:34.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9feedff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe80ccbb0 0x7f9fe80c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9feedff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccf80 0x7f9fe80c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9feedff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 0x7f9fe80689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9feedff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80c9180 con 0x7f9fe80ccf80 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9feedff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80c8570 con 0x7f9fe80ccbb0 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9feedff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80c8850 con 0x7f9fe80cdfe0 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fe7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccf80 0x7f9fe80c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fe7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccf80 0x7f9fe80c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40342/0 (socket says 172.21.15.124:40342) 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fe7fff700 1 -- 172.21.15.124:0/2780711071 learned_addr learned my addr 172.21.15.124:0/2780711071 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fecb9b700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe80ccbb0 0x7f9fe80c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fed39c700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 0x7f9fe80689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fe7fff700 1 -- 172.21.15.124:0/2780711071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 msgr2=0x7f9fe80689a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fe7fff700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 0x7f9fe80689a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fe7fff700 1 -- 172.21.15.124:0/2780711071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe80ccbb0 msgr2=0x7f9fe80c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fe7fff700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe80ccbb0 0x7f9fe80c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fe7fff700 1 -- 172.21.15.124:0/2780711071 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc009420 con 0x7f9fe80ccf80 2023-10-06T04:44:34.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.104+0000 7f9fed39c700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 0x7f9fe80689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:34.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.105+0000 7f9fe7fff700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccf80 0x7f9fe80c9610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400e930 tx=0x7f9fd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.105+0000 7f9fe4ff9700 1 -- 172.21.15.124:0/2780711071 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400eed0 con 0x7f9fe80ccf80 2023-10-06T04:44:34.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.105+0000 7f9fe4ff9700 1 -- 172.21.15.124:0/2780711071 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd400c850 con 0x7f9fe80ccf80 2023-10-06T04:44:34.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.105+0000 7f9fe4ff9700 1 -- 172.21.15.124:0/2780711071 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400cbf0 con 0x7f9fe80ccf80 2023-10-06T04:44:34.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.105+0000 7f9feedff700 1 -- 172.21.15.124:0/2780711071 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe80c8b30 con 0x7f9fe80ccf80 2023-10-06T04:44:34.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.105+0000 7f9feedff700 1 -- 172.21.15.124:0/2780711071 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe80c9b50 con 0x7f9fe80ccf80 2023-10-06T04:44:34.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.106+0000 7f9feedff700 1 -- 172.21.15.124:0/2780711071 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe80c9d70 con 0x7f9fe80ccf80 2023-10-06T04:44:34.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.107+0000 7f9fe4ff9700 1 -- 172.21.15.124:0/2780711071 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fd4013470 con 0x7f9fe80ccf80 2023-10-06T04:44:34.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.108+0000 7f9fe4ff9700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.108+0000 7f9fe4ff9700 1 -- 172.21.15.124:0/2780711071 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9fd4084920 con 0x7f9fe80ccf80 2023-10-06T04:44:34.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.108+0000 7f9fecb9b700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.109+0000 7f9fecb9b700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fcc066f30 0x7f9fcc0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0093f0 tx=0x7f9fdc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.112+0000 7f9fe4ff9700 1 -- 172.21.15.124:0/2780711071 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fd4051990 con 0x7f9fe80ccf80 2023-10-06T04:44:34.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.309+0000 7f9feedff700 1 -- 172.21.15.124:0/2780711071 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fe80717a0 con 0x7f9fe80ccf80 2023-10-06T04:44:34.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.310+0000 7f9fe4ff9700 1 -- 172.21.15.124:0/2780711071 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f9fd4054fb0 con 0x7f9fe80ccf80 2023-10-06T04:44:34.312 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:34.313 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 -- 172.21.15.124:0/2780711071 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fcc066f30 msgr2=0x7f9fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fcc066f30 0x7f9fcc0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0093f0 tx=0x7f9fdc017000 comp rx=0 tx=0).stop 2023-10-06T04:44:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 -- 172.21.15.124:0/2780711071 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccf80 msgr2=0x7f9fe80c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccf80 0x7f9fe80c9610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400e930 tx=0x7f9fd40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 -- 172.21.15.124:0/2780711071 shutdown_connections 2023-10-06T04:44:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9fe80cdfe0 0x7f9fe80689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe80ccbb0 0x7f9fe80c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 --2- 172.21.15.124:0/2780711071 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9fe80ccf80 0x7f9fe80c9610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 -- 172.21.15.124:0/2780711071 >> 172.21.15.124:0/2780711071 conn(0x7f9fe8099710 msgr2=0x7f9fe80aded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 -- 172.21.15.124:0/2780711071 shutdown_connections 2023-10-06T04:44:34.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.312+0000 7f9feedff700 1 -- 172.21.15.124:0/2780711071 wait complete. 2023-10-06T04:44:34.332 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T04:44:34.333 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T04:44:34.333 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T04:44:34.334 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T04:44:34.334 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T04:44:34.335 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T04:44:34.335 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T04:44:34.335 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T04:44:34.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.675+0000 7f7f2f3ff700 1 Processor -- start 2023-10-06T04:44:34.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.675+0000 7fc06d7ff700 1 Processor -- start 2023-10-06T04:44:34.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.676+0000 7fc06d7ff700 1 -- start start 2023-10-06T04:44:34.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.676+0000 7f7f2f3ff700 1 -- start start 2023-10-06T04:44:34.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.678+0000 7f7f2f3ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7f28161810 0x7f7f280cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.678+0000 7f7f2f3ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7f280cba20 0x7f7f280aa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.678+0000 7f7f2f3ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2806b070 con 0x7f7f28161be0 2023-10-06T04:44:34.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.678+0000 7f7f2f3ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280c8240 con 0x7f7f28161810 2023-10-06T04:44:34.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.678+0000 7f7f2f3ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280a97b0 con 0x7f7f280cba20 2023-10-06T04:44:34.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.679+0000 7f7f2d99c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7f280cba20 0x7f7f280aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.679+0000 7f7f2d99c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7f280cba20 0x7f7f280aa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38206/0 (socket says 172.21.15.124:38206) 2023-10-06T04:44:34.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.679+0000 7f7f2d99c700 1 -- 172.21.15.124:0/1632506741 learned_addr learned my addr 172.21.15.124:0/1632506741 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.680+0000 7f7f2d19b700 1 --2- 172.21.15.124:0/1632506741 >> v2:172.21.15.124:3300/0 conn(0x7f7f28161810 0x7f7f280cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.680+0000 7fc06d7ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc0680b3d30 0x7fc06815a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.680+0000 7fc06d7ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0680b1ea0 0x7fc0680b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.680+0000 7fc06d7ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06815aac0 con 0x7fc0681594b0 2023-10-06T04:44:34.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.680+0000 7fc06d7ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0680b41b0 con 0x7fc0680b3d30 2023-10-06T04:44:34.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.680+0000 7fc06d7ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680b27e0 con 0x7fc0680b1ea0 2023-10-06T04:44:34.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.681+0000 7fc05e7fc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc0680b3d30 0x7fc06815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.681+0000 7fc05e7fc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc0680b3d30 0x7fc06815a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38208/0 (socket says 172.21.15.124:38208) 2023-10-06T04:44:34.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.681+0000 7fc05e7fc700 1 -- 172.21.15.124:0/3586574550 learned_addr learned my addr 172.21.15.124:0/3586574550 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.681+0000 7f7f2d19b700 1 -- 172.21.15.124:0/1632506741 >> v2:172.21.15.158:3300/0 conn(0x7f7f280cba20 msgr2=0x7f7f280aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.681+0000 7f7f2d19b700 1 --2- 172.21.15.124:0/1632506741 >> v2:172.21.15.158:3300/0 conn(0x7f7f280cba20 0x7f7f280aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.681+0000 7f7f2d19b700 1 -- 172.21.15.124:0/1632506741 >> v1:172.21.15.124:6789/0 conn(0x7f7f28161be0 legacy=0x7f7f280a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.681+0000 7f7f2d19b700 1 -- 172.21.15.124:0/1632506741 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280cbea0 con 0x7f7f28161810 2023-10-06T04:44:34.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.682+0000 7fc05e7fc700 1 -- 172.21.15.124:0/3586574550 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0680b1ea0 msgr2=0x7fc0680b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.682+0000 7fc05e7fc700 1 --2- 172.21.15.124:0/3586574550 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0680b1ea0 0x7fc0680b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.682+0000 7fc05e7fc700 1 -- 172.21.15.124:0/3586574550 >> v1:172.21.15.124:6789/0 conn(0x7fc0681594b0 legacy=0x7fc0680b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.682+0000 7fc05e7fc700 1 -- 172.21.15.124:0/3586574550 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0680b4410 con 0x7fc0680b3d30 2023-10-06T04:44:34.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.682+0000 7f7f2d19b700 1 --2- 172.21.15.124:0/1632506741 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f28161810 0x7f7f280cb4e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f2806a760 tx=0x7f7f180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26df8d0221c773c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.683+0000 7fc05e7fc700 1 --2- 172.21.15.124:0/3586574550 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0680b3d30 0x7fc06815a580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc050009f20 tx=0x7fc050009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1de0de8fb4e465ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.683+0000 7f7f1ffff700 1 -- 172.21.15.124:0/1632506741 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800b670 con 0x7f7f28161810 2023-10-06T04:44:34.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.683+0000 7f7f1ffff700 1 -- 172.21.15.124:0/1632506741 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1800b7f0 con 0x7f7f28161810 2023-10-06T04:44:34.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.683+0000 7f7f1ffff700 1 -- 172.21.15.124:0/1632506741 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800bbb0 con 0x7f7f28161810 2023-10-06T04:44:34.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.684+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1632506741 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f28161810 msgr2=0x7f7f280cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.684+0000 7f7f2f3ff700 1 --2- 172.21.15.124:0/1632506741 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f28161810 0x7f7f280cb4e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f2806a760 tx=0x7f7f180091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.684+0000 7fc0667fc700 1 -- 172.21.15.124:0/3586574550 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05000e070 con 0x7fc0680b3d30 2023-10-06T04:44:34.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.684+0000 7fc0667fc700 1 -- 172.21.15.124:0/3586574550 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05000ba40 con 0x7fc0680b3d30 2023-10-06T04:44:34.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.684+0000 7fc0667fc700 1 -- 172.21.15.124:0/3586574550 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0500092e0 con 0x7fc0680b3d30 2023-10-06T04:44:34.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.685+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1632506741 shutdown_connections 2023-10-06T04:44:34.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.685+0000 7f7f2f3ff700 1 --2- 172.21.15.124:0/1632506741 >> v2:172.21.15.158:3300/0 conn(0x7f7f280cba20 0x7f7f280aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.685+0000 7f7f2f3ff700 1 --2- 172.21.15.124:0/1632506741 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f28161810 0x7f7f280cb4e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.685+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1632506741 >> 172.21.15.124:0/1632506741 conn(0x7f7f280cc080 msgr2=0x7f7f280cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.685+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1632506741 shutdown_connections 2023-10-06T04:44:34.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.685+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1632506741 wait complete. 2023-10-06T04:44:34.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.685+0000 7fc06d7ff700 1 -- 172.21.15.124:0/3586574550 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0680b3d30 msgr2=0x7fc06815a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.685+0000 7fc06d7ff700 1 --2- 172.21.15.124:0/3586574550 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0680b3d30 0x7fc06815a580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc050009f20 tx=0x7fc050009840 comp rx=0 tx=0).stop 2023-10-06T04:44:34.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.686+0000 7fc06d7ff700 1 -- 172.21.15.124:0/3586574550 shutdown_connections 2023-10-06T04:44:34.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.686+0000 7fc06d7ff700 1 --2- 172.21.15.124:0/3586574550 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0680b1ea0 0x7fc0680b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.686+0000 7fc06d7ff700 1 --2- 172.21.15.124:0/3586574550 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0680b3d30 0x7fc06815a580 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc050009f20 tx=0x7fc050009840 comp rx=0 tx=0).stop 2023-10-06T04:44:34.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.686+0000 7fc06d7ff700 1 -- 172.21.15.124:0/3586574550 >> 172.21.15.124:0/3586574550 conn(0x7fc06806ed20 msgr2=0x7fc06806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.689+0000 7fc06d7ff700 1 -- 172.21.15.124:0/3586574550 shutdown_connections 2023-10-06T04:44:34.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.687+0000 7f7f2f3ff700 1 Processor -- start 2023-10-06T04:44:34.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.687+0000 7f7f2f3ff700 1 -- start start 2023-10-06T04:44:34.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.689+0000 7f7f2f3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f280cba20 0x7f7f281574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.689+0000 7f7f2f3ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f28161810 0x7f7f28157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.689+0000 7f7f2f3ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f28161be0 0x7f7f2815e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.689+0000 7f7f2f3ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28155440 con 0x7f7f28161810 2023-10-06T04:44:34.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.689+0000 7f7f2f3ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28155110 con 0x7f7f28161be0 2023-10-06T04:44:34.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.689+0000 7f7f2f3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2815f760 con 0x7f7f280cba20 2023-10-06T04:44:34.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.693+0000 7f7f2c99a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f28161810 0x7f7f28157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.693+0000 7f7f2c99a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f28161810 0x7f7f28157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40362/0 (socket says 172.21.15.124:40362) 2023-10-06T04:44:34.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.693+0000 7f7f2c99a700 1 -- 172.21.15.124:0/1615020871 learned_addr learned my addr 172.21.15.124:0/1615020871 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.689+0000 7fc06d7ff700 1 -- 172.21.15.124:0/3586574550 wait complete. 2023-10-06T04:44:34.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7fc06d7ff700 1 Processor -- start 2023-10-06T04:44:34.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.690+0000 7f6eff9ff700 1 Processor -- start 2023-10-06T04:44:34.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.690+0000 7f6eff9ff700 1 -- start start 2023-10-06T04:44:34.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7f6eff9ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6ef8161810 0x7f6ef80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7f6eff9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161be0 0x7f6ef80cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7f6eff9ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef806b070 con 0x7f6ef80a9c40 2023-10-06T04:44:34.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7f6eff9ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef80c8240 con 0x7f6ef8161810 2023-10-06T04:44:34.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7f6eff9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80a97b0 con 0x7f6ef8161be0 2023-10-06T04:44:34.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.690+0000 7f96c63ff700 1 Processor -- start 2023-10-06T04:44:34.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.690+0000 7f96c63ff700 1 -- start start 2023-10-06T04:44:34.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7f96c63ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96c00cbbf0 0x7f96c00c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7f96c63ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c006b070 con 0x7f96c0161810 2023-10-06T04:44:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7f96c63ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c00c8240 con 0x7f96c0161be0 2023-10-06T04:44:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7f96c63ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c00a97b0 con 0x7f96c00cbbf0 2023-10-06T04:44:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.693+0000 7f96bffff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f96c0161810 0x7f96c00cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36258/0 (socket says 172.21.15.124:36258) 2023-10-06T04:44:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.693+0000 7f96bffff700 1 -- 172.21.15.124:0/1349072620 learned_addr learned my addr 172.21.15.124:0/1349072620 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.693+0000 7f96bf7fe700 1 --2- 172.21.15.124:0/1349072620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96c00cbbf0 0x7f96c00c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7f6efdf9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6ef80a9c40 0x7f6ef80aa0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36266/0 (socket says 172.21.15.124:36266) 2023-10-06T04:44:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7f6efdf9c700 1 -- 172.21.15.124:0/2814681846 learned_addr learned my addr 172.21.15.124:0/2814681846 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.692+0000 7fc06d7ff700 1 -- start start 2023-10-06T04:44:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7fc06d7ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0680b1ea0 0x7fc0680a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7fc06d7ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0681594b0 0x7fc068179cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7fc06d7ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc068177810 0x7fc06816b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7fc06d7ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06806ba50 con 0x7fc068177810 2023-10-06T04:44:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7fc06d7ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06817a200 con 0x7fc0681594b0 2023-10-06T04:44:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7fc06d7ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06806b5c0 con 0x7fc0680b1ea0 2023-10-06T04:44:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7fc0677fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc068177810 0x7fc06816b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7fc0677fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc068177810 0x7fc06816b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40378/0 (socket says 172.21.15.124:40378) 2023-10-06T04:44:34.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7fc0677fe700 1 -- 172.21.15.124:0/1966782304 learned_addr learned my addr 172.21.15.124:0/1966782304 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7f7f2d99c700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f28161be0 0x7f7f2815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7f7f2d19b700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f280cba20 0x7f7f281574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7f7f2d99c700 1 -- 172.21.15.124:0/1615020871 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f280cba20 msgr2=0x7f7f281574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7f7f2d99c700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f280cba20 0x7f7f281574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7f7f2d99c700 1 -- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f28161810 msgr2=0x7f7f28157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7f7f2d99c700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f28161810 0x7f7f28157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.694+0000 7f7f2d99c700 1 -- 172.21.15.124:0/1615020871 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009420 con 0x7f7f28161be0 2023-10-06T04:44:34.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7f7f2d99c700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f28161be0 0x7f7f2815e860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f20007ba0 tx=0x7f7f20009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7fc05e7fc700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0681594b0 0x7fc068179cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7fc066ffd700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0680b1ea0 0x7fc0680a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7f6efcf9a700 1 --2- 172.21.15.124:0/2814681846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161be0 0x7f6ef80cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7f96bf7fe700 1 -- 172.21.15.124:0/1349072620 >> v1:172.21.15.158:6789/0 conn(0x7f96c0161be0 legacy=0x7f96c00c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7f96bf7fe700 1 -- 172.21.15.124:0/1349072620 >> v1:172.21.15.124:6789/0 conn(0x7f96c0161810 legacy=0x7f96c00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7f96bf7fe700 1 -- 172.21.15.124:0/1349072620 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c00a8e80 con 0x7f96c00cbbf0 2023-10-06T04:44:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7f6efcf9a700 1 -- 172.21.15.124:0/2814681846 >> v2:172.21.15.124:3300/0 conn(0x7f6ef8161810 msgr2=0x7f6ef80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7f6efcf9a700 1 --2- 172.21.15.124:0/2814681846 >> v2:172.21.15.124:3300/0 conn(0x7f6ef8161810 0x7f6ef80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7f6efcf9a700 1 -- 172.21.15.124:0/2814681846 >> v1:172.21.15.124:6789/0 conn(0x7f6ef80a9c40 legacy=0x7f6ef80aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.695+0000 7f6efcf9a700 1 -- 172.21.15.124:0/2814681846 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80a8e80 con 0x7f6ef8161be0 2023-10-06T04:44:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7fc0677fe700 1 -- 172.21.15.124:0/1966782304 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0680b1ea0 msgr2=0x7fc0680a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7fc0677fe700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0680b1ea0 0x7fc0680a6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7fc0677fe700 1 -- 172.21.15.124:0/1966782304 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0681594b0 msgr2=0x7fc068179cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7fc0677fe700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0681594b0 0x7fc068179cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7fc0677fe700 1 -- 172.21.15.124:0/1966782304 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc050009ae0 con 0x7fc068177810 2023-10-06T04:44:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7f96bf7fe700 1 --2- 172.21.15.124:0/1349072620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96c00cbbf0 0x7f96c00c66c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009910 tx=0x7f96b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b35f1ea88631db63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7f9b869ff700 1 Processor -- start 2023-10-06T04:44:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7f7f1d7fa700 1 -- 172.21.15.124:0/1615020871 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000d7d0 con 0x7f7f28161be0 2023-10-06T04:44:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7f7f1d7fa700 1 -- 172.21.15.124:0/1615020871 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2000f040 con 0x7f7f28161be0 2023-10-06T04:44:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7f7f1d7fa700 1 -- 172.21.15.124:0/1615020871 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000dba0 con 0x7f7f28161be0 2023-10-06T04:44:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7fc0677fe700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc068177810 0x7fc06816b960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc06000b810 tx=0x7fc0600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2815fa40 con 0x7f7f28161be0 2023-10-06T04:44:34.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2815eda0 con 0x7f7f28161be0 2023-10-06T04:44:34.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.697+0000 7f6efcf9a700 1 --2- 172.21.15.124:0/2814681846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161be0 0x7f6ef80cba20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80098e0 tx=0x7f6ee80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a75462fa8d343db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7f96beffd700 1 -- 172.21.15.124:0/1349072620 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b000b860 con 0x7f96c00cbbf0 2023-10-06T04:44:34.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7f96beffd700 1 -- 172.21.15.124:0/1349072620 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b000b9c0 con 0x7f96c00cbbf0 2023-10-06T04:44:34.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.696+0000 7f96beffd700 1 -- 172.21.15.124:0/1349072620 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b000bd80 con 0x7f96c00cbbf0 2023-10-06T04:44:34.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.697+0000 7f9b869ff700 1 -- start start 2023-10-06T04:44:34.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.697+0000 7f96c63ff700 1 -- 172.21.15.124:0/1349072620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96c00cbbf0 msgr2=0x7f96c00c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.697+0000 7f96c63ff700 1 --2- 172.21.15.124:0/1349072620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96c00cbbf0 0x7f96c00c66c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009910 tx=0x7f96b00091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.697+0000 7f6eeffff700 1 -- 172.21.15.124:0/2814681846 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8009e80 con 0x7f6ef8161be0 2023-10-06T04:44:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.697+0000 7f6eeffff700 1 -- 172.21.15.124:0/2814681846 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee800b860 con 0x7f6ef8161be0 2023-10-06T04:44:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.697+0000 7f6eeffff700 1 -- 172.21.15.124:0/2814681846 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee800bbe0 con 0x7f6ef8161be0 2023-10-06T04:44:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f280717a0 con 0x7f7f28161be0 2023-10-06T04:44:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7f96c63ff700 1 -- 172.21.15.124:0/1349072620 shutdown_connections 2023-10-06T04:44:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7f96c63ff700 1 --2- 172.21.15.124:0/1349072620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96c00cbbf0 0x7f96c00c66c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7f96c63ff700 1 -- 172.21.15.124:0/1349072620 >> 172.21.15.124:0/1349072620 conn(0x7f96c00cc080 msgr2=0x7f96c00cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7fc05f7fe700 1 -- 172.21.15.124:0/1966782304 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06000f510 con 0x7fc068177810 2023-10-06T04:44:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7fc05f7fe700 1 -- 172.21.15.124:0/1966782304 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06000f690 con 0x7fc068177810 2023-10-06T04:44:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7fc05f7fe700 1 -- 172.21.15.124:0/1966782304 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06000fa50 con 0x7fc068177810 2023-10-06T04:44:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06806a9b0 con 0x7fc068177810 2023-10-06T04:44:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7f6eff9ff700 1 -- 172.21.15.124:0/2814681846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161be0 msgr2=0x7f6ef80cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7f6eff9ff700 1 --2- 172.21.15.124:0/2814681846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161be0 0x7f6ef80cba20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80098e0 tx=0x7f6ee80091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.698+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06806af70 con 0x7fc068177810 2023-10-06T04:44:34.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7f6eff9ff700 1 -- 172.21.15.124:0/2814681846 shutdown_connections 2023-10-06T04:44:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7f6eff9ff700 1 --2- 172.21.15.124:0/2814681846 >> v2:172.21.15.124:3300/0 conn(0x7f6ef8161810 0x7f6ef80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7f6eff9ff700 1 --2- 172.21.15.124:0/2814681846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161be0 0x7f6ef80cba20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7f6eff9ff700 1 -- 172.21.15.124:0/2814681846 >> 172.21.15.124:0/2814681846 conn(0x7f6ef80cc080 msgr2=0x7f6ef80cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7f6eff9ff700 1 -- 172.21.15.124:0/2814681846 shutdown_connections 2023-10-06T04:44:34.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7f6eff9ff700 1 -- 172.21.15.124:0/2814681846 wait complete. 2023-10-06T04:44:34.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc04c000fd0 con 0x7fc068177810 2023-10-06T04:44:34.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.700+0000 7f96c63ff700 1 -- 172.21.15.124:0/1349072620 shutdown_connections 2023-10-06T04:44:34.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7f9b869ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9b800698a0 0x7f9b8006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7f9b869ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8006f120 con 0x7f9b800ae550 2023-10-06T04:44:34.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7f9b869ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8006e510 con 0x7f9b8006a570 2023-10-06T04:44:34.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.699+0000 7f9b869ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8006e7f0 con 0x7f9b800698a0 2023-10-06T04:44:34.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.701+0000 7f9b7f7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f9b8006a570 0x7f9b800c66c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:55140/0 (socket says 172.21.15.124:55140) 2023-10-06T04:44:34.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.701+0000 7f9b7f7fe700 1 -- 172.21.15.124:0/3909982038 learned_addr learned my addr 172.21.15.124:0/3909982038 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:34.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.701+0000 7f9b84f9c700 1 --2- 172.21.15.124:0/3909982038 >> v2:172.21.15.124:3300/0 conn(0x7f9b800698a0 0x7f9b8006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.701+0000 7f6eff9ff700 1 Processor -- start 2023-10-06T04:44:34.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.700+0000 7f96c63ff700 1 -- 172.21.15.124:0/1349072620 wait complete. 2023-10-06T04:44:34.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.702+0000 7f96c63ff700 1 Processor -- start 2023-10-06T04:44:34.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.702+0000 7f9b7effd700 1 -- 172.21.15.124:0/3909982038 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046366193 0 0) 0x7f9b8006e510 con 0x7f9b8006a570 2023-10-06T04:44:34.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.702+0000 7f9b7effd700 1 -- 172.21.15.124:0/3909982038 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b68003570 con 0x7f9b8006a570 2023-10-06T04:44:34.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.702+0000 7f9b84f9c700 1 -- 172.21.15.124:0/3909982038 >> v1:172.21.15.158:6789/0 conn(0x7f9b8006a570 legacy=0x7f9b800c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.702+0000 7f9b84f9c700 1 -- 172.21.15.124:0/3909982038 >> v1:172.21.15.124:6789/0 conn(0x7f9b800ae550 legacy=0x7f9b80069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.702+0000 7f9b84f9c700 1 -- 172.21.15.124:0/3909982038 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8006ead0 con 0x7f9b800698a0 2023-10-06T04:44:34.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.702+0000 7f9b84f9c700 1 --2- 172.21.15.124:0/3909982038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800698a0 0x7f9b8006df10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009e60 tx=0x7f9b78009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad32c94b0dc33c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.702+0000 7f8fb81ff700 1 Processor -- start 2023-10-06T04:44:34.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7f7f1d7fa700 1 -- 172.21.15.124:0/1615020871 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f2001f440 con 0x7f7f28161be0 2023-10-06T04:44:34.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7f9b7effd700 1 -- 172.21.15.124:0/3909982038 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800bb60 con 0x7f9b800698a0 2023-10-06T04:44:34.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7f9b7effd700 1 -- 172.21.15.124:0/3909982038 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7800bcc0 con 0x7f9b800698a0 2023-10-06T04:44:34.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7f9b7effd700 1 -- 172.21.15.124:0/3909982038 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b780116b0 con 0x7f9b800698a0 2023-10-06T04:44:34.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.702+0000 7f6eff9ff700 1 -- start start 2023-10-06T04:44:34.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7f6eff9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ef80a9c40 0x7f6ef80b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7f6eff9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161810 0x7f6ef80b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7f6eff9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ef8161be0 0x7f6ef80b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7f6eff9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef81610d0 con 0x7f6ef80a9c40 2023-10-06T04:44:34.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7f6eff9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8097710 con 0x7f6ef8161be0 2023-10-06T04:44:34.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7f6eff9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80979f0 con 0x7f6ef8161810 2023-10-06T04:44:34.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.703+0000 7fc05f7fe700 1 -- 172.21.15.124:0/1966782304 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc060024430 con 0x7fc068177810 2023-10-06T04:44:34.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f6efd79b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ef80a9c40 0x7f6ef80b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f6efcf9a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161810 0x7f6ef80b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f6efcf9a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161810 0x7f6ef80b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:60946/0 (socket says 172.21.15.124:60946) 2023-10-06T04:44:34.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f6efcf9a700 1 -- 172.21.15.124:0/120424509 learned_addr learned my addr 172.21.15.124:0/120424509 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f9b869ff700 1 -- 172.21.15.124:0/3909982038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800698a0 msgr2=0x7f9b8006df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f9b869ff700 1 --2- 172.21.15.124:0/3909982038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800698a0 0x7f9b8006df10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009e60 tx=0x7f9b78009780 comp rx=0 tx=0).stop 2023-10-06T04:44:34.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.702+0000 7f96c63ff700 1 -- start start 2023-10-06T04:44:34.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f96c63ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96c00cbbf0 0x7f96c0098190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f96c63ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96c0161810 0x7f96c0160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f96c63ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96c0161be0 0x7f96c0159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f96c63ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c00b18e0 con 0x7f96c0161810 2023-10-06T04:44:34.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f96c63ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c00b1d70 con 0x7f96c00cbbf0 2023-10-06T04:44:34.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f96c63ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c00b0cd0 con 0x7f96c0161be0 2023-10-06T04:44:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f6efcf9a700 1 -- 172.21.15.124:0/120424509 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ef8161be0 msgr2=0x7f6ef80b1610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:44:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f6efcf9a700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ef8161be0 0x7f6ef80b1610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f6efcf9a700 1 -- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ef80a9c40 msgr2=0x7f6ef80b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f6efcf9a700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ef80a9c40 0x7f6ef80b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f6efcf9a700 1 -- 172.21.15.124:0/120424509 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8009420 con 0x7f6ef8161810 2023-10-06T04:44:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7fc05f7fe700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc048067080 0x7fc048069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7fc05f7fe700 1 -- 172.21.15.124:0/1966782304 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc060084b60 con 0x7fc068177810 2023-10-06T04:44:34.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f96bf7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96c0161810 0x7f96c0160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f96bf7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96c0161810 0x7f96c0160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40412/0 (socket says 172.21.15.124:40412) 2023-10-06T04:44:34.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f96bf7fe700 1 -- 172.21.15.124:0/4174691700 learned_addr learned my addr 172.21.15.124:0/4174691700 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7fc05f7fe700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] conn(0x7fc04806f930 0x7fc048071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7fc05f7fe700 1 -- 172.21.15.124:0/1966782304 --> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0480723f0 con 0x7fc04806f930 2023-10-06T04:44:34.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7fc05f7fe700 1 -- 172.21.15.124:0/1966782304 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc060084e90 con 0x7fc068177810 2023-10-06T04:44:34.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f96bffff700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96c00cbbf0 0x7f96c0098190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f96c499c700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96c0161be0 0x7f96c0159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f8fb81ff700 1 -- start start 2023-10-06T04:44:34.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f7f1d7fa700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f0c067080 0x7f7f0c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.704+0000 7f7f1d7fa700 1 -- 172.21.15.124:0/1615020871 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7f20084c80 con 0x7f7f28161be0 2023-10-06T04:44:34.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f7f2d19b700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f0c067080 0x7f7f0c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f7f1d7fa700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] conn(0x7f7f0c06f930 0x7f7f0c071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f7f1d7fa700 1 -- 172.21.15.124:0/1615020871 --> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f0c0723f0 con 0x7f7f0c06f930 2023-10-06T04:44:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f7f1d7fa700 1 -- 172.21.15.124:0/1615020871 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f20084fb0 con 0x7f7f28161be0 2023-10-06T04:44:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f7f2c99a700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] conn(0x7f7f0c06f930 0x7f7f0c071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f6efcf9a700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161810 0x7f6ef80b10d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80091e0 tx=0x7f6ee8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7fc05e7fc700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] conn(0x7fc04806f930 0x7fc048071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7fc066ffd700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc048067080 0x7fc048069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f6eed7fa700 1 -- 172.21.15.124:0/120424509 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee800b9d0 con 0x7f6ef8161810 2023-10-06T04:44:34.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f6eed7fa700 1 -- 172.21.15.124:0/120424509 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee800bb30 con 0x7f6ef8161810 2023-10-06T04:44:34.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f6eed7fa700 1 -- 172.21.15.124:0/120424509 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8025650 con 0x7f6ef8161810 2023-10-06T04:44:34.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f7f2d19b700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f0c067080 0x7f7f0c069530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f2806a760 tx=0x7f7f18016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f8fb81ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8fb01594b0 0x7f8fb00b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f8fb81ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb015a580 0x7f8fb00b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f8fb81ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8fb00b59f0 0x7f8fb00b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f8fb81ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb00b4410 con 0x7f8fb01594b0 2023-10-06T04:44:34.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f8fb81ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb00b46f0 con 0x7f8fb00b59f0 2023-10-06T04:44:34.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f8fb81ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00b49d0 con 0x7f8fb015a580 2023-10-06T04:44:34.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.708+0000 7fc05e7fc700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] conn(0x7fc04806f930 0x7fc048071d40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.708+0000 7fc066ffd700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc048067080 0x7fc048069530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc06806ec70 tx=0x7fc058009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f96bffff700 1 -- 172.21.15.124:0/4174691700 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96c0161be0 msgr2=0x7f96c0159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f96bffff700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96c0161be0 0x7f96c0159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f96bffff700 1 -- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96c0161810 msgr2=0x7f96c0160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f96bffff700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96c0161810 0x7f96c0160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f96bffff700 1 -- 172.21.15.124:0/4174691700 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b0009420 con 0x7f96c00cbbf0 2023-10-06T04:44:34.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.706+0000 7f96bf7fe700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96c0161810 0x7f96c0160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:34.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f96bffff700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96c00cbbf0 0x7f96c0098190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f96b800cbc0 tx=0x7f96b8001970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f96a7fff700 1 -- 172.21.15.124:0/4174691700 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800a780 con 0x7f96c00cbbf0 2023-10-06T04:44:34.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f96a7fff700 1 -- 172.21.15.124:0/4174691700 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b800a900 con 0x7f96c00cbbf0 2023-10-06T04:44:34.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f96a7fff700 1 -- 172.21.15.124:0/4174691700 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800acc0 con 0x7f96c00cbbf0 2023-10-06T04:44:34.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c00b0fb0 con 0x7f96c00cbbf0 2023-10-06T04:44:34.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c00b1570 con 0x7f96c00cbbf0 2023-10-06T04:44:34.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.708+0000 7f8fb579a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb015a580 0x7f8fb00b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.708+0000 7f8fb579a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb015a580 0x7f8fb00b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:60958/0 (socket says 172.21.15.124:60958) 2023-10-06T04:44:34.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.708+0000 7f8fb579a700 1 -- 172.21.15.124:0/850890123 learned_addr learned my addr 172.21.15.124:0/850890123 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.708+0000 7fb1123ff700 1 Processor -- start 2023-10-06T04:44:34.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.708+0000 7f8fb679c700 1 --2- 172.21.15.124:0/850890123 >> v2:172.21.15.158:3300/0 conn(0x7f8fb00b59f0 0x7f8fb00b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.708+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96c00717a0 con 0x7f96c00cbbf0 2023-10-06T04:44:34.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.708+0000 7fb1123ff700 1 -- start start 2023-10-06T04:44:34.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f9b869ff700 1 -- 172.21.15.124:0/3909982038 shutdown_connections 2023-10-06T04:44:34.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f9b869ff700 1 --2- 172.21.15.124:0/3909982038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800698a0 0x7f9b8006df10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.705+0000 7f9b869ff700 1 -- 172.21.15.124:0/3909982038 >> 172.21.15.124:0/3909982038 conn(0x7f9b800cc080 msgr2=0x7f9b800cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.737 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.707+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef8097cd0 con 0x7f6ef8161810 2023-10-06T04:44:34.737 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.708+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef8160340 con 0x7f6ef8161810 2023-10-06T04:44:34.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.709+0000 7f8fb579a700 1 -- 172.21.15.124:0/850890123 >> v2:172.21.15.158:3300/0 conn(0x7f8fb00b59f0 msgr2=0x7f8fb00b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.709+0000 7f8fb579a700 1 --2- 172.21.15.124:0/850890123 >> v2:172.21.15.158:3300/0 conn(0x7f8fb00b59f0 0x7f8fb00b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.709+0000 7f8fb579a700 1 -- 172.21.15.124:0/850890123 >> v2:172.21.15.124:3300/0 conn(0x7f8fb01594b0 msgr2=0x7f8fb00b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.709+0000 7f8fb579a700 1 --2- 172.21.15.124:0/850890123 >> v2:172.21.15.124:3300/0 conn(0x7f8fb01594b0 0x7f8fb00b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.709+0000 7f8fb579a700 1 -- 172.21.15.124:0/850890123 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00b4cb0 con 0x7f8fb015a580 2023-10-06T04:44:34.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.709+0000 7f9b869ff700 1 -- 172.21.15.124:0/3909982038 shutdown_connections 2023-10-06T04:44:34.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.709+0000 7f9b869ff700 1 -- 172.21.15.124:0/3909982038 wait complete. 2023-10-06T04:44:34.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.709+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ef80717a0 con 0x7f6ef8161810 2023-10-06T04:44:34.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.709+0000 7fc05f7fe700 1 -- 172.21.15.124:0/1966782304 <== osd.1 v2:172.21.15.124:6800/114871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc0480723f0 con 0x7fc04806f930 2023-10-06T04:44:34.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.710+0000 7f11c03ff700 1 Processor -- start 2023-10-06T04:44:34.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.710+0000 7f7f2c99a700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] conn(0x7f7f0c06f930 0x7f7f0c071d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.710+0000 7f11c03ff700 1 -- start start 2023-10-06T04:44:34.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.711+0000 7f7f1d7fa700 1 -- 172.21.15.124:0/1615020871 <== osd.0 v2:172.21.15.124:6808/114868 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7f0c0723f0 con 0x7f7f0c06f930 2023-10-06T04:44:34.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.710+0000 7fb1123ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb10c0690e0 0x7fb10c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.710+0000 7fb1123ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c0c80e0 con 0x7fb10c15eac0 2023-10-06T04:44:34.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.710+0000 7fb1123ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c0c7560 con 0x7fb10c0694b0 2023-10-06T04:44:34.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.710+0000 7fb1123ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c0c7840 con 0x7fb10c0690e0 2023-10-06T04:44:34.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7f96a7fff700 1 -- 172.21.15.124:0/4174691700 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96b8007300 con 0x7f96c00cbbf0 2023-10-06T04:44:34.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.711+0000 7f9b869ff700 1 Processor -- start 2023-10-06T04:44:34.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7f9b869ff700 1 -- start start 2023-10-06T04:44:34.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f9b869ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b800698a0 0x7f9b80151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f9b869ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b8006a570 0x7f9b8016d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f9b869ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b800ae550 0x7f9b8016dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f9b869ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b80098160 con 0x7f9b8006a570 2023-10-06T04:44:34.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7f9b869ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8016e8b0 con 0x7f9b800ae550 2023-10-06T04:44:34.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7f9b869ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b80097b50 con 0x7f9b800698a0 2023-10-06T04:44:34.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.710+0000 7f8fb579a700 1 --2- 172.21.15.124:0/850890123 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb015a580 0x7f8fb00b54b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00af1e0 tx=0x7f8fa4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e88f984cb498d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7f8fb4f99700 1 -- 172.21.15.124:0/850890123 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4009e70 con 0x7f8fb015a580 2023-10-06T04:44:34.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7f8fb4f99700 1 -- 172.21.15.124:0/850890123 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400b860 con 0x7f8fb015a580 2023-10-06T04:44:34.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7f8fb4f99700 1 -- 172.21.15.124:0/850890123 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400bc00 con 0x7f8fb015a580 2023-10-06T04:44:34.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f8fb81ff700 1 -- 172.21.15.124:0/850890123 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb015a580 msgr2=0x7f8fb00b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f8fb81ff700 1 --2- 172.21.15.124:0/850890123 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb015a580 0x7f8fb00b54b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00af1e0 tx=0x7f8fa4009250 comp rx=0 tx=0).stop 2023-10-06T04:44:34.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7fb11099c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb10c15eac0 0x7fb10c0c6810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36284/0 (socket says 172.21.15.124:36284) 2023-10-06T04:44:34.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7fb11099c700 1 -- 172.21.15.124:0/9291206 learned_addr learned my addr 172.21.15.124:0/9291206 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:34.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7fb10bfff700 1 --2- 172.21.15.124:0/9291206 >> v2:172.21.15.124:3300/0 conn(0x7fb10c0690e0 0x7fb10c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191690539 0 0) 0x7fb10c0c7560 con 0x7fb10c0694b0 2023-10-06T04:44:34.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f4003570 con 0x7fb10c0694b0 2023-10-06T04:44:34.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194798682 0 0) 0x7fb10c0c80e0 con 0x7fb10c15eac0 2023-10-06T04:44:34.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb10c0c7560 con 0x7fb10c15eac0 2023-10-06T04:44:34.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3840035622 0 0) 0x7fb0f4003570 con 0x7fb10c0694b0 2023-10-06T04:44:34.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 >> v2:172.21.15.124:3300/0 conn(0x7fb10c0690e0 msgr2=0x7fb10c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 --2- 172.21.15.124:0/9291206 >> v2:172.21.15.124:3300/0 conn(0x7fb10c0690e0 0x7fb10c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 >> v1:172.21.15.124:6789/0 conn(0x7fb10c15eac0 legacy=0x7fb10c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0c7b20 con 0x7fb10c0694b0 2023-10-06T04:44:34.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fb100001470 con 0x7fb10c0694b0 2023-10-06T04:44:34.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 >> v1:172.21.15.158:6789/0 conn(0x7fb10c0694b0 legacy=0x7fb10c15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0f4003bf0 0x7fb0f4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0f4004810 0x7fb0f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f40051c0 0x7fb0f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0c7840 con 0x7fb0f4004810 2023-10-06T04:44:34.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f400c160 con 0x7fb0f40051c0 2023-10-06T04:44:34.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f400c320 con 0x7fb0f4003bf0 2023-10-06T04:44:34.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7f11c03ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11b80c7760 0x7f11b81550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7f11c03ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f11b8155610 0x7f11b80c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7f11c03ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b8069bd0 con 0x7f11b80ccb90 2023-10-06T04:44:34.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7f11c03ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b8155a70 con 0x7f11b8155610 2023-10-06T04:44:34.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.712+0000 7f11c03ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80ca340 con 0x7f11b80c7760 2023-10-06T04:44:34.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f11be99c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f11b8155610 0x7f11b80c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f11be99c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f11b8155610 0x7f11b80c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40432/0 (socket says 172.21.15.124:40432) 2023-10-06T04:44:34.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f11be99c700 1 -- 172.21.15.124:0/4181901580 learned_addr learned my addr 172.21.15.124:0/4181901580 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f11be99c700 1 -- 172.21.15.124:0/4181901580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11b80c7760 msgr2=0x7f11b81550d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:44:34.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f11be99c700 1 --2- 172.21.15.124:0/4181901580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11b80c7760 0x7f11b81550d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f11be99c700 1 -- 172.21.15.124:0/4181901580 >> v1:172.21.15.158:6789/0 conn(0x7f11b80ccb90 legacy=0x7f11b80690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.713+0000 7f11be99c700 1 -- 172.21.15.124:0/4181901580 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b80c9cf0 con 0x7f11b8155610 2023-10-06T04:44:34.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7f11be99c700 1 --2- 172.21.15.124:0/4181901580 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11b8155610 0x7f11b80c7f60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009f20 tx=0x7f11b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2113a0de9aff010b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7fb11099c700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f40051c0 0x7fb0f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7fb10bfff700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0f4003bf0 0x7fb0f4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7f96a7fff700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f96ac067000 0x7f96ac0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7f96a7fff700 1 -- 172.21.15.124:0/4174691700 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f96b80852c0 con 0x7f96c00cbbf0 2023-10-06T04:44:34.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7f96a7fff700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] conn(0x7f96ac06f8b0 0x7f96ac071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7f96a7fff700 1 -- 172.21.15.124:0/4174691700 --> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96ac072370 con 0x7f96ac06f8b0 2023-10-06T04:44:34.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7f96a7fff700 1 -- 172.21.15.124:0/4174691700 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96b80855b0 con 0x7f96c00cbbf0 2023-10-06T04:44:34.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f9b7ffff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b800698a0 0x7f9b80151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f9b7ffff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b800698a0 0x7f9b80151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:60982/0 (socket says 172.21.15.124:60982) 2023-10-06T04:44:34.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f9b7ffff700 1 -- 172.21.15.124:0/618741810 learned_addr learned my addr 172.21.15.124:0/618741810 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f9b84f9c700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b800ae550 0x7f9b8016dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f9b7f7fe700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b8006a570 0x7f9b8016d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7fb10b7fe700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0f4004810 0x7fb0f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f11bd199700 1 -- 172.21.15.124:0/4181901580 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b000e070 con 0x7f11b8155610 2023-10-06T04:44:34.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f11bd199700 1 -- 172.21.15.124:0/4181901580 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b000bad0 con 0x7f11b8155610 2023-10-06T04:44:34.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f11bd199700 1 -- 172.21.15.124:0/4181901580 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00092e0 con 0x7f11b8155610 2023-10-06T04:44:34.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7fb10b7fe700 1 -- 172.21.15.124:0/9291206 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0f4003bf0 msgr2=0x7fb0f4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7fb10b7fe700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0f4003bf0 0x7fb0f4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7fb10b7fe700 1 -- 172.21.15.124:0/9291206 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f40051c0 msgr2=0x7fb0f400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7fb10b7fe700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f40051c0 0x7fb0f400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7fb10b7fe700 1 -- 172.21.15.124:0/9291206 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0c7b20 con 0x7fb0f4004810 2023-10-06T04:44:34.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f96c499c700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] conn(0x7f96ac06f8b0 0x7f96ac071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f96bf7fe700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f96ac067000 0x7f96ac0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f9b7ffff700 1 -- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b800ae550 msgr2=0x7f9b8016dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f9b7ffff700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b800ae550 0x7f9b8016dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f9b7ffff700 1 -- 172.21.15.124:0/618741810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b8006a570 msgr2=0x7f9b8016d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f9b7ffff700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b8006a570 0x7f9b8016d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.715+0000 7f9b7ffff700 1 -- 172.21.15.124:0/618741810 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78009a20 con 0x7f9b800698a0 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f8fb81ff700 1 -- 172.21.15.124:0/850890123 shutdown_connections 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f8fb81ff700 1 --2- 172.21.15.124:0/850890123 >> v2:172.21.15.158:3300/0 conn(0x7f8fb00b59f0 0x7f8fb00b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f8fb81ff700 1 --2- 172.21.15.124:0/850890123 >> v2:172.21.15.124:3300/0 conn(0x7f8fb01594b0 0x7f8fb00b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f8fb81ff700 1 --2- 172.21.15.124:0/850890123 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb015a580 0x7f8fb00b54b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f8fb81ff700 1 -- 172.21.15.124:0/850890123 >> 172.21.15.124:0/850890123 conn(0x7f8fb006ed20 msgr2=0x7f8fb006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f8fb81ff700 1 -- 172.21.15.124:0/850890123 shutdown_connections 2023-10-06T04:44:34.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7fb10b7fe700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0f4004810 0x7fb0f4004c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb100002ee0 tx=0x7fb100007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d51587439dffbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7fb11099c700 1 -- 172.21.15.124:0/9291206 reap_dead start 2023-10-06T04:44:34.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f11c03ff700 1 -- 172.21.15.124:0/4181901580 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11b8155610 msgr2=0x7f11b80c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f11c03ff700 1 --2- 172.21.15.124:0/4181901580 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11b8155610 0x7f11b80c7f60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009f20 tx=0x7f11b0009840 comp rx=0 tx=0).stop 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10000caf0 con 0x7fb0f4004810 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10000cc50 con 0x7fb0f4004810 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7fb10affd700 1 -- 172.21.15.124:0/9291206 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100012420 con 0x7fb0f4004810 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.714+0000 7f6eed7fa700 1 -- 172.21.15.124:0/120424509 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ee8023070 con 0x7f6ef8161810 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f6eed7fa700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6edc066fb0 0x7f6edc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f6eed7fa700 1 -- 172.21.15.124:0/120424509 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ee80864e0 con 0x7f6ef8161810 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f6eed7fa700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] conn(0x7f6edc06f860 0x7f6edc071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f6eed7fa700 1 -- 172.21.15.124:0/120424509 --> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6edc072320 con 0x7f6edc06f860 2023-10-06T04:44:34.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f6eed7fa700 1 -- 172.21.15.124:0/120424509 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ee8086810 con 0x7f6ef8161810 2023-10-06T04:44:34.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7fb10bfff700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0f4003bf0 0x7fb0f4003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:34.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f9b7ffff700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b800698a0 0x7f9b80151fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c590 tx=0x7f9b7000c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.716+0000 7f8fb81ff700 1 -- 172.21.15.124:0/850890123 wait complete. 2023-10-06T04:44:34.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7f6efdf9c700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] conn(0x7f6edc06f860 0x7f6edc071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.718+0000 7f6efdf9c700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] conn(0x7f6edc06f860 0x7f6edc071c70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7f96c499c700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] conn(0x7f96ac06f8b0 0x7f96ac071cc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7f9b67fff700 1 -- 172.21.15.124:0/618741810 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70011590 con 0x7f9b800698a0 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7f9b67fff700 1 -- 172.21.15.124:0/618741810 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b70011710 con 0x7f9b800698a0 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7f9b67fff700 1 -- 172.21.15.124:0/618741810 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70011ad0 con 0x7f9b800698a0 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8016e290 con 0x7f9b800698a0 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b80097df0 con 0x7f9b800698a0 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.718+0000 7f8fb81ff700 1 Processor -- start 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7fb1123ff700 1 -- 172.21.15.124:0/9291206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0f4004810 msgr2=0x7fb0f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7fb1123ff700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0f4004810 0x7fb0f4004c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb100002ee0 tx=0x7fb100007830 comp rx=0 tx=0).stop 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7fb1123ff700 1 -- 172.21.15.124:0/9291206 shutdown_connections 2023-10-06T04:44:34.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7fb1123ff700 1 --2- 172.21.15.124:0/9291206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0f4004810 0x7fb0f4004c80 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb100002ee0 tx=0x7fb100007830 comp rx=0 tx=0).stop 2023-10-06T04:44:34.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.717+0000 7fb1123ff700 1 -- 172.21.15.124:0/9291206 >> 172.21.15.124:0/9291206 conn(0x7fb10c0cc080 msgr2=0x7fb10c0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.718+0000 7fb1123ff700 1 -- 172.21.15.124:0/9291206 shutdown_connections 2023-10-06T04:44:34.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.718+0000 7f11c03ff700 1 -- 172.21.15.124:0/4181901580 shutdown_connections 2023-10-06T04:44:34.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.718+0000 7f11c03ff700 1 --2- 172.21.15.124:0/4181901580 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11b8155610 0x7f11b80c7f60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.718+0000 7f11c03ff700 1 --2- 172.21.15.124:0/4181901580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11b80c7760 0x7f11b81550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.718+0000 7f11c03ff700 1 -- 172.21.15.124:0/4181901580 >> 172.21.15.124:0/4181901580 conn(0x7f11b80cc080 msgr2=0x7f11b80cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.719+0000 7f96a7fff700 1 -- 172.21.15.124:0/4174691700 <== osd.3 v2:172.21.15.124:6824/114900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f96ac072370 con 0x7f96ac06f8b0 2023-10-06T04:44:34.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.719+0000 7f11c03ff700 1 -- 172.21.15.124:0/4181901580 shutdown_connections 2023-10-06T04:44:34.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.718+0000 7f8fb81ff700 1 -- start start 2023-10-06T04:44:34.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.719+0000 7f6eed7fa700 1 -- 172.21.15.124:0/120424509 <== osd.2 v2:172.21.15.124:6816/114869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6edc072320 con 0x7f6edc06f860 2023-10-06T04:44:34.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.720+0000 7f8fb81ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb00b59f0 0x7f8fb006b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.720+0000 7f8fb81ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fb01594b0 0x7f8fb014d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.720+0000 7f8fb81ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fb015a580 0x7f8fb014ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.720+0000 7f8fb81ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb016cdd0 con 0x7f8fb01594b0 2023-10-06T04:44:34.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.720+0000 7f8fb81ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb014d7e0 con 0x7f8fb015a580 2023-10-06T04:44:34.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.720+0000 7f8fb81ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb014da60 con 0x7f8fb00b59f0 2023-10-06T04:44:34.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.719+0000 7fb1123ff700 1 -- 172.21.15.124:0/9291206 wait complete. 2023-10-06T04:44:34.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.721+0000 7fb1123ff700 1 Processor -- start 2023-10-06T04:44:34.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.721+0000 7f8fb5f9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb00b59f0 0x7f8fb006b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.721+0000 7f8fb5f9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb00b59f0 0x7f8fb006b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:60984/0 (socket says 172.21.15.124:60984) 2023-10-06T04:44:34.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.721+0000 7f8fb5f9b700 1 -- 172.21.15.124:0/3788074929 learned_addr learned my addr 172.21.15.124:0/3788074929 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.721+0000 7f8fb679c700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fb015a580 0x7f8fb014ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.719+0000 7f11c03ff700 1 -- 172.21.15.124:0/4181901580 wait complete. 2023-10-06T04:44:34.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7f11c03ff700 1 Processor -- start 2023-10-06T04:44:34.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.719+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b60000fd0 con 0x7f9b800698a0 2023-10-06T04:44:34.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7f8fb679c700 1 -- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb00b59f0 msgr2=0x7f8fb006b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7f8fb679c700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb00b59f0 0x7f8fb006b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7f8fb679c700 1 -- 172.21.15.124:0/3788074929 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fb01594b0 msgr2=0x7f8fb014d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7f8fb679c700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fb01594b0 0x7f8fb014d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7f8fb679c700 1 -- 172.21.15.124:0/3788074929 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa40094f0 con 0x7f8fb015a580 2023-10-06T04:44:34.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7f8fb679c700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fb015a580 0x7f8fb014ace0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009e20 tx=0x7f8fa800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.721+0000 7fb1123ff700 1 -- start start 2023-10-06T04:44:34.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7fb1123ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb10c06e4e0 0x7fb10c15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7fb1123ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb10c158f90 0x7fb10c158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7fb1123ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10c06e8b0 0x7fb10c158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7fb1123ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0ab0a0 con 0x7fb10c06e8b0 2023-10-06T04:44:34.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7fb1123ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0abbc0 con 0x7fb10c06e4e0 2023-10-06T04:44:34.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.722+0000 7fb1123ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0abe60 con 0x7fb10c158f90 2023-10-06T04:44:34.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7fb10b7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb10c158f90 0x7fb10c158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7fb10b7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb10c158f90 0x7fb10c158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:60990/0 (socket says 172.21.15.124:60990) 2023-10-06T04:44:34.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7fb10b7fe700 1 -- 172.21.15.124:0/2559800049 learned_addr learned my addr 172.21.15.124:0/2559800049 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7fb11099c700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10c06e8b0 0x7fb10c158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7f8fadffb700 1 -- 172.21.15.124:0/3788074929 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800cb50 con 0x7f8fb015a580 2023-10-06T04:44:34.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7f8fadffb700 1 -- 172.21.15.124:0/3788074929 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800f040 con 0x7f8fb015a580 2023-10-06T04:44:34.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7f8fadffb700 1 -- 172.21.15.124:0/3788074929 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8014480 con 0x7f8fb015a580 2023-10-06T04:44:34.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7fb10bfff700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb10c06e4e0 0x7fb10c15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7fb10b7fe700 1 -- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb10c06e4e0 msgr2=0x7fb10c15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7fb10b7fe700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb10c06e4e0 0x7fb10c15dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7fb10b7fe700 1 -- 172.21.15.124:0/2559800049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10c06e8b0 msgr2=0x7fb10c158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7fb10b7fe700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10c06e8b0 0x7fb10c158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7fb10b7fe700 1 -- 172.21.15.124:0/2559800049 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c171510 con 0x7fb10c158f90 2023-10-06T04:44:34.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.724+0000 7fb10b7fe700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb10c158f90 0x7fb10c158430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb100013000 tx=0x7fb100017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.723+0000 7f11c03ff700 1 -- start start 2023-10-06T04:44:34.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.724+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb014dd40 con 0x7f8fb015a580 2023-10-06T04:44:34.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.724+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb014e300 con 0x7f8fb015a580 2023-10-06T04:44:34.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.724+0000 7fb0f3fff700 1 -- 172.21.15.124:0/2559800049 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100007ae0 con 0x7fb10c158f90 2023-10-06T04:44:34.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.725+0000 7fb0f3fff700 1 -- 172.21.15.124:0/2559800049 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb100001370 con 0x7fb10c158f90 2023-10-06T04:44:34.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.725+0000 7fb0f3fff700 1 -- 172.21.15.124:0/2559800049 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100012a40 con 0x7fb10c158f90 2023-10-06T04:44:34.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.725+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c1717f0 con 0x7fb10c158f90 2023-10-06T04:44:34.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.725+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c15bb50 con 0x7fb10c158f90 2023-10-06T04:44:34.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.725+0000 7f11c03ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11b80c7760 0x7f11b80c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.725+0000 7f11c03ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11b80ccb90 0x7f11b80c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.725+0000 7f11c03ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11b8155610 0x7f11b80aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.725+0000 7f11c03ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80c5480 con 0x7f11b80c7760 2023-10-06T04:44:34.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.725+0000 7f11c03ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80c4870 con 0x7f11b8155610 2023-10-06T04:44:34.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.725+0000 7f11c03ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80c4b50 con 0x7f11b80ccb90 2023-10-06T04:44:34.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.726+0000 7f11be19b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11b80c7760 0x7f11b80c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.726+0000 7f11be19b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11b80c7760 0x7f11b80c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40486/0 (socket says 172.21.15.124:40486) 2023-10-06T04:44:34.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.726+0000 7f11be19b700 1 -- 172.21.15.124:0/3171838836 learned_addr learned my addr 172.21.15.124:0/3171838836 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:34.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.724+0000 7f9b67fff700 1 -- 172.21.15.124:0/618741810 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b7001c440 con 0x7f9b800698a0 2023-10-06T04:44:34.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.726+0000 7f9b67fff700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b6c067080 0x7f9b6c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.726+0000 7f9b67fff700 1 -- 172.21.15.124:0/618741810 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b70084030 con 0x7f9b800698a0 2023-10-06T04:44:34.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.726+0000 7f9b67fff700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] conn(0x7f9b6c06f930 0x7f9b6c071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.726+0000 7f9b67fff700 1 -- 172.21.15.124:0/618741810 --> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b6c0723f0 con 0x7f9b6c06f930 2023-10-06T04:44:34.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.726+0000 7f9b67fff700 1 -- 172.21.15.124:0/618741810 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b70084360 con 0x7f9b800698a0 2023-10-06T04:44:34.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.726+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0ec000fd0 con 0x7fb10c158f90 2023-10-06T04:44:34.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.727+0000 7f6efd79b700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6edc066fb0 0x7f6edc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.727+0000 7f9b7f7fe700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b6c067080 0x7f9b6c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.727+0000 7f9b84f9c700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] conn(0x7f9b6c06f930 0x7f9b6c071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.728+0000 7f6efd79b700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6edc066fb0 0x7f6edc069460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009f50 tx=0x7f6ef0009590 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.728+0000 7f8fadffb700 1 -- 172.21.15.124:0/3788074929 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fa80147f0 con 0x7f8fb015a580 2023-10-06T04:44:34.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.729+0000 7f8fadffb700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f9c067080 0x7f8f9c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.729+0000 7f8fadffb700 1 -- 172.21.15.124:0/3788074929 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8fa8085380 con 0x7f8fb015a580 2023-10-06T04:44:34.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.728+0000 7f9b7f7fe700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b6c067080 0x7f9b6c069530 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9b800c36b0 tx=0x7f9b74009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.729+0000 7f11be19b700 1 -- 172.21.15.124:0/3171838836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11b80ccb90 msgr2=0x7f11b80c5910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:44:34.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.729+0000 7f11be19b700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11b80ccb90 0x7f11b80c5910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.729+0000 7f11be19b700 1 -- 172.21.15.124:0/3171838836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11b8155610 msgr2=0x7f11b80aa040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:44:34.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.729+0000 7f11be19b700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11b8155610 0x7f11b80aa040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.729+0000 7f11be19b700 1 -- 172.21.15.124:0/3171838836 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009ae0 con 0x7f11b80c7760 2023-10-06T04:44:34.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.730+0000 7f11be19b700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11b80c7760 0x7f11b80c4200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f11a800b600 tx=0x7f11a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.727+0000 7f96bf7fe700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f96ac067000 0x7f96ac0694b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f96c00c2b80 tx=0x7f96b0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.730+0000 7fb0f3fff700 1 -- 172.21.15.124:0/2559800049 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb100024070 con 0x7fb10c158f90 2023-10-06T04:44:34.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7f11ae7fc700 1 -- 172.21.15.124:0/3171838836 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a800f510 con 0x7f11b80c7760 2023-10-06T04:44:34.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7f11ae7fc700 1 -- 172.21.15.124:0/3171838836 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a800f690 con 0x7f11b80c7760 2023-10-06T04:44:34.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7f11ae7fc700 1 -- 172.21.15.124:0/3171838836 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a800fa50 con 0x7f11b80c7760 2023-10-06T04:44:34.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b80c4e30 con 0x7f11b80c7760 2023-10-06T04:44:34.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7fb0f3fff700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb0f80670b0 0x7fb0f8069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7f8fb5f9b700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f9c067080 0x7f8f9c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b8140090 con 0x7f11b80c7760 2023-10-06T04:44:34.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7fb0f3fff700 1 -- 172.21.15.124:0/2559800049 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb1000867d0 con 0x7fb10c158f90 2023-10-06T04:44:34.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7fb0f3fff700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] conn(0x7fb0f806f960 0x7fb0f8071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7fb0f3fff700 1 -- 172.21.15.124:0/2559800049 --> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0f8072420 con 0x7fb0f806f960 2023-10-06T04:44:34.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.731+0000 7fb0f3fff700 1 -- 172.21.15.124:0/2559800049 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb100086b00 con 0x7fb10c158f90 2023-10-06T04:44:34.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.732+0000 7fb11099c700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] conn(0x7fb0f806f960 0x7fb0f8071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.732+0000 7fb10bfff700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb0f80670b0 0x7fb0f8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.733+0000 7fb10bfff700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb0f80670b0 0x7fb0f8069560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0093f0 tx=0x7fb0fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.733+0000 7f8fb81ff700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] conn(0x7f8fb006bcd0 0x7f8fb006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.733+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 --> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fb00b4f90 con 0x7f8fb006bcd0 2023-10-06T04:44:34.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.733+0000 7f8fb5f9b700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f9c067080 0x7f8f9c069530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009c10 tx=0x7f8fa0009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.734+0000 7f8fb579a700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] conn(0x7f8fb006bcd0 0x7f8fb006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.734+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11b80717a0 con 0x7f11b80c7760 2023-10-06T04:44:34.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.734+0000 7f9b84f9c700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] conn(0x7f9b6c06f930 0x7f9b6c071d40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.734+0000 7fb11099c700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] conn(0x7fb0f806f960 0x7fb0f8071d70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.734+0000 7f8fb579a700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] conn(0x7f8fb006bcd0 0x7f8fb006c0a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.735+0000 7f11ae7fc700 1 -- 172.21.15.124:0/3171838836 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11a801a400 con 0x7f11b80c7760 2023-10-06T04:44:34.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.736+0000 7f9b67fff700 1 -- 172.21.15.124:0/618741810 <== osd.4 v2:172.21.15.158:6800/115098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9b6c0723f0 con 0x7f9b6c06f930 2023-10-06T04:44:34.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.735+0000 7fb0f3fff700 1 -- 172.21.15.124:0/2559800049 <== osd.6 v2:172.21.15.158:6816/115109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb0f8072420 con 0x7fb0f806f960 2023-10-06T04:44:34.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.736+0000 7f11ae7fc700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f119c067000 0x7f119c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.736+0000 7f11ae7fc700 1 -- 172.21.15.124:0/3171838836 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11a8084070 con 0x7f11b80c7760 2023-10-06T04:44:34.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.736+0000 7f11ae7fc700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] conn(0x7f119c06f8b0 0x7f119c071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.736+0000 7f11ae7fc700 1 -- 172.21.15.124:0/3171838836 --> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f119c072370 con 0x7f119c06f8b0 2023-10-06T04:44:34.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.736+0000 7f11ae7fc700 1 -- 172.21.15.124:0/3171838836 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11a8086700 con 0x7f11b80c7760 2023-10-06T04:44:34.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.736+0000 7f11bd99a700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f119c067000 0x7f119c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.736+0000 7f11be99c700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] conn(0x7f119c06f8b0 0x7f119c071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.736+0000 7f8fadffb700 1 -- 172.21.15.124:0/3788074929 <== osd.5 v2:172.21.15.158:6808/115099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8fb00b4f90 con 0x7f8fb006bcd0 2023-10-06T04:44:34.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.737+0000 7f11bd99a700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f119c067000 0x7f119c0694b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f11b813ec00 tx=0x7f11b4006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.739+0000 7f11be99c700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] conn(0x7f119c06f8b0 0x7f119c071cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.740+0000 7f11ae7fc700 1 -- 172.21.15.124:0/3171838836 <== osd.7 v2:172.21.15.158:6824/115130 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f119c072370 con 0x7f119c06f8b0 2023-10-06T04:44:34.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.745+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 --> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc04c002d30 con 0x7fc04806f930 2023-10-06T04:44:34.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.745+0000 7fc05f7fe700 1 -- 172.21.15.124:0/1966782304 <== osd.1 v2:172.21.15.124:6800/114871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc04c002d30 con 0x7fc04806f930 2023-10-06T04:44:34.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.746+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] conn(0x7fc04806f930 msgr2=0x7fc048071d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.746+0000 7fc06d7ff700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] conn(0x7fc04806f930 0x7fc048071d40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.747+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc048067080 msgr2=0x7fc048069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.747+0000 7fc06d7ff700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc048067080 0x7fc048069530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc06806ec70 tx=0x7fc058009060 comp rx=0 tx=0).stop 2023-10-06T04:44:34.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.747+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc068177810 msgr2=0x7fc06816b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.747+0000 7fc06d7ff700 1 --2- 172.21.15.124:0/1966782304 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc068177810 0x7fc06816b960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc06000b810 tx=0x7fc0600091d0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.748+0000 7fc0677fe700 1 -- 172.21.15.124:0/1966782304 reap_dead start 2023-10-06T04:44:34.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.748+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 shutdown_connections 2023-10-06T04:44:34.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.748+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 >> 172.21.15.124:0/1966782304 conn(0x7fc06806ed20 msgr2=0x7fc068159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.748+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 --> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f280a8e80 con 0x7f7f0c06f930 2023-10-06T04:44:34.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.749+0000 7f7f1d7fa700 1 -- 172.21.15.124:0/1615020871 <== osd.0 v2:172.21.15.124:6808/114868 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f280a8e80 con 0x7f7f0c06f930 2023-10-06T04:44:34.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.749+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 shutdown_connections 2023-10-06T04:44:34.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.749+0000 7fc06d7ff700 1 -- 172.21.15.124:0/1966782304 wait complete. 2023-10-06T04:44:34.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.750+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] conn(0x7f7f0c06f930 msgr2=0x7f7f0c071d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.750+0000 7f7f2f3ff700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] conn(0x7f7f0c06f930 0x7f7f0c071d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.751+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f0c067080 msgr2=0x7f7f0c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.751+0000 7f7f2f3ff700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f0c067080 0x7f7f0c069530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f2806a760 tx=0x7f7f18016000 comp rx=0 tx=0).stop 2023-10-06T04:44:34.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.751+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f28161be0 msgr2=0x7f7f2815e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.751+0000 7f7f2f3ff700 1 --2- 172.21.15.124:0/1615020871 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f28161be0 0x7f7f2815e860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f20007ba0 tx=0x7f7f20009250 comp rx=0 tx=0).stop 2023-10-06T04:44:34.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.751+0000 7f7f2d99c700 1 -- 172.21.15.124:0/1615020871 reap_dead start 2023-10-06T04:44:34.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.751+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 shutdown_connections 2023-10-06T04:44:34.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.751+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 >> 172.21.15.124:0/1615020871 conn(0x7f7f280cc080 msgr2=0x7f7f2806f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.752+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 shutdown_connections 2023-10-06T04:44:34.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.752+0000 7f7f2f3ff700 1 -- 172.21.15.124:0/1615020871 wait complete. 2023-10-06T04:44:34.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.753+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 --> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f96c0161200 con 0x7f96ac06f8b0 2023-10-06T04:44:34.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.753+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 --> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ef80c83f0 con 0x7f6edc06f860 2023-10-06T04:44:34.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.754+0000 7f6eed7fa700 1 -- 172.21.15.124:0/120424509 <== osd.2 v2:172.21.15.124:6816/114869 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ef80c83f0 con 0x7f6edc06f860 2023-10-06T04:44:34.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.754+0000 7f96a7fff700 1 -- 172.21.15.124:0/4174691700 <== osd.3 v2:172.21.15.124:6824/114900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f96c0161200 con 0x7f96ac06f8b0 2023-10-06T04:44:34.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.755+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] conn(0x7f96ac06f8b0 msgr2=0x7f96ac071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.755+0000 7f96c63ff700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] conn(0x7f96ac06f8b0 0x7f96ac071cc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.755+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f96ac067000 msgr2=0x7f96ac0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.755+0000 7f96c63ff700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f96ac067000 0x7f96ac0694b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f96c00c2b80 tx=0x7f96b0017000 comp rx=0 tx=0).stop 2023-10-06T04:44:34.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.755+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96c00cbbf0 msgr2=0x7f96c0098190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.755+0000 7f96c63ff700 1 --2- 172.21.15.124:0/4174691700 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96c00cbbf0 0x7f96c0098190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f96b800cbc0 tx=0x7f96b8001970 comp rx=0 tx=0).stop 2023-10-06T04:44:34.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.755+0000 7f96c499c700 1 -- 172.21.15.124:0/4174691700 reap_dead start 2023-10-06T04:44:34.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.755+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 shutdown_connections 2023-10-06T04:44:34.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.755+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 >> 172.21.15.124:0/4174691700 conn(0x7f96c00cc080 msgr2=0x7f96c015cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.756+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 shutdown_connections 2023-10-06T04:44:34.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.756+0000 7f96c63ff700 1 -- 172.21.15.124:0/4174691700 wait complete. 2023-10-06T04:44:34.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.757+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] conn(0x7f6edc06f860 msgr2=0x7f6edc071c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.757+0000 7f6eff9ff700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] conn(0x7f6edc06f860 0x7f6edc071c70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.757+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6edc066fb0 msgr2=0x7f6edc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.757+0000 7f6eff9ff700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6edc066fb0 0x7f6edc069460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009f50 tx=0x7f6ef0009590 comp rx=0 tx=0).stop 2023-10-06T04:44:34.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.757+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161810 msgr2=0x7f6ef80b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.757+0000 7f6eff9ff700 1 --2- 172.21.15.124:0/120424509 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ef8161810 0x7f6ef80b10d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80091e0 tx=0x7f6ee8017000 comp rx=0 tx=0).stop 2023-10-06T04:44:34.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.762+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 --> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9b60002d30 con 0x7f9b6c06f930 2023-10-06T04:44:34.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.763+0000 7f6efdf9c700 1 -- 172.21.15.124:0/120424509 reap_dead start 2023-10-06T04:44:34.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.763+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 shutdown_connections 2023-10-06T04:44:34.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.763+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 >> 172.21.15.124:0/120424509 conn(0x7f6ef80cc080 msgr2=0x7f6ef806dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.764+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 shutdown_connections 2023-10-06T04:44:34.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.764+0000 7f6eff9ff700 1 -- 172.21.15.124:0/120424509 wait complete. 2023-10-06T04:44:34.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.764+0000 7f9b67fff700 1 -- 172.21.15.124:0/618741810 <== osd.4 v2:172.21.15.158:6800/115098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9b60002d30 con 0x7f9b6c06f930 2023-10-06T04:44:34.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.768+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 --> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8fb00b36a0 con 0x7f8fb006bcd0 2023-10-06T04:44:34.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.768+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 --> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0ec002d30 con 0x7fb0f806f960 2023-10-06T04:44:34.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.768+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] conn(0x7f9b6c06f930 msgr2=0x7f9b6c071d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.768+0000 7f9b869ff700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] conn(0x7f9b6c06f930 0x7f9b6c071d40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.769+0000 7f8fadffb700 1 -- 172.21.15.124:0/3788074929 <== osd.5 v2:172.21.15.158:6808/115099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8fb00b36a0 con 0x7f8fb006bcd0 2023-10-06T04:44:34.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.769+0000 7fb0f3fff700 1 -- 172.21.15.124:0/2559800049 <== osd.6 v2:172.21.15.158:6816/115109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb0ec002d30 con 0x7fb0f806f960 2023-10-06T04:44:34.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b6c067080 msgr2=0x7f9b6c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7f9b869ff700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b6c067080 0x7f9b6c069530 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9b800c36b0 tx=0x7f9b74009040 comp rx=0 tx=0).stop 2023-10-06T04:44:34.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b800698a0 msgr2=0x7f9b80151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7f9b869ff700 1 --2- 172.21.15.124:0/618741810 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b800698a0 0x7f9b80151fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c590 tx=0x7f9b7000c8a0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7f9b84f9c700 1 -- 172.21.15.124:0/618741810 reap_dead start 2023-10-06T04:44:34.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] conn(0x7fb0f806f960 msgr2=0x7fb0f8071d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7fb1123ff700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] conn(0x7fb0f806f960 0x7fb0f8071d70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 shutdown_connections 2023-10-06T04:44:34.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 >> 172.21.15.124:0/618741810 conn(0x7f9b800cc080 msgr2=0x7f9b800c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb0f80670b0 msgr2=0x7fb0f8069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7fb1123ff700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb0f80670b0 0x7fb0f8069560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0093f0 tx=0x7fb0fc008040 comp rx=0 tx=0).stop 2023-10-06T04:44:34.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb10c158f90 msgr2=0x7fb10c158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.770+0000 7fb1123ff700 1 --2- 172.21.15.124:0/2559800049 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb10c158f90 0x7fb10c158430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb100013000 tx=0x7fb100017000 comp rx=0 tx=0).stop 2023-10-06T04:44:34.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7fb11099c700 1 -- 172.21.15.124:0/2559800049 reap_dead start 2023-10-06T04:44:34.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] conn(0x7f8fb006bcd0 msgr2=0x7f8fb006c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7f8fb81ff700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] conn(0x7f8fb006bcd0 0x7f8fb006c0a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 shutdown_connections 2023-10-06T04:44:34.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 >> 172.21.15.124:0/2559800049 conn(0x7fb10c0cc080 msgr2=0x7fb10c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f9c067080 msgr2=0x7f8f9c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7f8fb81ff700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f9c067080 0x7f8f9c069530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009c10 tx=0x7f8fa0009250 comp rx=0 tx=0).stop 2023-10-06T04:44:34.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fb015a580 msgr2=0x7f8fb014ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7f8fb81ff700 1 --2- 172.21.15.124:0/3788074929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fb015a580 0x7f8fb014ace0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009e20 tx=0x7f8fa800b040 comp rx=0 tx=0).stop 2023-10-06T04:44:34.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 shutdown_connections 2023-10-06T04:44:34.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7f8fb679c700 1 -- 172.21.15.124:0/3788074929 reap_dead start 2023-10-06T04:44:34.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 shutdown_connections 2023-10-06T04:44:34.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 >> 172.21.15.124:0/3788074929 conn(0x7f8fb006ed20 msgr2=0x7f8fb00cf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.771+0000 7fb1123ff700 1 -- 172.21.15.124:0/2559800049 wait complete. 2023-10-06T04:44:34.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.772+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 shutdown_connections 2023-10-06T04:44:34.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.772+0000 7f8fb81ff700 1 -- 172.21.15.124:0/3788074929 wait complete. 2023-10-06T04:44:34.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.774+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 --> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f11b80c9fd0 con 0x7f119c06f8b0 2023-10-06T04:44:34.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.774+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 shutdown_connections 2023-10-06T04:44:34.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.774+0000 7f9b869ff700 1 -- 172.21.15.124:0/618741810 wait complete. 2023-10-06T04:44:34.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.776+0000 7f11ae7fc700 1 -- 172.21.15.124:0/3171838836 <== osd.7 v2:172.21.15.158:6824/115130 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f11b80c9fd0 con 0x7f119c06f8b0 2023-10-06T04:44:34.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.777+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 >> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] conn(0x7f119c06f8b0 msgr2=0x7f119c071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.777+0000 7f11c03ff700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] conn(0x7f119c06f8b0 0x7f119c071cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.777+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f119c067000 msgr2=0x7f119c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.777+0000 7f11c03ff700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f119c067000 0x7f119c0694b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f11b813ec00 tx=0x7f11b4006bc0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.777+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11b80c7760 msgr2=0x7f11b80c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.777+0000 7f11c03ff700 1 --2- 172.21.15.124:0/3171838836 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11b80c7760 0x7f11b80c4200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f11a800b600 tx=0x7f11a80091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.777+0000 7f11be99c700 1 -- 172.21.15.124:0/3171838836 reap_dead start 2023-10-06T04:44:34.807 INFO:teuthology.orchestra.run.smithi124.stdout:60129542150 2023-10-06T04:44:34.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.778+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 shutdown_connections 2023-10-06T04:44:34.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.778+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 >> 172.21.15.124:0/3171838836 conn(0x7f11b80cc080 msgr2=0x7f11b80c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.778+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 shutdown_connections 2023-10-06T04:44:34.808 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:44:34.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:34.778+0000 7f11c03ff700 1 -- 172.21.15.124:0/3171838836 wait complete. 2023-10-06T04:44:34.809 INFO:teuthology.orchestra.run.smithi124.stdout:60129542152 2023-10-06T04:44:34.809 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:44:34.810 INFO:teuthology.orchestra.run.smithi124.stdout:60129542150 2023-10-06T04:44:34.810 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:44:34.811 INFO:teuthology.orchestra.run.smithi124.stdout:60129542149 2023-10-06T04:44:34.811 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:44:34.812 INFO:teuthology.orchestra.run.smithi124.stdout:60129542149 2023-10-06T04:44:34.812 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:44:34.813 INFO:teuthology.orchestra.run.smithi124.stdout:60129542150 2023-10-06T04:44:34.813 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:44:34.814 INFO:teuthology.orchestra.run.smithi124.stdout:60129542149 2023-10-06T04:44:34.814 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:44:34.815 INFO:teuthology.orchestra.run.smithi124.stdout:60129542149 2023-10-06T04:44:34.815 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:44:35.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.192+0000 7ff5b15ff700 1 Processor -- start 2023-10-06T04:44:35.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.192+0000 7ff5b15ff700 1 -- start start 2023-10-06T04:44:35.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.193+0000 7f430bdff700 1 Processor -- start 2023-10-06T04:44:35.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.193+0000 7f430bdff700 1 -- start start 2023-10-06T04:44:35.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.195+0000 7ff5b15ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06a810 0x7ff5ac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.195+0000 7ff5b15ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff5ac1574a0 0x7ff5ac0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.195+0000 7ff5b15ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac0ca160 con 0x7ff5ac06d8d0 2023-10-06T04:44:35.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7ff5b15ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac06a240 con 0x7ff5ac1574a0 2023-10-06T04:44:35.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7ff5b15ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0a8d50 con 0x7ff5ac06a810 2023-10-06T04:44:35.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7ff5aa7fc700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ff5ac06d8d0 0x7ff5ac156d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:55162/0 (socket says 172.21.15.124:55162) 2023-10-06T04:44:35.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7ff5aa7fc700 1 -- 172.21.15.124:0/2463045947 learned_addr learned my addr 172.21.15.124:0/2463045947 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:35.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7ff5ab7fe700 1 --2- 172.21.15.124:0/2463045947 >> v2:172.21.15.158:3300/0 conn(0x7ff5ac1574a0 0x7ff5ac0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.197+0000 7ff5aaffd700 1 --2- 172.21.15.124:0/2463045947 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06a810 0x7ff5ac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7f430bdff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4304161810 0x7f43040cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7f430bdff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4304161be0 0x7f43040cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7f430bdff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f43040a9c40 0x7f43040aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7f430bdff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430406b070 con 0x7f4304161810 2023-10-06T04:44:35.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7f430bdff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43040c8240 con 0x7f43040a9c40 2023-10-06T04:44:35.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.196+0000 7f430bdff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43040a97b0 con 0x7f4304161be0 2023-10-06T04:44:35.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.197+0000 7f430939a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4304161be0 0x7f43040cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.197+0000 7f430939a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4304161be0 0x7f43040cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:32794/0 (socket says 172.21.15.124:32794) 2023-10-06T04:44:35.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.197+0000 7f430939a700 1 -- 172.21.15.124:0/3364684881 learned_addr learned my addr 172.21.15.124:0/3364684881 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.197+0000 7ff5aaffd700 1 -- 172.21.15.124:0/2463045947 >> v2:172.21.15.158:3300/0 conn(0x7ff5ac1574a0 msgr2=0x7ff5ac0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.197+0000 7ff5aaffd700 1 --2- 172.21.15.124:0/2463045947 >> v2:172.21.15.158:3300/0 conn(0x7ff5ac1574a0 0x7ff5ac0ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.197+0000 7ff5aaffd700 1 -- 172.21.15.124:0/2463045947 >> v1:172.21.15.158:6789/0 conn(0x7ff5ac06d8d0 legacy=0x7ff5ac156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.197+0000 7ff5aaffd700 1 -- 172.21.15.124:0/2463045947 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac069c80 con 0x7ff5ac06a810 2023-10-06T04:44:35.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.197+0000 7f430a39c700 1 --2- 172.21.15.124:0/3364684881 >> v2:172.21.15.158:3300/0 conn(0x7f43040a9c40 0x7f43040aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7ff5aaffd700 1 --2- 172.21.15.124:0/2463045947 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06a810 0x7ff5ac06d390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5940098e0 tx=0x7ff5940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1171d0f4c8d4195e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7f4309b9b700 1 --2- 172.21.15.124:0/3364684881 >> v2:172.21.15.124:3300/0 conn(0x7f4304161810 0x7f43040cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7ff5a9ffb700 1 -- 172.21.15.124:0/2463045947 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400b640 con 0x7ff5ac06a810 2023-10-06T04:44:35.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7f430939a700 1 -- 172.21.15.124:0/3364684881 >> v2:172.21.15.158:3300/0 conn(0x7f43040a9c40 msgr2=0x7f43040aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7f430939a700 1 --2- 172.21.15.124:0/3364684881 >> v2:172.21.15.158:3300/0 conn(0x7f43040a9c40 0x7f43040aa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7f430939a700 1 -- 172.21.15.124:0/3364684881 >> v2:172.21.15.124:3300/0 conn(0x7f4304161810 msgr2=0x7f43040cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7f430939a700 1 --2- 172.21.15.124:0/3364684881 >> v2:172.21.15.124:3300/0 conn(0x7f4304161810 0x7f43040cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7f430939a700 1 -- 172.21.15.124:0/3364684881 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43040a8e80 con 0x7f4304161be0 2023-10-06T04:44:35.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7f4309b9b700 1 --2- 172.21.15.124:0/3364684881 >> v2:172.21.15.124:3300/0 conn(0x7f4304161810 0x7f43040cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:35.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7ff5a9ffb700 1 -- 172.21.15.124:0/2463045947 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59400b7c0 con 0x7ff5ac06a810 2023-10-06T04:44:35.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7ff5a9ffb700 1 -- 172.21.15.124:0/2463045947 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400bb80 con 0x7ff5ac06a810 2023-10-06T04:44:35.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.198+0000 7f430939a700 1 --2- 172.21.15.124:0/3364684881 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4304161be0 0x7f43040cba20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f43040c8a00 tx=0x7f42fc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aae4d1b4fd76f9ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.199+0000 7ff5b15ff700 1 -- 172.21.15.124:0/2463045947 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06a810 msgr2=0x7ff5ac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.199+0000 7ff5b15ff700 1 --2- 172.21.15.124:0/2463045947 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06a810 0x7ff5ac06d390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5940098e0 tx=0x7ff5940091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.199+0000 7ff70bfff700 1 Processor -- start 2023-10-06T04:44:35.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.199+0000 7ff70bfff700 1 -- start start 2023-10-06T04:44:35.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.200+0000 7f4308b99700 1 -- 172.21.15.124:0/3364684881 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc00e070 con 0x7f4304161be0 2023-10-06T04:44:35.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.200+0000 7f4308b99700 1 -- 172.21.15.124:0/3364684881 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc00ba20 con 0x7f4304161be0 2023-10-06T04:44:35.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.200+0000 7f4308b99700 1 -- 172.21.15.124:0/3364684881 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc0092e0 con 0x7f4304161be0 2023-10-06T04:44:35.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.201+0000 7f430bdff700 1 -- 172.21.15.124:0/3364684881 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4304161be0 msgr2=0x7f43040cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.201+0000 7f430bdff700 1 --2- 172.21.15.124:0/3364684881 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4304161be0 0x7f43040cba20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f43040c8a00 tx=0x7f42fc009840 comp rx=0 tx=0).stop 2023-10-06T04:44:35.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.201+0000 7ff70bfff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff7040cb920 0x7ff7040c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.201+0000 7ff70bfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7040c7b20 0x7ff704068e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.202+0000 7ff70bfff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff704069830 con 0x7ff7040693d0 2023-10-06T04:44:35.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.202+0000 7ff70bfff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7040a9720 con 0x7ff7040cb920 2023-10-06T04:44:35.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.202+0000 7ff70bfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040aabc0 con 0x7ff7040c7b20 2023-10-06T04:44:35.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.202+0000 7ff70a59c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ff7040693d0 0x7ff704161550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:55164/0 (socket says 172.21.15.124:55164) 2023-10-06T04:44:35.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.202+0000 7ff70a59c700 1 -- 172.21.15.124:0/10632783 learned_addr learned my addr 172.21.15.124:0/10632783 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:35.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.202+0000 7ff70959a700 1 --2- 172.21.15.124:0/10632783 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7040c7b20 0x7ff704068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7f430bdff700 1 -- 172.21.15.124:0/3364684881 shutdown_connections 2023-10-06T04:44:35.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7f430bdff700 1 --2- 172.21.15.124:0/3364684881 >> v2:172.21.15.158:3300/0 conn(0x7f43040a9c40 0x7f43040aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7f430bdff700 1 --2- 172.21.15.124:0/3364684881 >> v2:172.21.15.124:3300/0 conn(0x7f4304161810 0x7f43040cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7f430bdff700 1 --2- 172.21.15.124:0/3364684881 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4304161be0 0x7f43040cba20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7f430bdff700 1 -- 172.21.15.124:0/3364684881 >> 172.21.15.124:0/3364684881 conn(0x7f43040cc080 msgr2=0x7f43040cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7f430bdff700 1 -- 172.21.15.124:0/3364684881 shutdown_connections 2023-10-06T04:44:35.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7f430bdff700 1 -- 172.21.15.124:0/3364684881 wait complete. 2023-10-06T04:44:35.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7ff5b15ff700 1 -- 172.21.15.124:0/2463045947 shutdown_connections 2023-10-06T04:44:35.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7ff5b15ff700 1 --2- 172.21.15.124:0/2463045947 >> v2:172.21.15.158:3300/0 conn(0x7ff5ac1574a0 0x7ff5ac0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7ff5b15ff700 1 --2- 172.21.15.124:0/2463045947 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06a810 0x7ff5ac06d390 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7ff5b15ff700 1 -- 172.21.15.124:0/2463045947 >> 172.21.15.124:0/2463045947 conn(0x7ff5ac0cc080 msgr2=0x7ff5ac0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.203+0000 7ff709d9b700 1 --2- 172.21.15.124:0/10632783 >> v2:172.21.15.158:3300/0 conn(0x7ff7040cb920 0x7ff7040c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.205+0000 7ff5b15ff700 1 -- 172.21.15.124:0/2463045947 shutdown_connections 2023-10-06T04:44:35.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.206+0000 7f430bdff700 1 Processor -- start 2023-10-06T04:44:35.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.206+0000 7f430bdff700 1 -- start start 2023-10-06T04:44:35.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.205+0000 7ff709d9b700 1 -- 172.21.15.124:0/10632783 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7040c7b20 msgr2=0x7ff704068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.205+0000 7ff709d9b700 1 --2- 172.21.15.124:0/10632783 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7040c7b20 0x7ff704068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.205+0000 7ff709d9b700 1 -- 172.21.15.124:0/10632783 >> v1:172.21.15.158:6789/0 conn(0x7ff7040693d0 legacy=0x7ff704161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.205+0000 7ff709d9b700 1 -- 172.21.15.124:0/10632783 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7040c80a0 con 0x7ff7040cb920 2023-10-06T04:44:35.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.207+0000 7f430bdff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43040a9c40 0x7f43040c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.207+0000 7f430bdff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4304161810 0x7f430415a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.207+0000 7f430bdff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4304161be0 0x7f43040cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.207+0000 7f430bdff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430416e790 con 0x7f4304161810 2023-10-06T04:44:35.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.207+0000 7f430bdff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430416de60 con 0x7f4304161be0 2023-10-06T04:44:35.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.207+0000 7f430bdff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430416e140 con 0x7f43040a9c40 2023-10-06T04:44:35.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.208+0000 7ff709d9b700 1 --2- 172.21.15.124:0/10632783 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7040cb920 0x7ff7040c75e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009e60 tx=0x7ff6f8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc430734f813a6be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.208+0000 7f430a39c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4304161be0 0x7f43040cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.208+0000 7f430a39c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4304161be0 0x7f43040cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38306/0 (socket says 172.21.15.124:38306) 2023-10-06T04:44:35.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.208+0000 7f430a39c700 1 -- 172.21.15.124:0/2799298145 learned_addr learned my addr 172.21.15.124:0/2799298145 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.209+0000 7f430a39c700 1 -- 172.21.15.124:0/2799298145 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43040a9c40 msgr2=0x7f43040c2440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:44:35.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.209+0000 7f430a39c700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43040a9c40 0x7f43040c2440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.209+0000 7f430a39c700 1 -- 172.21.15.124:0/2799298145 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4304161810 msgr2=0x7f430415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.209+0000 7f430a39c700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4304161810 0x7f430415a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.209+0000 7f430a39c700 1 -- 172.21.15.124:0/2799298145 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc009ae0 con 0x7f4304161be0 2023-10-06T04:44:35.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.209+0000 7ff5b15ff700 1 -- 172.21.15.124:0/2463045947 wait complete. 2023-10-06T04:44:35.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.209+0000 7f430a39c700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4304161be0 0x7f43040cb2b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42f400e8d0 tx=0x7f42f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.210+0000 7f2cd75ff700 1 Processor -- start 2023-10-06T04:44:35.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.210+0000 7f2cd75ff700 1 -- start start 2023-10-06T04:44:35.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.211+0000 7ff5b15ff700 1 Processor -- start 2023-10-06T04:44:35.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.212+0000 7ff5b15ff700 1 -- start start 2023-10-06T04:44:35.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.212+0000 7ff708d99700 1 -- 172.21.15.124:0/10632783 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f800e070 con 0x7ff7040cb920 2023-10-06T04:44:35.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.212+0000 7ff708d99700 1 -- 172.21.15.124:0/10632783 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f800bc30 con 0x7ff7040cb920 2023-10-06T04:44:35.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.212+0000 7ff708d99700 1 -- 172.21.15.124:0/10632783 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8012430 con 0x7ff7040cb920 2023-10-06T04:44:35.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7ff70bfff700 1 -- 172.21.15.124:0/10632783 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7040cb920 msgr2=0x7ff7040c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7ff70bfff700 1 --2- 172.21.15.124:0/10632783 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7040cb920 0x7ff7040c75e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009e60 tx=0x7ff6f8009780 comp rx=0 tx=0).stop 2023-10-06T04:44:35.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7f4fc15ff700 1 Processor -- start 2023-10-06T04:44:35.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7f4fc15ff700 1 -- start start 2023-10-06T04:44:35.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7ff5b15ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5ac06a810 0x7ff5ac16ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7ff5b15ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06d8d0 0x7ff5ac15df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7ff5b15ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5ac1574a0 0x7ff5ac15e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7ff5b15ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1514d0 con 0x7ff5ac06a810 2023-10-06T04:44:35.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7ff5b15ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac16b050 con 0x7ff5ac1574a0 2023-10-06T04:44:35.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7ff5b15ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15c360 con 0x7ff5ac06d8d0 2023-10-06T04:44:35.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7f2cd75ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2cd00cbbf0 0x7f2cd00c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7f2cd75ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2cd0161be0 0x7f2cd00c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7f2cd75ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd006b070 con 0x7f2cd0161810 2023-10-06T04:44:35.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7f2cd75ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd00c8240 con 0x7f2cd0161be0 2023-10-06T04:44:35.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.213+0000 7f2cd75ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd00a97b0 con 0x7f2cd00cbbf0 2023-10-06T04:44:35.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f2cd539b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f2cd0161810 0x7f2cd00cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:55170/0 (socket says 172.21.15.124:55170) 2023-10-06T04:44:35.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f2cd539b700 1 -- 172.21.15.124:0/384429322 learned_addr learned my addr 172.21.15.124:0/384429322 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:35.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f2cd5b9c700 1 --2- 172.21.15.124:0/384429322 >> v2:172.21.15.124:3300/0 conn(0x7f2cd0161be0 0x7f2cd00c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f42f9ffb700 1 -- 172.21.15.124:0/2799298145 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f400ee70 con 0x7f4304161be0 2023-10-06T04:44:35.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f42f9ffb700 1 -- 172.21.15.124:0/2799298145 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f400c850 con 0x7f4304161be0 2023-10-06T04:44:35.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f42f9ffb700 1 -- 172.21.15.124:0/2799298145 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f400cc50 con 0x7f4304161be0 2023-10-06T04:44:35.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f3faabff700 1 Processor -- start 2023-10-06T04:44:35.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7ff5aaffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5ac06a810 0x7ff5ac16ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7ff5aaffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5ac06a810 0x7ff5ac16ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40524/0 (socket says 172.21.15.124:40524) 2023-10-06T04:44:35.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7ff5aaffd700 1 -- 172.21.15.124:0/1735279561 learned_addr learned my addr 172.21.15.124:0/1735279561 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7ff5ab7fe700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5ac1574a0 0x7ff5ac15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7ff5aa7fc700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06d8d0 0x7ff5ac15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f3faabff700 1 -- start start 2023-10-06T04:44:35.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f430bdff700 1 -- 172.21.15.124:0/2799298145 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430416e420 con 0x7f4304161be0 2023-10-06T04:44:35.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f430bdff700 1 -- 172.21.15.124:0/2799298145 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430416db10 con 0x7f4304161be0 2023-10-06T04:44:35.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f2cd4b9a700 1 --2- 172.21.15.124:0/384429322 >> v2:172.21.15.158:3300/0 conn(0x7f2cd00cbbf0 0x7f2cd00c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f2cc7fff700 1 -- 172.21.15.124:0/384429322 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594295334 0 0) 0x7f2cd006b070 con 0x7f2cd0161810 2023-10-06T04:44:35.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.214+0000 7f2cc7fff700 1 -- 172.21.15.124:0/384429322 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cbc003570 con 0x7f2cd0161810 2023-10-06T04:44:35.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff70bfff700 1 -- 172.21.15.124:0/10632783 shutdown_connections 2023-10-06T04:44:35.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff70bfff700 1 --2- 172.21.15.124:0/10632783 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7040cb920 0x7ff7040c75e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff70bfff700 1 --2- 172.21.15.124:0/10632783 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7040c7b20 0x7ff704068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff70bfff700 1 -- 172.21.15.124:0/10632783 >> 172.21.15.124:0/10632783 conn(0x7ff7040cc080 msgr2=0x7ff7040cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7f2cd5b9c700 1 -- 172.21.15.124:0/384429322 >> v2:172.21.15.158:3300/0 conn(0x7f2cd00cbbf0 msgr2=0x7f2cd00c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7f2cd5b9c700 1 --2- 172.21.15.124:0/384429322 >> v2:172.21.15.158:3300/0 conn(0x7f2cd00cbbf0 0x7f2cd00c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7f2cd5b9c700 1 -- 172.21.15.124:0/384429322 >> v1:172.21.15.158:6789/0 conn(0x7f2cd0161810 legacy=0x7f2cd00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7f2cd5b9c700 1 -- 172.21.15.124:0/384429322 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd00a8e80 con 0x7f2cd0161be0 2023-10-06T04:44:35.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7f2cd4b9a700 1 --2- 172.21.15.124:0/384429322 >> v2:172.21.15.158:3300/0 conn(0x7f2cd00cbbf0 0x7f2cd00c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:35.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7f2cd5b9c700 1 --2- 172.21.15.124:0/384429322 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 0x7f2cd00c6c00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009e60 tx=0x7f2cc8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befe4517d2de120a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7fc6e05ff700 1 Processor -- start 2023-10-06T04:44:35.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff70bfff700 1 -- 172.21.15.124:0/10632783 shutdown_connections 2023-10-06T04:44:35.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff5aaffd700 1 -- 172.21.15.124:0/1735279561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06d8d0 msgr2=0x7ff5ac15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff5aaffd700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06d8d0 0x7ff5ac15df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff5aaffd700 1 -- 172.21.15.124:0/1735279561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5ac1574a0 msgr2=0x7ff5ac15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff5aaffd700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5ac1574a0 0x7ff5ac15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff5aaffd700 1 -- 172.21.15.124:0/1735279561 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594009420 con 0x7ff5ac06a810 2023-10-06T04:44:35.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f2cc7fff700 1 -- 172.21.15.124:0/384429322 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc800e070 con 0x7f2cd0161be0 2023-10-06T04:44:35.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f2cc7fff700 1 -- 172.21.15.124:0/384429322 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc800bb20 con 0x7f2cd0161be0 2023-10-06T04:44:35.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f2cc7fff700 1 -- 172.21.15.124:0/384429322 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8012430 con 0x7f2cd0161be0 2023-10-06T04:44:35.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.215+0000 7ff70bfff700 1 -- 172.21.15.124:0/10632783 wait complete. 2023-10-06T04:44:35.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f3faabff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 0x7f3fa40c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f3faabff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3fa4161be0 0x7f3fa40c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f3faabff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa406b070 con 0x7f3fa4161810 2023-10-06T04:44:35.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f3faabff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa40c8240 con 0x7f3fa4161be0 2023-10-06T04:44:35.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f3faabff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40a97b0 con 0x7f3fa40cbbf0 2023-10-06T04:44:35.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.217+0000 7f2cd75ff700 1 -- 172.21.15.124:0/384429322 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 msgr2=0x7f2cd00c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.217+0000 7f2cd75ff700 1 --2- 172.21.15.124:0/384429322 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 0x7f2cd00c6c00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009e60 tx=0x7f2cc8009780 comp rx=0 tx=0).stop 2023-10-06T04:44:35.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7fc6e05ff700 1 -- start start 2023-10-06T04:44:35.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.217+0000 7f3f9bfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 0x7f3fa40c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.217+0000 7f3f9bfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 0x7f3fa40c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:32824/0 (socket says 172.21.15.124:32824) 2023-10-06T04:44:35.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.217+0000 7f3f9bfff700 1 -- 172.21.15.124:0/2763944081 learned_addr learned my addr 172.21.15.124:0/2763944081 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.217+0000 7f3fa919c700 1 --2- 172.21.15.124:0/2763944081 >> v2:172.21.15.158:3300/0 conn(0x7f3fa4161be0 0x7f3fa40c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f4fc15ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4fbc0c85c0 0x7f4fbc154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f4fc15ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fbc155940 con 0x7f4fbc06b440 2023-10-06T04:44:35.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f4fc15ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fbc0c79a0 con 0x7f4fbc1554e0 2023-10-06T04:44:35.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.216+0000 7f4fc15ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc15c1a0 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.217+0000 7f4fbb7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f4fbc1554e0 0x7f4fbc068fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:55176/0 (socket says 172.21.15.124:55176) 2023-10-06T04:44:35.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.217+0000 7f4fbb7fe700 1 -- 172.21.15.124:0/2344122611 learned_addr learned my addr 172.21.15.124:0/2344122611 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:35.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.217+0000 7f4fba7fc700 1 --2- 172.21.15.124:0/2344122611 >> v2:172.21.15.158:3300/0 conn(0x7f4fbc0c85c0 0x7f4fbc154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f3f9bfff700 1 -- 172.21.15.124:0/2763944081 >> v2:172.21.15.158:3300/0 conn(0x7f3fa4161be0 msgr2=0x7f3fa40c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f3f9bfff700 1 --2- 172.21.15.124:0/2763944081 >> v2:172.21.15.158:3300/0 conn(0x7f3fa4161be0 0x7f3fa40c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f3f9bfff700 1 -- 172.21.15.124:0/2763944081 >> v1:172.21.15.124:6789/0 conn(0x7f3fa4161810 legacy=0x7f3fa40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f3f9bfff700 1 -- 172.21.15.124:0/2763944081 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40a8e80 con 0x7f3fa40cbbf0 2023-10-06T04:44:35.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f2cd75ff700 1 -- 172.21.15.124:0/384429322 shutdown_connections 2023-10-06T04:44:35.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f2cd75ff700 1 --2- 172.21.15.124:0/384429322 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 0x7f2cd00c6c00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f2cd75ff700 1 --2- 172.21.15.124:0/384429322 >> v2:172.21.15.158:3300/0 conn(0x7f2cd00cbbf0 0x7f2cd00c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f2cd75ff700 1 -- 172.21.15.124:0/384429322 >> 172.21.15.124:0/384429322 conn(0x7f2cd00cc080 msgr2=0x7f2cd00cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7fc6e05ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc6d80cbbf0 0x7fc6d80c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7fc6e05ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6d8161be0 0x7fc6d80c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7fc6e05ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d806b070 con 0x7fc6d8161810 2023-10-06T04:44:35.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7fc6e05ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d80c8240 con 0x7fc6d80cbbf0 2023-10-06T04:44:35.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7fc6e05ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80a97b0 con 0x7fc6d8161be0 2023-10-06T04:44:35.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7fc6de39b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fc6d8161810 0x7fc6d80cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:55184/0 (socket says 172.21.15.124:55184) 2023-10-06T04:44:35.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7fc6de39b700 1 -- 172.21.15.124:0/1593502727 learned_addr learned my addr 172.21.15.124:0/1593502727 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:35.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7fc6ddb9a700 1 --2- 172.21.15.124:0/1593502727 >> v2:172.21.15.158:3300/0 conn(0x7fc6d80cbbf0 0x7fc6d80c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f3f9bfff700 1 --2- 172.21.15.124:0/2763944081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 0x7f3fa40c66c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3f940099b0 tx=0x7f3f94009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81cd44fa8fa47099 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f4fba7fc700 1 -- 172.21.15.124:0/2344122611 >> v1:172.21.15.158:6789/0 conn(0x7f4fbc1554e0 legacy=0x7f4fbc068fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f4fba7fc700 1 -- 172.21.15.124:0/2344122611 >> v1:172.21.15.124:6789/0 conn(0x7f4fbc06b440 legacy=0x7f4fbc0c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f4fba7fc700 1 -- 172.21.15.124:0/2344122611 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0c6be0 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7fc6dd399700 1 -- 172.21.15.124:0/1593502727 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306409314 0 0) 0x7fc6d806b070 con 0x7fc6d8161810 2023-10-06T04:44:35.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7fc6dd399700 1 -- 172.21.15.124:0/1593502727 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6c4003570 con 0x7fc6d8161810 2023-10-06T04:44:35.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7fc6ddb9a700 1 -- 172.21.15.124:0/1593502727 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6d8161be0 msgr2=0x7fc6d80c6c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:44:35.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7fc6ddb9a700 1 --2- 172.21.15.124:0/1593502727 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6d8161be0 0x7fc6d80c6c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7fc6ddb9a700 1 -- 172.21.15.124:0/1593502727 >> v1:172.21.15.158:6789/0 conn(0x7fc6d8161810 legacy=0x7fc6d80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7fc6ddb9a700 1 -- 172.21.15.124:0/1593502727 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d80a8e80 con 0x7fc6d80cbbf0 2023-10-06T04:44:35.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7f3f9b7fe700 1 -- 172.21.15.124:0/2763944081 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94009ea0 con 0x7f3fa40cbbf0 2023-10-06T04:44:35.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7f3f9b7fe700 1 -- 172.21.15.124:0/2763944081 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9400b820 con 0x7f3fa40cbbf0 2023-10-06T04:44:35.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7f3f9b7fe700 1 -- 172.21.15.124:0/2763944081 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400bbc0 con 0x7f3fa40cbbf0 2023-10-06T04:44:35.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7ff70bfff700 1 Processor -- start 2023-10-06T04:44:35.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7ff70bfff700 1 -- start start 2023-10-06T04:44:35.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7fc6ddb9a700 1 --2- 172.21.15.124:0/1593502727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6d80cbbf0 0x7fc6d80c66c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80098e0 tx=0x7fc6c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=686cbd00d4279700 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7fc6dd399700 1 -- 172.21.15.124:0/1593502727 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800b640 con 0x7fc6d80cbbf0 2023-10-06T04:44:35.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7fc6dd399700 1 -- 172.21.15.124:0/1593502727 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c800b7c0 con 0x7fc6d80cbbf0 2023-10-06T04:44:35.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7fc6dd399700 1 -- 172.21.15.124:0/1593502727 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800bb80 con 0x7fc6d80cbbf0 2023-10-06T04:44:35.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7f3faabff700 1 -- 172.21.15.124:0/2763944081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 msgr2=0x7f3fa40c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7f3faabff700 1 --2- 172.21.15.124:0/2763944081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 0x7f3fa40c66c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3f940099b0 tx=0x7f3f94009250 comp rx=0 tx=0).stop 2023-10-06T04:44:35.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.218+0000 7f42f9ffb700 1 -- 172.21.15.124:0/2799298145 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42f4013680 con 0x7f4304161be0 2023-10-06T04:44:35.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7f42f9ffb700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f42e8067080 0x7f42e8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7f430bdff700 1 -- 172.21.15.124:0/2799298145 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430416e5b0 con 0x7f4304161be0 2023-10-06T04:44:35.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7f42f9ffb700 1 -- 172.21.15.124:0/2799298145 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f42f4084870 con 0x7f4304161be0 2023-10-06T04:44:35.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7ff70bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7040693d0 0x7ff704098400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7ff70bfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7040c7b20 0x7ff7040b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7ff70bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7040cb920 0x7ff7040b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7ff70bfff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff704159a50 con 0x7ff7040693d0 2023-10-06T04:44:35.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7ff70bfff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040993a0 con 0x7ff7040cb920 2023-10-06T04:44:35.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7ff70bfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff704159720 con 0x7ff7040c7b20 2023-10-06T04:44:35.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7ff709d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7040693d0 0x7ff704098400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7ff709d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7040693d0 0x7ff704098400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40538/0 (socket says 172.21.15.124:40538) 2023-10-06T04:44:35.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7ff709d9b700 1 -- 172.21.15.124:0/1865071631 learned_addr learned my addr 172.21.15.124:0/1865071631 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7f3faabff700 1 -- 172.21.15.124:0/2763944081 shutdown_connections 2023-10-06T04:44:35.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7f3faabff700 1 --2- 172.21.15.124:0/2763944081 >> v2:172.21.15.158:3300/0 conn(0x7f3fa4161be0 0x7f3fa40c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7f3faabff700 1 --2- 172.21.15.124:0/2763944081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 0x7f3fa40c66c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7f3faabff700 1 -- 172.21.15.124:0/2763944081 >> 172.21.15.124:0/2763944081 conn(0x7f3fa40cc080 msgr2=0x7f3fa40cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.220+0000 7ff70a59c700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7040cb920 0x7ff7040b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7fc6e05ff700 1 -- 172.21.15.124:0/1593502727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6d80cbbf0 msgr2=0x7fc6d80c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7fc6e05ff700 1 --2- 172.21.15.124:0/1593502727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6d80cbbf0 0x7fc6d80c66c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80098e0 tx=0x7fc6c80091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7f3faabff700 1 -- 172.21.15.124:0/2763944081 shutdown_connections 2023-10-06T04:44:35.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7fc6e05ff700 1 -- 172.21.15.124:0/1593502727 shutdown_connections 2023-10-06T04:44:35.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7fc6e05ff700 1 --2- 172.21.15.124:0/1593502727 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6d8161be0 0x7fc6d80c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7fc6e05ff700 1 --2- 172.21.15.124:0/1593502727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6d80cbbf0 0x7fc6d80c66c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7fc6e05ff700 1 -- 172.21.15.124:0/1593502727 >> 172.21.15.124:0/1593502727 conn(0x7fc6d80cc080 msgr2=0x7fc6d80cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7f4fba7fc700 1 --2- 172.21.15.124:0/2344122611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fbc0c85c0 0x7f4fbc154fa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009890 tx=0x7f4fb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a7f286dda736db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7ff5aaffd700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5ac06a810 0x7ff5ac16ab10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff594013000 tx=0x7ff594017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7f5cfe99d700 1 Processor -- start 2023-10-06T04:44:35.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.219+0000 7f5cfe99d700 1 -- start start 2023-10-06T04:44:35.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7fc6e05ff700 1 -- 172.21.15.124:0/1593502727 shutdown_connections 2023-10-06T04:44:35.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7fc6e05ff700 1 -- 172.21.15.124:0/1593502727 wait complete. 2023-10-06T04:44:35.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7f2cd75ff700 1 -- 172.21.15.124:0/384429322 shutdown_connections 2023-10-06T04:44:35.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7f2cd75ff700 1 -- 172.21.15.124:0/384429322 wait complete. 2023-10-06T04:44:35.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7f5cfe99d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5cf80b1b40 0x7f5cf80aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7ff70959a700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7040c7b20 0x7ff7040b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7ff70a59c700 1 -- 172.21.15.124:0/1865071631 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7040c7b20 msgr2=0x7ff7040b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7ff70a59c700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7040c7b20 0x7ff7040b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7ff70a59c700 1 -- 172.21.15.124:0/1865071631 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7040693d0 msgr2=0x7ff704098400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7ff70a59c700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7040693d0 0x7ff704098400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7ff70a59c700 1 -- 172.21.15.124:0/1865071631 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8009a20 con 0x7ff7040cb920 2023-10-06T04:44:35.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.222+0000 7f5cfe99d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5cf80af530 0x7f5cf80693c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.222+0000 7f5cfe99d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf8169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.222+0000 7f5cfe99d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf80af9a0 con 0x7f5cf80b1b40 2023-10-06T04:44:35.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.222+0000 7f5cfe99d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf81674c0 con 0x7f5cf80af530 2023-10-06T04:44:35.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.222+0000 7f5cfe99d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8166b90 con 0x7f5cf8069900 2023-10-06T04:44:35.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.222+0000 7ff70a59c700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7040cb920 0x7ff7040b1060 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc001eb0 tx=0x7ff6fc007e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7ff5a2ffd700 1 -- 172.21.15.124:0/1735279561 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59401f070 con 0x7ff5ac06a810 2023-10-06T04:44:35.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7ff5a2ffd700 1 -- 172.21.15.124:0/1735279561 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594000bc0 con 0x7ff5ac06a810 2023-10-06T04:44:35.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7ff5a2ffd700 1 -- 172.21.15.124:0/1735279561 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400bb80 con 0x7ff5ac06a810 2023-10-06T04:44:35.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.222+0000 7ff5b15ff700 1 -- 172.21.15.124:0/1735279561 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac15c640 con 0x7ff5ac06a810 2023-10-06T04:44:35.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7ff5b15ff700 1 -- 172.21.15.124:0/1735279561 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac15cc00 con 0x7ff5ac06a810 2023-10-06T04:44:35.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7fc6e05ff700 1 Processor -- start 2023-10-06T04:44:35.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.222+0000 7f5cfe19c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf8169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f5cfe19c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf8169cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:32842/0 (socket says 172.21.15.124:32842) 2023-10-06T04:44:35.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f5cfe19c700 1 -- 172.21.15.124:0/1741491964 learned_addr learned my addr 172.21.15.124:0/1741491964 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f5cfd19a700 1 --2- 172.21.15.124:0/1741491964 >> v2:172.21.15.158:3300/0 conn(0x7f5cf80af530 0x7f5cf80693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f5cfe19c700 1 -- 172.21.15.124:0/1741491964 >> v2:172.21.15.158:3300/0 conn(0x7f5cf80af530 msgr2=0x7f5cf80693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f5cfe19c700 1 --2- 172.21.15.124:0/1741491964 >> v2:172.21.15.158:3300/0 conn(0x7f5cf80af530 0x7f5cf80693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f5cfe19c700 1 -- 172.21.15.124:0/1741491964 >> v2:172.21.15.124:3300/0 conn(0x7f5cf80b1b40 msgr2=0x7f5cf80aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f5cfe19c700 1 --2- 172.21.15.124:0/1741491964 >> v2:172.21.15.124:3300/0 conn(0x7f5cf80b1b40 0x7f5cf80aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f5cfe19c700 1 -- 172.21.15.124:0/1741491964 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8166e70 con 0x7f5cf8069900 2023-10-06T04:44:35.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f5cfe19c700 1 --2- 172.21.15.124:0/1741491964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf8169cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5cf806f6f0 tx=0x7f5cf0007690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc73aa33e98b41a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7ff5b15ff700 1 -- 172.21.15.124:0/1735279561 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac1567f0 con 0x7ff5ac06a810 2023-10-06T04:44:35.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7ff701ffb700 1 -- 172.21.15.124:0/1865071631 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc005920 con 0x7ff7040cb920 2023-10-06T04:44:35.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7ff701ffb700 1 -- 172.21.15.124:0/1865071631 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc005aa0 con 0x7ff7040cb920 2023-10-06T04:44:35.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7ff701ffb700 1 -- 172.21.15.124:0/1865071631 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc005e60 con 0x7ff7040cb920 2023-10-06T04:44:35.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7f2cd75ff700 1 Processor -- start 2023-10-06T04:44:35.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7fc6e05ff700 1 -- start start 2023-10-06T04:44:35.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7fc6e05ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6d80cbbf0 0x7fc6d8157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7fc6e05ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6d8161810 0x7fc6d80aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7fc6e05ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6d8161be0 0x7fc6d8098120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7fc6e05ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80b0410 con 0x7fc6d8161be0 2023-10-06T04:44:35.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7fc6e05ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80af800 con 0x7fc6d80cbbf0 2023-10-06T04:44:35.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7fc6e05ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80afae0 con 0x7fc6d8161810 2023-10-06T04:44:35.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7f5cfc999700 1 -- 172.21.15.124:0/1741491964 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0007b40 con 0x7f5cf8069900 2023-10-06T04:44:35.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7f5cfc999700 1 -- 172.21.15.124:0/1741491964 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf0007ca0 con 0x7f5cf8069900 2023-10-06T04:44:35.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7f5cfc999700 1 -- 172.21.15.124:0/1741491964 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0012700 con 0x7f5cf8069900 2023-10-06T04:44:35.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f5cfe99d700 1 -- 172.21.15.124:0/1741491964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 msgr2=0x7f5cf8169cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f5cfe99d700 1 --2- 172.21.15.124:0/1741491964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf8169cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5cf806f6f0 tx=0x7f5cf0007690 comp rx=0 tx=0).stop 2023-10-06T04:44:35.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f5cfe99d700 1 -- 172.21.15.124:0/1741491964 shutdown_connections 2023-10-06T04:44:35.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f5cfe99d700 1 --2- 172.21.15.124:0/1741491964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf8169cd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f5cfe99d700 1 --2- 172.21.15.124:0/1741491964 >> v2:172.21.15.124:3300/0 conn(0x7f5cf80b1b40 0x7f5cf80aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f5cfe99d700 1 --2- 172.21.15.124:0/1741491964 >> v2:172.21.15.158:3300/0 conn(0x7f5cf80af530 0x7f5cf80693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f5cfe99d700 1 -- 172.21.15.124:0/1741491964 >> 172.21.15.124:0/1741491964 conn(0x7f5cf80675f0 msgr2=0x7f5cf80679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7f4fb9ffb700 1 -- 172.21.15.124:0/2344122611 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0011630 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7f4fb9ffb700 1 -- 172.21.15.124:0/2344122611 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0011790 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7f4fb9ffb700 1 -- 172.21.15.124:0/2344122611 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0011b30 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.222+0000 7f4fc15ff700 1 -- 172.21.15.124:0/2344122611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fbc0c85c0 msgr2=0x7f4fbc154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.222+0000 7f4fc15ff700 1 --2- 172.21.15.124:0/2344122611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fbc0c85c0 0x7f4fbc154fa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009890 tx=0x7f4fb00091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f4fc15ff700 1 -- 172.21.15.124:0/2344122611 shutdown_connections 2023-10-06T04:44:35.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f4fc15ff700 1 --2- 172.21.15.124:0/2344122611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fbc0c85c0 0x7f4fbc154fa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f4fc15ff700 1 -- 172.21.15.124:0/2344122611 >> 172.21.15.124:0/2344122611 conn(0x7f4fbc0cc080 msgr2=0x7f4fbc0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f4fc15ff700 1 -- 172.21.15.124:0/2344122611 shutdown_connections 2023-10-06T04:44:35.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f4fc15ff700 1 -- 172.21.15.124:0/2344122611 wait complete. 2023-10-06T04:44:35.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.221+0000 7f3faabff700 1 -- 172.21.15.124:0/2763944081 wait complete. 2023-10-06T04:44:35.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.223+0000 7f3faabff700 1 Processor -- start 2023-10-06T04:44:35.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7f3faabff700 1 -- start start 2023-10-06T04:44:35.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f3faabff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 0x7f3fa40afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f3faabff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fa4161810 0x7f3fa4098e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f3faabff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fa4161be0 0x7f3fa40b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f3faabff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40aeec0 con 0x7f3fa4161be0 2023-10-06T04:44:35.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f3faabff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40af130 con 0x7f3fa4161810 2023-10-06T04:44:35.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f3faabff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40af410 con 0x7f3fa40cbbf0 2023-10-06T04:44:35.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7f3fa919c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fa4161be0 0x7f3fa40b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7fc6ddb9a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6d8161810 0x7fc6d80aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7f5cfe99d700 1 -- 172.21.15.124:0/1741491964 shutdown_connections 2023-10-06T04:44:35.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.224+0000 7f2cd75ff700 1 -- start start 2023-10-06T04:44:35.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7fc6de39b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6d80cbbf0 0x7fc6d8157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7fc6de39b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6d80cbbf0 0x7fc6d8157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38378/0 (socket says 172.21.15.124:38378) 2023-10-06T04:44:35.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7fc6de39b700 1 -- 172.21.15.124:0/2500233225 learned_addr learned my addr 172.21.15.124:0/2500233225 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f2cd75ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cd00cbbf0 0x7f2cd01509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7f2cd75ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cd0161810 0x7f2cd015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7f2cd75ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 0x7f2cd0160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7f2cd75ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd015f9e0 con 0x7f2cd0161be0 2023-10-06T04:44:35.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7f2cd75ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00af5d0 con 0x7f2cd00cbbf0 2023-10-06T04:44:35.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7f2cd75ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00aefc0 con 0x7f2cd0161810 2023-10-06T04:44:35.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7ff709d9b700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7040693d0 0x7ff704098400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:35.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7fc6ddb9a700 1 -- 172.21.15.124:0/2500233225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6d80cbbf0 msgr2=0x7fc6d8157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7fc6ddb9a700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6d80cbbf0 0x7fc6d8157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7fc6ddb9a700 1 -- 172.21.15.124:0/2500233225 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6d8161be0 msgr2=0x7fc6d8098120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7fc6ddb9a700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6d8161be0 0x7fc6d8098120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f2cd5b9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 0x7f2cd0160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f2cd5b9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 0x7f2cd0160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40570/0 (socket says 172.21.15.124:40570) 2023-10-06T04:44:35.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f2cd5b9c700 1 -- 172.21.15.124:0/2051754966 learned_addr learned my addr 172.21.15.124:0/2051754966 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7fc6ddb9a700 1 -- 172.21.15.124:0/2500233225 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8009420 con 0x7fc6d8161810 2023-10-06T04:44:35.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7f3fa919c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fa4161be0 0x7f3fa40b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40552/0 (socket says 172.21.15.124:40552) 2023-10-06T04:44:35.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7f3fa919c700 1 -- 172.21.15.124:0/3261985110 learned_addr learned my addr 172.21.15.124:0/3261985110 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7ff70bfff700 1 -- 172.21.15.124:0/1865071631 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff704098de0 con 0x7ff7040cb920 2023-10-06T04:44:35.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7ff70bfff700 1 -- 172.21.15.124:0/1865071631 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7040af420 con 0x7ff7040cb920 2023-10-06T04:44:35.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7fc6ddb9a700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6d8161810 0x7fc6d80aee20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8016000 tx=0x7fc6c8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f3fa919c700 1 -- 172.21.15.124:0/3261985110 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 msgr2=0x7f3fa40afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f3fa919c700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 0x7f3fa40afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f3fa919c700 1 -- 172.21.15.124:0/3261985110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fa4161810 msgr2=0x7f3fa4098e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:44:35.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f3fa919c700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fa4161810 0x7f3fa4098e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f3fa919c700 1 -- 172.21.15.124:0/3261985110 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940094f0 con 0x7f3fa4161be0 2023-10-06T04:44:35.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f4fc15ff700 1 Processor -- start 2023-10-06T04:44:35.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.225+0000 7f4fc15ff700 1 -- start start 2023-10-06T04:44:35.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f4fc15ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fbc06b440 0x7f4fbc159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f4fc15ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fbc0c85c0 0x7f4fbc1537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f4fc15ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fbc1554e0 0x7f4fbc153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f4fc15ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc14a890 con 0x7f4fbc1554e0 2023-10-06T04:44:35.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f4fc15ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc1599a0 con 0x7f4fbc06b440 2023-10-06T04:44:35.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f4fc15ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc149f60 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.227+0000 7f4fba7fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fbc0c85c0 0x7f4fbc1537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f4fba7fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fbc0c85c0 0x7f4fbc1537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:32866/0 (socket says 172.21.15.124:32866) 2023-10-06T04:44:35.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f4fba7fc700 1 -- 172.21.15.124:0/904665228 learned_addr learned my addr 172.21.15.124:0/904665228 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f4fbaffd700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fbc06b440 0x7f4fbc159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f4fbb7fe700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fbc1554e0 0x7f4fbc153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.226+0000 7f5cfe99d700 1 -- 172.21.15.124:0/1741491964 wait complete. 2023-10-06T04:44:35.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f2cd5b9c700 1 -- 172.21.15.124:0/2051754966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cd0161810 msgr2=0x7f2cd015fe10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:44:35.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f2cd5b9c700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cd0161810 0x7f2cd015fe10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f2cd5b9c700 1 -- 172.21.15.124:0/2051754966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cd00cbbf0 msgr2=0x7f2cd01509c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:44:35.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f2cd5b9c700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cd00cbbf0 0x7f2cd01509c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f2cd5b9c700 1 -- 172.21.15.124:0/2051754966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc8009a20 con 0x7f2cd0161be0 2023-10-06T04:44:35.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f4fba7fc700 1 -- 172.21.15.124:0/904665228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fbc06b440 msgr2=0x7f4fbc159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f4fba7fc700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fbc06b440 0x7f4fbc159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f4fba7fc700 1 -- 172.21.15.124:0/904665228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fbc1554e0 msgr2=0x7f4fbc153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f4fba7fc700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fbc1554e0 0x7f4fbc153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f4fba7fc700 1 -- 172.21.15.124:0/904665228 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0009420 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.229+0000 7f2cd5b9c700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 0x7f2cd0160350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800b6c0 tx=0x7f2cc8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.229+0000 7ff70bfff700 1 -- 172.21.15.124:0/1865071631 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff704159c00 con 0x7ff7040cb920 2023-10-06T04:44:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7fc6ce7fc700 1 -- 172.21.15.124:0/2500233225 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c801f070 con 0x7fc6d8161810 2023-10-06T04:44:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7fc6ce7fc700 1 -- 172.21.15.124:0/2500233225 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c800b930 con 0x7fc6d8161810 2023-10-06T04:44:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.229+0000 7fc6ce7fc700 1 -- 172.21.15.124:0/2500233225 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8011420 con 0x7fc6d8161810 2023-10-06T04:44:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.229+0000 7f5cfe99d700 1 Processor -- start 2023-10-06T04:44:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.229+0000 7f3fa919c700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fa4161be0 0x7f3fa40b0800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009e90 tx=0x7f3f9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.229+0000 7fc6e05ff700 1 -- 172.21.15.124:0/2500233225 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d80afdc0 con 0x7fc6d8161810 2023-10-06T04:44:35.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.229+0000 7fc6e05ff700 1 -- 172.21.15.124:0/2500233225 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d80b08a0 con 0x7fc6d8161810 2023-10-06T04:44:35.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.229+0000 7f4fba7fc700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fbc0c85c0 0x7f4fbc1537c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00030c0 tx=0x7f4fb0016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.228+0000 7f4309b9b700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f42e8067080 0x7f42e8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.229+0000 7f5cfe99d700 1 -- start start 2023-10-06T04:44:35.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.230+0000 7f4309b9b700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f42e8067080 0x7f42e8069530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4300006fd0 tx=0x7f4300008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7fc6e05ff700 1 -- 172.21.15.124:0/2500233225 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d80b0580 con 0x7fc6d8161810 2023-10-06T04:44:35.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f5cfe99d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf80c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f5cfe99d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80af530 0x7f5cf8086d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f5cfe99d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5cf80b1b40 0x7f5cf80c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f5cfe99d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80c6f80 con 0x7f5cf80af530 2023-10-06T04:44:35.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f5cfe99d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80c7260 con 0x7f5cf80b1b40 2023-10-06T04:44:35.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f5cfe99d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80c7540 con 0x7f5cf8069900 2023-10-06T04:44:35.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f5cfd99b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf80c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f5cfd99b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf80c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:32872/0 (socket says 172.21.15.124:32872) 2023-10-06T04:44:35.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f5cfd99b700 1 -- 172.21.15.124:0/2527655976 learned_addr learned my addr 172.21.15.124:0/2527655976 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:35.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f5cfe19c700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5cf80b1b40 0x7f5cf80c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f4fa2ffd700 1 -- 172.21.15.124:0/904665228 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0025470 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f4fa2ffd700 1 -- 172.21.15.124:0/904665228 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb00255d0 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f4fa2ffd700 1 -- 172.21.15.124:0/904665228 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0025950 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f4fc15ff700 1 -- 172.21.15.124:0/904665228 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc14a240 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7f4fc15ff700 1 -- 172.21.15.124:0/904665228 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc14ad20 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.232+0000 7f5cfd99b700 1 -- 172.21.15.124:0/2527655976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5cf80b1b40 msgr2=0x7f5cf80c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.232+0000 7f5cfd99b700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5cf80b1b40 0x7f5cf80c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.232+0000 7f5cfd99b700 1 -- 172.21.15.124:0/2527655976 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80af530 msgr2=0x7f5cf8086d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.232+0000 7f5cfd99b700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80af530 0x7f5cf8086d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.232+0000 7f5cfd99b700 1 -- 172.21.15.124:0/2527655976 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf000be70 con 0x7f5cf8069900 2023-10-06T04:44:35.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.233+0000 7f4fc15ff700 1 -- 172.21.15.124:0/904665228 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c0052b0 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.232+0000 7fc6ce7fc700 1 -- 172.21.15.124:0/2500233225 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6c8011870 con 0x7fc6d8161810 2023-10-06T04:44:35.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.232+0000 7ff5a2ffd700 1 -- 172.21.15.124:0/1735279561 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff594023070 con 0x7ff5ac06a810 2023-10-06T04:44:35.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.231+0000 7ff701ffb700 1 -- 172.21.15.124:0/1865071631 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6fc0072e0 con 0x7ff7040cb920 2023-10-06T04:44:35.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.233+0000 7ff701ffb700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff6e8067080 0x7ff6e8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.233+0000 7ff701ffb700 1 -- 172.21.15.124:0/1865071631 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6fc083720 con 0x7ff7040cb920 2023-10-06T04:44:35.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.233+0000 7ff5a2ffd700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff58c067080 0x7ff58c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.233+0000 7ff5a2ffd700 1 -- 172.21.15.124:0/1735279561 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff594085f20 con 0x7ff5ac06a810 2023-10-06T04:44:35.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.233+0000 7f5cfd99b700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf80c4a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400b810 tx=0x7f5cf40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7f2cc57fa700 1 -- 172.21.15.124:0/2051754966 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8012e30 con 0x7f2cd0161be0 2023-10-06T04:44:35.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7f2cc57fa700 1 -- 172.21.15.124:0/2051754966 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc801d630 con 0x7f2cd0161be0 2023-10-06T04:44:35.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7f2cc57fa700 1 -- 172.21.15.124:0/2051754966 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc801d9f0 con 0x7f2cd0161be0 2023-10-06T04:44:35.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7fc6ce7fc700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc6bc067080 0x7fc6bc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7fc6ce7fc700 1 -- 172.21.15.124:0/2500233225 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc6c8085950 con 0x7fc6d8161810 2023-10-06T04:44:35.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7ff5aa7fc700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff58c067080 0x7ff58c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7f3f98ff9700 1 -- 172.21.15.124:0/3261985110 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00cc20 con 0x7f3fa4161be0 2023-10-06T04:44:35.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7f3f98ff9700 1 -- 172.21.15.124:0/3261985110 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00f040 con 0x7f3fa4161be0 2023-10-06T04:44:35.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7f3f98ff9700 1 -- 172.21.15.124:0/3261985110 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c014480 con 0x7f3fa4161be0 2023-10-06T04:44:35.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7f3faabff700 1 -- 172.21.15.124:0/3261985110 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa40af6f0 con 0x7f3fa4161be0 2023-10-06T04:44:35.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7f3faabff700 1 -- 172.21.15.124:0/3261985110 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa40b1250 con 0x7f3fa4161be0 2023-10-06T04:44:35.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7ff5a2ffd700 1 -- 172.21.15.124:0/1735279561 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff594053090 con 0x7ff5ac06a810 2023-10-06T04:44:35.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7f2cd75ff700 1 -- 172.21.15.124:0/2051754966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd015f700 con 0x7f2cd0161be0 2023-10-06T04:44:35.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7f2cd75ff700 1 -- 172.21.15.124:0/2051754966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd0150f00 con 0x7f2cd0161be0 2023-10-06T04:44:35.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.235+0000 7fc6de39b700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc6bc067080 0x7fc6bc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.236+0000 7f42f9ffb700 1 -- 172.21.15.124:0/2799298145 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f430416e5b0 con 0x7f4304161be0 2023-10-06T04:44:35.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.236+0000 7f3faabff700 1 -- 172.21.15.124:0/3261985110 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa40717a0 con 0x7f3fa4161be0 2023-10-06T04:44:35.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.236+0000 7fc6de39b700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc6bc067080 0x7fc6bc069530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4001a30 tx=0x7fc6d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.234+0000 7ff709d9b700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff6e8067080 0x7ff6e8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.237+0000 7ff709d9b700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff6e8067080 0x7ff6e8069530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800bfa0 tx=0x7ff6f8019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.236+0000 7f2cd75ff700 1 -- 172.21.15.124:0/2051754966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd00aee20 con 0x7f2cd0161be0 2023-10-06T04:44:35.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.235+0000 7f4fa2ffd700 1 -- 172.21.15.124:0/904665228 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fb0022070 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.236+0000 7f4fa2ffd700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fa8067080 0x7f4fa8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.236+0000 7f4fa2ffd700 1 -- 172.21.15.124:0/904665228 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4fb0086870 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.237+0000 7f4fbaffd700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fa8067080 0x7f4fa8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.238+0000 7f4fbaffd700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fa8067080 0x7f4fa8069530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4fac001710 tx=0x7f4fac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.239+0000 7f2cc57fa700 1 -- 172.21.15.124:0/2051754966 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cc8024070 con 0x7f2cd0161be0 2023-10-06T04:44:35.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.239+0000 7ff5aa7fc700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff58c067080 0x7ff58c069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0c2cd0 tx=0x7ff59c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.239+0000 7f3f98ff9700 1 -- 172.21.15.124:0/3261985110 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f9c0147f0 con 0x7f3fa4161be0 2023-10-06T04:44:35.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.239+0000 7fc6ce7fc700 1 -- 172.21.15.124:0/2500233225 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6c80529c0 con 0x7fc6d8161810 2023-10-06T04:44:35.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.240+0000 7ff701ffb700 1 -- 172.21.15.124:0/1865071631 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff704159c00 con 0x7ff7040cb920 2023-10-06T04:44:35.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.240+0000 7f2cc57fa700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cb4067080 0x7f2cb4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.240+0000 7f2cc57fa700 1 -- 172.21.15.124:0/2051754966 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2cc8087310 con 0x7f2cd0161be0 2023-10-06T04:44:35.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.241+0000 7f3f98ff9700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3f90067080 0x7f3f90069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.241+0000 7f3f98ff9700 1 -- 172.21.15.124:0/3261985110 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f9c0858a0 con 0x7f3fa4161be0 2023-10-06T04:44:35.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.242+0000 7f2cd539b700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cb4067080 0x7f2cb4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.242+0000 7f3fa899b700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3f90067080 0x7f3f90069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.243+0000 7f3fa899b700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3f90067080 0x7f3f90069530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009720 tx=0x7f3fa0006c30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.243+0000 7f2cd539b700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cb4067080 0x7f2cb4069530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0058d0 tx=0x7f2ccc0010a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.244+0000 7f5cedffb700 1 -- 172.21.15.124:0/2527655976 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf400f510 con 0x7f5cf8069900 2023-10-06T04:44:35.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.244+0000 7f5cedffb700 1 -- 172.21.15.124:0/2527655976 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf400f690 con 0x7f5cf8069900 2023-10-06T04:44:35.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.244+0000 7f5cedffb700 1 -- 172.21.15.124:0/2527655976 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf400fa50 con 0x7f5cf8069900 2023-10-06T04:44:35.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.244+0000 7f5cfe99d700 1 -- 172.21.15.124:0/2527655976 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf80c7820 con 0x7f5cf8069900 2023-10-06T04:44:35.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.244+0000 7f5cfe99d700 1 -- 172.21.15.124:0/2527655976 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf80c3c10 con 0x7f5cf8069900 2023-10-06T04:44:35.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.245+0000 7f3f98ff9700 1 -- 172.21.15.124:0/3261985110 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f9c0564a0 con 0x7f3fa4161be0 2023-10-06T04:44:35.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.248+0000 7f5cfe99d700 1 -- 172.21.15.124:0/2527655976 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf804c380 con 0x7f5cf8069900 2023-10-06T04:44:35.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.251+0000 7f5cedffb700 1 -- 172.21.15.124:0/2527655976 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cf401a400 con 0x7f5cf8069900 2023-10-06T04:44:35.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.252+0000 7f5cedffb700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5cdc067080 0x7f5cdc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.252+0000 7f5cedffb700 1 -- 172.21.15.124:0/2527655976 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5cf4084140 con 0x7f5cf8069900 2023-10-06T04:44:35.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.253+0000 7f2cc57fa700 1 -- 172.21.15.124:0/2051754966 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cc8057f10 con 0x7f2cd0161be0 2023-10-06T04:44:35.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.253+0000 7f5cfd19a700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5cdc067080 0x7f5cdc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.254+0000 7f5cfd19a700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5cdc067080 0x7f5cdc069530 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80c18c0 tx=0x7f5ce8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.255+0000 7f5cedffb700 1 -- 172.21.15.124:0/2527655976 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cf40512b0 con 0x7f5cf8069900 2023-10-06T04:44:35.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.245+0000 7f4fa2ffd700 1 -- 172.21.15.124:0/904665228 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fb00539e0 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.671+0000 7ff5b15ff700 1 -- 172.21.15.124:0/1735279561 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff5ac0717a0 con 0x7ff5ac06a810 2023-10-06T04:44:35.678 INFO:teuthology.orchestra.run.smithi124.stdout:60129542150 2023-10-06T04:44:35.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.672+0000 7ff5a2ffd700 1 -- 172.21.15.124:0/1735279561 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff594015020 con 0x7ff5ac06a810 2023-10-06T04:44:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.677+0000 7ff5b15ff700 1 -- 172.21.15.124:0/1735279561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff58c067080 msgr2=0x7ff58c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.677+0000 7ff5b15ff700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff58c067080 0x7ff58c069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0c2cd0 tx=0x7ff59c009040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.677+0000 7ff5b15ff700 1 -- 172.21.15.124:0/1735279561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5ac06a810 msgr2=0x7ff5ac16ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.677+0000 7ff5b15ff700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5ac06a810 0x7ff5ac16ab10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff594013000 tx=0x7ff594017000 comp rx=0 tx=0).stop 2023-10-06T04:44:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.678+0000 7ff5b15ff700 1 -- 172.21.15.124:0/1735279561 shutdown_connections 2023-10-06T04:44:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.678+0000 7ff5b15ff700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5ac1574a0 0x7ff5ac15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.678+0000 7ff5b15ff700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5ac06a810 0x7ff5ac16ab10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.678+0000 7ff5b15ff700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff58c067080 0x7ff58c069530 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.678+0000 7ff5b15ff700 1 --2- 172.21.15.124:0/1735279561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5ac06d8d0 0x7ff5ac15df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.678+0000 7ff5b15ff700 1 -- 172.21.15.124:0/1735279561 >> 172.21.15.124:0/1735279561 conn(0x7ff5ac0cc080 msgr2=0x7ff5ac153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.679+0000 7ff5b15ff700 1 -- 172.21.15.124:0/1735279561 shutdown_connections 2023-10-06T04:44:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.679+0000 7ff5b15ff700 1 -- 172.21.15.124:0/1735279561 wait complete. 2023-10-06T04:44:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.679+0000 7fc6e05ff700 1 -- 172.21.15.124:0/2500233225 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc6d80717a0 con 0x7fc6d8161810 2023-10-06T04:44:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.681+0000 7fc6ce7fc700 1 -- 172.21.15.124:0/2500233225 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6c8015020 con 0x7fc6d8161810 2023-10-06T04:44:35.687 INFO:teuthology.orchestra.run.smithi124.stdout:60129542147 2023-10-06T04:44:35.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.684+0000 7f430bdff700 1 -- 172.21.15.124:0/2799298145 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f430416e5b0 con 0x7f4304161be0 2023-10-06T04:44:35.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.685+0000 7f3faabff700 1 -- 172.21.15.124:0/3261985110 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3fa40ccdd0 con 0x7f3fa4161be0 2023-10-06T04:44:35.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.685+0000 7fc6e05ff700 1 -- 172.21.15.124:0/2500233225 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc6bc067080 msgr2=0x7fc6bc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.685+0000 7fc6e05ff700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc6bc067080 0x7fc6bc069530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4001a30 tx=0x7fc6d4009040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.685+0000 7fc6e05ff700 1 -- 172.21.15.124:0/2500233225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6d8161810 msgr2=0x7fc6d80aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.685+0000 7fc6e05ff700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6d8161810 0x7fc6d80aee20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8016000 tx=0x7fc6c8017000 comp rx=0 tx=0).stop 2023-10-06T04:44:35.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7fc6e05ff700 1 -- 172.21.15.124:0/2500233225 shutdown_connections 2023-10-06T04:44:35.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7fc6e05ff700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6d8161be0 0x7fc6d8098120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7fc6e05ff700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6d80cbbf0 0x7fc6d8157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7fc6e05ff700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc6bc067080 0x7fc6bc069530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7fc6e05ff700 1 --2- 172.21.15.124:0/2500233225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6d8161810 0x7fc6d80aee20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7fc6e05ff700 1 -- 172.21.15.124:0/2500233225 >> 172.21.15.124:0/2500233225 conn(0x7fc6d80cc080 msgr2=0x7fc6d80c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7f3f98ff9700 1 -- 172.21.15.124:0/3261985110 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f9c056030 con 0x7f3fa4161be0 2023-10-06T04:44:35.690 INFO:teuthology.orchestra.run.smithi124.stdout:60129542148 2023-10-06T04:44:35.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7f42f9ffb700 1 -- 172.21.15.124:0/2799298145 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f430416e5b0 con 0x7f4304161be0 2023-10-06T04:44:35.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7ff70bfff700 1 -- 172.21.15.124:0/1865071631 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff704069830 con 0x7ff7040cb920 2023-10-06T04:44:35.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7fc6e05ff700 1 -- 172.21.15.124:0/2500233225 shutdown_connections 2023-10-06T04:44:35.691 INFO:teuthology.orchestra.run.smithi124.stdout:60129542148 2023-10-06T04:44:35.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.686+0000 7fc6e05ff700 1 -- 172.21.15.124:0/2500233225 wait complete. 2023-10-06T04:44:35.692 INFO:teuthology.orchestra.run.smithi124.stdout:60129542148 2023-10-06T04:44:35.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.687+0000 7ff701ffb700 1 -- 172.21.15.124:0/1865071631 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff704069830 con 0x7ff7040cb920 2023-10-06T04:44:35.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f3faabff700 1 -- 172.21.15.124:0/3261985110 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3f90067080 msgr2=0x7f3f90069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f3faabff700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3f90067080 0x7f3f90069530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009720 tx=0x7f3fa0006c30 comp rx=0 tx=0).stop 2023-10-06T04:44:35.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f3faabff700 1 -- 172.21.15.124:0/3261985110 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fa4161be0 msgr2=0x7f3fa40b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f3faabff700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fa4161be0 0x7f3fa40b0800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009e90 tx=0x7f3f9c00b040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f3faabff700 1 -- 172.21.15.124:0/3261985110 shutdown_connections 2023-10-06T04:44:35.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f3faabff700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fa4161be0 0x7f3fa40b0800 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f3faabff700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3f90067080 0x7f3f90069530 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009720 tx=0x7f3fa0006c30 comp rx=0 tx=0).stop 2023-10-06T04:44:35.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f3faabff700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa40cbbf0 0x7f3fa40afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f3faabff700 1 --2- 172.21.15.124:0/3261985110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fa4161810 0x7f3fa4098e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f3faabff700 1 -- 172.21.15.124:0/3261985110 >> 172.21.15.124:0/3261985110 conn(0x7f3fa40cc080 msgr2=0x7f3fa406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.690+0000 7f4fc15ff700 1 -- 172.21.15.124:0/904665228 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4f9c005830 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f430bdff700 1 -- 172.21.15.124:0/2799298145 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f42e8067080 msgr2=0x7f42e8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f430bdff700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f42e8067080 0x7f42e8069530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4300006fd0 tx=0x7f4300008040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f430bdff700 1 -- 172.21.15.124:0/2799298145 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4304161be0 msgr2=0x7f43040cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f430bdff700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4304161be0 0x7f43040cb2b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42f400e8d0 tx=0x7f42f40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f3faabff700 1 -- 172.21.15.124:0/3261985110 shutdown_connections 2023-10-06T04:44:35.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f430bdff700 1 -- 172.21.15.124:0/2799298145 shutdown_connections 2023-10-06T04:44:35.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f430bdff700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4304161be0 0x7f43040cb2b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f430bdff700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f42e8067080 0x7f42e8069530 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4300006fd0 tx=0x7f4300008040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f430bdff700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43040a9c40 0x7f43040c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f430bdff700 1 --2- 172.21.15.124:0/2799298145 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4304161810 0x7f430415a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f430bdff700 1 -- 172.21.15.124:0/2799298145 >> 172.21.15.124:0/2799298145 conn(0x7f43040cc080 msgr2=0x7f430406d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f3faabff700 1 -- 172.21.15.124:0/3261985110 wait complete. 2023-10-06T04:44:35.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7f4fa2ffd700 1 -- 172.21.15.124:0/904665228 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4fb0057000 con 0x7f4fbc0c85c0 2023-10-06T04:44:35.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7ff70bfff700 1 -- 172.21.15.124:0/1865071631 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff6e8067080 msgr2=0x7ff6e8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7ff70bfff700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff6e8067080 0x7ff6e8069530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800bfa0 tx=0x7ff6f8019000 comp rx=0 tx=0).stop 2023-10-06T04:44:35.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7ff70bfff700 1 -- 172.21.15.124:0/1865071631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7040cb920 msgr2=0x7ff7040b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.691+0000 7ff70bfff700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7040cb920 0x7ff7040b1060 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc001eb0 tx=0x7ff6fc007e60 comp rx=0 tx=0).stop 2023-10-06T04:44:35.697 INFO:teuthology.orchestra.run.smithi124.stdout:60129542147 2023-10-06T04:44:35.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.692+0000 7ff70bfff700 1 -- 172.21.15.124:0/1865071631 shutdown_connections 2023-10-06T04:44:35.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.692+0000 7ff70bfff700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7040cb920 0x7ff7040b1060 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.692+0000 7ff70bfff700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7040693d0 0x7ff704098400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.692+0000 7ff70bfff700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff6e8067080 0x7ff6e8069530 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.692+0000 7ff70bfff700 1 --2- 172.21.15.124:0/1865071631 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7040c7b20 0x7ff7040b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.692+0000 7ff70bfff700 1 -- 172.21.15.124:0/1865071631 >> 172.21.15.124:0/1865071631 conn(0x7ff7040cc080 msgr2=0x7ff70415cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.692+0000 7ff70bfff700 1 -- 172.21.15.124:0/1865071631 shutdown_connections 2023-10-06T04:44:35.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.692+0000 7ff70bfff700 1 -- 172.21.15.124:0/1865071631 wait complete. 2023-10-06T04:44:35.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.693+0000 7f5cfe99d700 1 -- 172.21.15.124:0/2527655976 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5cf806a000 con 0x7f5cf8069900 2023-10-06T04:44:35.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.694+0000 7f2cd75ff700 1 -- 172.21.15.124:0/2051754966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2cd00af780 con 0x7f2cd0161be0 2023-10-06T04:44:35.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.693+0000 7f430bdff700 1 -- 172.21.15.124:0/2799298145 shutdown_connections 2023-10-06T04:44:35.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.693+0000 7f430bdff700 1 -- 172.21.15.124:0/2799298145 wait complete. 2023-10-06T04:44:35.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.694+0000 7f5cedffb700 1 -- 172.21.15.124:0/2527655976 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5cf40548d0 con 0x7f5cf8069900 2023-10-06T04:44:35.700 INFO:teuthology.orchestra.run.smithi124.stdout:60129542147 2023-10-06T04:44:35.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.695+0000 7f2cc57fa700 1 -- 172.21.15.124:0/2051754966 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2cd00af780 con 0x7f2cd0161be0 2023-10-06T04:44:35.700 INFO:teuthology.orchestra.run.smithi124.stdout:60129542147 2023-10-06T04:44:35.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.699+0000 7f4fc15ff700 1 -- 172.21.15.124:0/904665228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fa8067080 msgr2=0x7f4fa8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.699+0000 7f4fc15ff700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fa8067080 0x7f4fa8069530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4fac001710 tx=0x7f4fac009040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.699+0000 7f4fc15ff700 1 -- 172.21.15.124:0/904665228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fbc0c85c0 msgr2=0x7f4fbc1537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.699+0000 7f4fc15ff700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fbc0c85c0 0x7f4fbc1537c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00030c0 tx=0x7f4fb0016000 comp rx=0 tx=0).stop 2023-10-06T04:44:35.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.699+0000 7f2cd75ff700 1 -- 172.21.15.124:0/2051754966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cb4067080 msgr2=0x7f2cb4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.699+0000 7f2cd75ff700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cb4067080 0x7f2cb4069530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0058d0 tx=0x7f2ccc0010a0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.699+0000 7f2cd75ff700 1 -- 172.21.15.124:0/2051754966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 msgr2=0x7f2cd0160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.699+0000 7f2cd75ff700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 0x7f2cd0160350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800b6c0 tx=0x7f2cc8019000 comp rx=0 tx=0).stop 2023-10-06T04:44:35.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.700+0000 7f2cd75ff700 1 -- 172.21.15.124:0/2051754966 shutdown_connections 2023-10-06T04:44:35.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.700+0000 7f2cd75ff700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd0161be0 0x7f2cd0160350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.700+0000 7f2cd75ff700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cd00cbbf0 0x7f2cd01509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.700+0000 7f2cd75ff700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cb4067080 0x7f2cb4069530 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.700+0000 7f2cd75ff700 1 --2- 172.21.15.124:0/2051754966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cd0161810 0x7f2cd015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.700+0000 7f2cd75ff700 1 -- 172.21.15.124:0/2051754966 >> 172.21.15.124:0/2051754966 conn(0x7f2cd00cc080 msgr2=0x7f2cd015c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.700+0000 7f2cd75ff700 1 -- 172.21.15.124:0/2051754966 shutdown_connections 2023-10-06T04:44:35.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.700+0000 7f2cd75ff700 1 -- 172.21.15.124:0/2051754966 wait complete. 2023-10-06T04:44:35.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.704+0000 7f5cfe99d700 1 -- 172.21.15.124:0/2527655976 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5cdc067080 msgr2=0x7f5cdc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.704+0000 7f5cfe99d700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5cdc067080 0x7f5cdc069530 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80c18c0 tx=0x7f5ce8008040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.704+0000 7f5cfe99d700 1 -- 172.21.15.124:0/2527655976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 msgr2=0x7f5cf80c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.704+0000 7f5cfe99d700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf80c4a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400b810 tx=0x7f5cf40091d0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.705+0000 7f5cfe99d700 1 -- 172.21.15.124:0/2527655976 shutdown_connections 2023-10-06T04:44:35.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.705+0000 7f5cfe99d700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5cf80b1b40 0x7f5cf80c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.705+0000 7f5cfe99d700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5cdc067080 0x7f5cdc069530 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.705+0000 7f5cfe99d700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5cf8069900 0x7f5cf80c4a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.705+0000 7f5cfe99d700 1 --2- 172.21.15.124:0/2527655976 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80af530 0x7f5cf8086d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.705+0000 7f5cfe99d700 1 -- 172.21.15.124:0/2527655976 >> 172.21.15.124:0/2527655976 conn(0x7f5cf80675f0 msgr2=0x7f5cf8169360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.705+0000 7f5cfe99d700 1 -- 172.21.15.124:0/2527655976 shutdown_connections 2023-10-06T04:44:35.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.705+0000 7f5cfe99d700 1 -- 172.21.15.124:0/2527655976 wait complete. 2023-10-06T04:44:35.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.0 2023-10-06T04:44:35.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.714+0000 7f4fc15ff700 1 -- 172.21.15.124:0/904665228 shutdown_connections 2023-10-06T04:44:35.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.714+0000 7f4fc15ff700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fbc1554e0 0x7f4fbc153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.714+0000 7f4fc15ff700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fbc06b440 0x7f4fbc159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.714+0000 7f4fc15ff700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fa8067080 0x7f4fa8069530 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.714+0000 7f4fc15ff700 1 --2- 172.21.15.124:0/904665228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fbc0c85c0 0x7f4fbc1537c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.714+0000 7f4fc15ff700 1 -- 172.21.15.124:0/904665228 >> 172.21.15.124:0/904665228 conn(0x7f4fbc0cc080 msgr2=0x7f4fbc068e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.714+0000 7f4fc15ff700 1 -- 172.21.15.124:0/904665228 shutdown_connections 2023-10-06T04:44:35.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:35.715+0000 7f4fc15ff700 1 -- 172.21.15.124:0/904665228 wait complete. 2023-10-06T04:44:35.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.5 2023-10-06T04:44:35.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.3 2023-10-06T04:44:35.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.1 2023-10-06T04:44:35.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.6 2023-10-06T04:44:35.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.2 2023-10-06T04:44:35.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.7 2023-10-06T04:44:35.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.4 2023-10-06T04:44:36.718 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:44:36.723 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:44:36.725 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:44:36.731 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:44:36.733 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:44:36.736 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:44:36.736 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:44:36.740 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:44:37.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.028+0000 7f62d4fff700 1 Processor -- start 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.028+0000 7f62d4fff700 1 -- start start 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.030+0000 7f62d4fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f62d00cb920 0x7f62d00c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.030+0000 7f62d4fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f62d00695a0 0x7f62d00a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.030+0000 7f62d4fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d00a9720 con 0x7f62d00c7b20 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.030+0000 7f62d4fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d00c80a0 con 0x7f62d00695a0 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.030+0000 7f62d4fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d00a8df0 con 0x7f62d00cb920 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.032+0000 7f62ce59c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f62d00cb920 0x7f62d00c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.032+0000 7f62ce59c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f62d00cb920 0x7f62d00c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38410/0 (socket says 172.21.15.124:38410) 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.032+0000 7f62ce59c700 1 -- 172.21.15.124:0/2150759539 learned_addr learned my addr 172.21.15.124:0/2150759539 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.033+0000 7f62ce59c700 1 -- 172.21.15.124:0/2150759539 >> v2:172.21.15.124:3300/0 conn(0x7f62d00695a0 msgr2=0x7f62d00a9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.033+0000 7f62ce59c700 1 --2- 172.21.15.124:0/2150759539 >> v2:172.21.15.124:3300/0 conn(0x7f62d00695a0 0x7f62d00a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.033+0000 7f62ce59c700 1 -- 172.21.15.124:0/2150759539 >> v1:172.21.15.158:6789/0 conn(0x7f62d00c7b20 legacy=0x7f62d0068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.033+0000 7f62ce59c700 1 -- 172.21.15.124:0/2150759539 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d00a90d0 con 0x7f62d00cb920 2023-10-06T04:44:37.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.035+0000 7f62ce59c700 1 --2- 172.21.15.124:0/2150759539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62d00cb920 0x7f62d00c75e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62d0063cd0 tx=0x7f62c0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=962a50bf0f8f79c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.037+0000 7f62cd59a700 1 -- 172.21.15.124:0/2150759539 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c000b860 con 0x7f62d00cb920 2023-10-06T04:44:37.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.037+0000 7f62cd59a700 1 -- 172.21.15.124:0/2150759539 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c000b9c0 con 0x7f62d00cb920 2023-10-06T04:44:37.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.037+0000 7f62cd59a700 1 -- 172.21.15.124:0/2150759539 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c000bd60 con 0x7f62d00cb920 2023-10-06T04:44:37.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.038+0000 7f62d4fff700 1 -- 172.21.15.124:0/2150759539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62d00cb920 msgr2=0x7f62d00c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.038+0000 7f62d4fff700 1 --2- 172.21.15.124:0/2150759539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62d00cb920 0x7f62d00c75e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62d0063cd0 tx=0x7f62c0009250 comp rx=0 tx=0).stop 2023-10-06T04:44:37.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.039+0000 7f62d4fff700 1 -- 172.21.15.124:0/2150759539 shutdown_connections 2023-10-06T04:44:37.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.039+0000 7f62d4fff700 1 --2- 172.21.15.124:0/2150759539 >> v2:172.21.15.124:3300/0 conn(0x7f62d00695a0 0x7f62d00a9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.039+0000 7f62d4fff700 1 --2- 172.21.15.124:0/2150759539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62d00cb920 0x7f62d00c75e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.039+0000 7f62d4fff700 1 -- 172.21.15.124:0/2150759539 >> 172.21.15.124:0/2150759539 conn(0x7f62d00cc080 msgr2=0x7f62d00cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.039+0000 7f62d4fff700 1 -- 172.21.15.124:0/2150759539 shutdown_connections 2023-10-06T04:44:37.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.039+0000 7f62d4fff700 1 -- 172.21.15.124:0/2150759539 wait complete. 2023-10-06T04:44:37.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.041+0000 7f62d4fff700 1 Processor -- start 2023-10-06T04:44:37.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.043+0000 7f62d4fff700 1 -- start start 2023-10-06T04:44:37.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.044+0000 7f62d4fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62d00695a0 0x7f62d0097ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.044+0000 7f62d4fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62d00c7b20 0x7f62d00c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.044+0000 7f62d4fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62d00cb920 0x7f62d00c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.044+0000 7f62d4fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d014f890 con 0x7f62d00cb920 2023-10-06T04:44:37.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.044+0000 7f62d4fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0099000 con 0x7f62d00c7b20 2023-10-06T04:44:37.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.044+0000 7f62d4fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d00c5f90 con 0x7f62d00695a0 2023-10-06T04:44:37.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.045+0000 7f62ce59c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62d00695a0 0x7f62d0097ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.045+0000 7f62cdd9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62d00c7b20 0x7f62d00c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.045+0000 7f62cdd9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62d00c7b20 0x7f62d00c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38412/0 (socket says 172.21.15.124:38412) 2023-10-06T04:44:37.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.045+0000 7f62cdd9b700 1 -- 172.21.15.124:0/4120861107 learned_addr learned my addr 172.21.15.124:0/4120861107 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.048+0000 7f62ce59c700 1 -- 172.21.15.124:0/4120861107 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62d00c7b20 msgr2=0x7f62d00c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.048+0000 7f62ce59c700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62d00c7b20 0x7f62d00c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.048+0000 7f62ce59c700 1 -- 172.21.15.124:0/4120861107 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62d00cb920 msgr2=0x7f62d00c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.048+0000 7f62ce59c700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62d00cb920 0x7f62d00c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.048+0000 7f62ce59c700 1 -- 172.21.15.124:0/4120861107 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c00094f0 con 0x7f62d00695a0 2023-10-06T04:44:37.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.048+0000 7f62ce59c700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62d00695a0 0x7f62d0097ba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f62d0129430 tx=0x7f62c0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.049+0000 7f62be7fc700 1 -- 172.21.15.124:0/4120861107 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0026480 con 0x7f62d00695a0 2023-10-06T04:44:37.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.049+0000 7f62be7fc700 1 -- 172.21.15.124:0/4120861107 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c001f070 con 0x7f62d00695a0 2023-10-06T04:44:37.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.049+0000 7f62be7fc700 1 -- 172.21.15.124:0/4120861107 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0026890 con 0x7f62d00695a0 2023-10-06T04:44:37.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.049+0000 7f62d4fff700 1 -- 172.21.15.124:0/4120861107 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d0099490 con 0x7f62d00695a0 2023-10-06T04:44:37.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.049+0000 7f62d4fff700 1 -- 172.21.15.124:0/4120861107 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d0098750 con 0x7f62d00695a0 2023-10-06T04:44:37.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.052+0000 7f62d4fff700 1 -- 172.21.15.124:0/4120861107 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d00992e0 con 0x7f62d00695a0 2023-10-06T04:44:37.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.055+0000 7f62be7fc700 1 -- 172.21.15.124:0/4120861107 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62c0026cc0 con 0x7f62d00695a0 2023-10-06T04:44:37.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.056+0000 7f62be7fc700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f62b0067080 0x7f62b0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.056+0000 7f62be7fc700 1 -- 172.21.15.124:0/4120861107 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f62c0021070 con 0x7f62d00695a0 2023-10-06T04:44:37.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.057+0000 7f62cdd9b700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f62b0067080 0x7f62b0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.059+0000 7f62cdd9b700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f62b0067080 0x7f62b0069530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f62c40078a0 tx=0x7f62c4007830 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.061+0000 7f62be7fc700 1 -- 172.21.15.124:0/4120861107 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62c0053560 con 0x7f62d00695a0 2023-10-06T04:44:37.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.105+0000 7f7c6a3ff700 1 Processor -- start 2023-10-06T04:44:37.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.106+0000 7f7c6a3ff700 1 -- start start 2023-10-06T04:44:37.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.108+0000 7f7c6a3ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7c64161810 0x7f7c640cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.108+0000 7f7c6a3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161be0 0x7f7c640cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.108+0000 7f7c6a3ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c640a9c40 0x7f7c640aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.108+0000 7f7c6a3ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6406b070 con 0x7f7c64161810 2023-10-06T04:44:37.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.108+0000 7f7c6a3ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c640c8240 con 0x7f7c640a9c40 2023-10-06T04:44:37.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.108+0000 7f7c6a3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640a97b0 con 0x7f7c64161be0 2023-10-06T04:44:37.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.110+0000 7f7c637fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161be0 0x7f7c640cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.110+0000 7f7c6899c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c640a9c40 0x7f7c640aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.110+0000 7f7c6899c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c640a9c40 0x7f7c640aa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38424/0 (socket says 172.21.15.124:38424) 2023-10-06T04:44:37.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.110+0000 7f7c6899c700 1 -- 172.21.15.124:0/1415079017 learned_addr learned my addr 172.21.15.124:0/1415079017 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.111+0000 7f7c6899c700 1 -- 172.21.15.124:0/1415079017 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161be0 msgr2=0x7f7c640cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.111+0000 7f7c6899c700 1 --2- 172.21.15.124:0/1415079017 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161be0 0x7f7c640cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.111+0000 7f7c6899c700 1 -- 172.21.15.124:0/1415079017 >> v2:172.21.15.124:3300/0 conn(0x7f7c64161810 msgr2=0x7f7c640cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.111+0000 7f7c6899c700 1 --2- 172.21.15.124:0/1415079017 >> v2:172.21.15.124:3300/0 conn(0x7f7c64161810 0x7f7c640cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.111+0000 7f7c6899c700 1 -- 172.21.15.124:0/1415079017 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c640a8e80 con 0x7f7c640a9c40 2023-10-06T04:44:37.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.112+0000 7f7c6899c700 1 --2- 172.21.15.124:0/1415079017 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c640a9c40 0x7f7c640aa0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c640c8a00 tx=0x7f7c58009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89ed393742dc07eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.112+0000 7f7c62ffd700 1 -- 172.21.15.124:0/1415079017 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800b860 con 0x7f7c640a9c40 2023-10-06T04:44:37.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.112+0000 7f7c62ffd700 1 -- 172.21.15.124:0/1415079017 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5800b9c0 con 0x7f7c640a9c40 2023-10-06T04:44:37.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.112+0000 7f7c62ffd700 1 -- 172.21.15.124:0/1415079017 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800bd60 con 0x7f7c640a9c40 2023-10-06T04:44:37.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.113+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/1415079017 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c640a9c40 msgr2=0x7f7c640aa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.113+0000 7f7c6a3ff700 1 --2- 172.21.15.124:0/1415079017 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c640a9c40 0x7f7c640aa0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c640c8a00 tx=0x7f7c58009250 comp rx=0 tx=0).stop 2023-10-06T04:44:37.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.114+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/1415079017 shutdown_connections 2023-10-06T04:44:37.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.114+0000 7f7c6a3ff700 1 --2- 172.21.15.124:0/1415079017 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c640a9c40 0x7f7c640aa0c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.114+0000 7f7c6a3ff700 1 --2- 172.21.15.124:0/1415079017 >> v2:172.21.15.124:3300/0 conn(0x7f7c64161810 0x7f7c640cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.114+0000 7f7c6a3ff700 1 --2- 172.21.15.124:0/1415079017 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161be0 0x7f7c640cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.114+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/1415079017 >> 172.21.15.124:0/1415079017 conn(0x7f7c640cc080 msgr2=0x7f7c640cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.114+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/1415079017 shutdown_connections 2023-10-06T04:44:37.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.114+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/1415079017 wait complete. 2023-10-06T04:44:37.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.117+0000 7f7c6a3ff700 1 Processor -- start 2023-10-06T04:44:37.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.118+0000 7f7c6a3ff700 1 -- start start 2023-10-06T04:44:37.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.119+0000 7f7c6a3ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c640a9c40 0x7f7c6413d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.119+0000 7f7c6a3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161810 0x7f7c640afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.119+0000 7f7c6a3ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c64161be0 0x7f7c640b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.119+0000 7f7c6a3ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640b0800 con 0x7f7c640a9c40 2023-10-06T04:44:37.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.119+0000 7f7c6a3ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640af8f0 con 0x7f7c64161be0 2023-10-06T04:44:37.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.119+0000 7f7c6a3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64160b30 con 0x7f7c64161810 2023-10-06T04:44:37.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.120+0000 7f7c63fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c640a9c40 0x7f7c6413d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.120+0000 7f7c6899c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c64161be0 0x7f7c640b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.120+0000 7f7c63fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c640a9c40 0x7f7c6413d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40642/0 (socket says 172.21.15.124:40642) 2023-10-06T04:44:37.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.120+0000 7f7c63fff700 1 -- 172.21.15.124:0/599890273 learned_addr learned my addr 172.21.15.124:0/599890273 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.120+0000 7f7c637fe700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161810 0x7f7c640afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.120+0000 7f7c6899c700 1 -- 172.21.15.124:0/599890273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161810 msgr2=0x7f7c640afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.120+0000 7f7c6899c700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161810 0x7f7c640afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.120+0000 7f7c6899c700 1 -- 172.21.15.124:0/599890273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c640a9c40 msgr2=0x7f7c6413d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.120+0000 7f7c6899c700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c640a9c40 0x7f7c6413d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.121+0000 7f7c6899c700 1 -- 172.21.15.124:0/599890273 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580094f0 con 0x7f7c64161be0 2023-10-06T04:44:37.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.121+0000 7f7c637fe700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161810 0x7f7c640afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:37.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.121+0000 7f7c6899c700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c64161be0 0x7f7c640b02c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c6406b800 tx=0x7f7c58017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.122+0000 7f7c4bfff700 1 -- 172.21.15.124:0/599890273 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800b860 con 0x7f7c64161be0 2023-10-06T04:44:37.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.122+0000 7f7c4bfff700 1 -- 172.21.15.124:0/599890273 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5801a660 con 0x7f7c64161be0 2023-10-06T04:44:37.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.122+0000 7f7c4bfff700 1 -- 172.21.15.124:0/599890273 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5801aa40 con 0x7f7c64161be0 2023-10-06T04:44:37.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.123+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/599890273 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c640aefc0 con 0x7f7c64161be0 2023-10-06T04:44:37.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.123+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/599890273 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c640af580 con 0x7f7c64161be0 2023-10-06T04:44:37.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.124+0000 7f7faabff700 1 Processor -- start 2023-10-06T04:44:37.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.124+0000 7febc59ff700 1 Processor -- start 2023-10-06T04:44:37.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.124+0000 7febc59ff700 1 -- start start 2023-10-06T04:44:37.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.124+0000 7f7faabff700 1 -- start start 2023-10-06T04:44:37.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.126+0000 7f7faabff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7fa40b3d30 0x7f7fa415a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.126+0000 7f7faabff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7fa40b1ea0 0x7f7fa40b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.126+0000 7f7faabff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa415aac0 con 0x7f7fa41594b0 2023-10-06T04:44:37.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.126+0000 7f7faabff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa40b41b0 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.126+0000 7f7faabff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa40b27e0 con 0x7f7fa40b3d30 2023-10-06T04:44:37.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.127+0000 7f7c4bfff700 1 -- 172.21.15.124:0/599890273 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c58010380 con 0x7f7c64161be0 2023-10-06T04:44:37.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.127+0000 7f7fa899b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f7fa41594b0 0x7f7fa40b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:55210/0 (socket says 172.21.15.124:55210) 2023-10-06T04:44:37.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.128+0000 7f7fa899b700 1 -- 172.21.15.124:0/1757571035 learned_addr learned my addr 172.21.15.124:0/1757571035 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:37.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.128+0000 7f7fa3fff700 1 --2- 172.21.15.124:0/1757571035 >> v2:172.21.15.158:3300/0 conn(0x7f7fa40b3d30 0x7f7fa415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.129+0000 7f7c4bfff700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c50067030 0x7f7c500694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.129+0000 7f7c4bfff700 1 -- 172.21.15.124:0/599890273 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7c58085b20 con 0x7f7c64161be0 2023-10-06T04:44:37.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.130+0000 7f7fa3fff700 1 -- 172.21.15.124:0/1757571035 >> v2:172.21.15.124:3300/0 conn(0x7f7fa40b1ea0 msgr2=0x7f7fa40b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.130+0000 7f7fa3fff700 1 --2- 172.21.15.124:0/1757571035 >> v2:172.21.15.124:3300/0 conn(0x7f7fa40b1ea0 0x7f7fa40b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.130+0000 7f7fa3fff700 1 -- 172.21.15.124:0/1757571035 >> v1:172.21.15.158:6789/0 conn(0x7f7fa41594b0 legacy=0x7f7fa40b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.130+0000 7f7fa3fff700 1 -- 172.21.15.124:0/1757571035 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40b4410 con 0x7f7fa40b3d30 2023-10-06T04:44:37.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.130+0000 7f7c63fff700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c50067030 0x7f7c500694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.130+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/599890273 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c640afa80 con 0x7f7c64161be0 2023-10-06T04:44:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.129+0000 7febc59ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7febc00cc7a0 0x7febc013b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.129+0000 7febc59ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc00c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.129+0000 7febc59ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7febc00c2250 0x7febc00c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.129+0000 7febc59ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00c26d0 con 0x7febc00c2250 2023-10-06T04:44:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.129+0000 7febc59ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00c28c0 con 0x7febc00cc7a0 2023-10-06T04:44:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.129+0000 7febc59ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00ca6c0 con 0x7febc013bd20 2023-10-06T04:44:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.130+0000 7febbe7fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc00c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.130+0000 7febbe7fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc00c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:32902/0 (socket says 172.21.15.124:32902) 2023-10-06T04:44:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.130+0000 7febbe7fc700 1 -- 172.21.15.124:0/2751474616 learned_addr learned my addr 172.21.15.124:0/2751474616 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7febbeffd700 1 --2- 172.21.15.124:0/2751474616 >> v2:172.21.15.158:3300/0 conn(0x7febc00cc7a0 0x7febc013b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7febbf7fe700 1 --2- 172.21.15.124:0/2751474616 >> v2:172.21.15.124:3300/0 conn(0x7febc00c2250 0x7febc00c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7f7c63fff700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c50067030 0x7f7c500694e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009c00 tx=0x7f7c540091d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7f7fa3fff700 1 --2- 172.21.15.124:0/1757571035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fa40b3d30 0x7f7fa415a580 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40af780 tx=0x7f7f940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1cf930d1e42ec56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7febbe7fc700 1 -- 172.21.15.124:0/2751474616 >> v2:172.21.15.158:3300/0 conn(0x7febc00cc7a0 msgr2=0x7febc013b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7febbe7fc700 1 --2- 172.21.15.124:0/2751474616 >> v2:172.21.15.158:3300/0 conn(0x7febc00cc7a0 0x7febc013b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7febbe7fc700 1 -- 172.21.15.124:0/2751474616 >> v2:172.21.15.124:3300/0 conn(0x7febc00c2250 msgr2=0x7febc00c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7febbe7fc700 1 --2- 172.21.15.124:0/2751474616 >> v2:172.21.15.124:3300/0 conn(0x7febc00c2250 0x7febc00c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7febbe7fc700 1 -- 172.21.15.124:0/2751474616 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc015b100 con 0x7febc013bd20 2023-10-06T04:44:37.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.132+0000 7febbe7fc700 1 --2- 172.21.15.124:0/2751474616 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc00c1d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7febb00099b0 tx=0x7febb0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b1e6c996899498 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7ff496bff700 1 Processor -- start 2023-10-06T04:44:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.131+0000 7ff496bff700 1 -- start start 2023-10-06T04:44:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.132+0000 7febbdffb700 1 -- 172.21.15.124:0/2751474616 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0009ea0 con 0x7febc013bd20 2023-10-06T04:44:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.133+0000 7febbdffb700 1 -- 172.21.15.124:0/2751474616 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb000b820 con 0x7febc013bd20 2023-10-06T04:44:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.133+0000 7febbdffb700 1 -- 172.21.15.124:0/2751474616 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb000bbc0 con 0x7febc013bd20 2023-10-06T04:44:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.133+0000 7febc59ff700 1 -- 172.21.15.124:0/2751474616 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 msgr2=0x7febc00c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7febc59ff700 1 --2- 172.21.15.124:0/2751474616 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc00c1d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7febb00099b0 tx=0x7febb0009250 comp rx=0 tx=0).stop 2023-10-06T04:44:37.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7febc59ff700 1 -- 172.21.15.124:0/2751474616 shutdown_connections 2023-10-06T04:44:37.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7febc59ff700 1 --2- 172.21.15.124:0/2751474616 >> v2:172.21.15.124:3300/0 conn(0x7febc00c2250 0x7febc00c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7febc59ff700 1 --2- 172.21.15.124:0/2751474616 >> v2:172.21.15.158:3300/0 conn(0x7febc00cc7a0 0x7febc013b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7febc59ff700 1 --2- 172.21.15.124:0/2751474616 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc00c1d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7febc59ff700 1 -- 172.21.15.124:0/2751474616 >> 172.21.15.124:0/2751474616 conn(0x7febc00680c0 msgr2=0x7febc00cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.133+0000 7ff496bff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff490068e90 0x7ff490069330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.133+0000 7ff496bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff4900a9bb0 0x7ff4900a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.133+0000 7ff496bff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4900a9720 con 0x7ff4900cb920 2023-10-06T04:44:37.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.133+0000 7ff496bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff490069870 con 0x7ff4900a9bb0 2023-10-06T04:44:37.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.133+0000 7ff496bff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4900c80a0 con 0x7ff490068e90 2023-10-06T04:44:37.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7ff49519c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff4900a9bb0 0x7ff4900a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7ff49519c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff4900a9bb0 0x7ff4900a9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40668/0 (socket says 172.21.15.124:40668) 2023-10-06T04:44:37.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7ff49519c700 1 -- 172.21.15.124:0/4060301949 learned_addr learned my addr 172.21.15.124:0/4060301949 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7febc59ff700 1 -- 172.21.15.124:0/2751474616 shutdown_connections 2023-10-06T04:44:37.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7ff48ffff700 1 --2- 172.21.15.124:0/4060301949 >> v2:172.21.15.158:3300/0 conn(0x7ff490068e90 0x7ff490069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.135+0000 7ff48f7fe700 1 -- 172.21.15.124:0/4060301949 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141041525 0 0) 0x7ff4900a9720 con 0x7ff4900cb920 2023-10-06T04:44:37.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.135+0000 7ff48f7fe700 1 -- 172.21.15.124:0/4060301949 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff47c003570 con 0x7ff4900cb920 2023-10-06T04:44:37.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.135+0000 7ff49519c700 1 -- 172.21.15.124:0/4060301949 >> v2:172.21.15.158:3300/0 conn(0x7ff490068e90 msgr2=0x7ff490069330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.135+0000 7ff49519c700 1 --2- 172.21.15.124:0/4060301949 >> v2:172.21.15.158:3300/0 conn(0x7ff490068e90 0x7ff490069330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.135+0000 7ff49519c700 1 -- 172.21.15.124:0/4060301949 >> v1:172.21.15.124:6789/0 conn(0x7ff4900cb920 legacy=0x7ff4900c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.135+0000 7ff49519c700 1 -- 172.21.15.124:0/4060301949 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4900a8df0 con 0x7ff4900a9bb0 2023-10-06T04:44:37.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7f7008dff700 1 Processor -- start 2023-10-06T04:44:37.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7f7008dff700 1 -- start start 2023-10-06T04:44:37.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.135+0000 7ff49519c700 1 --2- 172.21.15.124:0/4060301949 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4900a9bb0 0x7ff4900a9fd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff490129430 tx=0x7ff488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6808b84288d0fdae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.134+0000 7febc59ff700 1 -- 172.21.15.124:0/2751474616 wait complete. 2023-10-06T04:44:37.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.136+0000 7ff48f7fe700 1 -- 172.21.15.124:0/4060301949 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488009e70 con 0x7ff4900a9bb0 2023-10-06T04:44:37.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.136+0000 7ff48f7fe700 1 -- 172.21.15.124:0/4060301949 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48800b860 con 0x7ff4900a9bb0 2023-10-06T04:44:37.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.136+0000 7ff48f7fe700 1 -- 172.21.15.124:0/4060301949 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48800bbe0 con 0x7ff4900a9bb0 2023-10-06T04:44:37.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7febc59ff700 1 Processor -- start 2023-10-06T04:44:37.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7f7008dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f70040c8100 0x7f7004154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7f7008dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700406b440 0x7f70041554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7ff496bff700 1 -- 172.21.15.124:0/4060301949 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4900a9bb0 msgr2=0x7ff4900a9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7ff496bff700 1 --2- 172.21.15.124:0/4060301949 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4900a9bb0 0x7ff4900a9fd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff490129430 tx=0x7ff488009250 comp rx=0 tx=0).stop 2023-10-06T04:44:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7f7008dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70040cad60 con 0x7f70040c84d0 2023-10-06T04:44:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7f7008dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70040c6970 con 0x7f70040c8100 2023-10-06T04:44:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7f7008dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70040c79a0 con 0x7f700406b440 2023-10-06T04:44:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7f7002d9d700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f70040c84d0 0x7f7004068fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36320/0 (socket says 172.21.15.124:36320) 2023-10-06T04:44:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7f7002d9d700 1 -- 172.21.15.124:0/1913361161 learned_addr learned my addr 172.21.15.124:0/1913361161 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7f7001d9b700 1 --2- 172.21.15.124:0/1913361161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700406b440 0x7f70041554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7f700259c700 1 --2- 172.21.15.124:0/1913361161 >> v2:172.21.15.158:3300/0 conn(0x7f70040c8100 0x7f7004154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7f7fa37fe700 1 -- 172.21.15.124:0/1757571035 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400b6b0 con 0x7f7fa40b3d30 2023-10-06T04:44:37.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7f7fa37fe700 1 -- 172.21.15.124:0/1757571035 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9400b810 con 0x7f7fa40b3d30 2023-10-06T04:44:37.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7f7fa37fe700 1 -- 172.21.15.124:0/1757571035 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400bbb0 con 0x7f7fa40b3d30 2023-10-06T04:44:37.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7ff496bff700 1 -- 172.21.15.124:0/4060301949 shutdown_connections 2023-10-06T04:44:37.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7ff496bff700 1 --2- 172.21.15.124:0/4060301949 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4900a9bb0 0x7ff4900a9fd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7ff496bff700 1 --2- 172.21.15.124:0/4060301949 >> v2:172.21.15.158:3300/0 conn(0x7ff490068e90 0x7ff490069330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7ff496bff700 1 -- 172.21.15.124:0/4060301949 >> 172.21.15.124:0/4060301949 conn(0x7ff4900cc080 msgr2=0x7ff4900cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.137+0000 7febc59ff700 1 -- start start 2023-10-06T04:44:37.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7f7001d9b700 1 -- 172.21.15.124:0/1913361161 >> v2:172.21.15.158:3300/0 conn(0x7f70040c8100 msgr2=0x7f7004154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7f7001d9b700 1 --2- 172.21.15.124:0/1913361161 >> v2:172.21.15.158:3300/0 conn(0x7f70040c8100 0x7f7004154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7f7001d9b700 1 -- 172.21.15.124:0/1913361161 >> v1:172.21.15.124:6789/0 conn(0x7f70040c84d0 legacy=0x7f7004068fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7f7001d9b700 1 -- 172.21.15.124:0/1913361161 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70040c6be0 con 0x7f700406b440 2023-10-06T04:44:37.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7febc59ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febc00c2250 0x7febc00ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7febc59ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febc00cc7a0 0x7febc014b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7febc59ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7febc59ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc014c3f0 con 0x7febc00c2250 2023-10-06T04:44:37.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7febc59ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00983a0 con 0x7febc00cc7a0 2023-10-06T04:44:37.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.138+0000 7febc59ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc0099950 con 0x7febc013bd20 2023-10-06T04:44:37.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7febbf7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7febbf7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc014b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:32924/0 (socket says 172.21.15.124:32924) 2023-10-06T04:44:37.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7febbf7fe700 1 -- 172.21.15.124:0/1003560695 learned_addr learned my addr 172.21.15.124:0/1003560695 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7febbeffd700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febc00c2250 0x7febc00ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7febbe7fc700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febc00cc7a0 0x7febc014b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7ff496bff700 1 -- 172.21.15.124:0/4060301949 shutdown_connections 2023-10-06T04:44:37.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7ff496bff700 1 -- 172.21.15.124:0/4060301949 wait complete. 2023-10-06T04:44:37.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7f7001d9b700 1 --2- 172.21.15.124:0/1913361161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700406b440 0x7f70041554e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6ff40098e0 tx=0x7f6ff40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc45aa9c128fa57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7f700159a700 1 -- 172.21.15.124:0/1913361161 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400b640 con 0x7f700406b440 2023-10-06T04:44:37.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7f700159a700 1 -- 172.21.15.124:0/1913361161 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff400b7a0 con 0x7f700406b440 2023-10-06T04:44:37.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.139+0000 7f700159a700 1 -- 172.21.15.124:0/1913361161 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400bb40 con 0x7f700406b440 2023-10-06T04:44:37.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7f7faabff700 1 -- 172.21.15.124:0/1757571035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fa40b3d30 msgr2=0x7f7fa415a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7f7faabff700 1 --2- 172.21.15.124:0/1757571035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fa40b3d30 0x7f7fa415a580 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40af780 tx=0x7f7f940091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7febbf7fe700 1 -- 172.21.15.124:0/1003560695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febc00cc7a0 msgr2=0x7febc014b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7febbf7fe700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febc00cc7a0 0x7febc014b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7febbf7fe700 1 -- 172.21.15.124:0/1003560695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febc00c2250 msgr2=0x7febc00ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7febbf7fe700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febc00c2250 0x7febc00ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7febbf7fe700 1 -- 172.21.15.124:0/1003560695 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb00094f0 con 0x7febc013bd20 2023-10-06T04:44:37.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7fbc363ff700 1 Processor -- start 2023-10-06T04:44:37.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7f7faabff700 1 -- 172.21.15.124:0/1757571035 shutdown_connections 2023-10-06T04:44:37.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7f7faabff700 1 --2- 172.21.15.124:0/1757571035 >> v2:172.21.15.124:3300/0 conn(0x7f7fa40b1ea0 0x7f7fa40b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7f7faabff700 1 --2- 172.21.15.124:0/1757571035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fa40b3d30 0x7f7fa415a580 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7f7faabff700 1 -- 172.21.15.124:0/1757571035 >> 172.21.15.124:0/1757571035 conn(0x7f7fa406ed20 msgr2=0x7f7fa406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.141+0000 7f7c4bfff700 1 -- 172.21.15.124:0/599890273 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c58052c10 con 0x7f7c64161be0 2023-10-06T04:44:37.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.141+0000 7febbf7fe700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc014b590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7febb8007f50 tx=0x7febb8009860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.141+0000 7ff496bff700 1 Processor -- start 2023-10-06T04:44:37.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7f7008dff700 1 -- 172.21.15.124:0/1913361161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700406b440 msgr2=0x7f70041554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.140+0000 7f7008dff700 1 --2- 172.21.15.124:0/1913361161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700406b440 0x7f70041554e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6ff40098e0 tx=0x7f6ff40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.141+0000 7fbc363ff700 1 -- start start 2023-10-06T04:44:37.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7fbc363ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbc300cbbf0 0x7fbc300c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7fbc363ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbc30161be0 0x7fbc300c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7fbc363ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3006b070 con 0x7fbc30161810 2023-10-06T04:44:37.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7fbc363ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc300c8240 con 0x7fbc30161be0 2023-10-06T04:44:37.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7fbc363ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc300a97b0 con 0x7fbc300cbbf0 2023-10-06T04:44:37.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7f7faabff700 1 -- 172.21.15.124:0/1757571035 shutdown_connections 2023-10-06T04:44:37.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.142+0000 7ff496bff700 1 -- start start 2023-10-06T04:44:37.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7ff496bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff490068e90 0x7ff490099260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7ff496bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4900a9bb0 0x7ff4900b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7ff496bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4900cb920 0x7ff4900c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7ff496bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff490098dd0 con 0x7ff4900a9bb0 2023-10-06T04:44:37.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7ff496bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff490097f00 con 0x7ff4900cb920 2023-10-06T04:44:37.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7ff496bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900981c0 con 0x7ff490068e90 2023-10-06T04:44:37.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7fbc2ffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fbc30161810 0x7fbc300cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:55226/0 (socket says 172.21.15.124:55226) 2023-10-06T04:44:37.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7fbc2ffff700 1 -- 172.21.15.124:0/269132918 learned_addr learned my addr 172.21.15.124:0/269132918 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:37.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7f7008dff700 1 -- 172.21.15.124:0/1913361161 shutdown_connections 2023-10-06T04:44:37.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7f7008dff700 1 --2- 172.21.15.124:0/1913361161 >> v2:172.21.15.158:3300/0 conn(0x7f70040c8100 0x7f7004154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7f7008dff700 1 --2- 172.21.15.124:0/1913361161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700406b440 0x7f70041554e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7f7008dff700 1 -- 172.21.15.124:0/1913361161 >> 172.21.15.124:0/1913361161 conn(0x7f70040cc080 msgr2=0x7f70040cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7ff49519c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4900cb920 0x7ff4900c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7ff49519c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4900cb920 0x7ff4900c3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38486/0 (socket says 172.21.15.124:38486) 2023-10-06T04:44:37.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7ff49519c700 1 -- 172.21.15.124:0/678610211 learned_addr learned my addr 172.21.15.124:0/678610211 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7ff49499b700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff490068e90 0x7ff490099260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7ff49519c700 1 -- 172.21.15.124:0/678610211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff490068e90 msgr2=0x7ff490099260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7ff49519c700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff490068e90 0x7ff490099260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7ff49519c700 1 -- 172.21.15.124:0/678610211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4900a9bb0 msgr2=0x7ff4900b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7ff49519c700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4900a9bb0 0x7ff4900b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7ff49519c700 1 -- 172.21.15.124:0/678610211 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880094f0 con 0x7ff4900cb920 2023-10-06T04:44:37.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.144+0000 7fbc3499c700 1 --2- 172.21.15.124:0/269132918 >> v2:172.21.15.124:3300/0 conn(0x7fbc30161be0 0x7fbc300c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.143+0000 7f7faabff700 1 -- 172.21.15.124:0/1757571035 wait complete. 2023-10-06T04:44:37.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7f7faabff700 1 Processor -- start 2023-10-06T04:44:37.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.145+0000 7fbc2f7fe700 1 --2- 172.21.15.124:0/269132918 >> v2:172.21.15.158:3300/0 conn(0x7fbc300cbbf0 0x7fbc300c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.145+0000 7fbc2effd700 1 -- 172.21.15.124:0/269132918 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742327102 0 0) 0x7fbc3006b070 con 0x7fbc30161810 2023-10-06T04:44:37.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.145+0000 7fbc2effd700 1 -- 172.21.15.124:0/269132918 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc18003570 con 0x7fbc30161810 2023-10-06T04:44:37.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7f7faabff700 1 -- start start 2023-10-06T04:44:37.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.145+0000 7f7008dff700 1 -- 172.21.15.124:0/1913361161 shutdown_connections 2023-10-06T04:44:37.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.145+0000 7f7008dff700 1 -- 172.21.15.124:0/1913361161 wait complete. 2023-10-06T04:44:37.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7fbc2f7fe700 1 -- 172.21.15.124:0/269132918 >> v2:172.21.15.124:3300/0 conn(0x7fbc30161be0 msgr2=0x7fbc300c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7fbc2f7fe700 1 --2- 172.21.15.124:0/269132918 >> v2:172.21.15.124:3300/0 conn(0x7fbc30161be0 0x7fbc300c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7fbc2f7fe700 1 -- 172.21.15.124:0/269132918 >> v1:172.21.15.158:6789/0 conn(0x7fbc30161810 legacy=0x7fbc300cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7fbc2f7fe700 1 -- 172.21.15.124:0/269132918 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc300a8e80 con 0x7fbc300cbbf0 2023-10-06T04:44:37.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7fbc2f7fe700 1 --2- 172.21.15.124:0/269132918 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc300cbbf0 0x7fbc300c66c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009e60 tx=0x7fbc28009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dd0a291818338b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7ff49519c700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4900cb920 0x7ff4900c3f60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff490063d00 tx=0x7ff488017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7ff48cff9700 1 -- 172.21.15.124:0/678610211 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48800baa0 con 0x7ff4900cb920 2023-10-06T04:44:37.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7ff48cff9700 1 -- 172.21.15.124:0/678610211 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff488025420 con 0x7ff4900cb920 2023-10-06T04:44:37.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.146+0000 7ff48cff9700 1 -- 172.21.15.124:0/678610211 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880257e0 con 0x7ff4900cb920 2023-10-06T04:44:37.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.147+0000 7ff496bff700 1 -- 172.21.15.124:0/678610211 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4900984a0 con 0x7ff4900cb920 2023-10-06T04:44:37.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.147+0000 7ff496bff700 1 -- 172.21.15.124:0/678610211 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff490098a60 con 0x7ff4900cb920 2023-10-06T04:44:37.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.147+0000 7f7faabff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7fa40b1ea0 0x7f7fa4150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.147+0000 7f7faabff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fa40b3d30 0x7f7fa4179f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.147+0000 7f7faabff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7fa41594b0 0x7f7fa417a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.147+0000 7f7faabff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa414e340 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.147+0000 7f7faabff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40ce930 con 0x7f7fa40b3d30 2023-10-06T04:44:37.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.147+0000 7f7faabff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa414e520 con 0x7f7fa41594b0 2023-10-06T04:44:37.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.142+0000 7feba6ffd700 1 -- 172.21.15.124:0/1003560695 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800ecd0 con 0x7febc013bd20 2023-10-06T04:44:37.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.142+0000 7feba6ffd700 1 -- 172.21.15.124:0/1003560695 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb800ee50 con 0x7febc013bd20 2023-10-06T04:44:37.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.142+0000 7feba6ffd700 1 -- 172.21.15.124:0/1003560695 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8014670 con 0x7febc013bd20 2023-10-06T04:44:37.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.142+0000 7febc59ff700 1 -- 172.21.15.124:0/1003560695 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc014bad0 con 0x7febc013bd20 2023-10-06T04:44:37.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.142+0000 7febc59ff700 1 -- 172.21.15.124:0/1003560695 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc014bda0 con 0x7febc013bd20 2023-10-06T04:44:37.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.145+0000 7febc59ff700 1 -- 172.21.15.124:0/1003560695 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba00052b0 con 0x7febc013bd20 2023-10-06T04:44:37.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.148+0000 7f7fa899b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7fa40b1ea0 0x7f7fa4150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.148+0000 7f7fa899b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7fa40b1ea0 0x7f7fa4150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40682/0 (socket says 172.21.15.124:40682) 2023-10-06T04:44:37.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.148+0000 7f7fa899b700 1 -- 172.21.15.124:0/1868685466 learned_addr learned my addr 172.21.15.124:0/1868685466 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.148+0000 7fbc2effd700 1 -- 172.21.15.124:0/269132918 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2800e070 con 0x7fbc300cbbf0 2023-10-06T04:44:37.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.148+0000 7fbc2effd700 1 -- 172.21.15.124:0/269132918 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2800bb20 con 0x7fbc300cbbf0 2023-10-06T04:44:37.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.148+0000 7fbc2effd700 1 -- 172.21.15.124:0/269132918 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28012430 con 0x7fbc300cbbf0 2023-10-06T04:44:37.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.148+0000 7f7fa919c700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7fa41594b0 0x7f7fa417a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.149+0000 7f7fa899b700 1 -- 172.21.15.124:0/1868685466 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7fa41594b0 msgr2=0x7f7fa417a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.149+0000 7f7fa899b700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7fa41594b0 0x7f7fa417a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.149+0000 7fbc363ff700 1 -- 172.21.15.124:0/269132918 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc300cbbf0 msgr2=0x7fbc300c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.149+0000 7fbc363ff700 1 --2- 172.21.15.124:0/269132918 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc300cbbf0 0x7fbc300c66c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009e60 tx=0x7fbc28009780 comp rx=0 tx=0).stop 2023-10-06T04:44:37.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.149+0000 7f7fa899b700 1 -- 172.21.15.124:0/1868685466 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fa40b3d30 msgr2=0x7f7fa4179f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.149+0000 7f7fa899b700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fa40b3d30 0x7f7fa4179f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.149+0000 7f7fa899b700 1 -- 172.21.15.124:0/1868685466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f94009420 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.149+0000 7f7fa899b700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7fa40b1ea0 0x7f7fa4150150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00cc70 tx=0x7f7f9c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.148+0000 7f7008dff700 1 Processor -- start 2023-10-06T04:44:37.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.148+0000 7f7008dff700 1 -- start start 2023-10-06T04:44:37.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.150+0000 7f7008dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f700406b440 0x7f70040a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.150+0000 7f7008dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70040c8100 0x7f7004154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.150+0000 7f7008dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70040c84d0 0x7f700417a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.150+0000 7f7008dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70040b0e30 con 0x7f700406b440 2023-10-06T04:44:37.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.150+0000 7f7008dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70040aa380 con 0x7f70040c84d0 2023-10-06T04:44:37.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.150+0000 7f7008dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70040a9770 con 0x7f70040c8100 2023-10-06T04:44:37.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.150+0000 7f7001d9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70040c8100 0x7f7004154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.150+0000 7f7001d9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70040c8100 0x7f7004154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:32952/0 (socket says 172.21.15.124:32952) 2023-10-06T04:44:37.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.150+0000 7f7001d9b700 1 -- 172.21.15.124:0/1989004025 learned_addr learned my addr 172.21.15.124:0/1989004025 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7fbc363ff700 1 -- 172.21.15.124:0/269132918 shutdown_connections 2023-10-06T04:44:37.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7fbc363ff700 1 --2- 172.21.15.124:0/269132918 >> v2:172.21.15.124:3300/0 conn(0x7fbc30161be0 0x7fbc300c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7fbc363ff700 1 --2- 172.21.15.124:0/269132918 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc300cbbf0 0x7fbc300c66c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7fbc363ff700 1 -- 172.21.15.124:0/269132918 >> 172.21.15.124:0/269132918 conn(0x7fbc300cc080 msgr2=0x7fbc300cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7f700259c700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f700406b440 0x7f70040a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7f7002d9d700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70040c84d0 0x7f700417a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7f7fa0ff9700 1 -- 172.21.15.124:0/1868685466 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00ce80 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7f7fa0ff9700 1 -- 172.21.15.124:0/1868685466 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c00ab70 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7f7fa0ff9700 1 -- 172.21.15.124:0/1868685466 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0070f0 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7f7faabff700 1 -- 172.21.15.124:0/1868685466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa414e800 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7f7faabff700 1 -- 172.21.15.124:0/1868685466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa40ceed0 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.153+0000 7f7faabff700 1 -- 172.21.15.124:0/1868685466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa40cf0c0 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7feba6ffd700 1 -- 172.21.15.124:0/1003560695 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febb80149e0 con 0x7febc013bd20 2023-10-06T04:44:37.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.152+0000 7feba6ffd700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7febac067080 0x7febac069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.153+0000 7feba6ffd700 1 -- 172.21.15.124:0/1003560695 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7febb8085cf0 con 0x7febc013bd20 2023-10-06T04:44:37.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.153+0000 7febbeffd700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7febac067080 0x7febac069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7ff496bff700 1 -- 172.21.15.124:0/678610211 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff490098f40 con 0x7ff4900cb920 2023-10-06T04:44:37.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.151+0000 7ff48cff9700 1 -- 172.21.15.124:0/678610211 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff488023070 con 0x7ff4900cb920 2023-10-06T04:44:37.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.153+0000 7ff48cff9700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff470067080 0x7ff470069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.153+0000 7ff48cff9700 1 -- 172.21.15.124:0/678610211 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff488085d00 con 0x7ff4900cb920 2023-10-06T04:44:37.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.153+0000 7ff49499b700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff470067080 0x7ff470069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.152+0000 7f700259c700 1 -- 172.21.15.124:0/1989004025 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70040c8100 msgr2=0x7f7004154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.152+0000 7f700259c700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70040c8100 0x7f7004154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.152+0000 7f700259c700 1 -- 172.21.15.124:0/1989004025 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70040c84d0 msgr2=0x7f700417a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.152+0000 7f700259c700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70040c84d0 0x7f700417a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.152+0000 7f700259c700 1 -- 172.21.15.124:0/1989004025 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff4009420 con 0x7f700406b440 2023-10-06T04:44:37.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.152+0000 7f700259c700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f700406b440 0x7f70040a8f40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800ea50 tx=0x7f6ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.154+0000 7ff49499b700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff470067080 0x7ff470069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff480007fd0 tx=0x7ff480009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.155+0000 7feba6ffd700 1 -- 172.21.15.124:0/1003560695 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febb8052e60 con 0x7febc013bd20 2023-10-06T04:44:37.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.154+0000 7f9a5bbff700 1 Processor -- start 2023-10-06T04:44:37.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.155+0000 7f9a5bbff700 1 -- start start 2023-10-06T04:44:37.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.154+0000 7f6ff27fc700 1 -- 172.21.15.124:0/1989004025 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800ee90 con 0x7f700406b440 2023-10-06T04:44:37.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.154+0000 7f6ff27fc700 1 -- 172.21.15.124:0/1989004025 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff800c7f0 con 0x7f700406b440 2023-10-06T04:44:37.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.154+0000 7f6ff27fc700 1 -- 172.21.15.124:0/1989004025 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800cbb0 con 0x7f700406b440 2023-10-06T04:44:37.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.154+0000 7f7008dff700 1 -- 172.21.15.124:0/1989004025 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70040a9a50 con 0x7f700406b440 2023-10-06T04:44:37.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.155+0000 7f7008dff700 1 -- 172.21.15.124:0/1989004025 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70040aa010 con 0x7f700406b440 2023-10-06T04:44:37.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.156+0000 7fbc363ff700 1 -- 172.21.15.124:0/269132918 shutdown_connections 2023-10-06T04:44:37.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.156+0000 7f7fa0ff9700 1 -- 172.21.15.124:0/1868685466 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f9c007520 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.157+0000 7febbeffd700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7febac067080 0x7febac069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7febb4009d40 tx=0x7febb4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.157+0000 7f9a5bbff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9a540c8100 0x7f9a54154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.157+0000 7f9a5bbff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9a540c84d0 0x7f9a541554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.157+0000 7f9a5bbff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a540c6970 con 0x7f9a54068fe0 2023-10-06T04:44:37.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.157+0000 7f9a5bbff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a540c79a0 con 0x7f9a540c84d0 2023-10-06T04:44:37.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.157+0000 7f9a5bbff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a540c6be0 con 0x7f9a540c8100 2023-10-06T04:44:37.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.158+0000 7ff48cff9700 1 -- 172.21.15.124:0/678610211 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff488052d70 con 0x7ff4900cb920 2023-10-06T04:44:37.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.157+0000 7fbc363ff700 1 -- 172.21.15.124:0/269132918 wait complete. 2023-10-06T04:44:37.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.159+0000 7fbc363ff700 1 Processor -- start 2023-10-06T04:44:37.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7f7008dff700 1 -- 172.21.15.124:0/1989004025 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70040717a0 con 0x7f700406b440 2023-10-06T04:44:37.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.160+0000 7fbc363ff700 1 -- start start 2023-10-06T04:44:37.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7fbc363ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc300cbbf0 0x7fbc300c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7fbc363ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc30161810 0x7fbc30098990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7fbc363ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc30161be0 0x7fbc30098ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7fbc363ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc30099410 con 0x7fbc30161810 2023-10-06T04:44:37.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7fbc363ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301474b0 con 0x7fbc300cbbf0 2023-10-06T04:44:37.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7fbc363ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc30149d20 con 0x7fbc30161be0 2023-10-06T04:44:37.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7fbc2ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc300cbbf0 0x7fbc300c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7fbc2f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc30161810 0x7fbc30098990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7fbc2ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc300cbbf0 0x7fbc300c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38512/0 (socket says 172.21.15.124:38512) 2023-10-06T04:44:37.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7fbc2ffff700 1 -- 172.21.15.124:0/3340839639 learned_addr learned my addr 172.21.15.124:0/3340839639 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7fbc3499c700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc30161be0 0x7fbc30098ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7fbc2f7fe700 1 -- 172.21.15.124:0/3340839639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc30161be0 msgr2=0x7fbc30098ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7fbc2f7fe700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc30161be0 0x7fbc30098ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7fbc2f7fe700 1 -- 172.21.15.124:0/3340839639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc300cbbf0 msgr2=0x7fbc300c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7fbc2f7fe700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc300cbbf0 0x7fbc300c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.162+0000 7fbc2f7fe700 1 -- 172.21.15.124:0/3340839639 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc28009a20 con 0x7fbc30161810 2023-10-06T04:44:37.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.163+0000 7fbc2f7fe700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc30161810 0x7fbc30098990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbc28016000 tx=0x7fbc28019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.158+0000 7f9a5999b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9a540c8100 0x7f9a54154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.158+0000 7f9a5999b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9a540c8100 0x7f9a54154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38510/0 (socket says 172.21.15.124:38510) 2023-10-06T04:44:37.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.158+0000 7f9a5999b700 1 -- 172.21.15.124:0/3143956031 learned_addr learned my addr 172.21.15.124:0/3143956031 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.159+0000 7f9a5999b700 1 -- 172.21.15.124:0/3143956031 >> v2:172.21.15.124:3300/0 conn(0x7f9a540c84d0 msgr2=0x7f9a541554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.159+0000 7f9a5999b700 1 --2- 172.21.15.124:0/3143956031 >> v2:172.21.15.124:3300/0 conn(0x7f9a540c84d0 0x7f9a541554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.159+0000 7f9a5999b700 1 -- 172.21.15.124:0/3143956031 >> v1:172.21.15.158:6789/0 conn(0x7f9a54068fe0 legacy=0x7f9a54069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.159+0000 7f9a5999b700 1 -- 172.21.15.124:0/3143956031 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a540c6ec0 con 0x7f9a540c8100 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.159+0000 7f9a5999b700 1 --2- 172.21.15.124:0/3143956031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a540c8100 0x7f9a54154fa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a5406cac0 tx=0x7f9a48009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b2cd579ac353bec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.160+0000 7f9a58999700 1 -- 172.21.15.124:0/3143956031 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4800e070 con 0x7f9a540c8100 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.160+0000 7f9a58999700 1 -- 172.21.15.124:0/3143956031 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4800b950 con 0x7f9a540c8100 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.160+0000 7f9a58999700 1 -- 172.21.15.124:0/3143956031 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a480092e0 con 0x7f9a540c8100 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3143956031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a540c8100 msgr2=0x7f9a54154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7f9a5bbff700 1 --2- 172.21.15.124:0/3143956031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a540c8100 0x7f9a54154fa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a5406cac0 tx=0x7f9a48009840 comp rx=0 tx=0).stop 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3143956031 shutdown_connections 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7f9a5bbff700 1 --2- 172.21.15.124:0/3143956031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a540c8100 0x7f9a54154fa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7f9a5bbff700 1 --2- 172.21.15.124:0/3143956031 >> v2:172.21.15.124:3300/0 conn(0x7f9a540c84d0 0x7f9a541554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3143956031 >> 172.21.15.124:0/3143956031 conn(0x7f9a540cc080 msgr2=0x7f9a540cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.163+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3143956031 shutdown_connections 2023-10-06T04:44:37.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.163+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3143956031 wait complete. 2023-10-06T04:44:37.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.157+0000 7f7fa0ff9700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f90067080 0x7f7f90069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.157+0000 7f7fa0ff9700 1 -- 172.21.15.124:0/1868685466 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7f9c084930 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.160+0000 7f7fa3fff700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f90067080 0x7f7f90069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.161+0000 7f7fa3fff700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f90067080 0x7f7f90069530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40d0680 tx=0x7f7f94017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.165+0000 7f7fa0ff9700 1 -- 172.21.15.124:0/1868685466 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f9c051b60 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.165+0000 7fbc17fff700 1 -- 172.21.15.124:0/3340839639 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28012cb0 con 0x7fbc30161810 2023-10-06T04:44:37.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.166+0000 7fbc17fff700 1 -- 172.21.15.124:0/3340839639 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28012e10 con 0x7fbc30161810 2023-10-06T04:44:37.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.166+0000 7fbc17fff700 1 -- 172.21.15.124:0/3340839639 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280276c0 con 0x7fbc30161810 2023-10-06T04:44:37.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.166+0000 7fbc363ff700 1 -- 172.21.15.124:0/3340839639 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3014a000 con 0x7fbc30161810 2023-10-06T04:44:37.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.166+0000 7fbc363ff700 1 -- 172.21.15.124:0/3340839639 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3014a5c0 con 0x7fbc30161810 2023-10-06T04:44:37.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.170+0000 7fbc363ff700 1 -- 172.21.15.124:0/3340839639 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc100052b0 con 0x7fbc30161810 2023-10-06T04:44:37.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.166+0000 7f9a5bbff700 1 Processor -- start 2023-10-06T04:44:37.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.168+0000 7f9a5bbff700 1 -- start start 2023-10-06T04:44:37.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.169+0000 7f9a5bbff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a54068fe0 0x7f9a5416e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.169+0000 7f9a5bbff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9a540c8100 0x7f9a540adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.169+0000 7f9a5bbff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a540c84d0 0x7f9a5414be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.169+0000 7f9a5bbff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a54147c30 con 0x7f9a540c8100 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.169+0000 7f9a5bbff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a54154450 con 0x7f9a54068fe0 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.169+0000 7f9a5bbff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540ac1f0 con 0x7f9a540c84d0 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.170+0000 7f9a5999b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a54068fe0 0x7f9a5416e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.170+0000 7f9a5999b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a54068fe0 0x7f9a5416e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:38514/0 (socket says 172.21.15.124:38514) 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.170+0000 7f9a5999b700 1 -- 172.21.15.124:0/3754556450 learned_addr learned my addr 172.21.15.124:0/3754556450 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.170+0000 7f9a5a19c700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a540c84d0 0x7f9a5414be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.170+0000 7f9a5919a700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9a540c8100 0x7f9a540adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.171+0000 7f9a5a19c700 1 -- 172.21.15.124:0/3754556450 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a54068fe0 msgr2=0x7f9a5416e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.171+0000 7f9a5a19c700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a54068fe0 0x7f9a5416e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.171+0000 7f9a5a19c700 1 -- 172.21.15.124:0/3754556450 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9a540c8100 msgr2=0x7f9a540adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.171+0000 7f9a5a19c700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9a540c8100 0x7f9a540adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.171+0000 7f9a5a19c700 1 -- 172.21.15.124:0/3754556450 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a48009ae0 con 0x7f9a540c84d0 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.172+0000 7f9a5a19c700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a540c84d0 0x7f9a5414be60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00c600 tx=0x7f9a4c007da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.172+0000 7f9a51ffb700 1 -- 172.21.15.124:0/3754556450 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c011590 con 0x7f9a540c84d0 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.172+0000 7f9a51ffb700 1 -- 172.21.15.124:0/3754556450 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c0116f0 con 0x7f9a540c84d0 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.172+0000 7f9a51ffb700 1 -- 172.21.15.124:0/3754556450 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c011ab0 con 0x7f9a540c84d0 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.172+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3754556450 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a540b07f0 con 0x7f9a540c84d0 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.173+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3754556450 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a540ae590 con 0x7f9a540c84d0 2023-10-06T04:44:37.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.174+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3754556450 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a540b05c0 con 0x7f9a540c84d0 2023-10-06T04:44:37.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.176+0000 7fbc17fff700 1 -- 172.21.15.124:0/3340839639 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc28024070 con 0x7fbc30161810 2023-10-06T04:44:37.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.179+0000 7f9a51ffb700 1 -- 172.21.15.124:0/3754556450 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a4c01b3b0 con 0x7f9a540c84d0 2023-10-06T04:44:37.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.180+0000 7f9a51ffb700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9a38067080 0x7f9a38069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.180+0000 7f9a51ffb700 1 -- 172.21.15.124:0/3754556450 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a4c083b80 con 0x7f9a540c84d0 2023-10-06T04:44:37.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.181+0000 7f9a5999b700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9a38067080 0x7f9a38069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.178+0000 7fbc17fff700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbc1c067080 0x7fbc1c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.178+0000 7fbc17fff700 1 -- 172.21.15.124:0/3340839639 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbc28087150 con 0x7fbc30161810 2023-10-06T04:44:37.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.182+0000 7fbc2ffff700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbc1c067080 0x7fbc1c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.183+0000 7fbc2ffff700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbc1c067080 0x7fbc1c069530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbc30150ca0 tx=0x7fbc24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.182+0000 7f9a51ffb700 1 -- 172.21.15.124:0/3754556450 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a540b05c0 con 0x7f9a540c84d0 2023-10-06T04:44:37.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.184+0000 7f9a5999b700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9a38067080 0x7f9a38069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a54157910 tx=0x7f9a48017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.185+0000 7fbc17fff700 1 -- 172.21.15.124:0/3340839639 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc280542c0 con 0x7fbc30161810 2023-10-06T04:44:37.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.174+0000 7f6ff27fc700 1 -- 172.21.15.124:0/1989004025 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ff8013470 con 0x7f700406b440 2023-10-06T04:44:37.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.176+0000 7f6ff27fc700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6fe4067080 0x7f6fe4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.176+0000 7f6ff27fc700 1 -- 172.21.15.124:0/1989004025 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ff8084fd0 con 0x7f700406b440 2023-10-06T04:44:37.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.176+0000 7f6ff27fc700 1 -- 172.21.15.124:0/1989004025 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ff8085460 con 0x7f700406b440 2023-10-06T04:44:37.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.182+0000 7f7001d9b700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6fe4067080 0x7f6fe4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.183+0000 7f7001d9b700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6fe4067080 0x7f6fe4069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70040aaca0 tx=0x7f6ff4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.497+0000 7f62d4fff700 1 -- 172.21.15.124:0/4120861107 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62d00717a0 con 0x7f62d00695a0 2023-10-06T04:44:37.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.498+0000 7f62be7fc700 1 -- 172.21.15.124:0/4120861107 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62c0024380 con 0x7f62d00695a0 2023-10-06T04:44:37.504 INFO:teuthology.orchestra.run.smithi124.stdout:60129542152 2023-10-06T04:44:37.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.502+0000 7f62d4fff700 1 -- 172.21.15.124:0/4120861107 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f62b0067080 msgr2=0x7f62b0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.502+0000 7f62d4fff700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f62b0067080 0x7f62b0069530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f62c40078a0 tx=0x7f62c4007830 comp rx=0 tx=0).stop 2023-10-06T04:44:37.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.502+0000 7f62d4fff700 1 -- 172.21.15.124:0/4120861107 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62d00695a0 msgr2=0x7f62d0097ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.502+0000 7f62d4fff700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62d00695a0 0x7f62d0097ba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f62d0129430 tx=0x7f62c0017000 comp rx=0 tx=0).stop 2023-10-06T04:44:37.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.503+0000 7f62d4fff700 1 -- 172.21.15.124:0/4120861107 shutdown_connections 2023-10-06T04:44:37.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.503+0000 7f62d4fff700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62d00cb920 0x7f62d00c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.503+0000 7f62d4fff700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f62b0067080 0x7f62b0069530 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.503+0000 7f62d4fff700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62d00695a0 0x7f62d0097ba0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.503+0000 7f62d4fff700 1 --2- 172.21.15.124:0/4120861107 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62d00c7b20 0x7f62d00c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.503+0000 7f62d4fff700 1 -- 172.21.15.124:0/4120861107 >> 172.21.15.124:0/4120861107 conn(0x7f62d00cc080 msgr2=0x7f62d014fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.504+0000 7f62d4fff700 1 -- 172.21.15.124:0/4120861107 shutdown_connections 2023-10-06T04:44:37.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.504+0000 7f62d4fff700 1 -- 172.21.15.124:0/4120861107 wait complete. 2023-10-06T04:44:37.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2023-10-06T04:44:37.536 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:37.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.550+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/599890273 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7c640717a0 con 0x7f7c64161be0 2023-10-06T04:44:37.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.550+0000 7f7c4bfff700 1 -- 172.21.15.124:0/599890273 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c58015070 con 0x7f7c64161be0 2023-10-06T04:44:37.553 INFO:teuthology.orchestra.run.smithi124.stdout:60129542149 2023-10-06T04:44:37.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.553+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/599890273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c50067030 msgr2=0x7f7c500694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.553+0000 7f7c6a3ff700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c50067030 0x7f7c500694e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009c00 tx=0x7f7c540091d0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.553+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/599890273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c64161be0 msgr2=0x7f7c640b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.553+0000 7f7c6a3ff700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c64161be0 0x7f7c640b02c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c6406b800 tx=0x7f7c58017000 comp rx=0 tx=0).stop 2023-10-06T04:44:37.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.553+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/599890273 shutdown_connections 2023-10-06T04:44:37.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.553+0000 7f7c6a3ff700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c64161be0 0x7f7c640b02c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.553+0000 7f7c6a3ff700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c640a9c40 0x7f7c6413d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.553+0000 7f7c6a3ff700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c50067030 0x7f7c500694e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.553+0000 7f7c6a3ff700 1 --2- 172.21.15.124:0/599890273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c64161810 0x7f7c640afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.553+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/599890273 >> 172.21.15.124:0/599890273 conn(0x7f7c640cc080 msgr2=0x7f7c6406d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.554+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/599890273 shutdown_connections 2023-10-06T04:44:37.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.554+0000 7f7c6a3ff700 1 -- 172.21.15.124:0/599890273 wait complete. 2023-10-06T04:44:37.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2023-10-06T04:44:37.574 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:37.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.601+0000 7ff496bff700 1 -- 172.21.15.124:0/678610211 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff4900717a0 con 0x7ff4900cb920 2023-10-06T04:44:37.604 INFO:teuthology.orchestra.run.smithi124.stdout:60129542150 2023-10-06T04:44:37.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.602+0000 7ff48cff9700 1 -- 172.21.15.124:0/678610211 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff488015090 con 0x7ff4900cb920 2023-10-06T04:44:37.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.604+0000 7febc59ff700 1 -- 172.21.15.124:0/1003560695 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feba0005830 con 0x7febc013bd20 2023-10-06T04:44:37.607 INFO:teuthology.orchestra.run.smithi124.stdout:60129542150 2023-10-06T04:44:37.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.604+0000 7feba6ffd700 1 -- 172.21.15.124:0/1003560695 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7febb8056480 con 0x7febc013bd20 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.605+0000 7ff496bff700 1 -- 172.21.15.124:0/678610211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff470067080 msgr2=0x7ff470069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.605+0000 7ff496bff700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff470067080 0x7ff470069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff480007fd0 tx=0x7ff480009040 comp rx=0 tx=0).stop 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.605+0000 7ff496bff700 1 -- 172.21.15.124:0/678610211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4900cb920 msgr2=0x7ff4900c3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.605+0000 7ff496bff700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4900cb920 0x7ff4900c3f60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff490063d00 tx=0x7ff488017000 comp rx=0 tx=0).stop 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.605+0000 7ff496bff700 1 -- 172.21.15.124:0/678610211 shutdown_connections 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.605+0000 7ff496bff700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4900cb920 0x7ff4900c3f60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.605+0000 7ff496bff700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff470067080 0x7ff470069530 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.605+0000 7ff496bff700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff490068e90 0x7ff490099260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.605+0000 7ff496bff700 1 --2- 172.21.15.124:0/678610211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4900a9bb0 0x7ff4900b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.605+0000 7ff496bff700 1 -- 172.21.15.124:0/678610211 >> 172.21.15.124:0/678610211 conn(0x7ff4900cc080 msgr2=0x7ff49015c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.606+0000 7ff496bff700 1 -- 172.21.15.124:0/678610211 shutdown_connections 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.606+0000 7ff496bff700 1 -- 172.21.15.124:0/678610211 wait complete. 2023-10-06T04:44:37.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.607+0000 7f7faabff700 1 -- 172.21.15.124:0/1868685466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7fa40717a0 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 -- 172.21.15.124:0/1003560695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7febac067080 msgr2=0x7febac069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7febac067080 0x7febac069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7febb4009d40 tx=0x7febb4008040 comp rx=0 tx=0).stop 2023-10-06T04:44:37.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 -- 172.21.15.124:0/1003560695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 msgr2=0x7febc014b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc014b590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7febb8007f50 tx=0x7febb8009860 comp rx=0 tx=0).stop 2023-10-06T04:44:37.612 INFO:teuthology.orchestra.run.smithi124.stdout:60129542150 2023-10-06T04:44:37.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7f7fa0ff9700 1 -- 172.21.15.124:0/1868685466 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f9c055180 con 0x7f7fa40b1ea0 2023-10-06T04:44:37.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 -- 172.21.15.124:0/1003560695 shutdown_connections 2023-10-06T04:44:37.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7febac067080 0x7febac069530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febc013bd20 0x7febc014b590 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febc00c2250 0x7febc00ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 --2- 172.21.15.124:0/1003560695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febc00cc7a0 0x7febc014b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 -- 172.21.15.124:0/1003560695 >> 172.21.15.124:0/1003560695 conn(0x7febc00680c0 msgr2=0x7febc006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 -- 172.21.15.124:0/1003560695 shutdown_connections 2023-10-06T04:44:37.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.608+0000 7febc59ff700 1 -- 172.21.15.124:0/1003560695 wait complete. 2023-10-06T04:44:37.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 -- 172.21.15.124:0/1868685466 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f90067080 msgr2=0x7f7f90069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f90067080 0x7f7f90069530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40d0680 tx=0x7f7f94017000 comp rx=0 tx=0).stop 2023-10-06T04:44:37.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 -- 172.21.15.124:0/1868685466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7fa40b1ea0 msgr2=0x7f7fa4150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7fa40b1ea0 0x7f7fa4150150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00cc70 tx=0x7f7f9c001a30 comp rx=0 tx=0).stop 2023-10-06T04:44:37.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 -- 172.21.15.124:0/1868685466 shutdown_connections 2023-10-06T04:44:37.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f90067080 0x7f7f90069530 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7fa41594b0 0x7f7fa417a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7fa40b1ea0 0x7f7fa4150150 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 --2- 172.21.15.124:0/1868685466 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fa40b3d30 0x7f7fa4179f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 -- 172.21.15.124:0/1868685466 >> 172.21.15.124:0/1868685466 conn(0x7f7fa406ed20 msgr2=0x7f7fa415f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 -- 172.21.15.124:0/1868685466 shutdown_connections 2023-10-06T04:44:37.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.612+0000 7f7faabff700 1 -- 172.21.15.124:0/1868685466 wait complete. 2023-10-06T04:44:37.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.620+0000 7f7008dff700 1 -- 172.21.15.124:0/1989004025 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f70040b1e50 con 0x7f700406b440 2023-10-06T04:44:37.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.620+0000 7f6ff27fc700 1 -- 172.21.15.124:0/1989004025 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ff8052140 con 0x7f700406b440 2023-10-06T04:44:37.623 INFO:teuthology.orchestra.run.smithi124.stdout:60129542149 2023-10-06T04:44:37.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.624+0000 7f7008dff700 1 -- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6fe4067080 msgr2=0x7f6fe4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.624+0000 7f7008dff700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6fe4067080 0x7f6fe4069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70040aaca0 tx=0x7f6ff4017000 comp rx=0 tx=0).stop 2023-10-06T04:44:37.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.624+0000 7f7008dff700 1 -- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f700406b440 msgr2=0x7f70040a8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.624+0000 7f7008dff700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f700406b440 0x7f70040a8f40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800ea50 tx=0x7f6ff80091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.625+0000 7f7008dff700 1 -- 172.21.15.124:0/1989004025 shutdown_connections 2023-10-06T04:44:37.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.625+0000 7f7008dff700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70040c84d0 0x7f700417a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.625+0000 7f7008dff700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f700406b440 0x7f70040a8f40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.625+0000 7f7008dff700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6fe4067080 0x7f6fe4069530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.625+0000 7f7008dff700 1 --2- 172.21.15.124:0/1989004025 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70040c8100 0x7f7004154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.625+0000 7f7008dff700 1 -- 172.21.15.124:0/1989004025 >> 172.21.15.124:0/1989004025 conn(0x7f70040cc080 msgr2=0x7f7004157030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.625+0000 7f7008dff700 1 -- 172.21.15.124:0/1989004025 shutdown_connections 2023-10-06T04:44:37.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.625+0000 7f7008dff700 1 -- 172.21.15.124:0/1989004025 wait complete. 2023-10-06T04:44:37.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2023-10-06T04:44:37.631 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:37.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2023-10-06T04:44:37.632 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:37.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.636+0000 7fbc363ff700 1 -- 172.21.15.124:0/3340839639 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbc10005830 con 0x7fbc30161810 2023-10-06T04:44:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.636+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3754556450 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9a540b05c0 con 0x7f9a540c84d0 2023-10-06T04:44:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.636+0000 7fbc17fff700 1 -- 172.21.15.124:0/3340839639 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc280578e0 con 0x7fbc30161810 2023-10-06T04:44:37.640 INFO:teuthology.orchestra.run.smithi124.stdout:60129542149 2023-10-06T04:44:37.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.637+0000 7f9a51ffb700 1 -- 172.21.15.124:0/3754556450 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a540b05c0 con 0x7f9a540c84d0 2023-10-06T04:44:37.641 INFO:teuthology.orchestra.run.smithi124.stdout:60129542149 2023-10-06T04:44:37.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2023-10-06T04:44:37.642 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:37.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.638+0000 7fbc363ff700 1 -- 172.21.15.124:0/3340839639 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbc1c067080 msgr2=0x7fbc1c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbc1c067080 0x7fbc1c069530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbc30150ca0 tx=0x7fbc24009040 comp rx=0 tx=0).stop 2023-10-06T04:44:37.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 -- 172.21.15.124:0/3340839639 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc30161810 msgr2=0x7fbc30098990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc30161810 0x7fbc30098990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbc28016000 tx=0x7fbc28019000 comp rx=0 tx=0).stop 2023-10-06T04:44:37.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 -- 172.21.15.124:0/3340839639 shutdown_connections 2023-10-06T04:44:37.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbc1c067080 0x7fbc1c069530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc30161be0 0x7fbc30098ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc300cbbf0 0x7fbc300c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 --2- 172.21.15.124:0/3340839639 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc30161810 0x7fbc30098990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 -- 172.21.15.124:0/3340839639 >> 172.21.15.124:0/3340839639 conn(0x7fbc300cc080 msgr2=0x7fbc3014d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 -- 172.21.15.124:0/3340839639 shutdown_connections 2023-10-06T04:44:37.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7fbc363ff700 1 -- 172.21.15.124:0/3340839639 wait complete. 2023-10-06T04:44:37.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3754556450 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9a38067080 msgr2=0x7f9a38069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9a38067080 0x7f9a38069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a54157910 tx=0x7f9a48017000 comp rx=0 tx=0).stop 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3754556450 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a540c84d0 msgr2=0x7f9a5414be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a540c84d0 0x7f9a5414be60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00c600 tx=0x7f9a4c007da0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3754556450 shutdown_connections 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9a38067080 0x7f9a38069530 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a540c84d0 0x7f9a5414be60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a54068fe0 0x7f9a5416e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 --2- 172.21.15.124:0/3754556450 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9a540c8100 0x7f9a540adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3754556450 >> 172.21.15.124:0/3754556450 conn(0x7f9a540cc080 msgr2=0x7f9a54157940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3754556450 shutdown_connections 2023-10-06T04:44:37.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.639+0000 7f9a5bbff700 1 -- 172.21.15.124:0/3754556450 wait complete. 2023-10-06T04:44:37.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2023-10-06T04:44:37.651 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:37.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2023-10-06T04:44:37.669 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:37.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2023-10-06T04:44:37.670 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:37.670 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:44:37.670 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:44:37.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.897+0000 7fd391bff700 1 Processor -- start 2023-10-06T04:44:37.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.897+0000 7fd391bff700 1 -- start start 2023-10-06T04:44:37.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.898+0000 7fd391bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd38c0cae80 0x7fd38c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.898+0000 7fd391bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c1598e0 0x7fd38c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.898+0000 7fd391bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38c0c1d10 con 0x7fd38c0ccec0 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.898+0000 7fd391bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38c0cd430 con 0x7fd38c0cae80 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.898+0000 7fd391bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c0688a0 con 0x7fd38c1598e0 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.898+0000 7fd38b7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd38c0cae80 0x7fd38c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.898+0000 7fd38b7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd38c0cae80 0x7fd38c0cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40722/0 (socket says 172.21.15.124:40722) 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.898+0000 7fd38b7fe700 1 -- 172.21.15.124:0/1571758448 learned_addr learned my addr 172.21.15.124:0/1571758448 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.898+0000 7fd38bfff700 1 --2- 172.21.15.124:0/1571758448 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c1598e0 0x7fd38c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.899+0000 7fd38b7fe700 1 -- 172.21.15.124:0/1571758448 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c1598e0 msgr2=0x7fd38c0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.899+0000 7fd38b7fe700 1 --2- 172.21.15.124:0/1571758448 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c1598e0 0x7fd38c0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.899+0000 7fd38b7fe700 1 -- 172.21.15.124:0/1571758448 >> v1:172.21.15.158:6789/0 conn(0x7fd38c0ccec0 legacy=0x7fd38c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.899+0000 7fd38b7fe700 1 -- 172.21.15.124:0/1571758448 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c068b80 con 0x7fd38c0cae80 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.899+0000 7fd38bfff700 1 --2- 172.21.15.124:0/1571758448 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c1598e0 0x7fd38c0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:37.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.899+0000 7fd38b7fe700 1 --2- 172.21.15.124:0/1571758448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c0cae80 0x7fd38c0cc980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0099b0 tx=0x7fd37c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7b8d47930479d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.899+0000 7fd38a7fc700 1 -- 172.21.15.124:0/1571758448 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00b820 con 0x7fd38c0cae80 2023-10-06T04:44:37.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.899+0000 7fd38a7fc700 1 -- 172.21.15.124:0/1571758448 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c00b980 con 0x7fd38c0cae80 2023-10-06T04:44:37.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.899+0000 7fd38a7fc700 1 -- 172.21.15.124:0/1571758448 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00bd20 con 0x7fd38c0cae80 2023-10-06T04:44:37.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.900+0000 7fd391bff700 1 -- 172.21.15.124:0/1571758448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c0cae80 msgr2=0x7fd38c0cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.900+0000 7fd391bff700 1 --2- 172.21.15.124:0/1571758448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c0cae80 0x7fd38c0cc980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0099b0 tx=0x7fd37c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:37.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.900+0000 7fd391bff700 1 -- 172.21.15.124:0/1571758448 shutdown_connections 2023-10-06T04:44:37.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.900+0000 7fd391bff700 1 --2- 172.21.15.124:0/1571758448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c0cae80 0x7fd38c0cc980 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.900+0000 7fd391bff700 1 --2- 172.21.15.124:0/1571758448 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c1598e0 0x7fd38c0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.900+0000 7fd391bff700 1 -- 172.21.15.124:0/1571758448 >> 172.21.15.124:0/1571758448 conn(0x7fd38c0974f0 msgr2=0x7fd38c0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.900+0000 7fd391bff700 1 -- 172.21.15.124:0/1571758448 shutdown_connections 2023-10-06T04:44:37.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.900+0000 7fd391bff700 1 -- 172.21.15.124:0/1571758448 wait complete. 2023-10-06T04:44:37.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.901+0000 7fd391bff700 1 Processor -- start 2023-10-06T04:44:37.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.901+0000 7fd391bff700 1 -- start start 2023-10-06T04:44:37.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.902+0000 7fd391bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c0cae80 0x7fd38c15f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.902+0000 7fd391bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c0ccec0 0x7fd38c0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.902+0000 7fd391bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c1598e0 0x7fd38c0c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.902+0000 7fd391bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c15a570 con 0x7fd38c1598e0 2023-10-06T04:44:37.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.902+0000 7fd391bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c0c61f0 con 0x7fd38c0ccec0 2023-10-06T04:44:37.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.902+0000 7fd391bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c0c64c0 con 0x7fd38c0cae80 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c1598e0 0x7fd38c0c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c1598e0 0x7fd38c0c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40738/0 (socket says 172.21.15.124:40738) 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38bfff700 1 -- 172.21.15.124:0/434107031 learned_addr learned my addr 172.21.15.124:0/434107031 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38affd700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c0ccec0 0x7fd38c0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38b7fe700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c0cae80 0x7fd38c15f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38bfff700 1 -- 172.21.15.124:0/434107031 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c0cae80 msgr2=0x7fd38c15f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38bfff700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c0cae80 0x7fd38c15f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38bfff700 1 -- 172.21.15.124:0/434107031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c0ccec0 msgr2=0x7fd38c0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38bfff700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c0ccec0 0x7fd38c0c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38bfff700 1 -- 172.21.15.124:0/434107031 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0094f0 con 0x7fd38c1598e0 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38b7fe700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c0cae80 0x7fd38c15f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38affd700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c0ccec0 0x7fd38c0c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:37.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd38bfff700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c1598e0 0x7fd38c0c7a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd38400cef0 tx=0x7fd384007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.903+0000 7fd3737fe700 1 -- 172.21.15.124:0/434107031 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400ae00 con 0x7fd38c1598e0 2023-10-06T04:44:37.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.904+0000 7fd3737fe700 1 -- 172.21.15.124:0/434107031 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd384016420 con 0x7fd38c1598e0 2023-10-06T04:44:37.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.904+0000 7fd391bff700 1 -- 172.21.15.124:0/434107031 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38c0c67a0 con 0x7fd38c1598e0 2023-10-06T04:44:37.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.904+0000 7fd3737fe700 1 -- 172.21.15.124:0/434107031 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840167e0 con 0x7fd38c1598e0 2023-10-06T04:44:37.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.904+0000 7fd391bff700 1 -- 172.21.15.124:0/434107031 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38c15a810 con 0x7fd38c1598e0 2023-10-06T04:44:37.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.905+0000 7fd391bff700 1 -- 172.21.15.124:0/434107031 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38c0c6cc0 con 0x7fd38c1598e0 2023-10-06T04:44:37.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.906+0000 7fd3737fe700 1 -- 172.21.15.124:0/434107031 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd384016bd0 con 0x7fd38c1598e0 2023-10-06T04:44:37.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.907+0000 7fd3737fe700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd378066f30 0x7fd3780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.907+0000 7fd3737fe700 1 -- 172.21.15.124:0/434107031 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd384012070 con 0x7fd38c1598e0 2023-10-06T04:44:37.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.907+0000 7fd38b7fe700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd378066f30 0x7fd3780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.908+0000 7fd38b7fe700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd378066f30 0x7fd3780693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0099b0 tx=0x7fd37c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:37.911+0000 7fd3737fe700 1 -- 172.21.15.124:0/434107031 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd38404e5a0 con 0x7fd38c1598e0 2023-10-06T04:44:38.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.100+0000 7fd391bff700 1 -- 172.21.15.124:0/434107031 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd38c15aa30 con 0x7fd378066f30 2023-10-06T04:44:38.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.109+0000 7fd3737fe700 1 -- 172.21.15.124:0/434107031 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286831 (secure 0 0 0) 0x7fd38c15aa30 con 0x7fd378066f30 2023-10-06T04:44:38.115 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:38.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 -- 172.21.15.124:0/434107031 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd378066f30 msgr2=0x7fd3780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd378066f30 0x7fd3780693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0099b0 tx=0x7fd37c016000 comp rx=0 tx=0).stop 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 -- 172.21.15.124:0/434107031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c1598e0 msgr2=0x7fd38c0c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c1598e0 0x7fd38c0c7a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd38400cef0 tx=0x7fd384007860 comp rx=0 tx=0).stop 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 -- 172.21.15.124:0/434107031 shutdown_connections 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38c1598e0 0x7fd38c0c7a30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd378066f30 0x7fd3780693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd38c0cae80 0x7fd38c15f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 --2- 172.21.15.124:0/434107031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c0ccec0 0x7fd38c0c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 -- 172.21.15.124:0/434107031 >> 172.21.15.124:0/434107031 conn(0x7fd38c0974f0 msgr2=0x7fd38c0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 -- 172.21.15.124:0/434107031 shutdown_connections 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.113+0000 7fd391bff700 1 -- 172.21.15.124:0/434107031 wait complete. 2023-10-06T04:44:38.118 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:44:38.133 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-06T04:44:37.909264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381288,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593432,"statfs":{"total":773094113280,"available":770655674368,"internally_reserved":0,"allocated":3055616,"data_stored":1838228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.758944"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174396+0000","last_change":"2023-10-06T04:44:28.173422+0000","last_active":"2023-10-06T04:44:28.174396+0000","last_peered":"2023-10-06T04:44:28.174396+0000","last_clean":"2023-10-06T04:44:28.174396+0000","last_became_active":"2023-10-06T04:44:28.172872+0000","last_became_peered":"2023-10-06T04:44:28.172872+0000","last_unstale":"2023-10-06T04:44:28.174396+0000","last_undegraded":"2023-10-06T04:44:28.174396+0000","last_fullsized":"2023-10-06T04:44:28.174396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:26.020254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177872+0000","last_change":"2023-10-06T04:44:28.166093+0000","last_active":"2023-10-06T04:44:28.177872+0000","last_peered":"2023-10-06T04:44:28.177872+0000","last_clean":"2023-10-06T04:44:28.177872+0000","last_became_active":"2023-10-06T04:44:28.165832+0000","last_became_peered":"2023-10-06T04:44:28.165832+0000","last_unstale":"2023-10-06T04:44:28.177872+0000","last_undegraded":"2023-10-06T04:44:28.177872+0000","last_fullsized":"2023-10-06T04:44:28.177872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:20.325293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184510+0000","last_change":"2023-10-06T04:44:28.181890+0000","last_active":"2023-10-06T04:44:28.184510+0000","last_peered":"2023-10-06T04:44:28.184510+0000","last_clean":"2023-10-06T04:44:28.184510+0000","last_became_active":"2023-10-06T04:44:28.181525+0000","last_became_peered":"2023-10-06T04:44:28.181525+0000","last_unstale":"2023-10-06T04:44:28.184510+0000","last_undegraded":"2023-10-06T04:44:28.184510+0000","last_fullsized":"2023-10-06T04:44:28.184510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:10.808836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183592+0000","last_change":"2023-10-06T04:44:28.175818+0000","last_active":"2023-10-06T04:44:28.183592+0000","last_peered":"2023-10-06T04:44:28.183592+0000","last_clean":"2023-10-06T04:44:28.183592+0000","last_became_active":"2023-10-06T04:44:28.175535+0000","last_became_peered":"2023-10-06T04:44:28.175535+0000","last_unstale":"2023-10-06T04:44:28.183592+0000","last_undegraded":"2023-10-06T04:44:28.183592+0000","last_fullsized":"2023-10-06T04:44:28.183592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:54.215039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187267+0000","last_change":"2023-10-06T04:44:28.181590+0000","last_active":"2023-10-06T04:44:28.187267+0000","last_peered":"2023-10-06T04:44:28.187267+0000","last_clean":"2023-10-06T04:44:28.187267+0000","last_became_active":"2023-10-06T04:44:28.181326+0000","last_became_peered":"2023-10-06T04:44:28.181326+0000","last_unstale":"2023-10-06T04:44:28.187267+0000","last_undegraded":"2023-10-06T04:44:28.187267+0000","last_fullsized":"2023-10-06T04:44:28.187267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:22.042195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184289+0000","last_change":"2023-10-06T04:44:28.180417+0000","last_active":"2023-10-06T04:44:28.184289+0000","last_peered":"2023-10-06T04:44:28.184289+0000","last_clean":"2023-10-06T04:44:28.184289+0000","last_became_active":"2023-10-06T04:44:28.179929+0000","last_became_peered":"2023-10-06T04:44:28.179929+0000","last_unstale":"2023-10-06T04:44:28.184289+0000","last_undegraded":"2023-10-06T04:44:28.184289+0000","last_fullsized":"2023-10-06T04:44:28.184289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:37.525707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182963+0000","last_change":"2023-10-06T04:44:28.178946+0000","last_active":"2023-10-06T04:44:28.182963+0000","last_peered":"2023-10-06T04:44:28.182963+0000","last_clean":"2023-10-06T04:44:28.182963+0000","last_became_active":"2023-10-06T04:44:28.178304+0000","last_became_peered":"2023-10-06T04:44:28.178304+0000","last_unstale":"2023-10-06T04:44:28.182963+0000","last_undegraded":"2023-10-06T04:44:28.182963+0000","last_fullsized":"2023-10-06T04:44:28.182963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.327276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.180058+0000","last_change":"2023-10-06T04:44:28.175157+0000","last_active":"2023-10-06T04:44:28.180058+0000","last_peered":"2023-10-06T04:44:28.180058+0000","last_clean":"2023-10-06T04:44:28.180058+0000","last_became_active":"2023-10-06T04:44:28.174893+0000","last_became_peered":"2023-10-06T04:44:28.174893+0000","last_unstale":"2023-10-06T04:44:28.180058+0000","last_undegraded":"2023-10-06T04:44:28.180058+0000","last_fullsized":"2023-10-06T04:44:28.180058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.047230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175971+0000","last_change":"2023-10-06T04:44:28.172925+0000","last_active":"2023-10-06T04:44:28.175971+0000","last_peered":"2023-10-06T04:44:28.175971+0000","last_clean":"2023-10-06T04:44:28.175971+0000","last_became_active":"2023-10-06T04:44:28.172656+0000","last_became_peered":"2023-10-06T04:44:28.172656+0000","last_unstale":"2023-10-06T04:44:28.175971+0000","last_undegraded":"2023-10-06T04:44:28.175971+0000","last_fullsized":"2023-10-06T04:44:28.175971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:58.202199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.169346+0000","last_change":"2023-10-06T04:44:28.162650+0000","last_active":"2023-10-06T04:44:28.169346+0000","last_peered":"2023-10-06T04:44:28.169346+0000","last_clean":"2023-10-06T04:44:28.169346+0000","last_became_active":"2023-10-06T04:44:28.162164+0000","last_became_peered":"2023-10-06T04:44:28.162164+0000","last_unstale":"2023-10-06T04:44:28.169346+0000","last_undegraded":"2023-10-06T04:44:28.169346+0000","last_fullsized":"2023-10-06T04:44:28.169346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182834+0000","last_change":"2023-10-06T04:44:28.174246+0000","last_active":"2023-10-06T04:44:28.182834+0000","last_peered":"2023-10-06T04:44:28.182834+0000","last_clean":"2023-10-06T04:44:28.182834+0000","last_became_active":"2023-10-06T04:44:28.173913+0000","last_became_peered":"2023-10-06T04:44:28.173913+0000","last_unstale":"2023-10-06T04:44:28.182834+0000","last_undegraded":"2023-10-06T04:44:28.182834+0000","last_fullsized":"2023-10-06T04:44:28.182834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182061+0000","last_change":"2023-10-06T04:44:28.175653+0000","last_active":"2023-10-06T04:44:28.182061+0000","last_peered":"2023-10-06T04:44:28.182061+0000","last_clean":"2023-10-06T04:44:28.182061+0000","last_became_active":"2023-10-06T04:44:28.175322+0000","last_became_peered":"2023-10-06T04:44:28.175322+0000","last_unstale":"2023-10-06T04:44:28.182061+0000","last_undegraded":"2023-10-06T04:44:28.182061+0000","last_fullsized":"2023-10-06T04:44:28.182061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:45.455338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174379+0000","last_change":"2023-10-06T04:44:28.173340+0000","last_active":"2023-10-06T04:44:28.174379+0000","last_peered":"2023-10-06T04:44:28.174379+0000","last_clean":"2023-10-06T04:44:28.174379+0000","last_became_active":"2023-10-06T04:44:28.173003+0000","last_became_peered":"2023-10-06T04:44:28.173003+0000","last_unstale":"2023-10-06T04:44:28.174379+0000","last_undegraded":"2023-10-06T04:44:28.174379+0000","last_fullsized":"2023-10-06T04:44:28.174379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:33.543547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177809+0000","last_change":"2023-10-06T04:44:28.164616+0000","last_active":"2023-10-06T04:44:28.177809+0000","last_peered":"2023-10-06T04:44:28.177809+0000","last_clean":"2023-10-06T04:44:28.177809+0000","last_became_active":"2023-10-06T04:44:28.164191+0000","last_became_peered":"2023-10-06T04:44:28.164191+0000","last_unstale":"2023-10-06T04:44:28.177809+0000","last_undegraded":"2023-10-06T04:44:28.177809+0000","last_fullsized":"2023-10-06T04:44:28.177809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:59.257080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182983+0000","last_change":"2023-10-06T04:44:28.179115+0000","last_active":"2023-10-06T04:44:28.182983+0000","last_peered":"2023-10-06T04:44:28.182983+0000","last_clean":"2023-10-06T04:44:28.182983+0000","last_became_active":"2023-10-06T04:44:28.178643+0000","last_became_peered":"2023-10-06T04:44:28.178643+0000","last_unstale":"2023-10-06T04:44:28.182983+0000","last_undegraded":"2023-10-06T04:44:28.182983+0000","last_fullsized":"2023-10-06T04:44:28.182983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184235+0000","last_change":"2023-10-06T04:44:28.180012+0000","last_active":"2023-10-06T04:44:28.184235+0000","last_peered":"2023-10-06T04:44:28.184235+0000","last_clean":"2023-10-06T04:44:28.184235+0000","last_became_active":"2023-10-06T04:44:28.179719+0000","last_became_peered":"2023-10-06T04:44:28.179719+0000","last_unstale":"2023-10-06T04:44:28.184235+0000","last_undegraded":"2023-10-06T04:44:28.184235+0000","last_fullsized":"2023-10-06T04:44:28.184235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.765680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175953+0000","last_change":"2023-10-06T04:44:28.172407+0000","last_active":"2023-10-06T04:44:28.175953+0000","last_peered":"2023-10-06T04:44:28.175953+0000","last_clean":"2023-10-06T04:44:28.175953+0000","last_became_active":"2023-10-06T04:44:28.172144+0000","last_became_peered":"2023-10-06T04:44:28.172144+0000","last_unstale":"2023-10-06T04:44:28.175953+0000","last_undegraded":"2023-10-06T04:44:28.175953+0000","last_fullsized":"2023-10-06T04:44:28.175953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:30.261730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184051+0000","last_change":"2023-10-06T04:44:28.175526+0000","last_active":"2023-10-06T04:44:28.184051+0000","last_peered":"2023-10-06T04:44:28.184051+0000","last_clean":"2023-10-06T04:44:28.184051+0000","last_became_active":"2023-10-06T04:44:28.174982+0000","last_became_peered":"2023-10-06T04:44:28.174982+0000","last_unstale":"2023-10-06T04:44:28.184051+0000","last_undegraded":"2023-10-06T04:44:28.184051+0000","last_fullsized":"2023-10-06T04:44:28.184051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:44.708051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.167827+0000","last_change":"2023-10-06T04:44:28.165012+0000","last_active":"2023-10-06T04:44:28.167827+0000","last_peered":"2023-10-06T04:44:28.167827+0000","last_clean":"2023-10-06T04:44:28.167827+0000","last_became_active":"2023-10-06T04:44:28.164574+0000","last_became_peered":"2023-10-06T04:44:28.164574+0000","last_unstale":"2023-10-06T04:44:28.167827+0000","last_undegraded":"2023-10-06T04:44:28.167827+0000","last_fullsized":"2023-10-06T04:44:28.167827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:29.304110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.186324+0000","last_change":"2023-10-06T04:44:28.178396+0000","last_active":"2023-10-06T04:44:28.186324+0000","last_peered":"2023-10-06T04:44:28.186324+0000","last_clean":"2023-10-06T04:44:28.186324+0000","last_became_active":"2023-10-06T04:44:28.178046+0000","last_became_peered":"2023-10-06T04:44:28.178046+0000","last_unstale":"2023-10-06T04:44:28.186324+0000","last_undegraded":"2023-10-06T04:44:28.186324+0000","last_fullsized":"2023-10-06T04:44:28.186324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:06.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183703+0000","last_change":"2023-10-06T04:44:28.182289+0000","last_active":"2023-10-06T04:44:28.183703+0000","last_peered":"2023-10-06T04:44:28.183703+0000","last_clean":"2023-10-06T04:44:28.183703+0000","last_became_active":"2023-10-06T04:44:28.181655+0000","last_became_peered":"2023-10-06T04:44:28.181655+0000","last_unstale":"2023-10-06T04:44:28.183703+0000","last_undegraded":"2023-10-06T04:44:28.183703+0000","last_fullsized":"2023-10-06T04:44:28.183703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:20.325293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.169239+0000","last_change":"2023-10-06T04:44:28.166193+0000","last_active":"2023-10-06T04:44:28.169239+0000","last_peered":"2023-10-06T04:44:28.169239+0000","last_clean":"2023-10-06T04:44:28.169239+0000","last_became_active":"2023-10-06T04:44:28.165254+0000","last_became_peered":"2023-10-06T04:44:28.165254+0000","last_unstale":"2023-10-06T04:44:28.169239+0000","last_undegraded":"2023-10-06T04:44:28.169239+0000","last_fullsized":"2023-10-06T04:44:28.169239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.526003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182644+0000","last_change":"2023-10-06T04:44:28.172488+0000","last_active":"2023-10-06T04:44:28.182644+0000","last_peered":"2023-10-06T04:44:28.182644+0000","last_clean":"2023-10-06T04:44:28.182644+0000","last_became_active":"2023-10-06T04:44:28.172052+0000","last_became_peered":"2023-10-06T04:44:28.172052+0000","last_unstale":"2023-10-06T04:44:28.182644+0000","last_undegraded":"2023-10-06T04:44:28.182644+0000","last_fullsized":"2023-10-06T04:44:28.182644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:25.165826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.192712+0000","last_change":"2023-10-06T04:44:28.188043+0000","last_active":"2023-10-06T04:44:28.192712+0000","last_peered":"2023-10-06T04:44:28.192712+0000","last_clean":"2023-10-06T04:44:28.192712+0000","last_became_active":"2023-10-06T04:44:28.187730+0000","last_became_peered":"2023-10-06T04:44:28.187730+0000","last_unstale":"2023-10-06T04:44:28.192712+0000","last_undegraded":"2023-10-06T04:44:28.192712+0000","last_fullsized":"2023-10-06T04:44:28.192712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170258+0000","last_change":"2023-10-06T04:44:28.165414+0000","last_active":"2023-10-06T04:44:28.170258+0000","last_peered":"2023-10-06T04:44:28.170258+0000","last_clean":"2023-10-06T04:44:28.170258+0000","last_became_active":"2023-10-06T04:44:28.165101+0000","last_became_peered":"2023-10-06T04:44:28.165101+0000","last_unstale":"2023-10-06T04:44:28.170258+0000","last_undegraded":"2023-10-06T04:44:28.170258+0000","last_fullsized":"2023-10-06T04:44:28.170258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.526003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177390+0000","last_change":"2023-10-06T04:44:28.168938+0000","last_active":"2023-10-06T04:44:28.177390+0000","last_peered":"2023-10-06T04:44:28.177390+0000","last_clean":"2023-10-06T04:44:28.177390+0000","last_became_active":"2023-10-06T04:44:28.168679+0000","last_became_peered":"2023-10-06T04:44:28.168679+0000","last_unstale":"2023-10-06T04:44:28.177390+0000","last_undegraded":"2023-10-06T04:44:28.177390+0000","last_fullsized":"2023-10-06T04:44:28.177390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:35:22.562710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.179522+0000","last_change":"2023-10-06T04:44:28.169001+0000","last_active":"2023-10-06T04:44:28.179522+0000","last_peered":"2023-10-06T04:44:28.179522+0000","last_clean":"2023-10-06T04:44:28.179522+0000","last_became_active":"2023-10-06T04:44:28.168663+0000","last_became_peered":"2023-10-06T04:44:28.168663+0000","last_unstale":"2023-10-06T04:44:28.179522+0000","last_undegraded":"2023-10-06T04:44:28.179522+0000","last_fullsized":"2023-10-06T04:44:28.179522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:18.824278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187348+0000","last_change":"2023-10-06T04:44:27.176063+0000","last_active":"2023-10-06T04:44:28.187348+0000","last_peered":"2023-10-06T04:44:28.187348+0000","last_clean":"2023-10-06T04:44:28.187348+0000","last_became_active":"2023-10-06T04:44:27.175663+0000","last_became_peered":"2023-10-06T04:44:27.175663+0000","last_unstale":"2023-10-06T04:44:28.187348+0000","last_undegraded":"2023-10-06T04:44:28.187348+0000","last_fullsized":"2023-10-06T04:44:28.187348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182422+0000","last_change":"2023-10-06T04:44:28.171391+0000","last_active":"2023-10-06T04:44:28.182422+0000","last_peered":"2023-10-06T04:44:28.182422+0000","last_clean":"2023-10-06T04:44:28.182422+0000","last_became_active":"2023-10-06T04:44:28.171117+0000","last_became_peered":"2023-10-06T04:44:28.171117+0000","last_unstale":"2023-10-06T04:44:28.182422+0000","last_undegraded":"2023-10-06T04:44:28.182422+0000","last_fullsized":"2023-10-06T04:44:28.182422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:06.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.153053+0000","last_change":"2023-10-06T04:44:27.175499+0000","last_active":"2023-10-06T04:44:28.153053+0000","last_peered":"2023-10-06T04:44:28.153053+0000","last_clean":"2023-10-06T04:44:28.153053+0000","last_became_active":"2023-10-06T04:44:27.175181+0000","last_became_peered":"2023-10-06T04:44:27.175181+0000","last_unstale":"2023-10-06T04:44:28.153053+0000","last_undegraded":"2023-10-06T04:44:28.153053+0000","last_fullsized":"2023-10-06T04:44:28.153053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:18.613164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176004+0000","last_change":"2023-10-06T04:44:28.171657+0000","last_active":"2023-10-06T04:44:28.176004+0000","last_peered":"2023-10-06T04:44:28.176004+0000","last_clean":"2023-10-06T04:44:28.176004+0000","last_became_active":"2023-10-06T04:44:28.171374+0000","last_became_peered":"2023-10-06T04:44:28.171374+0000","last_unstale":"2023-10-06T04:44:28.176004+0000","last_undegraded":"2023-10-06T04:44:28.176004+0000","last_fullsized":"2023-10-06T04:44:28.176004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:10.149033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.158784+0000","last_change":"2023-10-06T04:44:27.160189+0000","last_active":"2023-10-06T04:44:28.158784+0000","last_peered":"2023-10-06T04:44:28.158784+0000","last_clean":"2023-10-06T04:44:28.158784+0000","last_became_active":"2023-10-06T04:44:27.159913+0000","last_became_peered":"2023-10-06T04:44:27.159913+0000","last_unstale":"2023-10-06T04:44:28.158784+0000","last_undegraded":"2023-10-06T04:44:28.158784+0000","last_fullsized":"2023-10-06T04:44:28.158784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:31.797194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173154+0000","last_change":"2023-10-06T04:44:28.169511+0000","last_active":"2023-10-06T04:44:28.173154+0000","last_peered":"2023-10-06T04:44:28.173154+0000","last_clean":"2023-10-06T04:44:28.173154+0000","last_became_active":"2023-10-06T04:44:28.169196+0000","last_became_peered":"2023-10-06T04:44:28.169196+0000","last_unstale":"2023-10-06T04:44:28.173154+0000","last_undegraded":"2023-10-06T04:44:28.173154+0000","last_fullsized":"2023-10-06T04:44:28.173154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:14.693541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.157141+0000","last_change":"2023-10-06T04:44:27.165250+0000","last_active":"2023-10-06T04:44:28.157141+0000","last_peered":"2023-10-06T04:44:28.157141+0000","last_clean":"2023-10-06T04:44:28.157141+0000","last_became_active":"2023-10-06T04:44:27.164945+0000","last_became_peered":"2023-10-06T04:44:27.164945+0000","last_unstale":"2023-10-06T04:44:28.157141+0000","last_undegraded":"2023-10-06T04:44:28.157141+0000","last_fullsized":"2023-10-06T04:44:28.157141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:25.014932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183077+0000","last_change":"2023-10-06T04:44:28.178132+0000","last_active":"2023-10-06T04:44:28.183077+0000","last_peered":"2023-10-06T04:44:28.183077+0000","last_clean":"2023-10-06T04:44:28.183077+0000","last_became_active":"2023-10-06T04:44:28.177887+0000","last_became_peered":"2023-10-06T04:44:28.177887+0000","last_unstale":"2023-10-06T04:44:28.183077+0000","last_undegraded":"2023-10-06T04:44:28.183077+0000","last_fullsized":"2023-10-06T04:44:28.183077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:05.030988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.154814+0000","last_change":"2023-10-06T04:44:27.175489+0000","last_active":"2023-10-06T04:44:28.154814+0000","last_peered":"2023-10-06T04:44:28.154814+0000","last_clean":"2023-10-06T04:44:28.154814+0000","last_became_active":"2023-10-06T04:44:27.175091+0000","last_became_peered":"2023-10-06T04:44:27.175091+0000","last_unstale":"2023-10-06T04:44:28.154814+0000","last_undegraded":"2023-10-06T04:44:28.154814+0000","last_fullsized":"2023-10-06T04:44:28.154814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182780+0000","last_change":"2023-10-06T04:44:28.175583+0000","last_active":"2023-10-06T04:44:28.182780+0000","last_peered":"2023-10-06T04:44:28.182780+0000","last_clean":"2023-10-06T04:44:28.182780+0000","last_became_active":"2023-10-06T04:44:28.174168+0000","last_became_peered":"2023-10-06T04:44:28.174168+0000","last_unstale":"2023-10-06T04:44:28.182780+0000","last_undegraded":"2023-10-06T04:44:28.182780+0000","last_fullsized":"2023-10-06T04:44:28.182780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:13.248204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194379+0000","last_change":"2023-10-06T04:44:27.173497+0000","last_active":"2023-10-06T04:44:28.194379+0000","last_peered":"2023-10-06T04:44:28.194379+0000","last_clean":"2023-10-06T04:44:28.194379+0000","last_became_active":"2023-10-06T04:44:27.173266+0000","last_became_peered":"2023-10-06T04:44:27.173266+0000","last_unstale":"2023-10-06T04:44:28.194379+0000","last_undegraded":"2023-10-06T04:44:28.194379+0000","last_fullsized":"2023-10-06T04:44:28.194379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:25.287936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170646+0000","last_change":"2023-10-06T04:44:28.164074+0000","last_active":"2023-10-06T04:44:28.170646+0000","last_peered":"2023-10-06T04:44:28.170646+0000","last_clean":"2023-10-06T04:44:28.170646+0000","last_became_active":"2023-10-06T04:44:28.163794+0000","last_became_peered":"2023-10-06T04:44:28.163794+0000","last_unstale":"2023-10-06T04:44:28.170646+0000","last_undegraded":"2023-10-06T04:44:28.170646+0000","last_fullsized":"2023-10-06T04:44:28.170646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:00.867338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.195971+0000","last_change":"2023-10-06T04:44:27.174376+0000","last_active":"2023-10-06T04:44:28.195971+0000","last_peered":"2023-10-06T04:44:28.195971+0000","last_clean":"2023-10-06T04:44:28.195971+0000","last_became_active":"2023-10-06T04:44:27.172580+0000","last_became_peered":"2023-10-06T04:44:27.172580+0000","last_unstale":"2023-10-06T04:44:28.195971+0000","last_undegraded":"2023-10-06T04:44:28.195971+0000","last_fullsized":"2023-10-06T04:44:28.195971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:18.718435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184206+0000","last_change":"2023-10-06T04:44:28.176191+0000","last_active":"2023-10-06T04:44:28.184206+0000","last_peered":"2023-10-06T04:44:28.184206+0000","last_clean":"2023-10-06T04:44:28.184206+0000","last_became_active":"2023-10-06T04:44:28.175904+0000","last_became_peered":"2023-10-06T04:44:28.175904+0000","last_unstale":"2023-10-06T04:44:28.184206+0000","last_undegraded":"2023-10-06T04:44:28.184206+0000","last_fullsized":"2023-10-06T04:44:28.184206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:02.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.193953+0000","last_change":"2023-10-06T04:44:27.176572+0000","last_active":"2023-10-06T04:44:28.193953+0000","last_peered":"2023-10-06T04:44:28.193953+0000","last_clean":"2023-10-06T04:44:28.193953+0000","last_became_active":"2023-10-06T04:44:27.176184+0000","last_became_peered":"2023-10-06T04:44:27.176184+0000","last_unstale":"2023-10-06T04:44:28.193953+0000","last_undegraded":"2023-10-06T04:44:28.193953+0000","last_fullsized":"2023-10-06T04:44:28.193953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:42.805321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183777+0000","last_change":"2023-10-06T04:44:28.179767+0000","last_active":"2023-10-06T04:44:28.183777+0000","last_peered":"2023-10-06T04:44:28.183777+0000","last_clean":"2023-10-06T04:44:28.183777+0000","last_became_active":"2023-10-06T04:44:28.178145+0000","last_became_peered":"2023-10-06T04:44:28.178145+0000","last_unstale":"2023-10-06T04:44:28.183777+0000","last_undegraded":"2023-10-06T04:44:28.183777+0000","last_fullsized":"2023-10-06T04:44:28.183777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.765680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.157130+0000","last_change":"2023-10-06T04:44:27.169868+0000","last_active":"2023-10-06T04:44:28.157130+0000","last_peered":"2023-10-06T04:44:28.157130+0000","last_clean":"2023-10-06T04:44:28.157130+0000","last_became_active":"2023-10-06T04:44:27.169616+0000","last_became_peered":"2023-10-06T04:44:27.169616+0000","last_unstale":"2023-10-06T04:44:28.157130+0000","last_undegraded":"2023-10-06T04:44:28.157130+0000","last_fullsized":"2023-10-06T04:44:28.157130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:56.308717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.179502+0000","last_change":"2023-10-06T04:44:28.168629+0000","last_active":"2023-10-06T04:44:28.179502+0000","last_peered":"2023-10-06T04:44:28.179502+0000","last_clean":"2023-10-06T04:44:28.179502+0000","last_became_active":"2023-10-06T04:44:28.168374+0000","last_became_peered":"2023-10-06T04:44:28.168374+0000","last_unstale":"2023-10-06T04:44:28.179502+0000","last_undegraded":"2023-10-06T04:44:28.179502+0000","last_fullsized":"2023-10-06T04:44:28.179502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.163827+0000","last_change":"2023-10-06T04:44:27.175001+0000","last_active":"2023-10-06T04:44:28.163827+0000","last_peered":"2023-10-06T04:44:28.163827+0000","last_clean":"2023-10-06T04:44:28.163827+0000","last_became_active":"2023-10-06T04:44:27.174715+0000","last_became_peered":"2023-10-06T04:44:27.174715+0000","last_unstale":"2023-10-06T04:44:28.163827+0000","last_undegraded":"2023-10-06T04:44:28.163827+0000","last_fullsized":"2023-10-06T04:44:28.163827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:16.760012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187237+0000","last_change":"2023-10-06T04:44:28.181610+0000","last_active":"2023-10-06T04:44:28.187237+0000","last_peered":"2023-10-06T04:44:28.187237+0000","last_clean":"2023-10-06T04:44:28.187237+0000","last_became_active":"2023-10-06T04:44:28.180610+0000","last_became_peered":"2023-10-06T04:44:28.180610+0000","last_unstale":"2023-10-06T04:44:28.187237+0000","last_undegraded":"2023-10-06T04:44:28.187237+0000","last_fullsized":"2023-10-06T04:44:28.187237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:15.790501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.191273+0000","last_change":"2023-10-06T04:44:27.162747+0000","last_active":"2023-10-06T04:44:28.191273+0000","last_peered":"2023-10-06T04:44:28.191273+0000","last_clean":"2023-10-06T04:44:28.191273+0000","last_became_active":"2023-10-06T04:44:27.162395+0000","last_became_peered":"2023-10-06T04:44:27.162395+0000","last_unstale":"2023-10-06T04:44:28.191273+0000","last_undegraded":"2023-10-06T04:44:28.191273+0000","last_fullsized":"2023-10-06T04:44:28.191273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182885+0000","last_change":"2023-10-06T04:44:28.175866+0000","last_active":"2023-10-06T04:44:28.182885+0000","last_peered":"2023-10-06T04:44:28.182885+0000","last_clean":"2023-10-06T04:44:28.182885+0000","last_became_active":"2023-10-06T04:44:28.174850+0000","last_became_peered":"2023-10-06T04:44:28.174850+0000","last_unstale":"2023-10-06T04:44:28.182885+0000","last_undegraded":"2023-10-06T04:44:28.182885+0000","last_fullsized":"2023-10-06T04:44:28.182885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:44.943378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.193693+0000","last_change":"2023-10-06T04:44:27.171420+0000","last_active":"2023-10-06T04:44:28.193693+0000","last_peered":"2023-10-06T04:44:28.193693+0000","last_clean":"2023-10-06T04:44:28.193693+0000","last_became_active":"2023-10-06T04:44:27.170321+0000","last_became_peered":"2023-10-06T04:44:27.170321+0000","last_unstale":"2023-10-06T04:44:28.193693+0000","last_undegraded":"2023-10-06T04:44:28.193693+0000","last_fullsized":"2023-10-06T04:44:28.193693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.180040+0000","last_change":"2023-10-06T04:44:28.167916+0000","last_active":"2023-10-06T04:44:28.180040+0000","last_peered":"2023-10-06T04:44:28.180040+0000","last_clean":"2023-10-06T04:44:28.180040+0000","last_became_active":"2023-10-06T04:44:28.167567+0000","last_became_peered":"2023-10-06T04:44:28.167567+0000","last_unstale":"2023-10-06T04:44:28.180040+0000","last_undegraded":"2023-10-06T04:44:28.180040+0000","last_fullsized":"2023-10-06T04:44:28.180040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.327276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194098+0000","last_change":"2023-10-06T04:44:27.171251+0000","last_active":"2023-10-06T04:44:28.194098+0000","last_peered":"2023-10-06T04:44:28.194098+0000","last_clean":"2023-10-06T04:44:28.194098+0000","last_became_active":"2023-10-06T04:44:27.170918+0000","last_became_peered":"2023-10-06T04:44:27.170918+0000","last_unstale":"2023-10-06T04:44:28.194098+0000","last_undegraded":"2023-10-06T04:44:28.194098+0000","last_fullsized":"2023-10-06T04:44:28.194098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:31.797194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182452+0000","last_change":"2023-10-06T04:44:28.173878+0000","last_active":"2023-10-06T04:44:28.182452+0000","last_peered":"2023-10-06T04:44:28.182452+0000","last_clean":"2023-10-06T04:44:28.182452+0000","last_became_active":"2023-10-06T04:44:28.173437+0000","last_became_peered":"2023-10-06T04:44:28.173437+0000","last_unstale":"2023-10-06T04:44:28.182452+0000","last_undegraded":"2023-10-06T04:44:28.182452+0000","last_fullsized":"2023-10-06T04:44:28.182452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:13.338361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194313+0000","last_change":"2023-10-06T04:44:27.176907+0000","last_active":"2023-10-06T04:44:28.194313+0000","last_peered":"2023-10-06T04:44:28.194313+0000","last_clean":"2023-10-06T04:44:28.194313+0000","last_became_active":"2023-10-06T04:44:27.176591+0000","last_became_peered":"2023-10-06T04:44:27.176591+0000","last_unstale":"2023-10-06T04:44:28.194313+0000","last_undegraded":"2023-10-06T04:44:28.194313+0000","last_fullsized":"2023-10-06T04:44:28.194313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:48.634872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174467+0000","last_change":"2023-10-06T04:44:28.170672+0000","last_active":"2023-10-06T04:44:28.174467+0000","last_peered":"2023-10-06T04:44:28.174467+0000","last_clean":"2023-10-06T04:44:28.174467+0000","last_became_active":"2023-10-06T04:44:28.170212+0000","last_became_peered":"2023-10-06T04:44:28.170212+0000","last_unstale":"2023-10-06T04:44:28.174467+0000","last_undegraded":"2023-10-06T04:44:28.174467+0000","last_fullsized":"2023-10-06T04:44:28.174467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.153605+0000","last_change":"2023-10-06T04:44:27.166881+0000","last_active":"2023-10-06T04:44:28.153605+0000","last_peered":"2023-10-06T04:44:28.153605+0000","last_clean":"2023-10-06T04:44:28.153605+0000","last_became_active":"2023-10-06T04:44:27.166606+0000","last_became_peered":"2023-10-06T04:44:27.166606+0000","last_unstale":"2023-10-06T04:44:28.153605+0000","last_undegraded":"2023-10-06T04:44:28.153605+0000","last_fullsized":"2023-10-06T04:44:28.153605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:01.501146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173200+0000","last_change":"2023-10-06T04:44:28.167261+0000","last_active":"2023-10-06T04:44:28.173200+0000","last_peered":"2023-10-06T04:44:28.173200+0000","last_clean":"2023-10-06T04:44:28.173200+0000","last_became_active":"2023-10-06T04:44:28.167017+0000","last_became_peered":"2023-10-06T04:44:28.167017+0000","last_unstale":"2023-10-06T04:44:28.173200+0000","last_undegraded":"2023-10-06T04:44:28.173200+0000","last_fullsized":"2023-10-06T04:44:28.173200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:37.963273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187450+0000","last_change":"2023-10-06T04:44:27.169708+0000","last_active":"2023-10-06T04:44:28.187450+0000","last_peered":"2023-10-06T04:44:28.187450+0000","last_clean":"2023-10-06T04:44:28.187450+0000","last_became_active":"2023-10-06T04:44:27.169446+0000","last_became_peered":"2023-10-06T04:44:27.169446+0000","last_unstale":"2023-10-06T04:44:28.187450+0000","last_undegraded":"2023-10-06T04:44:28.187450+0000","last_fullsized":"2023-10-06T04:44:28.187450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:42.805321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.186392+0000","last_change":"2023-10-06T04:44:28.182653+0000","last_active":"2023-10-06T04:44:28.186392+0000","last_peered":"2023-10-06T04:44:28.186392+0000","last_clean":"2023-10-06T04:44:28.186392+0000","last_became_active":"2023-10-06T04:44:28.182103+0000","last_became_peered":"2023-10-06T04:44:28.182103+0000","last_unstale":"2023-10-06T04:44:28.186392+0000","last_undegraded":"2023-10-06T04:44:28.186392+0000","last_fullsized":"2023-10-06T04:44:28.186392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:13.248204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.159163+0000","last_change":"2023-10-06T04:44:27.173805+0000","last_active":"2023-10-06T04:44:28.159163+0000","last_peered":"2023-10-06T04:44:28.159163+0000","last_clean":"2023-10-06T04:44:28.159163+0000","last_became_active":"2023-10-06T04:44:27.173356+0000","last_became_peered":"2023-10-06T04:44:27.173356+0000","last_unstale":"2023-10-06T04:44:28.159163+0000","last_undegraded":"2023-10-06T04:44:28.159163+0000","last_fullsized":"2023-10-06T04:44:28.159163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182814+0000","last_change":"2023-10-06T04:44:28.174085+0000","last_active":"2023-10-06T04:44:28.182814+0000","last_peered":"2023-10-06T04:44:28.182814+0000","last_clean":"2023-10-06T04:44:28.182814+0000","last_became_active":"2023-10-06T04:44:28.173252+0000","last_became_peered":"2023-10-06T04:44:28.173252+0000","last_unstale":"2023-10-06T04:44:28.182814+0000","last_undegraded":"2023-10-06T04:44:28.182814+0000","last_fullsized":"2023-10-06T04:44:28.182814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:44.943378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.159414+0000","last_change":"2023-10-06T04:44:27.173971+0000","last_active":"2023-10-06T04:44:28.159414+0000","last_peered":"2023-10-06T04:44:28.159414+0000","last_clean":"2023-10-06T04:44:28.159414+0000","last_became_active":"2023-10-06T04:44:27.173624+0000","last_became_peered":"2023-10-06T04:44:27.173624+0000","last_unstale":"2023-10-06T04:44:28.159414+0000","last_undegraded":"2023-10-06T04:44:28.159414+0000","last_fullsized":"2023-10-06T04:44:28.159414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:59.033178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184064+0000","last_change":"2023-10-06T04:44:28.175781+0000","last_active":"2023-10-06T04:44:28.184064+0000","last_peered":"2023-10-06T04:44:28.184064+0000","last_clean":"2023-10-06T04:44:28.184064+0000","last_became_active":"2023-10-06T04:44:28.174281+0000","last_became_peered":"2023-10-06T04:44:28.174281+0000","last_unstale":"2023-10-06T04:44:28.184064+0000","last_undegraded":"2023-10-06T04:44:28.184064+0000","last_fullsized":"2023-10-06T04:44:28.184064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:58.131405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.158675+0000","last_change":"2023-10-06T04:44:27.175348+0000","last_active":"2023-10-06T04:44:28.158675+0000","last_peered":"2023-10-06T04:44:28.158675+0000","last_clean":"2023-10-06T04:44:28.158675+0000","last_became_active":"2023-10-06T04:44:27.175051+0000","last_became_peered":"2023-10-06T04:44:27.175051+0000","last_unstale":"2023-10-06T04:44:28.158675+0000","last_undegraded":"2023-10-06T04:44:28.158675+0000","last_fullsized":"2023-10-06T04:44:28.158675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:16.760012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184769+0000","last_change":"2023-10-06T04:44:28.177266+0000","last_active":"2023-10-06T04:44:28.184769+0000","last_peered":"2023-10-06T04:44:28.184769+0000","last_clean":"2023-10-06T04:44:28.184769+0000","last_became_active":"2023-10-06T04:44:28.176965+0000","last_became_peered":"2023-10-06T04:44:28.176965+0000","last_unstale":"2023-10-06T04:44:28.184769+0000","last_undegraded":"2023-10-06T04:44:28.184769+0000","last_fullsized":"2023-10-06T04:44:28.184769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:37.963273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184327+0000","last_change":"2023-10-06T04:44:27.172020+0000","last_active":"2023-10-06T04:44:28.184327+0000","last_peered":"2023-10-06T04:44:28.184327+0000","last_clean":"2023-10-06T04:44:28.184327+0000","last_became_active":"2023-10-06T04:44:27.171708+0000","last_became_peered":"2023-10-06T04:44:27.171708+0000","last_unstale":"2023-10-06T04:44:28.184327+0000","last_undegraded":"2023-10-06T04:44:28.184327+0000","last_fullsized":"2023-10-06T04:44:28.184327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.158952+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:44:28.158952+0000","last_peered":"2023-10-06T04:44:28.158952+0000","last_clean":"2023-10-06T04:44:28.158952+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:44:28.158952+0000","last_undegraded":"2023-10-06T04:44:28.158952+0000","last_fullsized":"2023-10-06T04:44:28.158952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183055+0000","last_change":"2023-10-06T04:44:28.177250+0000","last_active":"2023-10-06T04:44:28.183055+0000","last_peered":"2023-10-06T04:44:28.183055+0000","last_clean":"2023-10-06T04:44:28.183055+0000","last_became_active":"2023-10-06T04:44:28.174266+0000","last_became_peered":"2023-10-06T04:44:28.174266+0000","last_unstale":"2023-10-06T04:44:28.183055+0000","last_undegraded":"2023-10-06T04:44:28.183055+0000","last_fullsized":"2023-10-06T04:44:28.183055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:58.131405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.157826+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:44:28.157826+0000","last_peered":"2023-10-06T04:44:28.157826+0000","last_clean":"2023-10-06T04:44:28.157826+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:44:28.157826+0000","last_undegraded":"2023-10-06T04:44:28.157826+0000","last_fullsized":"2023-10-06T04:44:28.157826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:44:29.573165+0000","last_change":"2023-10-06T04:44:27.167851+0000","last_active":"2023-10-06T04:44:29.573165+0000","last_peered":"2023-10-06T04:44:29.573165+0000","last_clean":"2023-10-06T04:44:29.573165+0000","last_became_active":"2023-10-06T04:44:27.167572+0000","last_became_peered":"2023-10-06T04:44:27.167572+0000","last_unstale":"2023-10-06T04:44:29.573165+0000","last_undegraded":"2023-10-06T04:44:29.573165+0000","last_fullsized":"2023-10-06T04:44:29.573165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:28.298788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184244+0000","last_change":"2023-10-06T04:44:28.177734+0000","last_active":"2023-10-06T04:44:28.184244+0000","last_peered":"2023-10-06T04:44:28.184244+0000","last_clean":"2023-10-06T04:44:28.184244+0000","last_became_active":"2023-10-06T04:44:28.173936+0000","last_became_peered":"2023-10-06T04:44:28.173936+0000","last_unstale":"2023-10-06T04:44:28.184244+0000","last_undegraded":"2023-10-06T04:44:28.184244+0000","last_fullsized":"2023-10-06T04:44:28.184244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:31.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.153186+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:44:28.153186+0000","last_peered":"2023-10-06T04:44:28.153186+0000","last_clean":"2023-10-06T04:44:28.153186+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:44:28.153186+0000","last_undegraded":"2023-10-06T04:44:28.153186+0000","last_fullsized":"2023-10-06T04:44:28.153186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.161824+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:44:28.161824+0000","last_peered":"2023-10-06T04:44:28.161824+0000","last_clean":"2023-10-06T04:44:28.161824+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:44:28.161824+0000","last_undegraded":"2023-10-06T04:44:28.161824+0000","last_fullsized":"2023-10-06T04:44:28.161824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.157310+0000","last_change":"2023-10-06T04:44:27.171258+0000","last_active":"2023-10-06T04:44:28.157310+0000","last_peered":"2023-10-06T04:44:28.157310+0000","last_clean":"2023-10-06T04:44:28.157310+0000","last_became_active":"2023-10-06T04:44:27.170923+0000","last_became_peered":"2023-10-06T04:44:27.170923+0000","last_unstale":"2023-10-06T04:44:28.157310+0000","last_undegraded":"2023-10-06T04:44:28.157310+0000","last_fullsized":"2023-10-06T04:44:28.157310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:18.613164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.166333+0000","last_change":"2023-10-06T04:44:28.160968+0000","last_active":"2023-10-06T04:44:28.166333+0000","last_peered":"2023-10-06T04:44:28.166333+0000","last_clean":"2023-10-06T04:44:28.166333+0000","last_became_active":"2023-10-06T04:44:28.160710+0000","last_became_peered":"2023-10-06T04:44:28.160710+0000","last_unstale":"2023-10-06T04:44:28.166333+0000","last_undegraded":"2023-10-06T04:44:28.166333+0000","last_fullsized":"2023-10-06T04:44:28.166333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:16.179899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.161110+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:44:28.161110+0000","last_peered":"2023-10-06T04:44:28.161110+0000","last_clean":"2023-10-06T04:44:28.161110+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:44:28.161110+0000","last_undegraded":"2023-10-06T04:44:28.161110+0000","last_fullsized":"2023-10-06T04:44:28.161110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.154164+0000","last_change":"2023-10-06T04:44:27.164147+0000","last_active":"2023-10-06T04:44:28.154164+0000","last_peered":"2023-10-06T04:44:28.154164+0000","last_clean":"2023-10-06T04:44:28.154164+0000","last_became_active":"2023-10-06T04:44:27.163860+0000","last_became_peered":"2023-10-06T04:44:27.163860+0000","last_unstale":"2023-10-06T04:44:28.154164+0000","last_undegraded":"2023-10-06T04:44:28.154164+0000","last_fullsized":"2023-10-06T04:44:28.154164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:11.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.166411+0000","last_change":"2023-10-06T04:44:28.162519+0000","last_active":"2023-10-06T04:44:28.166411+0000","last_peered":"2023-10-06T04:44:28.166411+0000","last_clean":"2023-10-06T04:44:28.166411+0000","last_became_active":"2023-10-06T04:44:28.162231+0000","last_became_peered":"2023-10-06T04:44:28.162231+0000","last_unstale":"2023-10-06T04:44:28.166411+0000","last_undegraded":"2023-10-06T04:44:28.166411+0000","last_fullsized":"2023-10-06T04:44:28.166411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:37.642261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.161347+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:44:28.161347+0000","last_peered":"2023-10-06T04:44:28.161347+0000","last_clean":"2023-10-06T04:44:28.161347+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:44:28.161347+0000","last_undegraded":"2023-10-06T04:44:28.161347+0000","last_fullsized":"2023-10-06T04:44:28.161347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.159233+0000","last_change":"2023-10-06T04:44:27.170762+0000","last_active":"2023-10-06T04:44:28.159233+0000","last_peered":"2023-10-06T04:44:28.159233+0000","last_clean":"2023-10-06T04:44:28.159233+0000","last_became_active":"2023-10-06T04:44:27.170417+0000","last_became_peered":"2023-10-06T04:44:27.170417+0000","last_unstale":"2023-10-06T04:44:28.159233+0000","last_undegraded":"2023-10-06T04:44:28.159233+0000","last_fullsized":"2023-10-06T04:44:28.159233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:01.501146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181199+0000","last_change":"2023-10-06T04:44:28.177577+0000","last_active":"2023-10-06T04:44:28.181199+0000","last_peered":"2023-10-06T04:44:28.181199+0000","last_clean":"2023-10-06T04:44:28.181199+0000","last_became_active":"2023-10-06T04:44:28.176998+0000","last_became_peered":"2023-10-06T04:44:28.176998+0000","last_unstale":"2023-10-06T04:44:28.181199+0000","last_undegraded":"2023-10-06T04:44:28.181199+0000","last_fullsized":"2023-10-06T04:44:28.181199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.047230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.152795+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:44:28.152795+0000","last_peered":"2023-10-06T04:44:28.152795+0000","last_clean":"2023-10-06T04:44:28.152795+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:44:28.152795+0000","last_undegraded":"2023-10-06T04:44:28.152795+0000","last_fullsized":"2023-10-06T04:44:28.152795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.158416+0000","last_change":"2023-10-06T04:44:27.174609+0000","last_active":"2023-10-06T04:44:28.158416+0000","last_peered":"2023-10-06T04:44:28.158416+0000","last_clean":"2023-10-06T04:44:28.158416+0000","last_became_active":"2023-10-06T04:44:27.173130+0000","last_became_peered":"2023-10-06T04:44:27.173130+0000","last_unstale":"2023-10-06T04:44:28.158416+0000","last_undegraded":"2023-10-06T04:44:28.158416+0000","last_fullsized":"2023-10-06T04:44:28.158416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176669+0000","last_change":"2023-10-06T04:44:28.166656+0000","last_active":"2023-10-06T04:44:28.176669+0000","last_peered":"2023-10-06T04:44:28.176669+0000","last_clean":"2023-10-06T04:44:28.176669+0000","last_became_active":"2023-10-06T04:44:28.166293+0000","last_became_peered":"2023-10-06T04:44:28.166293+0000","last_unstale":"2023-10-06T04:44:28.176669+0000","last_undegraded":"2023-10-06T04:44:28.176669+0000","last_fullsized":"2023-10-06T04:44:28.176669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:39.049512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.156705+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:44:28.156705+0000","last_peered":"2023-10-06T04:44:28.156705+0000","last_clean":"2023-10-06T04:44:28.156705+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:44:28.156705+0000","last_undegraded":"2023-10-06T04:44:28.156705+0000","last_fullsized":"2023-10-06T04:44:28.156705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.154741+0000","last_change":"2023-10-06T04:44:27.173242+0000","last_active":"2023-10-06T04:44:28.154741+0000","last_peered":"2023-10-06T04:44:28.154741+0000","last_clean":"2023-10-06T04:44:28.154741+0000","last_became_active":"2023-10-06T04:44:27.172919+0000","last_became_peered":"2023-10-06T04:44:27.172919+0000","last_unstale":"2023-10-06T04:44:28.154741+0000","last_undegraded":"2023-10-06T04:44:28.154741+0000","last_fullsized":"2023-10-06T04:44:28.154741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:56.308717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176036+0000","last_change":"2023-10-06T04:44:28.169044+0000","last_active":"2023-10-06T04:44:28.176036+0000","last_peered":"2023-10-06T04:44:28.176036+0000","last_clean":"2023-10-06T04:44:28.176036+0000","last_became_active":"2023-10-06T04:44:28.168793+0000","last_became_peered":"2023-10-06T04:44:28.168793+0000","last_unstale":"2023-10-06T04:44:28.176036+0000","last_undegraded":"2023-10-06T04:44:28.176036+0000","last_fullsized":"2023-10-06T04:44:28.176036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:38.672585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.157562+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:44:28.157562+0000","last_peered":"2023-10-06T04:44:28.157562+0000","last_clean":"2023-10-06T04:44:28.157562+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:44:28.157562+0000","last_undegraded":"2023-10-06T04:44:28.157562+0000","last_fullsized":"2023-10-06T04:44:28.157562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.155182+0000","last_change":"2023-10-06T04:44:27.164715+0000","last_active":"2023-10-06T04:44:28.155182+0000","last_peered":"2023-10-06T04:44:28.155182+0000","last_clean":"2023-10-06T04:44:28.155182+0000","last_became_active":"2023-10-06T04:44:27.164441+0000","last_became_peered":"2023-10-06T04:44:27.164441+0000","last_unstale":"2023-10-06T04:44:28.155182+0000","last_undegraded":"2023-10-06T04:44:28.155182+0000","last_fullsized":"2023-10-06T04:44:28.155182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170626+0000","last_change":"2023-10-06T04:44:28.163762+0000","last_active":"2023-10-06T04:44:28.170626+0000","last_peered":"2023-10-06T04:44:28.170626+0000","last_clean":"2023-10-06T04:44:28.170626+0000","last_became_active":"2023-10-06T04:44:28.162829+0000","last_became_peered":"2023-10-06T04:44:28.162829+0000","last_unstale":"2023-10-06T04:44:28.170626+0000","last_undegraded":"2023-10-06T04:44:28.170626+0000","last_fullsized":"2023-10-06T04:44:28.170626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:47.764193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.191804+0000","last_change":"2023-10-06T04:44:27.173098+0000","last_active":"2023-10-06T04:44:28.191804+0000","last_peered":"2023-10-06T04:44:28.191804+0000","last_clean":"2023-10-06T04:44:28.191804+0000","last_became_active":"2023-10-06T04:44:27.172825+0000","last_became_peered":"2023-10-06T04:44:27.172825+0000","last_unstale":"2023-10-06T04:44:28.191804+0000","last_undegraded":"2023-10-06T04:44:28.191804+0000","last_fullsized":"2023-10-06T04:44:28.191804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:11.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170956+0000","last_change":"2023-10-06T04:44:28.165992+0000","last_active":"2023-10-06T04:44:28.170956+0000","last_peered":"2023-10-06T04:44:28.170956+0000","last_clean":"2023-10-06T04:44:28.170956+0000","last_became_active":"2023-10-06T04:44:28.165719+0000","last_became_peered":"2023-10-06T04:44:28.165719+0000","last_unstale":"2023-10-06T04:44:28.170956+0000","last_undegraded":"2023-10-06T04:44:28.170956+0000","last_fullsized":"2023-10-06T04:44:28.170956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:12.681182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.186798+0000","last_change":"2023-10-06T04:44:27.168462+0000","last_active":"2023-10-06T04:44:28.186798+0000","last_peered":"2023-10-06T04:44:28.186798+0000","last_clean":"2023-10-06T04:44:28.186798+0000","last_became_active":"2023-10-06T04:44:27.167211+0000","last_became_peered":"2023-10-06T04:44:27.167211+0000","last_unstale":"2023-10-06T04:44:28.186798+0000","last_undegraded":"2023-10-06T04:44:28.186798+0000","last_fullsized":"2023-10-06T04:44:28.186798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:18.718435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184357+0000","last_change":"2023-10-06T04:44:28.181846+0000","last_active":"2023-10-06T04:44:28.184357+0000","last_peered":"2023-10-06T04:44:28.184357+0000","last_clean":"2023-10-06T04:44:28.184357+0000","last_became_active":"2023-10-06T04:44:28.181641+0000","last_became_peered":"2023-10-06T04:44:28.181641+0000","last_unstale":"2023-10-06T04:44:28.184357+0000","last_undegraded":"2023-10-06T04:44:28.184357+0000","last_fullsized":"2023-10-06T04:44:28.184357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:01.432720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.185604+0000","last_change":"2023-10-06T04:44:27.168466+0000","last_active":"2023-10-06T04:44:28.185604+0000","last_peered":"2023-10-06T04:44:28.185604+0000","last_clean":"2023-10-06T04:44:28.185604+0000","last_became_active":"2023-10-06T04:44:27.167928+0000","last_became_peered":"2023-10-06T04:44:27.167928+0000","last_unstale":"2023-10-06T04:44:28.185604+0000","last_undegraded":"2023-10-06T04:44:28.185604+0000","last_fullsized":"2023-10-06T04:44:28.185604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184306+0000","last_change":"2023-10-06T04:44:28.181253+0000","last_active":"2023-10-06T04:44:28.184306+0000","last_peered":"2023-10-06T04:44:28.184306+0000","last_clean":"2023-10-06T04:44:28.184306+0000","last_became_active":"2023-10-06T04:44:28.181011+0000","last_became_peered":"2023-10-06T04:44:28.181011+0000","last_unstale":"2023-10-06T04:44:28.184306+0000","last_undegraded":"2023-10-06T04:44:28.184306+0000","last_fullsized":"2023-10-06T04:44:28.184306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:12.890746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.188170+0000","last_change":"2023-10-06T04:44:27.164196+0000","last_active":"2023-10-06T04:44:28.188170+0000","last_peered":"2023-10-06T04:44:28.188170+0000","last_clean":"2023-10-06T04:44:28.188170+0000","last_became_active":"2023-10-06T04:44:27.163920+0000","last_became_peered":"2023-10-06T04:44:27.163920+0000","last_unstale":"2023-10-06T04:44:28.188170+0000","last_undegraded":"2023-10-06T04:44:28.188170+0000","last_fullsized":"2023-10-06T04:44:28.188170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:25.287936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182629+0000","last_change":"2023-10-06T04:44:28.172288+0000","last_active":"2023-10-06T04:44:28.182629+0000","last_peered":"2023-10-06T04:44:28.182629+0000","last_clean":"2023-10-06T04:44:28.182629+0000","last_became_active":"2023-10-06T04:44:28.171740+0000","last_became_peered":"2023-10-06T04:44:28.171740+0000","last_unstale":"2023-10-06T04:44:28.182629+0000","last_undegraded":"2023-10-06T04:44:28.182629+0000","last_fullsized":"2023-10-06T04:44:28.182629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:18.824278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187878+0000","last_change":"2023-10-06T04:44:27.167494+0000","last_active":"2023-10-06T04:44:28.187878+0000","last_peered":"2023-10-06T04:44:28.187878+0000","last_clean":"2023-10-06T04:44:28.187878+0000","last_became_active":"2023-10-06T04:44:27.167155+0000","last_became_peered":"2023-10-06T04:44:27.167155+0000","last_unstale":"2023-10-06T04:44:28.187878+0000","last_undegraded":"2023-10-06T04:44:28.187878+0000","last_fullsized":"2023-10-06T04:44:28.187878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:32.538225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182250+0000","last_change":"2023-10-06T04:44:28.173948+0000","last_active":"2023-10-06T04:44:28.182250+0000","last_peered":"2023-10-06T04:44:28.182250+0000","last_clean":"2023-10-06T04:44:28.182250+0000","last_became_active":"2023-10-06T04:44:28.173514+0000","last_became_peered":"2023-10-06T04:44:28.173514+0000","last_unstale":"2023-10-06T04:44:28.182250+0000","last_undegraded":"2023-10-06T04:44:28.182250+0000","last_fullsized":"2023-10-06T04:44:28.182250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:05.030988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.178297+0000","last_change":"2023-10-06T04:44:28.173994+0000","last_active":"2023-10-06T04:44:28.178297+0000","last_peered":"2023-10-06T04:44:28.178297+0000","last_clean":"2023-10-06T04:44:28.178297+0000","last_became_active":"2023-10-06T04:44:28.173726+0000","last_became_peered":"2023-10-06T04:44:28.173726+0000","last_unstale":"2023-10-06T04:44:28.178297+0000","last_undegraded":"2023-10-06T04:44:28.178297+0000","last_fullsized":"2023-10-06T04:44:28.178297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:11.893905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183032+0000","last_change":"2023-10-06T04:44:28.176890+0000","last_active":"2023-10-06T04:44:28.183032+0000","last_peered":"2023-10-06T04:44:28.183032+0000","last_clean":"2023-10-06T04:44:28.183032+0000","last_became_active":"2023-10-06T04:44:28.174436+0000","last_became_peered":"2023-10-06T04:44:28.174436+0000","last_unstale":"2023-10-06T04:44:28.183032+0000","last_undegraded":"2023-10-06T04:44:28.183032+0000","last_fullsized":"2023-10-06T04:44:28.183032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:44.708051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184270+0000","last_change":"2023-10-06T04:44:28.176267+0000","last_active":"2023-10-06T04:44:28.184270+0000","last_peered":"2023-10-06T04:44:28.184270+0000","last_clean":"2023-10-06T04:44:28.184270+0000","last_became_active":"2023-10-06T04:44:28.175988+0000","last_became_peered":"2023-10-06T04:44:28.175988+0000","last_unstale":"2023-10-06T04:44:28.184270+0000","last_undegraded":"2023-10-06T04:44:28.184270+0000","last_fullsized":"2023-10-06T04:44:28.184270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:17.605122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182577+0000","last_change":"2023-10-06T04:44:28.174588+0000","last_active":"2023-10-06T04:44:28.182577+0000","last_peered":"2023-10-06T04:44:28.182577+0000","last_clean":"2023-10-06T04:44:28.182577+0000","last_became_active":"2023-10-06T04:44:28.174023+0000","last_became_peered":"2023-10-06T04:44:28.174023+0000","last_unstale":"2023-10-06T04:44:28.182577+0000","last_undegraded":"2023-10-06T04:44:28.182577+0000","last_fullsized":"2023-10-06T04:44:28.182577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:02.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170913+0000","last_change":"2023-10-06T04:44:28.164700+0000","last_active":"2023-10-06T04:44:28.170913+0000","last_peered":"2023-10-06T04:44:28.170913+0000","last_clean":"2023-10-06T04:44:28.170913+0000","last_became_active":"2023-10-06T04:44:28.164337+0000","last_became_peered":"2023-10-06T04:44:28.164337+0000","last_unstale":"2023-10-06T04:44:28.170913+0000","last_undegraded":"2023-10-06T04:44:28.170913+0000","last_fullsized":"2023-10-06T04:44:28.170913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:15.790501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":673730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":81610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298088,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073752,"statfs":{"total":96636764160,"available":96331522048,"internally_reserved":0,"allocated":819200,"data_stored":671978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":82164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":81610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":81700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":245760,"data_stored":83202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":233472,"data_stored":82234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:44:38.141 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:44:38.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.362+0000 7fe364dff700 1 Processor -- start 2023-10-06T04:44:38.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.362+0000 7fe364dff700 1 -- start start 2023-10-06T04:44:38.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.363+0000 7fe364dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 0x7fe3600cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.363+0000 7fe364dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe3601598e0 0x7fe3600afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.363+0000 7fe364dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3600c1d10 con 0x7fe3600ccec0 2023-10-06T04:44:38.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.363+0000 7fe364dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3600cd430 con 0x7fe3601598e0 2023-10-06T04:44:38.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.363+0000 7fe364dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600688a0 con 0x7fe3600cae80 2023-10-06T04:44:38.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.363+0000 7fe35dd9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fe3600ccec0 0x7fe3601591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36324/0 (socket says 172.21.15.124:36324) 2023-10-06T04:44:38.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35dd9b700 1 -- 172.21.15.124:0/2476961221 learned_addr learned my addr 172.21.15.124:0/2476961221 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:38.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35ed9d700 1 --2- 172.21.15.124:0/2476961221 >> v2:172.21.15.158:3300/0 conn(0x7fe3601598e0 0x7fe3600afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35e59c700 1 --2- 172.21.15.124:0/2476961221 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 0x7fe3600cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35d59a700 1 -- 172.21.15.124:0/2476961221 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012624185 0 0) 0x7fe3600c1d10 con 0x7fe3600ccec0 2023-10-06T04:44:38.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35d59a700 1 -- 172.21.15.124:0/2476961221 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe348003570 con 0x7fe3600ccec0 2023-10-06T04:44:38.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35d59a700 1 -- 172.21.15.124:0/2476961221 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1233504137 0 0) 0x7fe348003570 con 0x7fe3600ccec0 2023-10-06T04:44:38.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35e59c700 1 -- 172.21.15.124:0/2476961221 >> v2:172.21.15.158:3300/0 conn(0x7fe3601598e0 msgr2=0x7fe3600afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:38.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35e59c700 1 --2- 172.21.15.124:0/2476961221 >> v2:172.21.15.158:3300/0 conn(0x7fe3601598e0 0x7fe3600afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35e59c700 1 -- 172.21.15.124:0/2476961221 >> v1:172.21.15.124:6789/0 conn(0x7fe3600ccec0 legacy=0x7fe3601591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35e59c700 1 -- 172.21.15.124:0/2476961221 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe360068b80 con 0x7fe3600cae80 2023-10-06T04:44:38.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.364+0000 7fe35e59c700 1 --2- 172.21.15.124:0/2476961221 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 0x7fe3600cc980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3500098e0 tx=0x7fe3500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=273357da1acc9e86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:38.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe35d59a700 1 -- 172.21.15.124:0/2476961221 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354001470 con 0x7fe3600cae80 2023-10-06T04:44:38.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe35d59a700 1 -- 172.21.15.124:0/2476961221 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe350011420 con 0x7fe3600cae80 2023-10-06T04:44:38.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe35d59a700 1 -- 172.21.15.124:0/2476961221 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500117c0 con 0x7fe3600cae80 2023-10-06T04:44:38.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe364dff700 1 -- 172.21.15.124:0/2476961221 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 msgr2=0x7fe3600cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe364dff700 1 --2- 172.21.15.124:0/2476961221 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 0x7fe3600cc980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3500098e0 tx=0x7fe3500091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe364dff700 1 -- 172.21.15.124:0/2476961221 shutdown_connections 2023-10-06T04:44:38.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe364dff700 1 --2- 172.21.15.124:0/2476961221 >> v2:172.21.15.158:3300/0 conn(0x7fe3601598e0 0x7fe3600afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe364dff700 1 --2- 172.21.15.124:0/2476961221 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 0x7fe3600cc980 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe364dff700 1 -- 172.21.15.124:0/2476961221 >> 172.21.15.124:0/2476961221 conn(0x7fe3600974f0 msgr2=0x7fe3600639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:38.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe364dff700 1 -- 172.21.15.124:0/2476961221 shutdown_connections 2023-10-06T04:44:38.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.365+0000 7fe364dff700 1 -- 172.21.15.124:0/2476961221 wait complete. 2023-10-06T04:44:38.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.367+0000 7fe364dff700 1 Processor -- start 2023-10-06T04:44:38.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.367+0000 7fe364dff700 1 -- start start 2023-10-06T04:44:38.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe364dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 0x7fe36015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe364dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3600ccec0 0x7fe3601579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe364dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3601598e0 0x7fe36015b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe364dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36015cde0 con 0x7fe3601598e0 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe364dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360157f10 con 0x7fe3600ccec0 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe364dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36015c1d0 con 0x7fe3600cae80 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe35ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3601598e0 0x7fe36015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe35ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3601598e0 0x7fe36015b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40746/0 (socket says 172.21.15.124:40746) 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe35ed9d700 1 -- 172.21.15.124:0/4133210174 learned_addr learned my addr 172.21.15.124:0/4133210174 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe35e59c700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 0x7fe36015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe35dd9b700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3600ccec0 0x7fe3601579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe35ed9d700 1 -- 172.21.15.124:0/4133210174 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 msgr2=0x7fe36015a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe35ed9d700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 0x7fe36015a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe35ed9d700 1 -- 172.21.15.124:0/4133210174 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3600ccec0 msgr2=0x7fe3601579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.368+0000 7fe35ed9d700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3600ccec0 0x7fe3601579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.369+0000 7fe35ed9d700 1 -- 172.21.15.124:0/4133210174 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe350009420 con 0x7fe3601598e0 2023-10-06T04:44:38.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.369+0000 7fe35ed9d700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3601598e0 0x7fe36015b960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe358009df0 tx=0x7fe35800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:38.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.369+0000 7fe34e7fc700 1 -- 172.21.15.124:0/4133210174 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35800caa0 con 0x7fe3601598e0 2023-10-06T04:44:38.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.369+0000 7fe34e7fc700 1 -- 172.21.15.124:0/4133210174 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35800f040 con 0x7fe3601598e0 2023-10-06T04:44:38.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.369+0000 7fe364dff700 1 -- 172.21.15.124:0/4133210174 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36015c4b0 con 0x7fe3601598e0 2023-10-06T04:44:38.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.369+0000 7fe34e7fc700 1 -- 172.21.15.124:0/4133210174 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35800ce70 con 0x7fe3601598e0 2023-10-06T04:44:38.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.369+0000 7fe364dff700 1 -- 172.21.15.124:0/4133210174 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36015ca70 con 0x7fe3601598e0 2023-10-06T04:44:38.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.370+0000 7fe364dff700 1 -- 172.21.15.124:0/4133210174 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3600717a0 con 0x7fe3601598e0 2023-10-06T04:44:38.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.371+0000 7fe34e7fc700 1 -- 172.21.15.124:0/4133210174 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe358014690 con 0x7fe3601598e0 2023-10-06T04:44:38.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.372+0000 7fe34e7fc700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe340066f30 0x7fe3400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.372+0000 7fe34e7fc700 1 -- 172.21.15.124:0/4133210174 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe358084f20 con 0x7fe3601598e0 2023-10-06T04:44:38.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.372+0000 7fe35e59c700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe340066f30 0x7fe3400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.373+0000 7fe35e59c700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe340066f30 0x7fe3400693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3500093f0 tx=0x7fe350016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:38.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.376+0000 7fe34e7fc700 1 -- 172.21.15.124:0/4133210174 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe358055ac0 con 0x7fe3601598e0 2023-10-06T04:44:38.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.562+0000 7fe364dff700 1 -- 172.21.15.124:0/4133210174 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe36015cf20 con 0x7fe340066f30 2023-10-06T04:44:38.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.570+0000 7fe34e7fc700 1 -- 172.21.15.124:0/4133210174 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286831 (secure 0 0 0) 0x7fe36015cf20 con 0x7fe340066f30 2023-10-06T04:44:38.576 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:38.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 -- 172.21.15.124:0/4133210174 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe340066f30 msgr2=0x7fe3400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe340066f30 0x7fe3400693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3500093f0 tx=0x7fe350016000 comp rx=0 tx=0).stop 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 -- 172.21.15.124:0/4133210174 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3601598e0 msgr2=0x7fe36015b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3601598e0 0x7fe36015b960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe358009df0 tx=0x7fe35800b040 comp rx=0 tx=0).stop 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 -- 172.21.15.124:0/4133210174 shutdown_connections 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3601598e0 0x7fe36015b960 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe340066f30 0x7fe3400693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe3600cae80 0x7fe36015a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 --2- 172.21.15.124:0/4133210174 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3600ccec0 0x7fe3601579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 -- 172.21.15.124:0/4133210174 >> 172.21.15.124:0/4133210174 conn(0x7fe3600974f0 msgr2=0x7fe360158780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 -- 172.21.15.124:0/4133210174 shutdown_connections 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.574+0000 7fe364dff700 1 -- 172.21.15.124:0/4133210174 wait complete. 2023-10-06T04:44:38.579 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:44:38.594 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-06T04:44:37.909264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381288,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593432,"statfs":{"total":773094113280,"available":770655674368,"internally_reserved":0,"allocated":3055616,"data_stored":1838228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.758944"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174396+0000","last_change":"2023-10-06T04:44:28.173422+0000","last_active":"2023-10-06T04:44:28.174396+0000","last_peered":"2023-10-06T04:44:28.174396+0000","last_clean":"2023-10-06T04:44:28.174396+0000","last_became_active":"2023-10-06T04:44:28.172872+0000","last_became_peered":"2023-10-06T04:44:28.172872+0000","last_unstale":"2023-10-06T04:44:28.174396+0000","last_undegraded":"2023-10-06T04:44:28.174396+0000","last_fullsized":"2023-10-06T04:44:28.174396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:26.020254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177872+0000","last_change":"2023-10-06T04:44:28.166093+0000","last_active":"2023-10-06T04:44:28.177872+0000","last_peered":"2023-10-06T04:44:28.177872+0000","last_clean":"2023-10-06T04:44:28.177872+0000","last_became_active":"2023-10-06T04:44:28.165832+0000","last_became_peered":"2023-10-06T04:44:28.165832+0000","last_unstale":"2023-10-06T04:44:28.177872+0000","last_undegraded":"2023-10-06T04:44:28.177872+0000","last_fullsized":"2023-10-06T04:44:28.177872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:20.325293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184510+0000","last_change":"2023-10-06T04:44:28.181890+0000","last_active":"2023-10-06T04:44:28.184510+0000","last_peered":"2023-10-06T04:44:28.184510+0000","last_clean":"2023-10-06T04:44:28.184510+0000","last_became_active":"2023-10-06T04:44:28.181525+0000","last_became_peered":"2023-10-06T04:44:28.181525+0000","last_unstale":"2023-10-06T04:44:28.184510+0000","last_undegraded":"2023-10-06T04:44:28.184510+0000","last_fullsized":"2023-10-06T04:44:28.184510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:10.808836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183592+0000","last_change":"2023-10-06T04:44:28.175818+0000","last_active":"2023-10-06T04:44:28.183592+0000","last_peered":"2023-10-06T04:44:28.183592+0000","last_clean":"2023-10-06T04:44:28.183592+0000","last_became_active":"2023-10-06T04:44:28.175535+0000","last_became_peered":"2023-10-06T04:44:28.175535+0000","last_unstale":"2023-10-06T04:44:28.183592+0000","last_undegraded":"2023-10-06T04:44:28.183592+0000","last_fullsized":"2023-10-06T04:44:28.183592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:54.215039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187267+0000","last_change":"2023-10-06T04:44:28.181590+0000","last_active":"2023-10-06T04:44:28.187267+0000","last_peered":"2023-10-06T04:44:28.187267+0000","last_clean":"2023-10-06T04:44:28.187267+0000","last_became_active":"2023-10-06T04:44:28.181326+0000","last_became_peered":"2023-10-06T04:44:28.181326+0000","last_unstale":"2023-10-06T04:44:28.187267+0000","last_undegraded":"2023-10-06T04:44:28.187267+0000","last_fullsized":"2023-10-06T04:44:28.187267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:22.042195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184289+0000","last_change":"2023-10-06T04:44:28.180417+0000","last_active":"2023-10-06T04:44:28.184289+0000","last_peered":"2023-10-06T04:44:28.184289+0000","last_clean":"2023-10-06T04:44:28.184289+0000","last_became_active":"2023-10-06T04:44:28.179929+0000","last_became_peered":"2023-10-06T04:44:28.179929+0000","last_unstale":"2023-10-06T04:44:28.184289+0000","last_undegraded":"2023-10-06T04:44:28.184289+0000","last_fullsized":"2023-10-06T04:44:28.184289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:37.525707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182963+0000","last_change":"2023-10-06T04:44:28.178946+0000","last_active":"2023-10-06T04:44:28.182963+0000","last_peered":"2023-10-06T04:44:28.182963+0000","last_clean":"2023-10-06T04:44:28.182963+0000","last_became_active":"2023-10-06T04:44:28.178304+0000","last_became_peered":"2023-10-06T04:44:28.178304+0000","last_unstale":"2023-10-06T04:44:28.182963+0000","last_undegraded":"2023-10-06T04:44:28.182963+0000","last_fullsized":"2023-10-06T04:44:28.182963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.327276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.180058+0000","last_change":"2023-10-06T04:44:28.175157+0000","last_active":"2023-10-06T04:44:28.180058+0000","last_peered":"2023-10-06T04:44:28.180058+0000","last_clean":"2023-10-06T04:44:28.180058+0000","last_became_active":"2023-10-06T04:44:28.174893+0000","last_became_peered":"2023-10-06T04:44:28.174893+0000","last_unstale":"2023-10-06T04:44:28.180058+0000","last_undegraded":"2023-10-06T04:44:28.180058+0000","last_fullsized":"2023-10-06T04:44:28.180058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.047230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175971+0000","last_change":"2023-10-06T04:44:28.172925+0000","last_active":"2023-10-06T04:44:28.175971+0000","last_peered":"2023-10-06T04:44:28.175971+0000","last_clean":"2023-10-06T04:44:28.175971+0000","last_became_active":"2023-10-06T04:44:28.172656+0000","last_became_peered":"2023-10-06T04:44:28.172656+0000","last_unstale":"2023-10-06T04:44:28.175971+0000","last_undegraded":"2023-10-06T04:44:28.175971+0000","last_fullsized":"2023-10-06T04:44:28.175971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:58.202199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.169346+0000","last_change":"2023-10-06T04:44:28.162650+0000","last_active":"2023-10-06T04:44:28.169346+0000","last_peered":"2023-10-06T04:44:28.169346+0000","last_clean":"2023-10-06T04:44:28.169346+0000","last_became_active":"2023-10-06T04:44:28.162164+0000","last_became_peered":"2023-10-06T04:44:28.162164+0000","last_unstale":"2023-10-06T04:44:28.169346+0000","last_undegraded":"2023-10-06T04:44:28.169346+0000","last_fullsized":"2023-10-06T04:44:28.169346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182834+0000","last_change":"2023-10-06T04:44:28.174246+0000","last_active":"2023-10-06T04:44:28.182834+0000","last_peered":"2023-10-06T04:44:28.182834+0000","last_clean":"2023-10-06T04:44:28.182834+0000","last_became_active":"2023-10-06T04:44:28.173913+0000","last_became_peered":"2023-10-06T04:44:28.173913+0000","last_unstale":"2023-10-06T04:44:28.182834+0000","last_undegraded":"2023-10-06T04:44:28.182834+0000","last_fullsized":"2023-10-06T04:44:28.182834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182061+0000","last_change":"2023-10-06T04:44:28.175653+0000","last_active":"2023-10-06T04:44:28.182061+0000","last_peered":"2023-10-06T04:44:28.182061+0000","last_clean":"2023-10-06T04:44:28.182061+0000","last_became_active":"2023-10-06T04:44:28.175322+0000","last_became_peered":"2023-10-06T04:44:28.175322+0000","last_unstale":"2023-10-06T04:44:28.182061+0000","last_undegraded":"2023-10-06T04:44:28.182061+0000","last_fullsized":"2023-10-06T04:44:28.182061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:45.455338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174379+0000","last_change":"2023-10-06T04:44:28.173340+0000","last_active":"2023-10-06T04:44:28.174379+0000","last_peered":"2023-10-06T04:44:28.174379+0000","last_clean":"2023-10-06T04:44:28.174379+0000","last_became_active":"2023-10-06T04:44:28.173003+0000","last_became_peered":"2023-10-06T04:44:28.173003+0000","last_unstale":"2023-10-06T04:44:28.174379+0000","last_undegraded":"2023-10-06T04:44:28.174379+0000","last_fullsized":"2023-10-06T04:44:28.174379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:33.543547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177809+0000","last_change":"2023-10-06T04:44:28.164616+0000","last_active":"2023-10-06T04:44:28.177809+0000","last_peered":"2023-10-06T04:44:28.177809+0000","last_clean":"2023-10-06T04:44:28.177809+0000","last_became_active":"2023-10-06T04:44:28.164191+0000","last_became_peered":"2023-10-06T04:44:28.164191+0000","last_unstale":"2023-10-06T04:44:28.177809+0000","last_undegraded":"2023-10-06T04:44:28.177809+0000","last_fullsized":"2023-10-06T04:44:28.177809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:59.257080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182983+0000","last_change":"2023-10-06T04:44:28.179115+0000","last_active":"2023-10-06T04:44:28.182983+0000","last_peered":"2023-10-06T04:44:28.182983+0000","last_clean":"2023-10-06T04:44:28.182983+0000","last_became_active":"2023-10-06T04:44:28.178643+0000","last_became_peered":"2023-10-06T04:44:28.178643+0000","last_unstale":"2023-10-06T04:44:28.182983+0000","last_undegraded":"2023-10-06T04:44:28.182983+0000","last_fullsized":"2023-10-06T04:44:28.182983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184235+0000","last_change":"2023-10-06T04:44:28.180012+0000","last_active":"2023-10-06T04:44:28.184235+0000","last_peered":"2023-10-06T04:44:28.184235+0000","last_clean":"2023-10-06T04:44:28.184235+0000","last_became_active":"2023-10-06T04:44:28.179719+0000","last_became_peered":"2023-10-06T04:44:28.179719+0000","last_unstale":"2023-10-06T04:44:28.184235+0000","last_undegraded":"2023-10-06T04:44:28.184235+0000","last_fullsized":"2023-10-06T04:44:28.184235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.765680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.175953+0000","last_change":"2023-10-06T04:44:28.172407+0000","last_active":"2023-10-06T04:44:28.175953+0000","last_peered":"2023-10-06T04:44:28.175953+0000","last_clean":"2023-10-06T04:44:28.175953+0000","last_became_active":"2023-10-06T04:44:28.172144+0000","last_became_peered":"2023-10-06T04:44:28.172144+0000","last_unstale":"2023-10-06T04:44:28.175953+0000","last_undegraded":"2023-10-06T04:44:28.175953+0000","last_fullsized":"2023-10-06T04:44:28.175953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:30.261730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184051+0000","last_change":"2023-10-06T04:44:28.175526+0000","last_active":"2023-10-06T04:44:28.184051+0000","last_peered":"2023-10-06T04:44:28.184051+0000","last_clean":"2023-10-06T04:44:28.184051+0000","last_became_active":"2023-10-06T04:44:28.174982+0000","last_became_peered":"2023-10-06T04:44:28.174982+0000","last_unstale":"2023-10-06T04:44:28.184051+0000","last_undegraded":"2023-10-06T04:44:28.184051+0000","last_fullsized":"2023-10-06T04:44:28.184051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:44.708051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.167827+0000","last_change":"2023-10-06T04:44:28.165012+0000","last_active":"2023-10-06T04:44:28.167827+0000","last_peered":"2023-10-06T04:44:28.167827+0000","last_clean":"2023-10-06T04:44:28.167827+0000","last_became_active":"2023-10-06T04:44:28.164574+0000","last_became_peered":"2023-10-06T04:44:28.164574+0000","last_unstale":"2023-10-06T04:44:28.167827+0000","last_undegraded":"2023-10-06T04:44:28.167827+0000","last_fullsized":"2023-10-06T04:44:28.167827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:29.304110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.186324+0000","last_change":"2023-10-06T04:44:28.178396+0000","last_active":"2023-10-06T04:44:28.186324+0000","last_peered":"2023-10-06T04:44:28.186324+0000","last_clean":"2023-10-06T04:44:28.186324+0000","last_became_active":"2023-10-06T04:44:28.178046+0000","last_became_peered":"2023-10-06T04:44:28.178046+0000","last_unstale":"2023-10-06T04:44:28.186324+0000","last_undegraded":"2023-10-06T04:44:28.186324+0000","last_fullsized":"2023-10-06T04:44:28.186324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:06.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183703+0000","last_change":"2023-10-06T04:44:28.182289+0000","last_active":"2023-10-06T04:44:28.183703+0000","last_peered":"2023-10-06T04:44:28.183703+0000","last_clean":"2023-10-06T04:44:28.183703+0000","last_became_active":"2023-10-06T04:44:28.181655+0000","last_became_peered":"2023-10-06T04:44:28.181655+0000","last_unstale":"2023-10-06T04:44:28.183703+0000","last_undegraded":"2023-10-06T04:44:28.183703+0000","last_fullsized":"2023-10-06T04:44:28.183703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:20.325293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.169239+0000","last_change":"2023-10-06T04:44:28.166193+0000","last_active":"2023-10-06T04:44:28.169239+0000","last_peered":"2023-10-06T04:44:28.169239+0000","last_clean":"2023-10-06T04:44:28.169239+0000","last_became_active":"2023-10-06T04:44:28.165254+0000","last_became_peered":"2023-10-06T04:44:28.165254+0000","last_unstale":"2023-10-06T04:44:28.169239+0000","last_undegraded":"2023-10-06T04:44:28.169239+0000","last_fullsized":"2023-10-06T04:44:28.169239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.526003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182644+0000","last_change":"2023-10-06T04:44:28.172488+0000","last_active":"2023-10-06T04:44:28.182644+0000","last_peered":"2023-10-06T04:44:28.182644+0000","last_clean":"2023-10-06T04:44:28.182644+0000","last_became_active":"2023-10-06T04:44:28.172052+0000","last_became_peered":"2023-10-06T04:44:28.172052+0000","last_unstale":"2023-10-06T04:44:28.182644+0000","last_undegraded":"2023-10-06T04:44:28.182644+0000","last_fullsized":"2023-10-06T04:44:28.182644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:25.165826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.192712+0000","last_change":"2023-10-06T04:44:28.188043+0000","last_active":"2023-10-06T04:44:28.192712+0000","last_peered":"2023-10-06T04:44:28.192712+0000","last_clean":"2023-10-06T04:44:28.192712+0000","last_became_active":"2023-10-06T04:44:28.187730+0000","last_became_peered":"2023-10-06T04:44:28.187730+0000","last_unstale":"2023-10-06T04:44:28.192712+0000","last_undegraded":"2023-10-06T04:44:28.192712+0000","last_fullsized":"2023-10-06T04:44:28.192712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170258+0000","last_change":"2023-10-06T04:44:28.165414+0000","last_active":"2023-10-06T04:44:28.170258+0000","last_peered":"2023-10-06T04:44:28.170258+0000","last_clean":"2023-10-06T04:44:28.170258+0000","last_became_active":"2023-10-06T04:44:28.165101+0000","last_became_peered":"2023-10-06T04:44:28.165101+0000","last_unstale":"2023-10-06T04:44:28.170258+0000","last_undegraded":"2023-10-06T04:44:28.170258+0000","last_fullsized":"2023-10-06T04:44:28.170258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.526003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.177390+0000","last_change":"2023-10-06T04:44:28.168938+0000","last_active":"2023-10-06T04:44:28.177390+0000","last_peered":"2023-10-06T04:44:28.177390+0000","last_clean":"2023-10-06T04:44:28.177390+0000","last_became_active":"2023-10-06T04:44:28.168679+0000","last_became_peered":"2023-10-06T04:44:28.168679+0000","last_unstale":"2023-10-06T04:44:28.177390+0000","last_undegraded":"2023-10-06T04:44:28.177390+0000","last_fullsized":"2023-10-06T04:44:28.177390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:35:22.562710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.179522+0000","last_change":"2023-10-06T04:44:28.169001+0000","last_active":"2023-10-06T04:44:28.179522+0000","last_peered":"2023-10-06T04:44:28.179522+0000","last_clean":"2023-10-06T04:44:28.179522+0000","last_became_active":"2023-10-06T04:44:28.168663+0000","last_became_peered":"2023-10-06T04:44:28.168663+0000","last_unstale":"2023-10-06T04:44:28.179522+0000","last_undegraded":"2023-10-06T04:44:28.179522+0000","last_fullsized":"2023-10-06T04:44:28.179522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:18.824278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187348+0000","last_change":"2023-10-06T04:44:27.176063+0000","last_active":"2023-10-06T04:44:28.187348+0000","last_peered":"2023-10-06T04:44:28.187348+0000","last_clean":"2023-10-06T04:44:28.187348+0000","last_became_active":"2023-10-06T04:44:27.175663+0000","last_became_peered":"2023-10-06T04:44:27.175663+0000","last_unstale":"2023-10-06T04:44:28.187348+0000","last_undegraded":"2023-10-06T04:44:28.187348+0000","last_fullsized":"2023-10-06T04:44:28.187348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182422+0000","last_change":"2023-10-06T04:44:28.171391+0000","last_active":"2023-10-06T04:44:28.182422+0000","last_peered":"2023-10-06T04:44:28.182422+0000","last_clean":"2023-10-06T04:44:28.182422+0000","last_became_active":"2023-10-06T04:44:28.171117+0000","last_became_peered":"2023-10-06T04:44:28.171117+0000","last_unstale":"2023-10-06T04:44:28.182422+0000","last_undegraded":"2023-10-06T04:44:28.182422+0000","last_fullsized":"2023-10-06T04:44:28.182422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:06.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.153053+0000","last_change":"2023-10-06T04:44:27.175499+0000","last_active":"2023-10-06T04:44:28.153053+0000","last_peered":"2023-10-06T04:44:28.153053+0000","last_clean":"2023-10-06T04:44:28.153053+0000","last_became_active":"2023-10-06T04:44:27.175181+0000","last_became_peered":"2023-10-06T04:44:27.175181+0000","last_unstale":"2023-10-06T04:44:28.153053+0000","last_undegraded":"2023-10-06T04:44:28.153053+0000","last_fullsized":"2023-10-06T04:44:28.153053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:18.613164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176004+0000","last_change":"2023-10-06T04:44:28.171657+0000","last_active":"2023-10-06T04:44:28.176004+0000","last_peered":"2023-10-06T04:44:28.176004+0000","last_clean":"2023-10-06T04:44:28.176004+0000","last_became_active":"2023-10-06T04:44:28.171374+0000","last_became_peered":"2023-10-06T04:44:28.171374+0000","last_unstale":"2023-10-06T04:44:28.176004+0000","last_undegraded":"2023-10-06T04:44:28.176004+0000","last_fullsized":"2023-10-06T04:44:28.176004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:10.149033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.158784+0000","last_change":"2023-10-06T04:44:27.160189+0000","last_active":"2023-10-06T04:44:28.158784+0000","last_peered":"2023-10-06T04:44:28.158784+0000","last_clean":"2023-10-06T04:44:28.158784+0000","last_became_active":"2023-10-06T04:44:27.159913+0000","last_became_peered":"2023-10-06T04:44:27.159913+0000","last_unstale":"2023-10-06T04:44:28.158784+0000","last_undegraded":"2023-10-06T04:44:28.158784+0000","last_fullsized":"2023-10-06T04:44:28.158784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:31.797194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173154+0000","last_change":"2023-10-06T04:44:28.169511+0000","last_active":"2023-10-06T04:44:28.173154+0000","last_peered":"2023-10-06T04:44:28.173154+0000","last_clean":"2023-10-06T04:44:28.173154+0000","last_became_active":"2023-10-06T04:44:28.169196+0000","last_became_peered":"2023-10-06T04:44:28.169196+0000","last_unstale":"2023-10-06T04:44:28.173154+0000","last_undegraded":"2023-10-06T04:44:28.173154+0000","last_fullsized":"2023-10-06T04:44:28.173154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:14.693541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.157141+0000","last_change":"2023-10-06T04:44:27.165250+0000","last_active":"2023-10-06T04:44:28.157141+0000","last_peered":"2023-10-06T04:44:28.157141+0000","last_clean":"2023-10-06T04:44:28.157141+0000","last_became_active":"2023-10-06T04:44:27.164945+0000","last_became_peered":"2023-10-06T04:44:27.164945+0000","last_unstale":"2023-10-06T04:44:28.157141+0000","last_undegraded":"2023-10-06T04:44:28.157141+0000","last_fullsized":"2023-10-06T04:44:28.157141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:25.014932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183077+0000","last_change":"2023-10-06T04:44:28.178132+0000","last_active":"2023-10-06T04:44:28.183077+0000","last_peered":"2023-10-06T04:44:28.183077+0000","last_clean":"2023-10-06T04:44:28.183077+0000","last_became_active":"2023-10-06T04:44:28.177887+0000","last_became_peered":"2023-10-06T04:44:28.177887+0000","last_unstale":"2023-10-06T04:44:28.183077+0000","last_undegraded":"2023-10-06T04:44:28.183077+0000","last_fullsized":"2023-10-06T04:44:28.183077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:05.030988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.154814+0000","last_change":"2023-10-06T04:44:27.175489+0000","last_active":"2023-10-06T04:44:28.154814+0000","last_peered":"2023-10-06T04:44:28.154814+0000","last_clean":"2023-10-06T04:44:28.154814+0000","last_became_active":"2023-10-06T04:44:27.175091+0000","last_became_peered":"2023-10-06T04:44:27.175091+0000","last_unstale":"2023-10-06T04:44:28.154814+0000","last_undegraded":"2023-10-06T04:44:28.154814+0000","last_fullsized":"2023-10-06T04:44:28.154814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182780+0000","last_change":"2023-10-06T04:44:28.175583+0000","last_active":"2023-10-06T04:44:28.182780+0000","last_peered":"2023-10-06T04:44:28.182780+0000","last_clean":"2023-10-06T04:44:28.182780+0000","last_became_active":"2023-10-06T04:44:28.174168+0000","last_became_peered":"2023-10-06T04:44:28.174168+0000","last_unstale":"2023-10-06T04:44:28.182780+0000","last_undegraded":"2023-10-06T04:44:28.182780+0000","last_fullsized":"2023-10-06T04:44:28.182780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:13.248204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194379+0000","last_change":"2023-10-06T04:44:27.173497+0000","last_active":"2023-10-06T04:44:28.194379+0000","last_peered":"2023-10-06T04:44:28.194379+0000","last_clean":"2023-10-06T04:44:28.194379+0000","last_became_active":"2023-10-06T04:44:27.173266+0000","last_became_peered":"2023-10-06T04:44:27.173266+0000","last_unstale":"2023-10-06T04:44:28.194379+0000","last_undegraded":"2023-10-06T04:44:28.194379+0000","last_fullsized":"2023-10-06T04:44:28.194379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:25.287936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170646+0000","last_change":"2023-10-06T04:44:28.164074+0000","last_active":"2023-10-06T04:44:28.170646+0000","last_peered":"2023-10-06T04:44:28.170646+0000","last_clean":"2023-10-06T04:44:28.170646+0000","last_became_active":"2023-10-06T04:44:28.163794+0000","last_became_peered":"2023-10-06T04:44:28.163794+0000","last_unstale":"2023-10-06T04:44:28.170646+0000","last_undegraded":"2023-10-06T04:44:28.170646+0000","last_fullsized":"2023-10-06T04:44:28.170646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:00.867338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.195971+0000","last_change":"2023-10-06T04:44:27.174376+0000","last_active":"2023-10-06T04:44:28.195971+0000","last_peered":"2023-10-06T04:44:28.195971+0000","last_clean":"2023-10-06T04:44:28.195971+0000","last_became_active":"2023-10-06T04:44:27.172580+0000","last_became_peered":"2023-10-06T04:44:27.172580+0000","last_unstale":"2023-10-06T04:44:28.195971+0000","last_undegraded":"2023-10-06T04:44:28.195971+0000","last_fullsized":"2023-10-06T04:44:28.195971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:18.718435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184206+0000","last_change":"2023-10-06T04:44:28.176191+0000","last_active":"2023-10-06T04:44:28.184206+0000","last_peered":"2023-10-06T04:44:28.184206+0000","last_clean":"2023-10-06T04:44:28.184206+0000","last_became_active":"2023-10-06T04:44:28.175904+0000","last_became_peered":"2023-10-06T04:44:28.175904+0000","last_unstale":"2023-10-06T04:44:28.184206+0000","last_undegraded":"2023-10-06T04:44:28.184206+0000","last_fullsized":"2023-10-06T04:44:28.184206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:02.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.193953+0000","last_change":"2023-10-06T04:44:27.176572+0000","last_active":"2023-10-06T04:44:28.193953+0000","last_peered":"2023-10-06T04:44:28.193953+0000","last_clean":"2023-10-06T04:44:28.193953+0000","last_became_active":"2023-10-06T04:44:27.176184+0000","last_became_peered":"2023-10-06T04:44:27.176184+0000","last_unstale":"2023-10-06T04:44:28.193953+0000","last_undegraded":"2023-10-06T04:44:28.193953+0000","last_fullsized":"2023-10-06T04:44:28.193953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:42.805321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183777+0000","last_change":"2023-10-06T04:44:28.179767+0000","last_active":"2023-10-06T04:44:28.183777+0000","last_peered":"2023-10-06T04:44:28.183777+0000","last_clean":"2023-10-06T04:44:28.183777+0000","last_became_active":"2023-10-06T04:44:28.178145+0000","last_became_peered":"2023-10-06T04:44:28.178145+0000","last_unstale":"2023-10-06T04:44:28.183777+0000","last_undegraded":"2023-10-06T04:44:28.183777+0000","last_fullsized":"2023-10-06T04:44:28.183777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.765680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.157130+0000","last_change":"2023-10-06T04:44:27.169868+0000","last_active":"2023-10-06T04:44:28.157130+0000","last_peered":"2023-10-06T04:44:28.157130+0000","last_clean":"2023-10-06T04:44:28.157130+0000","last_became_active":"2023-10-06T04:44:27.169616+0000","last_became_peered":"2023-10-06T04:44:27.169616+0000","last_unstale":"2023-10-06T04:44:28.157130+0000","last_undegraded":"2023-10-06T04:44:28.157130+0000","last_fullsized":"2023-10-06T04:44:28.157130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:56.308717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.179502+0000","last_change":"2023-10-06T04:44:28.168629+0000","last_active":"2023-10-06T04:44:28.179502+0000","last_peered":"2023-10-06T04:44:28.179502+0000","last_clean":"2023-10-06T04:44:28.179502+0000","last_became_active":"2023-10-06T04:44:28.168374+0000","last_became_peered":"2023-10-06T04:44:28.168374+0000","last_unstale":"2023-10-06T04:44:28.179502+0000","last_undegraded":"2023-10-06T04:44:28.179502+0000","last_fullsized":"2023-10-06T04:44:28.179502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:08.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.163827+0000","last_change":"2023-10-06T04:44:27.175001+0000","last_active":"2023-10-06T04:44:28.163827+0000","last_peered":"2023-10-06T04:44:28.163827+0000","last_clean":"2023-10-06T04:44:28.163827+0000","last_became_active":"2023-10-06T04:44:27.174715+0000","last_became_peered":"2023-10-06T04:44:27.174715+0000","last_unstale":"2023-10-06T04:44:28.163827+0000","last_undegraded":"2023-10-06T04:44:28.163827+0000","last_fullsized":"2023-10-06T04:44:28.163827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:16.760012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187237+0000","last_change":"2023-10-06T04:44:28.181610+0000","last_active":"2023-10-06T04:44:28.187237+0000","last_peered":"2023-10-06T04:44:28.187237+0000","last_clean":"2023-10-06T04:44:28.187237+0000","last_became_active":"2023-10-06T04:44:28.180610+0000","last_became_peered":"2023-10-06T04:44:28.180610+0000","last_unstale":"2023-10-06T04:44:28.187237+0000","last_undegraded":"2023-10-06T04:44:28.187237+0000","last_fullsized":"2023-10-06T04:44:28.187237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:15.790501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.191273+0000","last_change":"2023-10-06T04:44:27.162747+0000","last_active":"2023-10-06T04:44:28.191273+0000","last_peered":"2023-10-06T04:44:28.191273+0000","last_clean":"2023-10-06T04:44:28.191273+0000","last_became_active":"2023-10-06T04:44:27.162395+0000","last_became_peered":"2023-10-06T04:44:27.162395+0000","last_unstale":"2023-10-06T04:44:28.191273+0000","last_undegraded":"2023-10-06T04:44:28.191273+0000","last_fullsized":"2023-10-06T04:44:28.191273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182885+0000","last_change":"2023-10-06T04:44:28.175866+0000","last_active":"2023-10-06T04:44:28.182885+0000","last_peered":"2023-10-06T04:44:28.182885+0000","last_clean":"2023-10-06T04:44:28.182885+0000","last_became_active":"2023-10-06T04:44:28.174850+0000","last_became_peered":"2023-10-06T04:44:28.174850+0000","last_unstale":"2023-10-06T04:44:28.182885+0000","last_undegraded":"2023-10-06T04:44:28.182885+0000","last_fullsized":"2023-10-06T04:44:28.182885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:44.943378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.193693+0000","last_change":"2023-10-06T04:44:27.171420+0000","last_active":"2023-10-06T04:44:28.193693+0000","last_peered":"2023-10-06T04:44:28.193693+0000","last_clean":"2023-10-06T04:44:28.193693+0000","last_became_active":"2023-10-06T04:44:27.170321+0000","last_became_peered":"2023-10-06T04:44:27.170321+0000","last_unstale":"2023-10-06T04:44:28.193693+0000","last_undegraded":"2023-10-06T04:44:28.193693+0000","last_fullsized":"2023-10-06T04:44:28.193693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.180040+0000","last_change":"2023-10-06T04:44:28.167916+0000","last_active":"2023-10-06T04:44:28.180040+0000","last_peered":"2023-10-06T04:44:28.180040+0000","last_clean":"2023-10-06T04:44:28.180040+0000","last_became_active":"2023-10-06T04:44:28.167567+0000","last_became_peered":"2023-10-06T04:44:28.167567+0000","last_unstale":"2023-10-06T04:44:28.180040+0000","last_undegraded":"2023-10-06T04:44:28.180040+0000","last_fullsized":"2023-10-06T04:44:28.180040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.327276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194098+0000","last_change":"2023-10-06T04:44:27.171251+0000","last_active":"2023-10-06T04:44:28.194098+0000","last_peered":"2023-10-06T04:44:28.194098+0000","last_clean":"2023-10-06T04:44:28.194098+0000","last_became_active":"2023-10-06T04:44:27.170918+0000","last_became_peered":"2023-10-06T04:44:27.170918+0000","last_unstale":"2023-10-06T04:44:28.194098+0000","last_undegraded":"2023-10-06T04:44:28.194098+0000","last_fullsized":"2023-10-06T04:44:28.194098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:31.797194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182452+0000","last_change":"2023-10-06T04:44:28.173878+0000","last_active":"2023-10-06T04:44:28.182452+0000","last_peered":"2023-10-06T04:44:28.182452+0000","last_clean":"2023-10-06T04:44:28.182452+0000","last_became_active":"2023-10-06T04:44:28.173437+0000","last_became_peered":"2023-10-06T04:44:28.173437+0000","last_unstale":"2023-10-06T04:44:28.182452+0000","last_undegraded":"2023-10-06T04:44:28.182452+0000","last_fullsized":"2023-10-06T04:44:28.182452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:13.338361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.194313+0000","last_change":"2023-10-06T04:44:27.176907+0000","last_active":"2023-10-06T04:44:28.194313+0000","last_peered":"2023-10-06T04:44:28.194313+0000","last_clean":"2023-10-06T04:44:28.194313+0000","last_became_active":"2023-10-06T04:44:27.176591+0000","last_became_peered":"2023-10-06T04:44:27.176591+0000","last_unstale":"2023-10-06T04:44:28.194313+0000","last_undegraded":"2023-10-06T04:44:28.194313+0000","last_fullsized":"2023-10-06T04:44:28.194313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:48.634872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.174467+0000","last_change":"2023-10-06T04:44:28.170672+0000","last_active":"2023-10-06T04:44:28.174467+0000","last_peered":"2023-10-06T04:44:28.174467+0000","last_clean":"2023-10-06T04:44:28.174467+0000","last_became_active":"2023-10-06T04:44:28.170212+0000","last_became_peered":"2023-10-06T04:44:28.170212+0000","last_unstale":"2023-10-06T04:44:28.174467+0000","last_undegraded":"2023-10-06T04:44:28.174467+0000","last_fullsized":"2023-10-06T04:44:28.174467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:55.923658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.153605+0000","last_change":"2023-10-06T04:44:27.166881+0000","last_active":"2023-10-06T04:44:28.153605+0000","last_peered":"2023-10-06T04:44:28.153605+0000","last_clean":"2023-10-06T04:44:28.153605+0000","last_became_active":"2023-10-06T04:44:27.166606+0000","last_became_peered":"2023-10-06T04:44:27.166606+0000","last_unstale":"2023-10-06T04:44:28.153605+0000","last_undegraded":"2023-10-06T04:44:28.153605+0000","last_fullsized":"2023-10-06T04:44:28.153605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:01.501146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.173200+0000","last_change":"2023-10-06T04:44:28.167261+0000","last_active":"2023-10-06T04:44:28.173200+0000","last_peered":"2023-10-06T04:44:28.173200+0000","last_clean":"2023-10-06T04:44:28.173200+0000","last_became_active":"2023-10-06T04:44:28.167017+0000","last_became_peered":"2023-10-06T04:44:28.167017+0000","last_unstale":"2023-10-06T04:44:28.173200+0000","last_undegraded":"2023-10-06T04:44:28.173200+0000","last_fullsized":"2023-10-06T04:44:28.173200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:37.963273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187450+0000","last_change":"2023-10-06T04:44:27.169708+0000","last_active":"2023-10-06T04:44:28.187450+0000","last_peered":"2023-10-06T04:44:28.187450+0000","last_clean":"2023-10-06T04:44:28.187450+0000","last_became_active":"2023-10-06T04:44:27.169446+0000","last_became_peered":"2023-10-06T04:44:27.169446+0000","last_unstale":"2023-10-06T04:44:28.187450+0000","last_undegraded":"2023-10-06T04:44:28.187450+0000","last_fullsized":"2023-10-06T04:44:28.187450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:42.805321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.186392+0000","last_change":"2023-10-06T04:44:28.182653+0000","last_active":"2023-10-06T04:44:28.186392+0000","last_peered":"2023-10-06T04:44:28.186392+0000","last_clean":"2023-10-06T04:44:28.186392+0000","last_became_active":"2023-10-06T04:44:28.182103+0000","last_became_peered":"2023-10-06T04:44:28.182103+0000","last_unstale":"2023-10-06T04:44:28.186392+0000","last_undegraded":"2023-10-06T04:44:28.186392+0000","last_fullsized":"2023-10-06T04:44:28.186392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:13.248204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.159163+0000","last_change":"2023-10-06T04:44:27.173805+0000","last_active":"2023-10-06T04:44:28.159163+0000","last_peered":"2023-10-06T04:44:28.159163+0000","last_clean":"2023-10-06T04:44:28.159163+0000","last_became_active":"2023-10-06T04:44:27.173356+0000","last_became_peered":"2023-10-06T04:44:27.173356+0000","last_unstale":"2023-10-06T04:44:28.159163+0000","last_undegraded":"2023-10-06T04:44:28.159163+0000","last_fullsized":"2023-10-06T04:44:28.159163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182814+0000","last_change":"2023-10-06T04:44:28.174085+0000","last_active":"2023-10-06T04:44:28.182814+0000","last_peered":"2023-10-06T04:44:28.182814+0000","last_clean":"2023-10-06T04:44:28.182814+0000","last_became_active":"2023-10-06T04:44:28.173252+0000","last_became_peered":"2023-10-06T04:44:28.173252+0000","last_unstale":"2023-10-06T04:44:28.182814+0000","last_undegraded":"2023-10-06T04:44:28.182814+0000","last_fullsized":"2023-10-06T04:44:28.182814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:44.943378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.159414+0000","last_change":"2023-10-06T04:44:27.173971+0000","last_active":"2023-10-06T04:44:28.159414+0000","last_peered":"2023-10-06T04:44:28.159414+0000","last_clean":"2023-10-06T04:44:28.159414+0000","last_became_active":"2023-10-06T04:44:27.173624+0000","last_became_peered":"2023-10-06T04:44:27.173624+0000","last_unstale":"2023-10-06T04:44:28.159414+0000","last_undegraded":"2023-10-06T04:44:28.159414+0000","last_fullsized":"2023-10-06T04:44:28.159414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:59.033178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184064+0000","last_change":"2023-10-06T04:44:28.175781+0000","last_active":"2023-10-06T04:44:28.184064+0000","last_peered":"2023-10-06T04:44:28.184064+0000","last_clean":"2023-10-06T04:44:28.184064+0000","last_became_active":"2023-10-06T04:44:28.174281+0000","last_became_peered":"2023-10-06T04:44:28.174281+0000","last_unstale":"2023-10-06T04:44:28.184064+0000","last_undegraded":"2023-10-06T04:44:28.184064+0000","last_fullsized":"2023-10-06T04:44:28.184064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:58.131405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.158675+0000","last_change":"2023-10-06T04:44:27.175348+0000","last_active":"2023-10-06T04:44:28.158675+0000","last_peered":"2023-10-06T04:44:28.158675+0000","last_clean":"2023-10-06T04:44:28.158675+0000","last_became_active":"2023-10-06T04:44:27.175051+0000","last_became_peered":"2023-10-06T04:44:27.175051+0000","last_unstale":"2023-10-06T04:44:28.158675+0000","last_undegraded":"2023-10-06T04:44:28.158675+0000","last_fullsized":"2023-10-06T04:44:28.158675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:16.760012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184769+0000","last_change":"2023-10-06T04:44:28.177266+0000","last_active":"2023-10-06T04:44:28.184769+0000","last_peered":"2023-10-06T04:44:28.184769+0000","last_clean":"2023-10-06T04:44:28.184769+0000","last_became_active":"2023-10-06T04:44:28.176965+0000","last_became_peered":"2023-10-06T04:44:28.176965+0000","last_unstale":"2023-10-06T04:44:28.184769+0000","last_undegraded":"2023-10-06T04:44:28.184769+0000","last_fullsized":"2023-10-06T04:44:28.184769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:37.963273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184327+0000","last_change":"2023-10-06T04:44:27.172020+0000","last_active":"2023-10-06T04:44:28.184327+0000","last_peered":"2023-10-06T04:44:28.184327+0000","last_clean":"2023-10-06T04:44:28.184327+0000","last_became_active":"2023-10-06T04:44:27.171708+0000","last_became_peered":"2023-10-06T04:44:27.171708+0000","last_unstale":"2023-10-06T04:44:28.184327+0000","last_undegraded":"2023-10-06T04:44:28.184327+0000","last_fullsized":"2023-10-06T04:44:28.184327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:07.521775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.158952+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:44:28.158952+0000","last_peered":"2023-10-06T04:44:28.158952+0000","last_clean":"2023-10-06T04:44:28.158952+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:44:28.158952+0000","last_undegraded":"2023-10-06T04:44:28.158952+0000","last_fullsized":"2023-10-06T04:44:28.158952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183055+0000","last_change":"2023-10-06T04:44:28.177250+0000","last_active":"2023-10-06T04:44:28.183055+0000","last_peered":"2023-10-06T04:44:28.183055+0000","last_clean":"2023-10-06T04:44:28.183055+0000","last_became_active":"2023-10-06T04:44:28.174266+0000","last_became_peered":"2023-10-06T04:44:28.174266+0000","last_unstale":"2023-10-06T04:44:28.183055+0000","last_undegraded":"2023-10-06T04:44:28.183055+0000","last_fullsized":"2023-10-06T04:44:28.183055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:58.131405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.157826+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:44:28.157826+0000","last_peered":"2023-10-06T04:44:28.157826+0000","last_clean":"2023-10-06T04:44:28.157826+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:44:28.157826+0000","last_undegraded":"2023-10-06T04:44:28.157826+0000","last_fullsized":"2023-10-06T04:44:28.157826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:44:29.573165+0000","last_change":"2023-10-06T04:44:27.167851+0000","last_active":"2023-10-06T04:44:29.573165+0000","last_peered":"2023-10-06T04:44:29.573165+0000","last_clean":"2023-10-06T04:44:29.573165+0000","last_became_active":"2023-10-06T04:44:27.167572+0000","last_became_peered":"2023-10-06T04:44:27.167572+0000","last_unstale":"2023-10-06T04:44:29.573165+0000","last_undegraded":"2023-10-06T04:44:29.573165+0000","last_fullsized":"2023-10-06T04:44:29.573165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:28.298788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184244+0000","last_change":"2023-10-06T04:44:28.177734+0000","last_active":"2023-10-06T04:44:28.184244+0000","last_peered":"2023-10-06T04:44:28.184244+0000","last_clean":"2023-10-06T04:44:28.184244+0000","last_became_active":"2023-10-06T04:44:28.173936+0000","last_became_peered":"2023-10-06T04:44:28.173936+0000","last_unstale":"2023-10-06T04:44:28.184244+0000","last_undegraded":"2023-10-06T04:44:28.184244+0000","last_fullsized":"2023-10-06T04:44:28.184244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:31.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.153186+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:44:28.153186+0000","last_peered":"2023-10-06T04:44:28.153186+0000","last_clean":"2023-10-06T04:44:28.153186+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:44:28.153186+0000","last_undegraded":"2023-10-06T04:44:28.153186+0000","last_fullsized":"2023-10-06T04:44:28.153186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.161824+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:44:28.161824+0000","last_peered":"2023-10-06T04:44:28.161824+0000","last_clean":"2023-10-06T04:44:28.161824+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:44:28.161824+0000","last_undegraded":"2023-10-06T04:44:28.161824+0000","last_fullsized":"2023-10-06T04:44:28.161824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.157310+0000","last_change":"2023-10-06T04:44:27.171258+0000","last_active":"2023-10-06T04:44:28.157310+0000","last_peered":"2023-10-06T04:44:28.157310+0000","last_clean":"2023-10-06T04:44:28.157310+0000","last_became_active":"2023-10-06T04:44:27.170923+0000","last_became_peered":"2023-10-06T04:44:27.170923+0000","last_unstale":"2023-10-06T04:44:28.157310+0000","last_undegraded":"2023-10-06T04:44:28.157310+0000","last_fullsized":"2023-10-06T04:44:28.157310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:18.613164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.166333+0000","last_change":"2023-10-06T04:44:28.160968+0000","last_active":"2023-10-06T04:44:28.166333+0000","last_peered":"2023-10-06T04:44:28.166333+0000","last_clean":"2023-10-06T04:44:28.166333+0000","last_became_active":"2023-10-06T04:44:28.160710+0000","last_became_peered":"2023-10-06T04:44:28.160710+0000","last_unstale":"2023-10-06T04:44:28.166333+0000","last_undegraded":"2023-10-06T04:44:28.166333+0000","last_fullsized":"2023-10-06T04:44:28.166333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:16.179899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.161110+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:44:28.161110+0000","last_peered":"2023-10-06T04:44:28.161110+0000","last_clean":"2023-10-06T04:44:28.161110+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:44:28.161110+0000","last_undegraded":"2023-10-06T04:44:28.161110+0000","last_fullsized":"2023-10-06T04:44:28.161110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.154164+0000","last_change":"2023-10-06T04:44:27.164147+0000","last_active":"2023-10-06T04:44:28.154164+0000","last_peered":"2023-10-06T04:44:28.154164+0000","last_clean":"2023-10-06T04:44:28.154164+0000","last_became_active":"2023-10-06T04:44:27.163860+0000","last_became_peered":"2023-10-06T04:44:27.163860+0000","last_unstale":"2023-10-06T04:44:28.154164+0000","last_undegraded":"2023-10-06T04:44:28.154164+0000","last_fullsized":"2023-10-06T04:44:28.154164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:11.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.166411+0000","last_change":"2023-10-06T04:44:28.162519+0000","last_active":"2023-10-06T04:44:28.166411+0000","last_peered":"2023-10-06T04:44:28.166411+0000","last_clean":"2023-10-06T04:44:28.166411+0000","last_became_active":"2023-10-06T04:44:28.162231+0000","last_became_peered":"2023-10-06T04:44:28.162231+0000","last_unstale":"2023-10-06T04:44:28.166411+0000","last_undegraded":"2023-10-06T04:44:28.166411+0000","last_fullsized":"2023-10-06T04:44:28.166411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:37.642261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.161347+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:44:28.161347+0000","last_peered":"2023-10-06T04:44:28.161347+0000","last_clean":"2023-10-06T04:44:28.161347+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:44:28.161347+0000","last_undegraded":"2023-10-06T04:44:28.161347+0000","last_fullsized":"2023-10-06T04:44:28.161347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.159233+0000","last_change":"2023-10-06T04:44:27.170762+0000","last_active":"2023-10-06T04:44:28.159233+0000","last_peered":"2023-10-06T04:44:28.159233+0000","last_clean":"2023-10-06T04:44:28.159233+0000","last_became_active":"2023-10-06T04:44:27.170417+0000","last_became_peered":"2023-10-06T04:44:27.170417+0000","last_unstale":"2023-10-06T04:44:28.159233+0000","last_undegraded":"2023-10-06T04:44:28.159233+0000","last_fullsized":"2023-10-06T04:44:28.159233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:01.501146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.181199+0000","last_change":"2023-10-06T04:44:28.177577+0000","last_active":"2023-10-06T04:44:28.181199+0000","last_peered":"2023-10-06T04:44:28.181199+0000","last_clean":"2023-10-06T04:44:28.181199+0000","last_became_active":"2023-10-06T04:44:28.176998+0000","last_became_peered":"2023-10-06T04:44:28.176998+0000","last_unstale":"2023-10-06T04:44:28.181199+0000","last_undegraded":"2023-10-06T04:44:28.181199+0000","last_fullsized":"2023-10-06T04:44:28.181199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.047230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.152795+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:44:28.152795+0000","last_peered":"2023-10-06T04:44:28.152795+0000","last_clean":"2023-10-06T04:44:28.152795+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:44:28.152795+0000","last_undegraded":"2023-10-06T04:44:28.152795+0000","last_fullsized":"2023-10-06T04:44:28.152795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.158416+0000","last_change":"2023-10-06T04:44:27.174609+0000","last_active":"2023-10-06T04:44:28.158416+0000","last_peered":"2023-10-06T04:44:28.158416+0000","last_clean":"2023-10-06T04:44:28.158416+0000","last_became_active":"2023-10-06T04:44:27.173130+0000","last_became_peered":"2023-10-06T04:44:27.173130+0000","last_unstale":"2023-10-06T04:44:28.158416+0000","last_undegraded":"2023-10-06T04:44:28.158416+0000","last_fullsized":"2023-10-06T04:44:28.158416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176669+0000","last_change":"2023-10-06T04:44:28.166656+0000","last_active":"2023-10-06T04:44:28.176669+0000","last_peered":"2023-10-06T04:44:28.176669+0000","last_clean":"2023-10-06T04:44:28.176669+0000","last_became_active":"2023-10-06T04:44:28.166293+0000","last_became_peered":"2023-10-06T04:44:28.166293+0000","last_unstale":"2023-10-06T04:44:28.176669+0000","last_undegraded":"2023-10-06T04:44:28.176669+0000","last_fullsized":"2023-10-06T04:44:28.176669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:39.049512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.156705+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:44:28.156705+0000","last_peered":"2023-10-06T04:44:28.156705+0000","last_clean":"2023-10-06T04:44:28.156705+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:44:28.156705+0000","last_undegraded":"2023-10-06T04:44:28.156705+0000","last_fullsized":"2023-10-06T04:44:28.156705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.154741+0000","last_change":"2023-10-06T04:44:27.173242+0000","last_active":"2023-10-06T04:44:28.154741+0000","last_peered":"2023-10-06T04:44:28.154741+0000","last_clean":"2023-10-06T04:44:28.154741+0000","last_became_active":"2023-10-06T04:44:27.172919+0000","last_became_peered":"2023-10-06T04:44:27.172919+0000","last_unstale":"2023-10-06T04:44:28.154741+0000","last_undegraded":"2023-10-06T04:44:28.154741+0000","last_fullsized":"2023-10-06T04:44:28.154741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:56.308717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.176036+0000","last_change":"2023-10-06T04:44:28.169044+0000","last_active":"2023-10-06T04:44:28.176036+0000","last_peered":"2023-10-06T04:44:28.176036+0000","last_clean":"2023-10-06T04:44:28.176036+0000","last_became_active":"2023-10-06T04:44:28.168793+0000","last_became_peered":"2023-10-06T04:44:28.168793+0000","last_unstale":"2023-10-06T04:44:28.176036+0000","last_undegraded":"2023-10-06T04:44:28.176036+0000","last_fullsized":"2023-10-06T04:44:28.176036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:38.672585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.157562+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:44:28.157562+0000","last_peered":"2023-10-06T04:44:28.157562+0000","last_clean":"2023-10-06T04:44:28.157562+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:44:28.157562+0000","last_undegraded":"2023-10-06T04:44:28.157562+0000","last_fullsized":"2023-10-06T04:44:28.157562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.155182+0000","last_change":"2023-10-06T04:44:27.164715+0000","last_active":"2023-10-06T04:44:28.155182+0000","last_peered":"2023-10-06T04:44:28.155182+0000","last_clean":"2023-10-06T04:44:28.155182+0000","last_became_active":"2023-10-06T04:44:27.164441+0000","last_became_peered":"2023-10-06T04:44:27.164441+0000","last_unstale":"2023-10-06T04:44:28.155182+0000","last_undegraded":"2023-10-06T04:44:28.155182+0000","last_fullsized":"2023-10-06T04:44:28.155182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:19.339820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170626+0000","last_change":"2023-10-06T04:44:28.163762+0000","last_active":"2023-10-06T04:44:28.170626+0000","last_peered":"2023-10-06T04:44:28.170626+0000","last_clean":"2023-10-06T04:44:28.170626+0000","last_became_active":"2023-10-06T04:44:28.162829+0000","last_became_peered":"2023-10-06T04:44:28.162829+0000","last_unstale":"2023-10-06T04:44:28.170626+0000","last_undegraded":"2023-10-06T04:44:28.170626+0000","last_fullsized":"2023-10-06T04:44:28.170626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:47.764193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.191804+0000","last_change":"2023-10-06T04:44:27.173098+0000","last_active":"2023-10-06T04:44:28.191804+0000","last_peered":"2023-10-06T04:44:28.191804+0000","last_clean":"2023-10-06T04:44:28.191804+0000","last_became_active":"2023-10-06T04:44:27.172825+0000","last_became_peered":"2023-10-06T04:44:27.172825+0000","last_unstale":"2023-10-06T04:44:28.191804+0000","last_undegraded":"2023-10-06T04:44:28.191804+0000","last_fullsized":"2023-10-06T04:44:28.191804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:11.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170956+0000","last_change":"2023-10-06T04:44:28.165992+0000","last_active":"2023-10-06T04:44:28.170956+0000","last_peered":"2023-10-06T04:44:28.170956+0000","last_clean":"2023-10-06T04:44:28.170956+0000","last_became_active":"2023-10-06T04:44:28.165719+0000","last_became_peered":"2023-10-06T04:44:28.165719+0000","last_unstale":"2023-10-06T04:44:28.170956+0000","last_undegraded":"2023-10-06T04:44:28.170956+0000","last_fullsized":"2023-10-06T04:44:28.170956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:12.681182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.186798+0000","last_change":"2023-10-06T04:44:27.168462+0000","last_active":"2023-10-06T04:44:28.186798+0000","last_peered":"2023-10-06T04:44:28.186798+0000","last_clean":"2023-10-06T04:44:28.186798+0000","last_became_active":"2023-10-06T04:44:27.167211+0000","last_became_peered":"2023-10-06T04:44:27.167211+0000","last_unstale":"2023-10-06T04:44:28.186798+0000","last_undegraded":"2023-10-06T04:44:28.186798+0000","last_fullsized":"2023-10-06T04:44:28.186798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:18.718435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184357+0000","last_change":"2023-10-06T04:44:28.181846+0000","last_active":"2023-10-06T04:44:28.184357+0000","last_peered":"2023-10-06T04:44:28.184357+0000","last_clean":"2023-10-06T04:44:28.184357+0000","last_became_active":"2023-10-06T04:44:28.181641+0000","last_became_peered":"2023-10-06T04:44:28.181641+0000","last_unstale":"2023-10-06T04:44:28.184357+0000","last_undegraded":"2023-10-06T04:44:28.184357+0000","last_fullsized":"2023-10-06T04:44:28.184357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:01.432720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.185604+0000","last_change":"2023-10-06T04:44:27.168466+0000","last_active":"2023-10-06T04:44:28.185604+0000","last_peered":"2023-10-06T04:44:28.185604+0000","last_clean":"2023-10-06T04:44:28.185604+0000","last_became_active":"2023-10-06T04:44:27.167928+0000","last_became_peered":"2023-10-06T04:44:27.167928+0000","last_unstale":"2023-10-06T04:44:28.185604+0000","last_undegraded":"2023-10-06T04:44:28.185604+0000","last_fullsized":"2023-10-06T04:44:28.185604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:32.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184306+0000","last_change":"2023-10-06T04:44:28.181253+0000","last_active":"2023-10-06T04:44:28.184306+0000","last_peered":"2023-10-06T04:44:28.184306+0000","last_clean":"2023-10-06T04:44:28.184306+0000","last_became_active":"2023-10-06T04:44:28.181011+0000","last_became_peered":"2023-10-06T04:44:28.181011+0000","last_unstale":"2023-10-06T04:44:28.184306+0000","last_undegraded":"2023-10-06T04:44:28.184306+0000","last_fullsized":"2023-10-06T04:44:28.184306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:12.890746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.188170+0000","last_change":"2023-10-06T04:44:27.164196+0000","last_active":"2023-10-06T04:44:28.188170+0000","last_peered":"2023-10-06T04:44:28.188170+0000","last_clean":"2023-10-06T04:44:28.188170+0000","last_became_active":"2023-10-06T04:44:27.163920+0000","last_became_peered":"2023-10-06T04:44:27.163920+0000","last_unstale":"2023-10-06T04:44:28.188170+0000","last_undegraded":"2023-10-06T04:44:28.188170+0000","last_fullsized":"2023-10-06T04:44:28.188170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:25.287936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182629+0000","last_change":"2023-10-06T04:44:28.172288+0000","last_active":"2023-10-06T04:44:28.182629+0000","last_peered":"2023-10-06T04:44:28.182629+0000","last_clean":"2023-10-06T04:44:28.182629+0000","last_became_active":"2023-10-06T04:44:28.171740+0000","last_became_peered":"2023-10-06T04:44:28.171740+0000","last_unstale":"2023-10-06T04:44:28.182629+0000","last_undegraded":"2023-10-06T04:44:28.182629+0000","last_fullsized":"2023-10-06T04:44:28.182629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:18.824278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.187878+0000","last_change":"2023-10-06T04:44:27.167494+0000","last_active":"2023-10-06T04:44:28.187878+0000","last_peered":"2023-10-06T04:44:28.187878+0000","last_clean":"2023-10-06T04:44:28.187878+0000","last_became_active":"2023-10-06T04:44:27.167155+0000","last_became_peered":"2023-10-06T04:44:27.167155+0000","last_unstale":"2023-10-06T04:44:28.187878+0000","last_undegraded":"2023-10-06T04:44:28.187878+0000","last_fullsized":"2023-10-06T04:44:28.187878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:26.136107+0000","last_clean_scrub_stamp":"2023-10-06T04:44:26.136107+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:32.538225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182250+0000","last_change":"2023-10-06T04:44:28.173948+0000","last_active":"2023-10-06T04:44:28.182250+0000","last_peered":"2023-10-06T04:44:28.182250+0000","last_clean":"2023-10-06T04:44:28.182250+0000","last_became_active":"2023-10-06T04:44:28.173514+0000","last_became_peered":"2023-10-06T04:44:28.173514+0000","last_unstale":"2023-10-06T04:44:28.182250+0000","last_undegraded":"2023-10-06T04:44:28.182250+0000","last_fullsized":"2023-10-06T04:44:28.182250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:05.030988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.178297+0000","last_change":"2023-10-06T04:44:28.173994+0000","last_active":"2023-10-06T04:44:28.178297+0000","last_peered":"2023-10-06T04:44:28.178297+0000","last_clean":"2023-10-06T04:44:28.178297+0000","last_became_active":"2023-10-06T04:44:28.173726+0000","last_became_peered":"2023-10-06T04:44:28.173726+0000","last_unstale":"2023-10-06T04:44:28.178297+0000","last_undegraded":"2023-10-06T04:44:28.178297+0000","last_fullsized":"2023-10-06T04:44:28.178297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:11.893905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.183032+0000","last_change":"2023-10-06T04:44:28.176890+0000","last_active":"2023-10-06T04:44:28.183032+0000","last_peered":"2023-10-06T04:44:28.183032+0000","last_clean":"2023-10-06T04:44:28.183032+0000","last_became_active":"2023-10-06T04:44:28.174436+0000","last_became_peered":"2023-10-06T04:44:28.174436+0000","last_unstale":"2023-10-06T04:44:28.183032+0000","last_undegraded":"2023-10-06T04:44:28.183032+0000","last_fullsized":"2023-10-06T04:44:28.183032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:44.708051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.184270+0000","last_change":"2023-10-06T04:44:28.176267+0000","last_active":"2023-10-06T04:44:28.184270+0000","last_peered":"2023-10-06T04:44:28.184270+0000","last_clean":"2023-10-06T04:44:28.184270+0000","last_became_active":"2023-10-06T04:44:28.175988+0000","last_became_peered":"2023-10-06T04:44:28.175988+0000","last_unstale":"2023-10-06T04:44:28.184270+0000","last_undegraded":"2023-10-06T04:44:28.184270+0000","last_fullsized":"2023-10-06T04:44:28.184270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:17.605122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.182577+0000","last_change":"2023-10-06T04:44:28.174588+0000","last_active":"2023-10-06T04:44:28.182577+0000","last_peered":"2023-10-06T04:44:28.182577+0000","last_clean":"2023-10-06T04:44:28.182577+0000","last_became_active":"2023-10-06T04:44:28.174023+0000","last_became_peered":"2023-10-06T04:44:28.174023+0000","last_unstale":"2023-10-06T04:44:28.182577+0000","last_undegraded":"2023-10-06T04:44:28.182577+0000","last_fullsized":"2023-10-06T04:44:28.182577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:02.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:44:28.170913+0000","last_change":"2023-10-06T04:44:28.164700+0000","last_active":"2023-10-06T04:44:28.170913+0000","last_peered":"2023-10-06T04:44:28.170913+0000","last_clean":"2023-10-06T04:44:28.170913+0000","last_became_active":"2023-10-06T04:44:28.164337+0000","last_became_peered":"2023-10-06T04:44:28.164337+0000","last_unstale":"2023-10-06T04:44:28.170913+0000","last_undegraded":"2023-10-06T04:44:28.170913+0000","last_fullsized":"2023-10-06T04:44:28.170913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:27.141430+0000","last_clean_scrub_stamp":"2023-10-06T04:44:27.141430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:15.790501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":673730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":81610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298088,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073752,"statfs":{"total":96636764160,"available":96331522048,"internally_reserved":0,"allocated":819200,"data_stored":671978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":82164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":81610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":81700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":245760,"data_stored":83202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":233472,"data_stored":82234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:44:38.604 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:44:38.604 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T04:44:38.604 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T04:44:38.604 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T04:44:38.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.820+0000 7fdda21ff700 1 Processor -- start 2023-10-06T04:44:38.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.820+0000 7fdda21ff700 1 -- start start 2023-10-06T04:44:38.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.821+0000 7fdda21ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd9c0cdfe0 0x7fdd9c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.821+0000 7fdda21ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9c0ccf80 0x7fdd9c0cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdda21ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0cf6b0 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdda21ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c0d0250 con 0x7fdd9c0cdfe0 2023-10-06T04:44:38.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdda21ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0ceaa0 con 0x7fdd9c0ccf80 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdd9affd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd9c0cdfe0 0x7fdd9c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdd9affd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd9c0cdfe0 0x7fdd9c0ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40754/0 (socket says 172.21.15.124:40754) 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdd9affd700 1 -- 172.21.15.124:0/3454232510 learned_addr learned my addr 172.21.15.124:0/3454232510 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdd9bfff700 1 --2- 172.21.15.124:0/3454232510 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9c0ccf80 0x7fdd9c0cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdd9affd700 1 -- 172.21.15.124:0/3454232510 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9c0ccf80 msgr2=0x7fdd9c0cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdd9affd700 1 --2- 172.21.15.124:0/3454232510 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9c0ccf80 0x7fdd9c0cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdd9affd700 1 -- 172.21.15.124:0/3454232510 >> v1:172.21.15.158:6789/0 conn(0x7fdd9c0ccbb0 legacy=0x7fdd9c0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdd9affd700 1 -- 172.21.15.124:0/3454232510 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0ced80 con 0x7fdd9c0cdfe0 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdd9a7fc700 1 -- 172.21.15.124:0/3454232510 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048428251 0 0) 0x7fdd9c0cf6b0 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.822+0000 7fdd9affd700 1 --2- 172.21.15.124:0/3454232510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0cdfe0 0x7fdd9c0ce450 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdd900099b0 tx=0x7fdd90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bae92ecd5a7a78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:38.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdd9a7fc700 1 -- 172.21.15.124:0/3454232510 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90009ea0 con 0x7fdd9c0cdfe0 2023-10-06T04:44:38.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdd9a7fc700 1 -- 172.21.15.124:0/3454232510 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9000b860 con 0x7fdd9c0cdfe0 2023-10-06T04:44:38.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdd9a7fc700 1 -- 172.21.15.124:0/3454232510 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9000bc00 con 0x7fdd9c0cdfe0 2023-10-06T04:44:38.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdda21ff700 1 -- 172.21.15.124:0/3454232510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0cdfe0 msgr2=0x7fdd9c0ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdda21ff700 1 --2- 172.21.15.124:0/3454232510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0cdfe0 0x7fdd9c0ce450 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdd900099b0 tx=0x7fdd90009250 comp rx=0 tx=0).stop 2023-10-06T04:44:38.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdda21ff700 1 -- 172.21.15.124:0/3454232510 shutdown_connections 2023-10-06T04:44:38.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdda21ff700 1 --2- 172.21.15.124:0/3454232510 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9c0ccf80 0x7fdd9c0cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdda21ff700 1 --2- 172.21.15.124:0/3454232510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0cdfe0 0x7fdd9c0ce450 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdda21ff700 1 -- 172.21.15.124:0/3454232510 >> 172.21.15.124:0/3454232510 conn(0x7fdd9c099710 msgr2=0x7fdd9c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:38.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdda21ff700 1 -- 172.21.15.124:0/3454232510 shutdown_connections 2023-10-06T04:44:38.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.823+0000 7fdda21ff700 1 -- 172.21.15.124:0/3454232510 wait complete. 2023-10-06T04:44:38.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.825+0000 7fdda21ff700 1 Processor -- start 2023-10-06T04:44:38.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.825+0000 7fdda21ff700 1 -- start start 2023-10-06T04:44:38.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdda21ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0ccbb0 0x7fdd9c09c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdda21ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9c0ccf80 0x7fdd9c158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdda21ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd9c0cdfe0 0x7fdd9c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdda21ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c09a970 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdda21ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c09c860 con 0x7fdd9c0cdfe0 2023-10-06T04:44:38.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdda21ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c09cb00 con 0x7fdd9c0ccf80 2023-10-06T04:44:38.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdd9b7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0ccbb0 0x7fdd9c09c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdd9b7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0ccbb0 0x7fdd9c09c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40766/0 (socket says 172.21.15.124:40766) 2023-10-06T04:44:38.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdd9b7fe700 1 -- 172.21.15.124:0/2875043259 learned_addr learned my addr 172.21.15.124:0/2875043259 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdd9affd700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9c0ccf80 0x7fdd9c158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.826+0000 7fdd9bfff700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd9c0cdfe0 0x7fdd9c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdd9b7fe700 1 -- 172.21.15.124:0/2875043259 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9c0ccf80 msgr2=0x7fdd9c158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdd9b7fe700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9c0ccf80 0x7fdd9c158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdd9b7fe700 1 -- 172.21.15.124:0/2875043259 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd9c0cdfe0 msgr2=0x7fdd9c0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdd9b7fe700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd9c0cdfe0 0x7fdd9c0c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdd9b7fe700 1 -- 172.21.15.124:0/2875043259 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd900094f0 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdd9b7fe700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0ccbb0 0x7fdd9c09c320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c7e0 tx=0x7fdd8c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdd837fe700 1 -- 172.21.15.124:0/2875043259 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0105c0 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdd837fe700 1 -- 172.21.15.124:0/2875043259 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c010740 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdda21ff700 1 -- 172.21.15.124:0/2875043259 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c09a320 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdd837fe700 1 -- 172.21.15.124:0/2875043259 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c010b00 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.827+0000 7fdda21ff700 1 -- 172.21.15.124:0/2875043259 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c158690 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.828+0000 7fdda21ff700 1 -- 172.21.15.124:0/2875043259 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c09a180 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.829+0000 7fdd837fe700 1 -- 172.21.15.124:0/2875043259 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd8c01b3b0 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.830+0000 7fdd837fe700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd88066f30 0x7fdd880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.831+0000 7fdd837fe700 1 -- 172.21.15.124:0/2875043259 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdd8c083c40 con 0x7fdd9c0ccbb0 2023-10-06T04:44:38.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.831+0000 7fdd9affd700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd88066f30 0x7fdd880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.831+0000 7fdd9affd700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd88066f30 0x7fdd880693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd900099b0 tx=0x7fdd90017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:38.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:38.835+0000 7fdd837fe700 1 -- 172.21.15.124:0/2875043259 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd9c09a180 con 0x7fdd9c0ccbb0 2023-10-06T04:44:39.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.068+0000 7fdda21ff700 1 -- 172.21.15.124:0/2875043259 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdd9c09a180 con 0x7fdd9c0ccbb0 2023-10-06T04:44:39.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.069+0000 7fdd837fe700 1 -- 172.21.15.124:0/2875043259 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fdd9c09a180 con 0x7fdd9c0ccbb0 2023-10-06T04:44:39.071 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:39.071 INFO:teuthology.orchestra.run.smithi124.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T04:44:39.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 -- 172.21.15.124:0/2875043259 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd88066f30 msgr2=0x7fdd880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd88066f30 0x7fdd880693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd900099b0 tx=0x7fdd90017000 comp rx=0 tx=0).stop 2023-10-06T04:44:39.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 -- 172.21.15.124:0/2875043259 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0ccbb0 msgr2=0x7fdd9c09c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0ccbb0 0x7fdd9c09c320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c7e0 tx=0x7fdd8c007df0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 -- 172.21.15.124:0/2875043259 shutdown_connections 2023-10-06T04:44:39.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd9c0cdfe0 0x7fdd9c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9c0ccbb0 0x7fdd9c09c320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd88066f30 0x7fdd880693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 --2- 172.21.15.124:0/2875043259 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9c0ccf80 0x7fdd9c158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 -- 172.21.15.124:0/2875043259 >> 172.21.15.124:0/2875043259 conn(0x7fdd9c099710 msgr2=0x7fdd9c0ae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:39.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 -- 172.21.15.124:0/2875043259 shutdown_connections 2023-10-06T04:44:39.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.071+0000 7fdda21ff700 1 -- 172.21.15.124:0/2875043259 wait complete. 2023-10-06T04:44:39.091 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T04:44:39.091 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:39.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.280+0000 7f1f47dff700 1 Processor -- start 2023-10-06T04:44:39.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.280+0000 7f1f47dff700 1 -- start start 2023-10-06T04:44:39.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.281+0000 7f1f47dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1f4015a750 0x7f1f400ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.281+0000 7f1f47dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1f400cd1b0 0x7f1f400cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.281+0000 7f1f47dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f400cbf10 con 0x7f1f400cb1a0 2023-10-06T04:44:39.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.281+0000 7f1f47dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4015b230 con 0x7f1f400cd1b0 2023-10-06T04:44:39.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.281+0000 7f1f47dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f400cd650 con 0x7f1f4015a750 2023-10-06T04:44:39.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.281+0000 7f1f4539a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1f400cd1b0 0x7f1f400cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.281+0000 7f1f4639c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f1f400cb1a0 0x7f1f4015b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36334/0 (socket says 172.21.15.124:36334) 2023-10-06T04:44:39.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.281+0000 7f1f4639c700 1 -- 172.21.15.124:0/4149963884 learned_addr learned my addr 172.21.15.124:0/4149963884 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:39.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.281+0000 7f1f45b9b700 1 --2- 172.21.15.124:0/4149963884 >> v2:172.21.15.158:3300/0 conn(0x7f1f4015a750 0x7f1f400ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.282+0000 7f1f44b99700 1 -- 172.21.15.124:0/4149963884 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416483724 0 0) 0x7f1f400cbf10 con 0x7f1f400cb1a0 2023-10-06T04:44:39.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.282+0000 7f1f4539a700 1 -- 172.21.15.124:0/4149963884 >> v2:172.21.15.158:3300/0 conn(0x7f1f4015a750 msgr2=0x7f1f400ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:39.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.282+0000 7f1f4539a700 1 --2- 172.21.15.124:0/4149963884 >> v2:172.21.15.158:3300/0 conn(0x7f1f4015a750 0x7f1f400ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.282+0000 7f1f4539a700 1 -- 172.21.15.124:0/4149963884 >> v1:172.21.15.124:6789/0 conn(0x7f1f400cb1a0 legacy=0x7f1f4015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.282+0000 7f1f4539a700 1 -- 172.21.15.124:0/4149963884 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f400cb950 con 0x7f1f400cd1b0 2023-10-06T04:44:39.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.282+0000 7f1f45b9b700 1 --2- 172.21.15.124:0/4149963884 >> v2:172.21.15.158:3300/0 conn(0x7f1f4015a750 0x7f1f400ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:39.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.282+0000 7f1f4539a700 1 --2- 172.21.15.124:0/4149963884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f400cd1b0 0x7f1f400cac60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1f400d14c0 tx=0x7f1f300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158142e75c9a2521 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:39.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.282+0000 7f1f44b99700 1 -- 172.21.15.124:0/4149963884 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000b6b0 con 0x7f1f400cd1b0 2023-10-06T04:44:39.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.282+0000 7f1f44b99700 1 -- 172.21.15.124:0/4149963884 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3000b810 con 0x7f1f400cd1b0 2023-10-06T04:44:39.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.282+0000 7f1f44b99700 1 -- 172.21.15.124:0/4149963884 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000bbb0 con 0x7f1f400cd1b0 2023-10-06T04:44:39.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.283+0000 7f1f47dff700 1 -- 172.21.15.124:0/4149963884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f400cd1b0 msgr2=0x7f1f400cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.283+0000 7f1f47dff700 1 --2- 172.21.15.124:0/4149963884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f400cd1b0 0x7f1f400cac60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1f400d14c0 tx=0x7f1f300091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.283+0000 7f1f47dff700 1 -- 172.21.15.124:0/4149963884 shutdown_connections 2023-10-06T04:44:39.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.283+0000 7f1f47dff700 1 --2- 172.21.15.124:0/4149963884 >> v2:172.21.15.158:3300/0 conn(0x7f1f4015a750 0x7f1f400ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.283+0000 7f1f47dff700 1 --2- 172.21.15.124:0/4149963884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f400cd1b0 0x7f1f400cac60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.283+0000 7f1f47dff700 1 -- 172.21.15.124:0/4149963884 >> 172.21.15.124:0/4149963884 conn(0x7f1f40099710 msgr2=0x7f1f4006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:39.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.283+0000 7f1f47dff700 1 -- 172.21.15.124:0/4149963884 shutdown_connections 2023-10-06T04:44:39.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.283+0000 7f1f47dff700 1 -- 172.21.15.124:0/4149963884 wait complete. 2023-10-06T04:44:39.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.284+0000 7f1f47dff700 1 Processor -- start 2023-10-06T04:44:39.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.284+0000 7f1f47dff700 1 -- start start 2023-10-06T04:44:39.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.285+0000 7f1f47dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1f400cb1a0 0x7f1f400c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.285+0000 7f1f47dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1f400cd1b0 0x7f1f40169880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.285+0000 7f1f47dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f4015a750 0x7f1f400cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.285+0000 7f1f47dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4016a340 con 0x7f1f4015a750 2023-10-06T04:44:39.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.285+0000 7f1f47dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4016a620 con 0x7f1f400cd1b0 2023-10-06T04:44:39.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.285+0000 7f1f47dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4016abf0 con 0x7f1f400cb1a0 2023-10-06T04:44:39.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f4639c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f4015a750 0x7f1f400cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f4639c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f4015a750 0x7f1f400cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40774/0 (socket says 172.21.15.124:40774) 2023-10-06T04:44:39.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f4639c700 1 -- 172.21.15.124:0/3484783825 learned_addr learned my addr 172.21.15.124:0/3484783825 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:39.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f4539a700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1f400cd1b0 0x7f1f40169880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f45b9b700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1f400cb1a0 0x7f1f400c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f4639c700 1 -- 172.21.15.124:0/3484783825 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1f400cb1a0 msgr2=0x7f1f400c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f4639c700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1f400cb1a0 0x7f1f400c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f4639c700 1 -- 172.21.15.124:0/3484783825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1f400cd1b0 msgr2=0x7f1f40169880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f4639c700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1f400cd1b0 0x7f1f40169880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f4639c700 1 -- 172.21.15.124:0/3484783825 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f30009420 con 0x7f1f4015a750 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f4639c700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f4015a750 0x7f1f400cefb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800cc10 tx=0x7f1f38001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.286+0000 7f1f35ffb700 1 -- 172.21.15.124:0/3484783825 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3800a850 con 0x7f1f4015a750 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.287+0000 7f1f35ffb700 1 -- 172.21.15.124:0/3484783825 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3800a9d0 con 0x7f1f4015a750 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.287+0000 7f1f47dff700 1 -- 172.21.15.124:0/3484783825 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4016aed0 con 0x7f1f4015a750 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.287+0000 7f1f35ffb700 1 -- 172.21.15.124:0/3484783825 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3800ad90 con 0x7f1f4015a750 2023-10-06T04:44:39.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.287+0000 7f1f47dff700 1 -- 172.21.15.124:0/3484783825 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f40069010 con 0x7f1f4015a750 2023-10-06T04:44:39.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.288+0000 7f1f47dff700 1 -- 172.21.15.124:0/3484783825 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4016aa50 con 0x7f1f4015a750 2023-10-06T04:44:39.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.288+0000 7f1f35ffb700 1 -- 172.21.15.124:0/3484783825 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f38007300 con 0x7f1f4015a750 2023-10-06T04:44:39.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.289+0000 7f1f35ffb700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1f24066f30 0x7f1f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.289+0000 7f1f35ffb700 1 -- 172.21.15.124:0/3484783825 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f38084960 con 0x7f1f4015a750 2023-10-06T04:44:39.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.289+0000 7f1f45b9b700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1f24066f30 0x7f1f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.290+0000 7f1f45b9b700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1f24066f30 0x7f1f240693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c006f00 tx=0x7f1f3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:39.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.293+0000 7f1f35ffb700 1 -- 172.21.15.124:0/3484783825 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f4016aa50 con 0x7f1f4015a750 2023-10-06T04:44:39.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.485+0000 7f1f47dff700 1 -- 172.21.15.124:0/3484783825 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f4016aa50 con 0x7f1f4015a750 2023-10-06T04:44:39.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.486+0000 7f1f35ffb700 1 -- 172.21.15.124:0/3484783825 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f1f4016aa50 con 0x7f1f4015a750 2023-10-06T04:44:39.489 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:39.489 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:39.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 -- 172.21.15.124:0/3484783825 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1f24066f30 msgr2=0x7f1f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1f24066f30 0x7f1f240693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c006f00 tx=0x7f1f3c008040 comp rx=0 tx=0).stop 2023-10-06T04:44:39.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 -- 172.21.15.124:0/3484783825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f4015a750 msgr2=0x7f1f400cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f4015a750 0x7f1f400cefb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800cc10 tx=0x7f1f38001970 comp rx=0 tx=0).stop 2023-10-06T04:44:39.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 -- 172.21.15.124:0/3484783825 shutdown_connections 2023-10-06T04:44:39.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f4015a750 0x7f1f400cefb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1f24066f30 0x7f1f240693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1f400cb1a0 0x7f1f400c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 --2- 172.21.15.124:0/3484783825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1f400cd1b0 0x7f1f40169880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 -- 172.21.15.124:0/3484783825 >> 172.21.15.124:0/3484783825 conn(0x7f1f40099710 msgr2=0x7f1f401538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:39.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 -- 172.21.15.124:0/3484783825 shutdown_connections 2023-10-06T04:44:39.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.489+0000 7f1f47dff700 1 -- 172.21.15.124:0/3484783825 wait complete. 2023-10-06T04:44:39.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:44:25.771714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:44:26.609661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:44:39.509 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:44:39.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.699+0000 7f52bf5ff700 1 Processor -- start 2023-10-06T04:44:39.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.700+0000 7f52bf5ff700 1 -- start start 2023-10-06T04:44:39.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bf5ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f52b8159480 0x7f52b815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bf5ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f52b80c8840 0x7f52b806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bf5ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b8068700 con 0x7f52b806d5a0 2023-10-06T04:44:39.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bf5ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b806d9c0 con 0x7f52b80c8840 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bf5ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b80c9030 con 0x7f52b8159480 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bcb9a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f52b80c8840 0x7f52b806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bcb9a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f52b80c8840 0x7f52b806d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40780/0 (socket says 172.21.15.124:40780) 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bcb9a700 1 -- 172.21.15.124:0/2695618708 learned_addr learned my addr 172.21.15.124:0/2695618708 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bd39b700 1 --2- 172.21.15.124:0/2695618708 >> v2:172.21.15.158:3300/0 conn(0x7f52b8159480 0x7f52b815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bcb9a700 1 -- 172.21.15.124:0/2695618708 >> v2:172.21.15.158:3300/0 conn(0x7f52b8159480 msgr2=0x7f52b815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bcb9a700 1 --2- 172.21.15.124:0/2695618708 >> v2:172.21.15.158:3300/0 conn(0x7f52b8159480 0x7f52b815dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.701+0000 7f52bcb9a700 1 -- 172.21.15.124:0/2695618708 >> v1:172.21.15.158:6789/0 conn(0x7f52b806d5a0 legacy=0x7f52b806b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.702+0000 7f52bcb9a700 1 -- 172.21.15.124:0/2695618708 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8068950 con 0x7f52b80c8840 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.702+0000 7f52bcb9a700 1 --2- 172.21.15.124:0/2695618708 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 0x7f52b806d060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f52b80cdf00 tx=0x7f52a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed0427c3a39b138 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:39.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.702+0000 7f52affff700 1 -- 172.21.15.124:0/2695618708 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a800b820 con 0x7f52b80c8840 2023-10-06T04:44:39.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.702+0000 7f52affff700 1 -- 172.21.15.124:0/2695618708 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a800b980 con 0x7f52b80c8840 2023-10-06T04:44:39.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.702+0000 7f52affff700 1 -- 172.21.15.124:0/2695618708 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a800bd20 con 0x7f52b80c8840 2023-10-06T04:44:39.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.702+0000 7f52bf5ff700 1 -- 172.21.15.124:0/2695618708 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 msgr2=0x7f52b806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.702+0000 7f52bf5ff700 1 --2- 172.21.15.124:0/2695618708 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 0x7f52b806d060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f52b80cdf00 tx=0x7f52a8009250 comp rx=0 tx=0).stop 2023-10-06T04:44:39.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.703+0000 7f52bf5ff700 1 -- 172.21.15.124:0/2695618708 shutdown_connections 2023-10-06T04:44:39.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.703+0000 7f52bf5ff700 1 --2- 172.21.15.124:0/2695618708 >> v2:172.21.15.158:3300/0 conn(0x7f52b8159480 0x7f52b815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.703+0000 7f52bf5ff700 1 --2- 172.21.15.124:0/2695618708 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 0x7f52b806d060 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.703+0000 7f52bf5ff700 1 -- 172.21.15.124:0/2695618708 >> 172.21.15.124:0/2695618708 conn(0x7f52b8063cc0 msgr2=0x7f52b80ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:39.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.703+0000 7f52bf5ff700 1 -- 172.21.15.124:0/2695618708 shutdown_connections 2023-10-06T04:44:39.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.703+0000 7f52bf5ff700 1 -- 172.21.15.124:0/2695618708 wait complete. 2023-10-06T04:44:39.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.704+0000 7f52bf5ff700 1 Processor -- start 2023-10-06T04:44:39.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.704+0000 7f52bf5ff700 1 -- start start 2023-10-06T04:44:39.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bf5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52b806d5a0 0x7f52b81526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bf5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 0x7f52b8152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bf5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b8159480 0x7f52b80c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bf5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80c1cd0 con 0x7f52b80c8840 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bf5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8150ff0 con 0x7f52b8159480 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bf5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80c2250 con 0x7f52b806d5a0 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bcb9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 0x7f52b8152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bcb9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 0x7f52b8152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40786/0 (socket says 172.21.15.124:40786) 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bcb9a700 1 -- 172.21.15.124:0/1825465228 learned_addr learned my addr 172.21.15.124:0/1825465228 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bd39b700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52b806d5a0 0x7f52b81526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.705+0000 7f52bdb9c700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b8159480 0x7f52b80c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52bcb9a700 1 -- 172.21.15.124:0/1825465228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52b806d5a0 msgr2=0x7f52b81526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52bcb9a700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52b806d5a0 0x7f52b81526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52bcb9a700 1 -- 172.21.15.124:0/1825465228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b8159480 msgr2=0x7f52b80c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52bcb9a700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b8159480 0x7f52b80c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52bcb9a700 1 -- 172.21.15.124:0/1825465228 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a80094f0 con 0x7f52b80c8840 2023-10-06T04:44:39.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52bcb9a700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 0x7f52b8152c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f52a80030c0 tx=0x7f52a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:39.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52ad7fa700 1 -- 172.21.15.124:0/1825465228 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8011d00 con 0x7f52b80c8840 2023-10-06T04:44:39.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52ad7fa700 1 -- 172.21.15.124:0/1825465228 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a8020070 con 0x7f52b80c8840 2023-10-06T04:44:39.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52ad7fa700 1 -- 172.21.15.124:0/1825465228 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a801b6a0 con 0x7f52b80c8840 2023-10-06T04:44:39.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52bf5ff700 1 -- 172.21.15.124:0/1825465228 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b80c69f0 con 0x7f52b80c8840 2023-10-06T04:44:39.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.706+0000 7f52bf5ff700 1 -- 172.21.15.124:0/1825465228 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b80c1ee0 con 0x7f52b80c8840 2023-10-06T04:44:39.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.707+0000 7f52bf5ff700 1 -- 172.21.15.124:0/1825465228 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b80c2070 con 0x7f52b80c8840 2023-10-06T04:44:39.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.708+0000 7f52ad7fa700 1 -- 172.21.15.124:0/1825465228 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52a8022030 con 0x7f52b80c8840 2023-10-06T04:44:39.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.709+0000 7f52ad7fa700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f529c066f30 0x7f529c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.709+0000 7f52ad7fa700 1 -- 172.21.15.124:0/1825465228 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f52a80865e0 con 0x7f52b80c8840 2023-10-06T04:44:39.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.709+0000 7f52bd39b700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f529c066f30 0x7f529c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.710+0000 7f52bd39b700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f529c066f30 0x7f529c0693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f52b4006fd0 tx=0x7f52b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:39.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.713+0000 7f52ad7fa700 1 -- 172.21.15.124:0/1825465228 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52a8053650 con 0x7f52b80c8840 2023-10-06T04:44:39.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.903+0000 7f52bf5ff700 1 -- 172.21.15.124:0/1825465228 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f52b80c2070 con 0x7f52b80c8840 2023-10-06T04:44:39.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.903+0000 7f52ad7fa700 1 -- 172.21.15.124:0/1825465228 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f52a8011e60 con 0x7f52b80c8840 2023-10-06T04:44:39.906 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:44:39.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.905+0000 7f52bf5ff700 1 -- 172.21.15.124:0/1825465228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f529c066f30 msgr2=0x7f529c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.905+0000 7f52bf5ff700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f529c066f30 0x7f529c0693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f52b4006fd0 tx=0x7f52b4008040 comp rx=0 tx=0).stop 2023-10-06T04:44:39.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.905+0000 7f52bf5ff700 1 -- 172.21.15.124:0/1825465228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 msgr2=0x7f52b8152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.905+0000 7f52bf5ff700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 0x7f52b8152c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f52a80030c0 tx=0x7f52a8016000 comp rx=0 tx=0).stop 2023-10-06T04:44:39.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.906+0000 7f52bf5ff700 1 -- 172.21.15.124:0/1825465228 shutdown_connections 2023-10-06T04:44:39.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.906+0000 7f52bf5ff700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b8159480 0x7f52b80c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.906+0000 7f52bf5ff700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f529c066f30 0x7f529c0693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.906+0000 7f52bf5ff700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52b806d5a0 0x7f52b81526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.906+0000 7f52bf5ff700 1 --2- 172.21.15.124:0/1825465228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52b80c8840 0x7f52b8152c20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.906+0000 7f52bf5ff700 1 -- 172.21.15.124:0/1825465228 >> 172.21.15.124:0/1825465228 conn(0x7f52b8063cc0 msgr2=0x7f52b806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:39.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.906+0000 7f52bf5ff700 1 -- 172.21.15.124:0/1825465228 shutdown_connections 2023-10-06T04:44:39.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:39.906+0000 7f52bf5ff700 1 -- 172.21.15.124:0/1825465228 wait complete. 2023-10-06T04:44:39.926 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:44:40.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.118+0000 7f2fce1ff700 1 Processor -- start 2023-10-06T04:44:40.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.118+0000 7f2fce1ff700 1 -- start start 2023-10-06T04:44:40.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.119+0000 7f2fce1ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2fc81592b0 0x7f2fc80b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.119+0000 7f2fce1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 0x7f2fc80ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.119+0000 7f2fce1ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc815d620 con 0x7f2fc8159680 2023-10-06T04:44:40.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.119+0000 7f2fce1ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc815d0d0 con 0x7f2fc81592b0 2023-10-06T04:44:40.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.119+0000 7f2fce1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80b2ed0 con 0x7f2fc80cc780 2023-10-06T04:44:40.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.119+0000 7f2fc77fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2fc81592b0 0x7f2fc80b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.119+0000 7f2fc6ffd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2fc8159680 0x7f2fc815dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36336/0 (socket says 172.21.15.124:36336) 2023-10-06T04:44:40.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.119+0000 7f2fc6ffd700 1 -- 172.21.15.124:0/3608663436 learned_addr learned my addr 172.21.15.124:0/3608663436 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:40.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc67fc700 1 -- 172.21.15.124:0/3608663436 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172676652 0 0) 0x7f2fc815d620 con 0x7f2fc8159680 2023-10-06T04:44:40.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc7fff700 1 --2- 172.21.15.124:0/3608663436 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 0x7f2fc80ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc67fc700 1 -- 172.21.15.124:0/3608663436 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb0003570 con 0x7f2fc8159680 2023-10-06T04:44:40.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc77fe700 1 -- 172.21.15.124:0/3608663436 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 msgr2=0x7f2fc80ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:40.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc77fe700 1 --2- 172.21.15.124:0/3608663436 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 0x7f2fc80ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc77fe700 1 -- 172.21.15.124:0/3608663436 >> v1:172.21.15.124:6789/0 conn(0x7f2fc8159680 legacy=0x7f2fc815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc77fe700 1 -- 172.21.15.124:0/3608663436 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80ccc00 con 0x7f2fc81592b0 2023-10-06T04:44:40.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc7fff700 1 --2- 172.21.15.124:0/3608663436 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 0x7f2fc80ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:40.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc77fe700 1 --2- 172.21.15.124:0/3608663436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc81592b0 0x7f2fc80b0080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80098e0 tx=0x7f2fb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ab0b706c4d3b6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc67fc700 1 -- 172.21.15.124:0/3608663436 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800b640 con 0x7f2fc81592b0 2023-10-06T04:44:40.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc67fc700 1 -- 172.21.15.124:0/3608663436 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800b7a0 con 0x7f2fc81592b0 2023-10-06T04:44:40.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.120+0000 7f2fc67fc700 1 -- 172.21.15.124:0/3608663436 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800bb40 con 0x7f2fc81592b0 2023-10-06T04:44:40.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.121+0000 7f2fce1ff700 1 -- 172.21.15.124:0/3608663436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc81592b0 msgr2=0x7f2fc80b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.121+0000 7f2fce1ff700 1 --2- 172.21.15.124:0/3608663436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc81592b0 0x7f2fc80b0080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80098e0 tx=0x7f2fb80091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.121+0000 7f2fce1ff700 1 -- 172.21.15.124:0/3608663436 shutdown_connections 2023-10-06T04:44:40.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.121+0000 7f2fce1ff700 1 --2- 172.21.15.124:0/3608663436 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 0x7f2fc80ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.121+0000 7f2fce1ff700 1 --2- 172.21.15.124:0/3608663436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc81592b0 0x7f2fc80b0080 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.121+0000 7f2fce1ff700 1 -- 172.21.15.124:0/3608663436 >> 172.21.15.124:0/3608663436 conn(0x7f2fc806ed20 msgr2=0x7f2fc806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:40.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.121+0000 7f2fce1ff700 1 -- 172.21.15.124:0/3608663436 shutdown_connections 2023-10-06T04:44:40.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.121+0000 7f2fce1ff700 1 -- 172.21.15.124:0/3608663436 wait complete. 2023-10-06T04:44:40.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.122+0000 7f2fce1ff700 1 Processor -- start 2023-10-06T04:44:40.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.123+0000 7f2fce1ff700 1 -- start start 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.123+0000 7f2fce1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 0x7f2fc8169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.123+0000 7f2fce1ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2fc81592b0 0x7f2fc815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.123+0000 7f2fce1ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc8159680 0x7f2fc80b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.123+0000 7f2fce1ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80b5370 con 0x7f2fc8159680 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.123+0000 7f2fce1ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80c5d40 con 0x7f2fc81592b0 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.123+0000 7f2fce1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80c5410 con 0x7f2fc80cc780 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc8159680 0x7f2fc80b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc8159680 0x7f2fc80b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40800/0 (socket says 172.21.15.124:40800) 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc7fff700 1 -- 172.21.15.124:0/2479955956 learned_addr learned my addr 172.21.15.124:0/2479955956 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc77fe700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 0x7f2fc8169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc6ffd700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2fc81592b0 0x7f2fc815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc7fff700 1 -- 172.21.15.124:0/2479955956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 msgr2=0x7f2fc8169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc7fff700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 0x7f2fc8169ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc7fff700 1 -- 172.21.15.124:0/2479955956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2fc81592b0 msgr2=0x7f2fc815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc7fff700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2fc81592b0 0x7f2fc815ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc7fff700 1 -- 172.21.15.124:0/2479955956 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb8009420 con 0x7f2fc8159680 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.124+0000 7f2fc7fff700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc8159680 0x7f2fc80b46b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000a380 tx=0x7f2fc0007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.125+0000 7f2faf7fe700 1 -- 172.21.15.124:0/2479955956 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0015440 con 0x7f2fc8159680 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.125+0000 7f2faf7fe700 1 -- 172.21.15.124:0/2479955956 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc00155a0 con 0x7f2fc8159680 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.125+0000 7f2fce1ff700 1 -- 172.21.15.124:0/2479955956 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc80c56f0 con 0x7f2fc8159680 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.125+0000 7f2faf7fe700 1 -- 172.21.15.124:0/2479955956 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0015960 con 0x7f2fc8159680 2023-10-06T04:44:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.125+0000 7f2fce1ff700 1 -- 172.21.15.124:0/2479955956 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc816a0e0 con 0x7f2fc8159680 2023-10-06T04:44:40.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.126+0000 7f2fce1ff700 1 -- 172.21.15.124:0/2479955956 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc80c5eb0 con 0x7f2fc8159680 2023-10-06T04:44:40.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.127+0000 7f2faf7fe700 1 -- 172.21.15.124:0/2479955956 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fc000d440 con 0x7f2fc8159680 2023-10-06T04:44:40.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.127+0000 7f2faf7fe700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2fb4066f30 0x7f2fb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.128+0000 7f2faf7fe700 1 -- 172.21.15.124:0/2479955956 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2fc0085040 con 0x7f2fc8159680 2023-10-06T04:44:40.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.128+0000 7f2fc77fe700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2fb4066f30 0x7f2fb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.128+0000 7f2fc77fe700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2fb4066f30 0x7f2fb40693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80093f0 tx=0x7f2fb8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.131+0000 7f2faf7fe700 1 -- 172.21.15.124:0/2479955956 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fc0052150 con 0x7f2fc8159680 2023-10-06T04:44:40.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.326+0000 7f2fce1ff700 1 -- 172.21.15.124:0/2479955956 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fc804c380 con 0x7f2fc8159680 2023-10-06T04:44:40.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.327+0000 7f2faf7fe700 1 -- 172.21.15.124:0/2479955956 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fc0055770 con 0x7f2fc8159680 2023-10-06T04:44:40.329 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:44:40.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 -- 172.21.15.124:0/2479955956 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2fb4066f30 msgr2=0x7f2fb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2fb4066f30 0x7f2fb40693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80093f0 tx=0x7f2fb8017000 comp rx=0 tx=0).stop 2023-10-06T04:44:40.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 -- 172.21.15.124:0/2479955956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc8159680 msgr2=0x7f2fc80b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc8159680 0x7f2fc80b46b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000a380 tx=0x7f2fc0007900 comp rx=0 tx=0).stop 2023-10-06T04:44:40.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 -- 172.21.15.124:0/2479955956 shutdown_connections 2023-10-06T04:44:40.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2fc8159680 0x7f2fc80b46b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2fb4066f30 0x7f2fb40693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2fc80cc780 0x7f2fc8169ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 --2- 172.21.15.124:0/2479955956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2fc81592b0 0x7f2fc815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 -- 172.21.15.124:0/2479955956 >> 172.21.15.124:0/2479955956 conn(0x7f2fc806ed20 msgr2=0x7f2fc80caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:40.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 -- 172.21.15.124:0/2479955956 shutdown_connections 2023-10-06T04:44:40.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.329+0000 7f2fce1ff700 1 -- 172.21.15.124:0/2479955956 wait complete. 2023-10-06T04:44:40.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:44:40.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.540+0000 7f3bd87ff700 1 Processor -- start 2023-10-06T04:44:40.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.540+0000 7f3bd87ff700 1 -- start start 2023-10-06T04:44:40.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.542+0000 7f3bd87ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3bd006a3d0 0x7f3bd00aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.542+0000 7f3bd87ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd0157ad0 con 0x7f3bd0157700 2023-10-06T04:44:40.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.542+0000 7f3bd87ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd006db30 con 0x7f3bd00694c0 2023-10-06T04:44:40.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.542+0000 7f3bd87ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd006de10 con 0x7f3bd006a3d0 2023-10-06T04:44:40.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.542+0000 7f3bd659b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f3bd0157700 0x7f3bd006d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36346/0 (socket says 172.21.15.124:36346) 2023-10-06T04:44:40.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.542+0000 7f3bd659b700 1 -- 172.21.15.124:0/1867760534 learned_addr learned my addr 172.21.15.124:0/1867760534 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:40.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.542+0000 7f3bd5d9a700 1 --2- 172.21.15.124:0/1867760534 >> v2:172.21.15.158:3300/0 conn(0x7f3bd006a3d0 0x7f3bd00aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.542+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145982155 0 0) 0x7f3bd0157ad0 con 0x7f3bd0157700 2023-10-06T04:44:40.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.542+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bbc003570 con 0x7f3bd0157700 2023-10-06T04:44:40.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3434668598 0 0) 0x7f3bbc003570 con 0x7f3bd0157700 2023-10-06T04:44:40.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 >> v2:172.21.15.158:3300/0 conn(0x7f3bd006a3d0 msgr2=0x7f3bd00aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 --2- 172.21.15.124:0/1867760534 >> v2:172.21.15.158:3300/0 conn(0x7f3bd006a3d0 0x7f3bd00aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 >> v1:172.21.15.158:6789/0 conn(0x7f3bd00694c0 legacy=0x7f3bd006ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd006e0f0 con 0x7f3bd0157700 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f3bcc001470 con 0x7f3bd0157700 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 >> v1:172.21.15.124:6789/0 conn(0x7f3bd0157700 legacy=0x7f3bd006d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bbc003ab0 0x7f3bbc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bbc004810 0x7f3bbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bbc005210 0x7f3bbc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd006de10 con 0x7f3bbc003ab0 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc00c130 con 0x7f3bbc005210 2023-10-06T04:44:40.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc00c2f0 con 0x7f3bbc004810 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd659b700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bbc003ab0 0x7f3bbc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd6d9c700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bbc005210 0x7f3bbc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd5d9a700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bbc004810 0x7f3bbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd659b700 1 -- 172.21.15.124:0/1867760534 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bbc004810 msgr2=0x7f3bbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd659b700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bbc004810 0x7f3bbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd659b700 1 -- 172.21.15.124:0/1867760534 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bbc005210 msgr2=0x7f3bbc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd659b700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bbc005210 0x7f3bbc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd6d9c700 1 -- 172.21.15.124:0/1867760534 reap_dead start 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.543+0000 7f3bd659b700 1 -- 172.21.15.124:0/1867760534 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc003570 con 0x7f3bbc003ab0 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.544+0000 7f3bd659b700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bbc003ab0 0x7f3bbc003ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00c2d0 tx=0x7f3bcc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0bbdee9197078 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.544+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00cba0 con 0x7f3bbc003ab0 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.544+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc00cd20 con 0x7f3bbc003ab0 2023-10-06T04:44:40.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.544+0000 7f3bd5599700 1 -- 172.21.15.124:0/1867760534 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc005b70 con 0x7f3bbc003ab0 2023-10-06T04:44:40.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.544+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1867760534 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bbc003ab0 msgr2=0x7f3bbc003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.544+0000 7f3bd87ff700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bbc003ab0 0x7f3bbc003ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00c2d0 tx=0x7f3bcc001d80 comp rx=0 tx=0).stop 2023-10-06T04:44:40.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.544+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1867760534 shutdown_connections 2023-10-06T04:44:40.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.544+0000 7f3bd87ff700 1 --2- 172.21.15.124:0/1867760534 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bbc003ab0 0x7f3bbc003ec0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.544+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1867760534 >> 172.21.15.124:0/1867760534 conn(0x7f3bd00680c0 msgr2=0x7f3bd00cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:40.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.544+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1867760534 shutdown_connections 2023-10-06T04:44:40.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.545+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1867760534 wait complete. 2023-10-06T04:44:40.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.546+0000 7f3bd87ff700 1 Processor -- start 2023-10-06T04:44:40.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.546+0000 7f3bd87ff700 1 -- start start 2023-10-06T04:44:40.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd87ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bbc003ab0 0x7f3bd00c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd87ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bd0167f80 0x7f3bd0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd87ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bd01683f0 0x7f3bd015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd87ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd0167af0 con 0x7f3bd0167f80 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd87ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd0166ee0 con 0x7f3bd01683f0 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd87ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd01671c0 con 0x7f3bbc003ab0 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd5d9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bd0167f80 0x7f3bd0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd5d9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bd0167f80 0x7f3bd0159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40820/0 (socket says 172.21.15.124:40820) 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd5d9a700 1 -- 172.21.15.124:0/1641920416 learned_addr learned my addr 172.21.15.124:0/1641920416 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd659b700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bbc003ab0 0x7f3bd00c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd6d9c700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bd01683f0 0x7f3bd015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd5d9a700 1 -- 172.21.15.124:0/1641920416 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bbc003ab0 msgr2=0x7f3bd00c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd5d9a700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bbc003ab0 0x7f3bd00c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd5d9a700 1 -- 172.21.15.124:0/1641920416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bd01683f0 msgr2=0x7f3bd015a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd5d9a700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bd01683f0 0x7f3bd015a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd5d9a700 1 -- 172.21.15.124:0/1641920416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd01674a0 con 0x7f3bd0167f80 2023-10-06T04:44:40.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd659b700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bbc003ab0 0x7f3bd00c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:40.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.547+0000 7f3bd6d9c700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bd01683f0 0x7f3bd015a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:40.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.548+0000 7f3bd5d9a700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bd0167f80 0x7f3bd0159d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0011a10 tx=0x7f3bc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.548+0000 7f3bc67fc700 1 -- 172.21.15.124:0/1641920416 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000f940 con 0x7f3bd0167f80 2023-10-06T04:44:40.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.548+0000 7f3bc67fc700 1 -- 172.21.15.124:0/1641920416 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc000faa0 con 0x7f3bd0167f80 2023-10-06T04:44:40.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.548+0000 7f3bc67fc700 1 -- 172.21.15.124:0/1641920416 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000fe20 con 0x7f3bd0167f80 2023-10-06T04:44:40.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.548+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1641920416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd0167780 con 0x7f3bd0167f80 2023-10-06T04:44:40.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.548+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1641920416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd00c98e0 con 0x7f3bd0167f80 2023-10-06T04:44:40.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.549+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1641920416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd0167ca0 con 0x7f3bd0167f80 2023-10-06T04:44:40.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.550+0000 7f3bc67fc700 1 -- 172.21.15.124:0/1641920416 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bc0014650 con 0x7f3bd0167f80 2023-10-06T04:44:40.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.551+0000 7f3bc67fc700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bb4066f30 0x7f3bb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.551+0000 7f3bc67fc700 1 -- 172.21.15.124:0/1641920416 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3bc0018030 con 0x7f3bd0167f80 2023-10-06T04:44:40.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.551+0000 7f3bd659b700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bb4066f30 0x7f3bb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.551+0000 7f3bd659b700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bb4066f30 0x7f3bb40693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc007c00 tx=0x7f3bcc015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.555+0000 7f3bc67fc700 1 -- 172.21.15.124:0/1641920416 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bd0167ca0 con 0x7f3bd0167f80 2023-10-06T04:44:40.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.747+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1641920416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bd0064850 con 0x7f3bd0167f80 2023-10-06T04:44:40.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.747+0000 7f3bc67fc700 1 -- 172.21.15.124:0/1641920416 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bc00520b0 con 0x7f3bd0167f80 2023-10-06T04:44:40.749 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-06T04:44:40.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.749+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1641920416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bb4066f30 msgr2=0x7f3bb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.749+0000 7f3bd87ff700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bb4066f30 0x7f3bb40693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc007c00 tx=0x7f3bcc015000 comp rx=0 tx=0).stop 2023-10-06T04:44:40.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.749+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1641920416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bd0167f80 msgr2=0x7f3bd0159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.749+0000 7f3bd87ff700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bd0167f80 0x7f3bd0159d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0011a10 tx=0x7f3bc00091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.749+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1641920416 shutdown_connections 2023-10-06T04:44:40.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.749+0000 7f3bd87ff700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bd01683f0 0x7f3bd015a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.750+0000 7f3bd87ff700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bb4066f30 0x7f3bb40693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.750+0000 7f3bd87ff700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bbc003ab0 0x7f3bd00c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.750+0000 7f3bd87ff700 1 --2- 172.21.15.124:0/1641920416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bd0167f80 0x7f3bd0159d90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.750+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1641920416 >> 172.21.15.124:0/1641920416 conn(0x7f3bd00680c0 msgr2=0x7f3bd0156860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:40.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.750+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1641920416 shutdown_connections 2023-10-06T04:44:40.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.750+0000 7f3bd87ff700 1 -- 172.21.15.124:0/1641920416 wait complete. 2023-10-06T04:44:40.769 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:44:40.962 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.959+0000 7f5a703ff700 1 Processor -- start 2023-10-06T04:44:40.962 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.960+0000 7f5a703ff700 1 -- start start 2023-10-06T04:44:40.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a703ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a681592b0 0x7f5a680b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a703ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5a680cc780 0x7f5a680ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a703ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6815d620 con 0x7f5a68159680 2023-10-06T04:44:40.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a703ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6815d0d0 con 0x7f5a680cc780 2023-10-06T04:44:40.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a703ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680b2ed0 con 0x7f5a681592b0 2023-10-06T04:44:40.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a6e99c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5a680cc780 0x7f5a680ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a6e99c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5a680cc780 0x7f5a680ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40836/0 (socket says 172.21.15.124:40836) 2023-10-06T04:44:40.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a6e99c700 1 -- 172.21.15.124:0/3164206072 learned_addr learned my addr 172.21.15.124:0/3164206072 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:40.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a6e19b700 1 --2- 172.21.15.124:0/3164206072 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a681592b0 0x7f5a680b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a6e99c700 1 -- 172.21.15.124:0/3164206072 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a681592b0 msgr2=0x7f5a680b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:40.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a6e99c700 1 --2- 172.21.15.124:0/3164206072 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a681592b0 0x7f5a680b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a6e99c700 1 -- 172.21.15.124:0/3164206072 >> v1:172.21.15.158:6789/0 conn(0x7f5a68159680 legacy=0x7f5a6815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.961+0000 7f5a6e99c700 1 -- 172.21.15.124:0/3164206072 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680ccc20 con 0x7f5a680cc780 2023-10-06T04:44:40.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.962+0000 7f5a6e99c700 1 --2- 172.21.15.124:0/3164206072 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a680cc780 0x7f5a680ccea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009f20 tx=0x7f5a60009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48b5b8f8026b2f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.962+0000 7f5a6d199700 1 -- 172.21.15.124:0/3164206072 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6000e070 con 0x7f5a680cc780 2023-10-06T04:44:40.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.962+0000 7f5a6d199700 1 -- 172.21.15.124:0/3164206072 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6000ba80 con 0x7f5a680cc780 2023-10-06T04:44:40.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.962+0000 7f5a6d199700 1 -- 172.21.15.124:0/3164206072 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600092e0 con 0x7f5a680cc780 2023-10-06T04:44:40.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.962+0000 7f5a703ff700 1 -- 172.21.15.124:0/3164206072 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a680cc780 msgr2=0x7f5a680ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.962+0000 7f5a703ff700 1 --2- 172.21.15.124:0/3164206072 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a680cc780 0x7f5a680ccea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009f20 tx=0x7f5a60009840 comp rx=0 tx=0).stop 2023-10-06T04:44:40.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.962+0000 7f5a703ff700 1 -- 172.21.15.124:0/3164206072 shutdown_connections 2023-10-06T04:44:40.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.962+0000 7f5a703ff700 1 --2- 172.21.15.124:0/3164206072 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a680cc780 0x7f5a680ccea0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.962+0000 7f5a703ff700 1 --2- 172.21.15.124:0/3164206072 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a681592b0 0x7f5a680b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.962+0000 7f5a703ff700 1 -- 172.21.15.124:0/3164206072 >> 172.21.15.124:0/3164206072 conn(0x7f5a6806ed20 msgr2=0x7f5a6806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:40.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.963+0000 7f5a703ff700 1 -- 172.21.15.124:0/3164206072 shutdown_connections 2023-10-06T04:44:40.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.963+0000 7f5a703ff700 1 -- 172.21.15.124:0/3164206072 wait complete. 2023-10-06T04:44:40.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.964+0000 7f5a703ff700 1 Processor -- start 2023-10-06T04:44:40.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.964+0000 7f5a703ff700 1 -- start start 2023-10-06T04:44:40.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a703ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a680cc780 0x7f5a68152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a703ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a681592b0 0x7f5a680c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a703ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a68159680 0x7f5a680d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a703ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6815b8d0 con 0x7f5a68159680 2023-10-06T04:44:40.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a703ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680c79f0 con 0x7f5a681592b0 2023-10-06T04:44:40.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a703ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680d0ec0 con 0x7f5a680cc780 2023-10-06T04:44:40.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a6e99c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a68159680 0x7f5a680d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a6e99c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a68159680 0x7f5a680d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40852/0 (socket says 172.21.15.124:40852) 2023-10-06T04:44:40.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a6e99c700 1 -- 172.21.15.124:0/3226850199 learned_addr learned my addr 172.21.15.124:0/3226850199 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:40.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a6d99a700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a681592b0 0x7f5a680c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.965+0000 7f5a6e19b700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a680cc780 0x7f5a68152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a6e99c700 1 -- 172.21.15.124:0/3226850199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a680cc780 msgr2=0x7f5a68152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a6e99c700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a680cc780 0x7f5a68152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a6e99c700 1 -- 172.21.15.124:0/3226850199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a681592b0 msgr2=0x7f5a680c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a6e99c700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a681592b0 0x7f5a680c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a6e99c700 1 -- 172.21.15.124:0/3226850199 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a60009ae0 con 0x7f5a68159680 2023-10-06T04:44:40.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a6e19b700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a680cc780 0x7f5a68152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:40.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a6e99c700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a68159680 0x7f5a680d0370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000b6c0 tx=0x7f5a60018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a5e7fc700 1 -- 172.21.15.124:0/3226850199 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60008dc0 con 0x7f5a68159680 2023-10-06T04:44:40.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a5e7fc700 1 -- 172.21.15.124:0/3226850199 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a60026460 con 0x7f5a68159680 2023-10-06T04:44:40.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a703ff700 1 -- 172.21.15.124:0/3226850199 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6815afa0 con 0x7f5a68159680 2023-10-06T04:44:40.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a5e7fc700 1 -- 172.21.15.124:0/3226850199 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60026820 con 0x7f5a68159680 2023-10-06T04:44:40.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.966+0000 7f5a703ff700 1 -- 172.21.15.124:0/3226850199 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6815b560 con 0x7f5a68159680 2023-10-06T04:44:40.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.967+0000 7f5a703ff700 1 -- 172.21.15.124:0/3226850199 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6815ba80 con 0x7f5a68159680 2023-10-06T04:44:40.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.968+0000 7f5a5e7fc700 1 -- 172.21.15.124:0/3226850199 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a60003040 con 0x7f5a68159680 2023-10-06T04:44:40.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.969+0000 7f5a5e7fc700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5a4c066f30 0x7f5a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.969+0000 7f5a5e7fc700 1 -- 172.21.15.124:0/3226850199 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a60086470 con 0x7f5a68159680 2023-10-06T04:44:40.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.969+0000 7f5a6e19b700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5a4c066f30 0x7f5a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.970+0000 7f5a6e19b700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5a4c066f30 0x7f5a4c0693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a64006fd0 tx=0x7f5a64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:40.973+0000 7f5a5e7fc700 1 -- 172.21.15.124:0/3226850199 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a6815ba80 con 0x7f5a68159680 2023-10-06T04:44:41.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.163+0000 7f5a703ff700 1 -- 172.21.15.124:0/3226850199 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a6815ba80 con 0x7f5a68159680 2023-10-06T04:44:41.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.163+0000 7f5a5e7fc700 1 -- 172.21.15.124:0/3226850199 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a6815ba80 con 0x7f5a68159680 2023-10-06T04:44:41.166 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-06T04:44:41.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 -- 172.21.15.124:0/3226850199 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5a4c066f30 msgr2=0x7f5a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5a4c066f30 0x7f5a4c0693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a64006fd0 tx=0x7f5a64008040 comp rx=0 tx=0).stop 2023-10-06T04:44:41.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 -- 172.21.15.124:0/3226850199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a68159680 msgr2=0x7f5a680d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a68159680 0x7f5a680d0370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000b6c0 tx=0x7f5a60018000 comp rx=0 tx=0).stop 2023-10-06T04:44:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 -- 172.21.15.124:0/3226850199 shutdown_connections 2023-10-06T04:44:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a68159680 0x7f5a680d0370 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5a4c066f30 0x7f5a4c0693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a680cc780 0x7f5a68152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 --2- 172.21.15.124:0/3226850199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a681592b0 0x7f5a680c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 -- 172.21.15.124:0/3226850199 >> 172.21.15.124:0/3226850199 conn(0x7f5a6806ed20 msgr2=0x7f5a680b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 -- 172.21.15.124:0/3226850199 shutdown_connections 2023-10-06T04:44:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.166+0000 7f5a703ff700 1 -- 172.21.15.124:0/3226850199 wait complete. 2023-10-06T04:44:41.186 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:41.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.374+0000 7f3d66fff700 1 Processor -- start 2023-10-06T04:44:41.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.374+0000 7f3d66fff700 1 -- start start 2023-10-06T04:44:41.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.376+0000 7f3d66fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d60068bb0 0x7f3d600b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.376+0000 7f3d66fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600cc040 con 0x7f3d6006ddc0 2023-10-06T04:44:41.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.376+0000 7f3d66fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6006e990 con 0x7f3d60159040 2023-10-06T04:44:41.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.376+0000 7f3d66fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600cb9f0 con 0x7f3d60068bb0 2023-10-06T04:44:41.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.376+0000 7f3d5ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d60068bb0 0x7f3d600b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.376+0000 7f3d64d9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f3d6006ddc0 0x7f3d6006e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36354/0 (socket says 172.21.15.124:36354) 2023-10-06T04:44:41.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.376+0000 7f3d64d9b700 1 -- 172.21.15.124:0/1849205789 learned_addr learned my addr 172.21.15.124:0/1849205789 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:41.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.376+0000 7f3d5ffff700 1 -- 172.21.15.124:0/1849205789 >> v1:172.21.15.158:6789/0 conn(0x7f3d60159040 legacy=0x7f3d60159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.377+0000 7f3d5ffff700 1 -- 172.21.15.124:0/1849205789 >> v1:172.21.15.124:6789/0 conn(0x7f3d6006ddc0 legacy=0x7f3d6006e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.377+0000 7f3d5ffff700 1 -- 172.21.15.124:0/1849205789 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600cbcd0 con 0x7f3d60068bb0 2023-10-06T04:44:41.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.377+0000 7f3d5f7fe700 1 -- 172.21.15.124:0/1849205789 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424796267 0 0) 0x7f3d600cc040 con 0x7f3d6006ddc0 2023-10-06T04:44:41.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.377+0000 7f3d5ffff700 1 --2- 172.21.15.124:0/1849205789 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60068bb0 0x7f3d600b1f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c0098e0 tx=0x7f3d4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e19627cd0ea858 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:41.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.377+0000 7f3d5f7fe700 1 -- 172.21.15.124:0/1849205789 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c009e80 con 0x7f3d60068bb0 2023-10-06T04:44:41.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.377+0000 7f3d5f7fe700 1 -- 172.21.15.124:0/1849205789 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c00b860 con 0x7f3d60068bb0 2023-10-06T04:44:41.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.377+0000 7f3d5f7fe700 1 -- 172.21.15.124:0/1849205789 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00bbe0 con 0x7f3d60068bb0 2023-10-06T04:44:41.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.378+0000 7f3d66fff700 1 -- 172.21.15.124:0/1849205789 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60068bb0 msgr2=0x7f3d600b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.378+0000 7f3d66fff700 1 --2- 172.21.15.124:0/1849205789 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60068bb0 0x7f3d600b1f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c0098e0 tx=0x7f3d4c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.378+0000 7f3d66fff700 1 -- 172.21.15.124:0/1849205789 shutdown_connections 2023-10-06T04:44:41.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.378+0000 7f3d66fff700 1 --2- 172.21.15.124:0/1849205789 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60068bb0 0x7f3d600b1f50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.378+0000 7f3d66fff700 1 -- 172.21.15.124:0/1849205789 >> 172.21.15.124:0/1849205789 conn(0x7f3d600cd390 msgr2=0x7f3d600b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:41.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.378+0000 7f3d66fff700 1 -- 172.21.15.124:0/1849205789 shutdown_connections 2023-10-06T04:44:41.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.378+0000 7f3d66fff700 1 -- 172.21.15.124:0/1849205789 wait complete. 2023-10-06T04:44:41.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.379+0000 7f3d66fff700 1 Processor -- start 2023-10-06T04:44:41.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.379+0000 7f3d66fff700 1 -- start start 2023-10-06T04:44:41.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.380+0000 7f3d66fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d60068bb0 0x7f3d6013ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.380+0000 7f3d66fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6006ddc0 0x7f3d6015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.380+0000 7f3d66fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60159040 0x7f3d6015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.380+0000 7f3d66fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600c5df0 con 0x7f3d60159040 2023-10-06T04:44:41.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.380+0000 7f3d66fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6013f1c0 con 0x7f3d60068bb0 2023-10-06T04:44:41.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.380+0000 7f3d66fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600c85a0 con 0x7f3d6006ddc0 2023-10-06T04:44:41.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d6559c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60159040 0x7f3d6015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d6559c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60159040 0x7f3d6015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40880/0 (socket says 172.21.15.124:40880) 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d6559c700 1 -- 172.21.15.124:0/3582401737 learned_addr learned my addr 172.21.15.124:0/3582401737 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d64d9b700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d60068bb0 0x7f3d6013ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d5ffff700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6006ddc0 0x7f3d6015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d6559c700 1 -- 172.21.15.124:0/3582401737 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6006ddc0 msgr2=0x7f3d6015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d6559c700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6006ddc0 0x7f3d6015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d6559c700 1 -- 172.21.15.124:0/3582401737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d60068bb0 msgr2=0x7f3d6013ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d6559c700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d60068bb0 0x7f3d6013ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d6559c700 1 -- 172.21.15.124:0/3582401737 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c009420 con 0x7f3d60159040 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d64d9b700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d60068bb0 0x7f3d6013ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d5ffff700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6006ddc0 0x7f3d6015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d6559c700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60159040 0x7f3d6015ca70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c840 tx=0x7f3d58001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:41.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d5cff9700 1 -- 172.21.15.124:0/3582401737 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58012630 con 0x7f3d60159040 2023-10-06T04:44:41.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d5cff9700 1 -- 172.21.15.124:0/3582401737 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580127b0 con 0x7f3d60159040 2023-10-06T04:44:41.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d5cff9700 1 -- 172.21.15.124:0/3582401737 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58012b70 con 0x7f3d60159040 2023-10-06T04:44:41.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d66fff700 1 -- 172.21.15.124:0/3582401737 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d600c8880 con 0x7f3d60159040 2023-10-06T04:44:41.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.381+0000 7f3d66fff700 1 -- 172.21.15.124:0/3582401737 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d600c8e40 con 0x7f3d60159040 2023-10-06T04:44:41.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.382+0000 7f3d66fff700 1 -- 172.21.15.124:0/3582401737 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d60155770 con 0x7f3d60159040 2023-10-06T04:44:41.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.383+0000 7f3d5cff9700 1 -- 172.21.15.124:0/3582401737 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d58003030 con 0x7f3d60159040 2023-10-06T04:44:41.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.384+0000 7f3d5cff9700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d44066f30 0x7f3d440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.384+0000 7f3d5cff9700 1 -- 172.21.15.124:0/3582401737 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3d580846f0 con 0x7f3d60159040 2023-10-06T04:44:41.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.384+0000 7f3d64d9b700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d44066f30 0x7f3d440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.385+0000 7f3d64d9b700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d44066f30 0x7f3d440693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3d600685c0 tx=0x7f3d54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:41.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.388+0000 7f3d5cff9700 1 -- 172.21.15.124:0/3582401737 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d60155770 con 0x7f3d60159040 2023-10-06T04:44:41.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.618+0000 7f3d66fff700 1 -- 172.21.15.124:0/3582401737 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d60155770 con 0x7f3d60159040 2023-10-06T04:44:41.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.619+0000 7f3d5cff9700 1 -- 172.21.15.124:0/3582401737 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f3d60155770 con 0x7f3d60159040 2023-10-06T04:44:41.621 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:41.621 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/3828511424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":3828511424},{"type":"v1","addr":"172.21.15.124:6836","nonce":3828511424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/1252041103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1252041103},{"type":"v1","addr":"172.21.15.158:6834","nonce":1252041103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/978440229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":978440229},{"type":"v1","addr":"172.21.15.124:6837","nonce":978440229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:27.635332+0000","modified":"2023-10-06T04:44:31.182630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6835/1693475602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":1693475602},{"type":"v1","addr":"172.21.15.158:6835","nonce":1693475602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:44:41.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 -- 172.21.15.124:0/3582401737 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d44066f30 msgr2=0x7f3d440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d44066f30 0x7f3d440693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3d600685c0 tx=0x7f3d54009040 comp rx=0 tx=0).stop 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 -- 172.21.15.124:0/3582401737 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60159040 msgr2=0x7f3d6015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60159040 0x7f3d6015ca70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c840 tx=0x7f3d58001670 comp rx=0 tx=0).stop 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 -- 172.21.15.124:0/3582401737 shutdown_connections 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d60159040 0x7f3d6015ca70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d60068bb0 0x7f3d6013ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d44066f30 0x7f3d440693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 --2- 172.21.15.124:0/3582401737 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6006ddc0 0x7f3d6015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 -- 172.21.15.124:0/3582401737 >> 172.21.15.124:0/3582401737 conn(0x7f3d600cd390 msgr2=0x7f3d600b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 -- 172.21.15.124:0/3582401737 shutdown_connections 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.621+0000 7f3d66fff700 1 -- 172.21.15.124:0/3582401737 wait complete. 2023-10-06T04:44:41.625 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2023-10-06T04:44:41.641 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:41.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.829+0000 7f39d91ff700 1 Processor -- start 2023-10-06T04:44:41.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.829+0000 7f39d91ff700 1 -- start start 2023-10-06T04:44:41.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.830+0000 7f39d91ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f39d40ac3d0 0x7f39d40aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.831+0000 7f39d91ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d4069cb0 con 0x7f39d406a850 2023-10-06T04:44:41.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.831+0000 7f39d91ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d4156110 con 0x7f39d40af350 2023-10-06T04:44:41.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.831+0000 7f39d91ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d406eaa0 con 0x7f39d40ac3d0 2023-10-06T04:44:41.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.831+0000 7f39d359e700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f39d406a850 0x7f39d40add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36358/0 (socket says 172.21.15.124:36358) 2023-10-06T04:44:41.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.831+0000 7f39d359e700 1 -- 172.21.15.124:0/4284219109 learned_addr learned my addr 172.21.15.124:0/4284219109 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:41.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.831+0000 7f39d2d9d700 1 --2- 172.21.15.124:0/4284219109 >> v2:172.21.15.158:3300/0 conn(0x7f39d40ac3d0 0x7f39d40aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.831+0000 7f39d1d9b700 1 -- 172.21.15.124:0/4284219109 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304177689 0 0) 0x7f39d4069cb0 con 0x7f39d406a850 2023-10-06T04:44:41.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.831+0000 7f39d1d9b700 1 -- 172.21.15.124:0/4284219109 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39bc003570 con 0x7f39d406a850 2023-10-06T04:44:41.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.831+0000 7f39d2d9d700 1 -- 172.21.15.124:0/4284219109 >> v1:172.21.15.158:6789/0 conn(0x7f39d40af350 legacy=0x7f39d406a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.831+0000 7f39d2d9d700 1 -- 172.21.15.124:0/4284219109 >> v1:172.21.15.124:6789/0 conn(0x7f39d406a850 legacy=0x7f39d40add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.832+0000 7f39d2d9d700 1 -- 172.21.15.124:0/4284219109 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d406ed80 con 0x7f39d40ac3d0 2023-10-06T04:44:41.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.832+0000 7f39d2d9d700 1 --2- 172.21.15.124:0/4284219109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39d40ac3d0 0x7f39d40aee10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39c400aa90 tx=0x7f39c400a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c47006889bbd16f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:41.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.832+0000 7f39d1d9b700 1 -- 172.21.15.124:0/4284219109 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400ca00 con 0x7f39d40ac3d0 2023-10-06T04:44:41.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.832+0000 7f39d1d9b700 1 -- 172.21.15.124:0/4284219109 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c400cb60 con 0x7f39d40ac3d0 2023-10-06T04:44:41.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.832+0000 7f39d1d9b700 1 -- 172.21.15.124:0/4284219109 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4018400 con 0x7f39d40ac3d0 2023-10-06T04:44:41.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.833+0000 7f39d91ff700 1 -- 172.21.15.124:0/4284219109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39d40ac3d0 msgr2=0x7f39d40aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.833+0000 7f39d91ff700 1 --2- 172.21.15.124:0/4284219109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39d40ac3d0 0x7f39d40aee10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39c400aa90 tx=0x7f39c400a330 comp rx=0 tx=0).stop 2023-10-06T04:44:41.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.833+0000 7f39d91ff700 1 -- 172.21.15.124:0/4284219109 shutdown_connections 2023-10-06T04:44:41.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.833+0000 7f39d91ff700 1 --2- 172.21.15.124:0/4284219109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39d40ac3d0 0x7f39d40aee10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.833+0000 7f39d91ff700 1 -- 172.21.15.124:0/4284219109 >> 172.21.15.124:0/4284219109 conn(0x7f39d40cc050 msgr2=0x7f39d40cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:41.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.833+0000 7f39d91ff700 1 -- 172.21.15.124:0/4284219109 shutdown_connections 2023-10-06T04:44:41.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.833+0000 7f39d91ff700 1 -- 172.21.15.124:0/4284219109 wait complete. 2023-10-06T04:44:41.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.834+0000 7f39d91ff700 1 Processor -- start 2023-10-06T04:44:41.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.834+0000 7f39d91ff700 1 -- start start 2023-10-06T04:44:41.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.835+0000 7f39d91ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39d406a850 0x7f39d4153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.835+0000 7f39d91ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39d40ac3d0 0x7f39d41581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.835+0000 7f39d91ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39d40af350 0x7f39d40caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.835+0000 7f39d91ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d40c9920 con 0x7f39d40af350 2023-10-06T04:44:41.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.835+0000 7f39d91ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4169b70 con 0x7f39d406a850 2023-10-06T04:44:41.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.835+0000 7f39d91ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4158b20 con 0x7f39d40ac3d0 2023-10-06T04:44:41.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.835+0000 7f39d359e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39d40af350 0x7f39d40caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.835+0000 7f39d359e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39d40af350 0x7f39d40caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40894/0 (socket says 172.21.15.124:40894) 2023-10-06T04:44:41.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39d359e700 1 -- 172.21.15.124:0/947006840 learned_addr learned my addr 172.21.15.124:0/947006840 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:41.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39d2d9d700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39d406a850 0x7f39d4153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39d259c700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39d40ac3d0 0x7f39d41581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39d359e700 1 -- 172.21.15.124:0/947006840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39d40ac3d0 msgr2=0x7f39d41581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39d359e700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39d40ac3d0 0x7f39d41581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39d359e700 1 -- 172.21.15.124:0/947006840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39d406a850 msgr2=0x7f39d4153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39d359e700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39d406a850 0x7f39d4153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39d359e700 1 -- 172.21.15.124:0/947006840 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c400a5d0 con 0x7f39d40af350 2023-10-06T04:44:41.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39d359e700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39d40af350 0x7f39d40caf20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f39cc001460 tx=0x7f39cc001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:41.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39baffd700 1 -- 172.21.15.124:0/947006840 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00a940 con 0x7f39d40af350 2023-10-06T04:44:41.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39baffd700 1 -- 172.21.15.124:0/947006840 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc00aaa0 con 0x7f39d40af350 2023-10-06T04:44:41.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39d91ff700 1 -- 172.21.15.124:0/947006840 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d4158e00 con 0x7f39d40af350 2023-10-06T04:44:41.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.836+0000 7f39baffd700 1 -- 172.21.15.124:0/947006840 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00ae20 con 0x7f39d40af350 2023-10-06T04:44:41.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.837+0000 7f39d91ff700 1 -- 172.21.15.124:0/947006840 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4169790 con 0x7f39d40af350 2023-10-06T04:44:41.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.838+0000 7f39d91ff700 1 -- 172.21.15.124:0/947006840 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d4169d20 con 0x7f39d40af350 2023-10-06T04:44:41.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.838+0000 7f39baffd700 1 -- 172.21.15.124:0/947006840 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39cc007300 con 0x7f39d40af350 2023-10-06T04:44:41.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.840+0000 7f39baffd700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c0066f00 0x7f39c00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.840+0000 7f39baffd700 1 -- 172.21.15.124:0/947006840 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39cc084b60 con 0x7f39d40af350 2023-10-06T04:44:41.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.840+0000 7f39d2d9d700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c0066f00 0x7f39c00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.840+0000 7f39d2d9d700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c0066f00 0x7f39c00693b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f39c400a370 tx=0x7f39c401a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:41.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:41.844+0000 7f39baffd700 1 -- 172.21.15.124:0/947006840 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39d4169d20 con 0x7f39d40af350 2023-10-06T04:44:42.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.040+0000 7f39d91ff700 1 -- 172.21.15.124:0/947006840 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39d4169ce0 con 0x7f39d40af350 2023-10-06T04:44:42.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.041+0000 7f39baffd700 1 -- 172.21.15.124:0/947006840 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f39cc051bc0 con 0x7f39d40af350 2023-10-06T04:44:42.044 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:42.044 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:42.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.043+0000 7f39d91ff700 1 -- 172.21.15.124:0/947006840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c0066f00 msgr2=0x7f39c00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.043+0000 7f39d91ff700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c0066f00 0x7f39c00693b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f39c400a370 tx=0x7f39c401a000 comp rx=0 tx=0).stop 2023-10-06T04:44:42.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.043+0000 7f39d91ff700 1 -- 172.21.15.124:0/947006840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39d40af350 msgr2=0x7f39d40caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.043+0000 7f39d91ff700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39d40af350 0x7f39d40caf20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f39cc001460 tx=0x7f39cc001ae0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.043+0000 7f39d91ff700 1 -- 172.21.15.124:0/947006840 shutdown_connections 2023-10-06T04:44:42.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.043+0000 7f39d91ff700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39d40af350 0x7f39d40caf20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.043+0000 7f39d91ff700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39d406a850 0x7f39d4153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.043+0000 7f39d91ff700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c0066f00 0x7f39c00693b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.043+0000 7f39d91ff700 1 --2- 172.21.15.124:0/947006840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39d40ac3d0 0x7f39d41581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.043+0000 7f39d91ff700 1 -- 172.21.15.124:0/947006840 >> 172.21.15.124:0/947006840 conn(0x7f39d40cc050 msgr2=0x7f39d40af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:42.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.044+0000 7f39d91ff700 1 -- 172.21.15.124:0/947006840 shutdown_connections 2023-10-06T04:44:42.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.044+0000 7f39d91ff700 1 -- 172.21.15.124:0/947006840 wait complete. 2023-10-06T04:44:42.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:44:25.771714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:44:26.609661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:44:42.064 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:44:42.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.254+0000 7f130ffff700 1 Processor -- start 2023-10-06T04:44:42.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.254+0000 7f130ffff700 1 -- start start 2023-10-06T04:44:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.255+0000 7f130ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1308159480 0x7f130815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.255+0000 7f130ffff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1308068700 con 0x7f13080c8840 2023-10-06T04:44:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.255+0000 7f130ffff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13080c9030 con 0x7f130806d770 2023-10-06T04:44:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.255+0000 7f130ffff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1308068950 con 0x7f1308159480 2023-10-06T04:44:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.255+0000 7f130dd9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1308159480 0x7f130815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.255+0000 7f130d59a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f13080c8840 0x7f130806d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:36368/0 (socket says 172.21.15.124:36368) 2023-10-06T04:44:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.255+0000 7f130d59a700 1 -- 172.21.15.124:0/1077977818 learned_addr learned my addr 172.21.15.124:0/1077977818 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:42.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.256+0000 7f130dd9b700 1 -- 172.21.15.124:0/1077977818 >> v1:172.21.15.158:6789/0 conn(0x7f130806d770 legacy=0x7f1308069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.256+0000 7f130dd9b700 1 -- 172.21.15.124:0/1077977818 >> v1:172.21.15.124:6789/0 conn(0x7f13080c8840 legacy=0x7f130806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.256+0000 7f130dd9b700 1 -- 172.21.15.124:0/1077977818 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1308068c30 con 0x7f1308159480 2023-10-06T04:44:42.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.256+0000 7f130dd9b700 1 --2- 172.21.15.124:0/1077977818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1308159480 0x7f130815dce0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13040098e0 tx=0x7f13040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1df06416aaecb9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.258+0000 7f130cd99700 1 -- 172.21.15.124:0/1077977818 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304009e80 con 0x7f1308159480 2023-10-06T04:44:42.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.258+0000 7f130cd99700 1 -- 172.21.15.124:0/1077977818 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130400b860 con 0x7f1308159480 2023-10-06T04:44:42.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.258+0000 7f130cd99700 1 -- 172.21.15.124:0/1077977818 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130400bbe0 con 0x7f1308159480 2023-10-06T04:44:42.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.258+0000 7f130ffff700 1 -- 172.21.15.124:0/1077977818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1308159480 msgr2=0x7f130815dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.258+0000 7f130ffff700 1 --2- 172.21.15.124:0/1077977818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1308159480 0x7f130815dce0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13040098e0 tx=0x7f13040091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.258+0000 7f130ffff700 1 -- 172.21.15.124:0/1077977818 shutdown_connections 2023-10-06T04:44:42.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.258+0000 7f130ffff700 1 --2- 172.21.15.124:0/1077977818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1308159480 0x7f130815dce0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.258+0000 7f130ffff700 1 -- 172.21.15.124:0/1077977818 >> 172.21.15.124:0/1077977818 conn(0x7f1308063cc0 msgr2=0x7f13080ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:42.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.258+0000 7f130ffff700 1 -- 172.21.15.124:0/1077977818 shutdown_connections 2023-10-06T04:44:42.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.258+0000 7f130ffff700 1 -- 172.21.15.124:0/1077977818 wait complete. 2023-10-06T04:44:42.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.260+0000 7f130ffff700 1 Processor -- start 2023-10-06T04:44:42.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.260+0000 7f130ffff700 1 -- start start 2023-10-06T04:44:42.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f130806d770 0x7f1308154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130ffff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13080c8840 0x7f13080c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1308159480 0x7f13080c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130ffff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080c3810 con 0x7f130806d770 2023-10-06T04:44:42.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130ffff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080c3af0 con 0x7f1308159480 2023-10-06T04:44:42.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130ffff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080c3dd0 con 0x7f13080c8840 2023-10-06T04:44:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130dd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f130806d770 0x7f1308154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130dd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f130806d770 0x7f1308154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40912/0 (socket says 172.21.15.124:40912) 2023-10-06T04:44:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130dd9b700 1 -- 172.21.15.124:0/2194564376 learned_addr learned my addr 172.21.15.124:0/2194564376 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130d59a700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13080c8840 0x7f13080c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130e59c700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1308159480 0x7f13080c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130dd9b700 1 -- 172.21.15.124:0/2194564376 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13080c8840 msgr2=0x7f13080c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130dd9b700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13080c8840 0x7f13080c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130dd9b700 1 -- 172.21.15.124:0/2194564376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1308159480 msgr2=0x7f13080c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.261+0000 7f130dd9b700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1308159480 0x7f13080c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.262+0000 7f130dd9b700 1 -- 172.21.15.124:0/2194564376 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304009420 con 0x7f130806d770 2023-10-06T04:44:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.262+0000 7f130dd9b700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f130806d770 0x7f1308154dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f130806f2a0 tx=0x7f1304017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.262+0000 7f12fdffb700 1 -- 172.21.15.124:0/2194564376 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130400bb20 con 0x7f130806d770 2023-10-06T04:44:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.262+0000 7f12fdffb700 1 -- 172.21.15.124:0/2194564376 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304025420 con 0x7f130806d770 2023-10-06T04:44:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.262+0000 7f12fdffb700 1 -- 172.21.15.124:0/2194564376 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13040257c0 con 0x7f130806d770 2023-10-06T04:44:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.262+0000 7f130ffff700 1 -- 172.21.15.124:0/2194564376 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13080c40b0 con 0x7f130806d770 2023-10-06T04:44:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.262+0000 7f130ffff700 1 -- 172.21.15.124:0/2194564376 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1308155310 con 0x7f130806d770 2023-10-06T04:44:42.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.263+0000 7f130ffff700 1 -- 172.21.15.124:0/2194564376 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130804c380 con 0x7f130806d770 2023-10-06T04:44:42.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.264+0000 7f12fdffb700 1 -- 172.21.15.124:0/2194564376 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1304023070 con 0x7f130806d770 2023-10-06T04:44:42.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.265+0000 7f12fdffb700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f12ec066f30 0x7f12ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.265+0000 7f12fdffb700 1 -- 172.21.15.124:0/2194564376 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1304085cd0 con 0x7f130806d770 2023-10-06T04:44:42.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.265+0000 7f130d59a700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f12ec066f30 0x7f12ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.265+0000 7f130d59a700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f12ec066f30 0x7f12ec0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f130806c2e0 tx=0x7f12f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.269+0000 7f12fdffb700 1 -- 172.21.15.124:0/2194564376 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1304052d40 con 0x7f130806d770 2023-10-06T04:44:42.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.460+0000 7f130ffff700 1 -- 172.21.15.124:0/2194564376 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1308068f10 con 0x7f130806d770 2023-10-06T04:44:42.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.460+0000 7f12fdffb700 1 -- 172.21.15.124:0/2194564376 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1304056360 con 0x7f130806d770 2023-10-06T04:44:42.463 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:44:42.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 -- 172.21.15.124:0/2194564376 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f12ec066f30 msgr2=0x7f12ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f12ec066f30 0x7f12ec0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f130806c2e0 tx=0x7f12f8009040 comp rx=0 tx=0).stop 2023-10-06T04:44:42.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 -- 172.21.15.124:0/2194564376 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f130806d770 msgr2=0x7f1308154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f130806d770 0x7f1308154dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f130806f2a0 tx=0x7f1304017000 comp rx=0 tx=0).stop 2023-10-06T04:44:42.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 -- 172.21.15.124:0/2194564376 shutdown_connections 2023-10-06T04:44:42.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1308159480 0x7f13080c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f130806d770 0x7f1308154dd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f12ec066f30 0x7f12ec0693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 --2- 172.21.15.124:0/2194564376 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13080c8840 0x7f13080c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 -- 172.21.15.124:0/2194564376 >> 172.21.15.124:0/2194564376 conn(0x7f1308063cc0 msgr2=0x7f130815b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:42.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 -- 172.21.15.124:0/2194564376 shutdown_connections 2023-10-06T04:44:42.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.463+0000 7f130ffff700 1 -- 172.21.15.124:0/2194564376 wait complete. 2023-10-06T04:44:42.483 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:44:42.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.672+0000 7f0dd5dff700 1 Processor -- start 2023-10-06T04:44:42.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.673+0000 7f0dd5dff700 1 -- start start 2023-10-06T04:44:42.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.674+0000 7f0dd5dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0dd01592b0 0x7f0dd00b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.674+0000 7f0dd5dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd00cc780 0x7f0dd00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.674+0000 7f0dd5dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd015d620 con 0x7f0dd0159680 2023-10-06T04:44:42.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.674+0000 7f0dd5dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd015d0d0 con 0x7f0dd01592b0 2023-10-06T04:44:42.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.674+0000 7f0dd5dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00b2ed0 con 0x7f0dd00cc780 2023-10-06T04:44:42.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.674+0000 7f0dcf7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0dd01592b0 0x7f0dd00b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.674+0000 7f0dcf7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0dd01592b0 0x7f0dd00b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40920/0 (socket says 172.21.15.124:40920) 2023-10-06T04:44:42.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.674+0000 7f0dcf7fe700 1 -- 172.21.15.124:0/4079363903 learned_addr learned my addr 172.21.15.124:0/4079363903 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:42.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.674+0000 7f0dcffff700 1 --2- 172.21.15.124:0/4079363903 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd00cc780 0x7f0dd00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.675+0000 7f0dcf7fe700 1 -- 172.21.15.124:0/4079363903 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd00cc780 msgr2=0x7f0dd00ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:42.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.675+0000 7f0dcf7fe700 1 --2- 172.21.15.124:0/4079363903 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd00cc780 0x7f0dd00ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.675+0000 7f0dcf7fe700 1 -- 172.21.15.124:0/4079363903 >> v1:172.21.15.158:6789/0 conn(0x7f0dd0159680 legacy=0x7f0dd015dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.675+0000 7f0dcf7fe700 1 -- 172.21.15.124:0/4079363903 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00ccc00 con 0x7f0dd01592b0 2023-10-06T04:44:42.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.675+0000 7f0dce7fc700 1 -- 172.21.15.124:0/4079363903 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408936378 0 0) 0x7f0dd015d620 con 0x7f0dd0159680 2023-10-06T04:44:42.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.675+0000 7f0dcf7fe700 1 --2- 172.21.15.124:0/4079363903 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd01592b0 0x7f0dd00b0080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00099b0 tx=0x7f0dc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823c2b81efaa2910 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.675+0000 7f0dce7fc700 1 -- 172.21.15.124:0/4079363903 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0009ea0 con 0x7f0dd01592b0 2023-10-06T04:44:42.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.675+0000 7f0dce7fc700 1 -- 172.21.15.124:0/4079363903 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000b860 con 0x7f0dd01592b0 2023-10-06T04:44:42.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.675+0000 7f0dce7fc700 1 -- 172.21.15.124:0/4079363903 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000bc00 con 0x7f0dd01592b0 2023-10-06T04:44:42.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.676+0000 7f0dd5dff700 1 -- 172.21.15.124:0/4079363903 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd01592b0 msgr2=0x7f0dd00b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.676+0000 7f0dd5dff700 1 --2- 172.21.15.124:0/4079363903 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd01592b0 0x7f0dd00b0080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00099b0 tx=0x7f0dc0009250 comp rx=0 tx=0).stop 2023-10-06T04:44:42.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.676+0000 7f0dd5dff700 1 -- 172.21.15.124:0/4079363903 shutdown_connections 2023-10-06T04:44:42.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.676+0000 7f0dd5dff700 1 --2- 172.21.15.124:0/4079363903 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd01592b0 0x7f0dd00b0080 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.676+0000 7f0dd5dff700 1 --2- 172.21.15.124:0/4079363903 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd00cc780 0x7f0dd00ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.676+0000 7f0dd5dff700 1 -- 172.21.15.124:0/4079363903 >> 172.21.15.124:0/4079363903 conn(0x7f0dd006ed20 msgr2=0x7f0dd006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:42.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.676+0000 7f0dd5dff700 1 -- 172.21.15.124:0/4079363903 shutdown_connections 2023-10-06T04:44:42.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.676+0000 7f0dd5dff700 1 -- 172.21.15.124:0/4079363903 wait complete. 2023-10-06T04:44:42.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.678+0000 7f0dd5dff700 1 Processor -- start 2023-10-06T04:44:42.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.678+0000 7f0dd5dff700 1 -- start start 2023-10-06T04:44:42.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.679+0000 7f0dd5dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0dd00cc780 0x7f0dd00c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.679+0000 7f0dd5dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd01592b0 0x7f0dd01562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.679+0000 7f0dd5dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd0159680 0x7f0dd00c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.679+0000 7f0dd5dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00cf360 con 0x7f0dd0159680 2023-10-06T04:44:42.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.679+0000 7f0dd5dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00c4e00 con 0x7f0dd00cc780 2023-10-06T04:44:42.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.679+0000 7f0dd5dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00ce750 con 0x7f0dd01592b0 2023-10-06T04:44:42.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.679+0000 7f0dcffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd0159680 0x7f0dd00c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dcffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd0159680 0x7f0dd00c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:40934/0 (socket says 172.21.15.124:40934) 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dcffff700 1 -- 172.21.15.124:0/3695926851 learned_addr learned my addr 172.21.15.124:0/3695926851 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dcf7fe700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0dd00cc780 0x7f0dd00c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dceffd700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd01592b0 0x7f0dd01562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dcffff700 1 -- 172.21.15.124:0/3695926851 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd01592b0 msgr2=0x7f0dd01562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dcffff700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd01592b0 0x7f0dd01562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dcffff700 1 -- 172.21.15.124:0/3695926851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0dd00cc780 msgr2=0x7f0dd00c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dcffff700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0dd00cc780 0x7f0dd00c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dcffff700 1 -- 172.21.15.124:0/3695926851 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00094f0 con 0x7f0dd0159680 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dceffd700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd01592b0 0x7f0dd01562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dcffff700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd0159680 0x7f0dd00c88c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009e90 tx=0x7f0dc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0db77fe700 1 -- 172.21.15.124:0/3695926851 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc800cc20 con 0x7f0dd0159680 2023-10-06T04:44:42.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0db77fe700 1 -- 172.21.15.124:0/3695926851 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc800f040 con 0x7f0dd0159680 2023-10-06T04:44:42.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0dd5dff700 1 -- 172.21.15.124:0/3695926851 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd00cea30 con 0x7f0dd0159680 2023-10-06T04:44:42.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.680+0000 7f0db77fe700 1 -- 172.21.15.124:0/3695926851 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8014480 con 0x7f0dd0159680 2023-10-06T04:44:42.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.681+0000 7f0dd5dff700 1 -- 172.21.15.124:0/3695926851 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd00ceff0 con 0x7f0dd0159680 2023-10-06T04:44:42.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.681+0000 7f0dd5dff700 1 -- 172.21.15.124:0/3695926851 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd00cf510 con 0x7f0dd0159680 2023-10-06T04:44:42.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.683+0000 7f0db77fe700 1 -- 172.21.15.124:0/3695926851 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0dc8014830 con 0x7f0dd0159680 2023-10-06T04:44:42.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.683+0000 7f0db77fe700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0dbc066f30 0x7f0dbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.683+0000 7f0db77fe700 1 -- 172.21.15.124:0/3695926851 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0dc8085430 con 0x7f0dd0159680 2023-10-06T04:44:42.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.684+0000 7f0dcf7fe700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0dbc066f30 0x7f0dbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.684+0000 7f0dcf7fe700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0dbc066f30 0x7f0dbc0693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00099b0 tx=0x7f0dc0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.687+0000 7f0db77fe700 1 -- 172.21.15.124:0/3695926851 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dd00cf510 con 0x7f0dd0159680 2023-10-06T04:44:42.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.876+0000 7f0dd5dff700 1 -- 172.21.15.124:0/3695926851 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0dd00cf510 con 0x7f0dd0159680 2023-10-06T04:44:42.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.876+0000 7f0db77fe700 1 -- 172.21.15.124:0/3695926851 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0dd00cf510 con 0x7f0dd0159680 2023-10-06T04:44:42.879 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:44:42.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 -- 172.21.15.124:0/3695926851 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0dbc066f30 msgr2=0x7f0dbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0dbc066f30 0x7f0dbc0693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00099b0 tx=0x7f0dc0017000 comp rx=0 tx=0).stop 2023-10-06T04:44:42.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 -- 172.21.15.124:0/3695926851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd0159680 msgr2=0x7f0dd00c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd0159680 0x7f0dd00c88c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009e90 tx=0x7f0dc800b040 comp rx=0 tx=0).stop 2023-10-06T04:44:42.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 -- 172.21.15.124:0/3695926851 shutdown_connections 2023-10-06T04:44:42.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0dd0159680 0x7f0dd00c88c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0dd00cc780 0x7f0dd00c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0dbc066f30 0x7f0dbc0693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 --2- 172.21.15.124:0/3695926851 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0dd01592b0 0x7f0dd01562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 -- 172.21.15.124:0/3695926851 >> 172.21.15.124:0/3695926851 conn(0x7f0dd006ed20 msgr2=0x7f0dd00b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:42.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 -- 172.21.15.124:0/3695926851 shutdown_connections 2023-10-06T04:44:42.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:42.879+0000 7f0dd5dff700 1 -- 172.21.15.124:0/3695926851 wait complete. 2023-10-06T04:44:42.899 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:44:43.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.088+0000 7fab92dff700 1 Processor -- start 2023-10-06T04:44:43.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.088+0000 7fab92dff700 1 -- start start 2023-10-06T04:44:43.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.089+0000 7fab92dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fab8c1592b0 0x7fab8c0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.089+0000 7fab92dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c159680 0x7fab8c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.089+0000 7fab92dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fab8c15dab0 0x7fab8c0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.089+0000 7fab92dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c15d0d0 con 0x7fab8c15dab0 2023-10-06T04:44:43.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.089+0000 7fab92dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c0b2ed0 con 0x7fab8c1592b0 2023-10-06T04:44:43.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.089+0000 7fab92dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0cccc0 con 0x7fab8c159680 2023-10-06T04:44:43.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab9139c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fab8c15dab0 0x7fab8c0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab9139c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fab8c15dab0 0x7fab8c0ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49312/0 (socket says 172.21.15.124:49312) 2023-10-06T04:44:43.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab9139c700 1 -- 172.21.15.124:0/3393730111 learned_addr learned my addr 172.21.15.124:0/3393730111 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:43.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab90b9b700 1 --2- 172.21.15.124:0/3393730111 >> v2:172.21.15.158:3300/0 conn(0x7fab8c1592b0 0x7fab8c0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab8bfff700 1 --2- 172.21.15.124:0/3393730111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c159680 0x7fab8c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab9139c700 1 -- 172.21.15.124:0/3393730111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c159680 msgr2=0x7fab8c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:43.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab9139c700 1 --2- 172.21.15.124:0/3393730111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c159680 0x7fab8c0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab9139c700 1 -- 172.21.15.124:0/3393730111 >> v2:172.21.15.158:3300/0 conn(0x7fab8c1592b0 msgr2=0x7fab8c0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:43.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab9139c700 1 --2- 172.21.15.124:0/3393730111 >> v2:172.21.15.158:3300/0 conn(0x7fab8c1592b0 0x7fab8c0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab9139c700 1 -- 172.21.15.124:0/3393730111 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c15d620 con 0x7fab8c15dab0 2023-10-06T04:44:43.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab8bfff700 1 --2- 172.21.15.124:0/3393730111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c159680 0x7fab8c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:43.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.090+0000 7fab9139c700 1 --2- 172.21.15.124:0/3393730111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c15dab0 0x7fab8c0ccea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0cdb70 tx=0x7fab84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ecd3d8fedd4dcdf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab8b7fe700 1 -- 172.21.15.124:0/3393730111 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400e070 con 0x7fab8c15dab0 2023-10-06T04:44:43.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab8b7fe700 1 -- 172.21.15.124:0/3393730111 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400ba50 con 0x7fab8c15dab0 2023-10-06T04:44:43.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab8b7fe700 1 -- 172.21.15.124:0/3393730111 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840092e0 con 0x7fab8c15dab0 2023-10-06T04:44:43.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab92dff700 1 -- 172.21.15.124:0/3393730111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c15dab0 msgr2=0x7fab8c0ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab92dff700 1 --2- 172.21.15.124:0/3393730111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c15dab0 0x7fab8c0ccea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0cdb70 tx=0x7fab84009840 comp rx=0 tx=0).stop 2023-10-06T04:44:43.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab92dff700 1 -- 172.21.15.124:0/3393730111 shutdown_connections 2023-10-06T04:44:43.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab92dff700 1 --2- 172.21.15.124:0/3393730111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c15dab0 0x7fab8c0ccea0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab92dff700 1 --2- 172.21.15.124:0/3393730111 >> v2:172.21.15.158:3300/0 conn(0x7fab8c1592b0 0x7fab8c0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab92dff700 1 --2- 172.21.15.124:0/3393730111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c159680 0x7fab8c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab92dff700 1 -- 172.21.15.124:0/3393730111 >> 172.21.15.124:0/3393730111 conn(0x7fab8c06ed20 msgr2=0x7fab8c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:43.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab92dff700 1 -- 172.21.15.124:0/3393730111 shutdown_connections 2023-10-06T04:44:43.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.091+0000 7fab92dff700 1 -- 172.21.15.124:0/3393730111 wait complete. 2023-10-06T04:44:43.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.093+0000 7fab92dff700 1 Processor -- start 2023-10-06T04:44:43.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.093+0000 7fab92dff700 1 -- start start 2023-10-06T04:44:43.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab92dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab8c1592b0 0x7fab8c158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab92dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c159680 0x7fab8c0c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab92dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c15dab0 0x7fab8c0c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab92dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0b4b00 con 0x7fab8c159680 2023-10-06T04:44:43.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab92dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0c6b30 con 0x7fab8c1592b0 2023-10-06T04:44:43.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab92dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0b44b0 con 0x7fab8c15dab0 2023-10-06T04:44:43.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab8bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c159680 0x7fab8c0c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab8bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c159680 0x7fab8c0c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49326/0 (socket says 172.21.15.124:49326) 2023-10-06T04:44:43.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab8bfff700 1 -- 172.21.15.124:0/1880026862 learned_addr learned my addr 172.21.15.124:0/1880026862 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:43.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab90b9b700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab8c1592b0 0x7fab8c158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab9139c700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c15dab0 0x7fab8c0c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab8bfff700 1 -- 172.21.15.124:0/1880026862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c15dab0 msgr2=0x7fab8c0c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab8bfff700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c15dab0 0x7fab8c0c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab8bfff700 1 -- 172.21.15.124:0/1880026862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab8c1592b0 msgr2=0x7fab8c158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab8bfff700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab8c1592b0 0x7fab8c158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.094+0000 7fab8bfff700 1 -- 172.21.15.124:0/1880026862 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84009ae0 con 0x7fab8c159680 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.095+0000 7fab8bfff700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c159680 0x7fab8c0c74b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fab7800c830 tx=0x7fab78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.095+0000 7fab88ff9700 1 -- 172.21.15.124:0/1880026862 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78011600 con 0x7fab8c159680 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.095+0000 7fab88ff9700 1 -- 172.21.15.124:0/1880026862 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78011760 con 0x7fab8c159680 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.095+0000 7fab92dff700 1 -- 172.21.15.124:0/1880026862 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c0b4790 con 0x7fab8c159680 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.095+0000 7fab88ff9700 1 -- 172.21.15.124:0/1880026862 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78011b20 con 0x7fab8c159680 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.095+0000 7fab92dff700 1 -- 172.21.15.124:0/1880026862 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c158bb0 con 0x7fab8c159680 2023-10-06T04:44:43.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.096+0000 7fab92dff700 1 -- 172.21.15.124:0/1880026862 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c0b4c70 con 0x7fab8c159680 2023-10-06T04:44:43.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.097+0000 7fab88ff9700 1 -- 172.21.15.124:0/1880026862 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab78018360 con 0x7fab8c159680 2023-10-06T04:44:43.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.098+0000 7fab88ff9700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 0x7fab700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.098+0000 7fab88ff9700 1 -- 172.21.15.124:0/1880026862 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fab78084620 con 0x7fab8c159680 2023-10-06T04:44:43.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.098+0000 7fab90b9b700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 0x7fab700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.098+0000 7fab90b9b700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 0x7fab700693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab80006fd0 tx=0x7fab80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.102+0000 7fab88ff9700 1 -- 172.21.15.124:0/1880026862 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab78051730 con 0x7fab8c159680 2023-10-06T04:44:43.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.297+0000 7fab92dff700 1 -- 172.21.15.124:0/1880026862 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab8c04c380 con 0x7fab8c159680 2023-10-06T04:44:43.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.297+0000 7fab88ff9700 1 -- 172.21.15.124:0/1880026862 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab78054d50 con 0x7fab8c159680 2023-10-06T04:44:43.300 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-06T04:44:43.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.299+0000 7fab92dff700 1 -- 172.21.15.124:0/1880026862 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 msgr2=0x7fab700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.299+0000 7fab92dff700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 0x7fab700693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab80006fd0 tx=0x7fab80008040 comp rx=0 tx=0).stop 2023-10-06T04:44:43.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.299+0000 7fab92dff700 1 -- 172.21.15.124:0/1880026862 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c159680 msgr2=0x7fab8c0c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.299+0000 7fab92dff700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c159680 0x7fab8c0c74b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fab7800c830 tx=0x7fab78008040 comp rx=0 tx=0).stop 2023-10-06T04:44:43.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.300+0000 7fab92dff700 1 -- 172.21.15.124:0/1880026862 shutdown_connections 2023-10-06T04:44:43.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.300+0000 7fab92dff700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fab70066f30 0x7fab700693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.300+0000 7fab92dff700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab8c15dab0 0x7fab8c0c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.300+0000 7fab92dff700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab8c1592b0 0x7fab8c158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.300+0000 7fab92dff700 1 --2- 172.21.15.124:0/1880026862 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fab8c159680 0x7fab8c0c74b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.300+0000 7fab92dff700 1 -- 172.21.15.124:0/1880026862 >> 172.21.15.124:0/1880026862 conn(0x7fab8c06ed20 msgr2=0x7fab8c0cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:43.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.300+0000 7fab92dff700 1 -- 172.21.15.124:0/1880026862 shutdown_connections 2023-10-06T04:44:43.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.300+0000 7fab92dff700 1 -- 172.21.15.124:0/1880026862 wait complete. 2023-10-06T04:44:43.320 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:44:43.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.510+0000 7f506a9ff700 1 Processor -- start 2023-10-06T04:44:43.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.510+0000 7f506a9ff700 1 -- start start 2023-10-06T04:44:43.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.511+0000 7f506a9ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5064159480 0x7f506415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.511+0000 7f506a9ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5064068700 con 0x7f506406d770 2023-10-06T04:44:43.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.511+0000 7f506a9ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50640c9030 con 0x7f50640c8840 2023-10-06T04:44:43.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.511+0000 7f506a9ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5064068950 con 0x7f5064159480 2023-10-06T04:44:43.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.511+0000 7f5063fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5064159480 0x7f506415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f5068f9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f506406d770 0x7f5064069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42862/0 (socket says 172.21.15.124:42862) 2023-10-06T04:44:43.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f5068f9c700 1 -- 172.21.15.124:0/3833206872 learned_addr learned my addr 172.21.15.124:0/3833206872 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:43.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f50637fe700 1 -- 172.21.15.124:0/3833206872 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298511215 0 0) 0x7f5064068700 con 0x7f506406d770 2023-10-06T04:44:43.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f50637fe700 1 -- 172.21.15.124:0/3833206872 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5050003570 con 0x7f506406d770 2023-10-06T04:44:43.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f5063fff700 1 -- 172.21.15.124:0/3833206872 >> v1:172.21.15.158:6789/0 conn(0x7f50640c8840 legacy=0x7f506406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f5063fff700 1 -- 172.21.15.124:0/3833206872 >> v1:172.21.15.124:6789/0 conn(0x7f506406d770 legacy=0x7f5064069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f5063fff700 1 -- 172.21.15.124:0/3833206872 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064068c30 con 0x7f5064159480 2023-10-06T04:44:43.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f5063fff700 1 --2- 172.21.15.124:0/3833206872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5064159480 0x7f506415dce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50540098e0 tx=0x7f50540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5df259642c0af58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f50637fe700 1 -- 172.21.15.124:0/3833206872 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400b640 con 0x7f5064159480 2023-10-06T04:44:43.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f50637fe700 1 -- 172.21.15.124:0/3833206872 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505400b7a0 con 0x7f5064159480 2023-10-06T04:44:43.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.512+0000 7f50637fe700 1 -- 172.21.15.124:0/3833206872 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400bb40 con 0x7f5064159480 2023-10-06T04:44:43.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.513+0000 7f506a9ff700 1 -- 172.21.15.124:0/3833206872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5064159480 msgr2=0x7f506415dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.513+0000 7f506a9ff700 1 --2- 172.21.15.124:0/3833206872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5064159480 0x7f506415dce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50540098e0 tx=0x7f50540091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.513+0000 7f506a9ff700 1 -- 172.21.15.124:0/3833206872 shutdown_connections 2023-10-06T04:44:43.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.513+0000 7f506a9ff700 1 --2- 172.21.15.124:0/3833206872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5064159480 0x7f506415dce0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.513+0000 7f506a9ff700 1 -- 172.21.15.124:0/3833206872 >> 172.21.15.124:0/3833206872 conn(0x7f5064063cc0 msgr2=0x7f50640ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:43.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.513+0000 7f506a9ff700 1 -- 172.21.15.124:0/3833206872 shutdown_connections 2023-10-06T04:44:43.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.513+0000 7f506a9ff700 1 -- 172.21.15.124:0/3833206872 wait complete. 2023-10-06T04:44:43.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.514+0000 7f506a9ff700 1 Processor -- start 2023-10-06T04:44:43.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.515+0000 7f506a9ff700 1 -- start start 2023-10-06T04:44:43.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.515+0000 7f506a9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f506406d770 0x7f5064153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.515+0000 7f506a9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50640c8840 0x7f50640ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.515+0000 7f506a9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5064159480 0x7f50640cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f506a9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50641559d0 con 0x7f50640c8840 2023-10-06T04:44:43.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f506a9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506415bff0 con 0x7f506406d770 2023-10-06T04:44:43.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f506a9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506415c2d0 con 0x7f5064159480 2023-10-06T04:44:43.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f505bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50640c8840 0x7f50640ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f505bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50640c8840 0x7f50640ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49344/0 (socket says 172.21.15.124:49344) 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f505bfff700 1 -- 172.21.15.124:0/1149664405 learned_addr learned my addr 172.21.15.124:0/1149664405 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f5063fff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f506406d770 0x7f5064153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f5068f9c700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5064159480 0x7f50640cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f505bfff700 1 -- 172.21.15.124:0/1149664405 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5064159480 msgr2=0x7f50640cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f505bfff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5064159480 0x7f50640cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f505bfff700 1 -- 172.21.15.124:0/1149664405 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f506406d770 msgr2=0x7f5064153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f505bfff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f506406d770 0x7f5064153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f505bfff700 1 -- 172.21.15.124:0/1149664405 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5054009420 con 0x7f50640c8840 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.516+0000 7f505bfff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50640c8840 0x7f50640ccda0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c590 tx=0x7f504c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.517+0000 7f5060ff9700 1 -- 172.21.15.124:0/1149664405 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c011590 con 0x7f50640c8840 2023-10-06T04:44:43.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.517+0000 7f5060ff9700 1 -- 172.21.15.124:0/1149664405 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c0116f0 con 0x7f50640c8840 2023-10-06T04:44:43.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.517+0000 7f5060ff9700 1 -- 172.21.15.124:0/1149664405 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c011ab0 con 0x7f50640c8840 2023-10-06T04:44:43.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.517+0000 7f506a9ff700 1 -- 172.21.15.124:0/1149664405 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506415c5b0 con 0x7f50640c8840 2023-10-06T04:44:43.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.517+0000 7f506a9ff700 1 -- 172.21.15.124:0/1149664405 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5064153ba0 con 0x7f50640c8840 2023-10-06T04:44:43.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.518+0000 7f506a9ff700 1 -- 172.21.15.124:0/1149664405 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5064155820 con 0x7f50640c8840 2023-10-06T04:44:43.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.519+0000 7f5060ff9700 1 -- 172.21.15.124:0/1149664405 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f504c01b3b0 con 0x7f50640c8840 2023-10-06T04:44:43.522 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.519+0000 7f5060ff9700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.522 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.519+0000 7f5060ff9700 1 -- 172.21.15.124:0/1149664405 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f504c083c90 con 0x7f50640c8840 2023-10-06T04:44:43.522 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.520+0000 7f5063fff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.522 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.520+0000 7f5063fff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5044066f30 0x7f50440693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f50540093f0 tx=0x7f5054017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.523+0000 7f5060ff9700 1 -- 172.21.15.124:0/1149664405 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f504c050d00 con 0x7f50640c8840 2023-10-06T04:44:43.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.712+0000 7f506a9ff700 1 -- 172.21.15.124:0/1149664405 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f506404c380 con 0x7f50640c8840 2023-10-06T04:44:43.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.713+0000 7f5060ff9700 1 -- 172.21.15.124:0/1149664405 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f504c017020 con 0x7f50640c8840 2023-10-06T04:44:43.716 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-06T04:44:43.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 -- 172.21.15.124:0/1149664405 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5044066f30 msgr2=0x7f50440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5044066f30 0x7f50440693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f50540093f0 tx=0x7f5054017000 comp rx=0 tx=0).stop 2023-10-06T04:44:43.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 -- 172.21.15.124:0/1149664405 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50640c8840 msgr2=0x7f50640ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50640c8840 0x7f50640ccda0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c590 tx=0x7f504c00c950 comp rx=0 tx=0).stop 2023-10-06T04:44:43.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 -- 172.21.15.124:0/1149664405 shutdown_connections 2023-10-06T04:44:43.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5064159480 0x7f50640cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f506406d770 0x7f5064153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 --2- 172.21.15.124:0/1149664405 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50640c8840 0x7f50640ccda0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 -- 172.21.15.124:0/1149664405 >> 172.21.15.124:0/1149664405 conn(0x7f5064063cc0 msgr2=0x7f50640b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:43.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.715+0000 7f506a9ff700 1 -- 172.21.15.124:0/1149664405 shutdown_connections 2023-10-06T04:44:43.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.716+0000 7f506a9ff700 1 -- 172.21.15.124:0/1149664405 wait complete. 2023-10-06T04:44:43.736 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:43.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.922+0000 7fc2a27ff700 1 Processor -- start 2023-10-06T04:44:43.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.922+0000 7fc2a27ff700 1 -- start start 2023-10-06T04:44:43.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.923+0000 7fc2a27ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc29c0ccbb0 0x7fc29c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.923+0000 7fc2a27ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c0cf6b0 con 0x7fc29c0cdfe0 2023-10-06T04:44:43.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc2a27ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c0ceaa0 con 0x7fc29c0ce450 2023-10-06T04:44:43.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc2a27ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0ce8b0 con 0x7fc29c0ccbb0 2023-10-06T04:44:43.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29b7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc29c0cdfe0 0x7fc29c0ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42870/0 (socket says 172.21.15.124:42870) 2023-10-06T04:44:43.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29b7fe700 1 -- 172.21.15.124:0/1593623822 learned_addr learned my addr 172.21.15.124:0/1593623822 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:43.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29bfff700 1 --2- 172.21.15.124:0/1593623822 >> v2:172.21.15.158:3300/0 conn(0x7fc29c0ccbb0 0x7fc29c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212694825 0 0) 0x7fc29c0cf6b0 con 0x7fc29c0cdfe0 2023-10-06T04:44:43.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc284003570 con 0x7fc29c0cdfe0 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 705950818 0 0) 0x7fc284003570 con 0x7fc29c0cdfe0 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 >> v2:172.21.15.158:3300/0 conn(0x7fc29c0ccbb0 msgr2=0x7fc29c0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29affd700 1 --2- 172.21.15.124:0/1593623822 >> v2:172.21.15.158:3300/0 conn(0x7fc29c0ccbb0 0x7fc29c0cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 >> v1:172.21.15.158:6789/0 conn(0x7fc29c0ce450 legacy=0x7fc29c0ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0ced80 con 0x7fc29c0cdfe0 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.924+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fc290001470 con 0x7fc29c0cdfe0 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 >> v1:172.21.15.124:6789/0 conn(0x7fc29c0cdfe0 legacy=0x7fc29c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29affd700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc284003a60 0x7fc284003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29affd700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc284004810 0x7fc284004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29affd700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2840051c0 0x7fc28400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28400c0a0 con 0x7fc284003a60 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28400c210 con 0x7fc284004810 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28400c3d0 con 0x7fc2840051c0 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29bfff700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc284003a60 0x7fc284003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29b7fe700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc284004810 0x7fc284004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc2a0d9c700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2840051c0 0x7fc28400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29bfff700 1 -- 172.21.15.124:0/1593623822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2840051c0 msgr2=0x7fc28400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29bfff700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2840051c0 0x7fc28400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29bfff700 1 -- 172.21.15.124:0/1593623822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc284004810 msgr2=0x7fc284004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29bfff700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc284004810 0x7fc284004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29bfff700 1 -- 172.21.15.124:0/1593623822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284003570 con 0x7fc284003a60 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc2a0d9c700 1 -- 172.21.15.124:0/1593623822 reap_dead start 2023-10-06T04:44:43.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.925+0000 7fc29bfff700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc284003a60 0x7fc284003e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009c00 tx=0x7fc28c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e197b4e3daf59c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.926+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00e710 con 0x7fc284003a60 2023-10-06T04:44:43.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.926+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c00e870 con 0x7fc284003a60 2023-10-06T04:44:43.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.926+0000 7fc29affd700 1 -- 172.21.15.124:0/1593623822 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00ec30 con 0x7fc284003a60 2023-10-06T04:44:43.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.926+0000 7fc2a27ff700 1 -- 172.21.15.124:0/1593623822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc284003a60 msgr2=0x7fc284003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.926+0000 7fc2a27ff700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc284003a60 0x7fc284003e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009c00 tx=0x7fc28c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.926+0000 7fc2a27ff700 1 -- 172.21.15.124:0/1593623822 shutdown_connections 2023-10-06T04:44:43.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.926+0000 7fc2a27ff700 1 --2- 172.21.15.124:0/1593623822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc284003a60 0x7fc284003e70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.926+0000 7fc2a27ff700 1 -- 172.21.15.124:0/1593623822 >> 172.21.15.124:0/1593623822 conn(0x7fc29c099710 msgr2=0x7fc29c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:43.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.926+0000 7fc2a27ff700 1 -- 172.21.15.124:0/1593623822 shutdown_connections 2023-10-06T04:44:43.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.926+0000 7fc2a27ff700 1 -- 172.21.15.124:0/1593623822 wait complete. 2023-10-06T04:44:43.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.928+0000 7fc2a27ff700 1 Processor -- start 2023-10-06T04:44:43.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.928+0000 7fc2a27ff700 1 -- start start 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a27ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc284003a60 0x7fc29c150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a27ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc29c153ce0 0x7fc29c0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a27ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0b4590 0x7fc29c0b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a27ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c16a7d0 con 0x7fc29c0b4590 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a27ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0b4f50 con 0x7fc284003a60 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a27ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0b0ba0 con 0x7fc29c153ce0 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a0d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0b4590 0x7fc29c0b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a0d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0b4590 0x7fc29c0b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49364/0 (socket says 172.21.15.124:49364) 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a0d9c700 1 -- 172.21.15.124:0/4179772735 learned_addr learned my addr 172.21.15.124:0/4179772735 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc29b7fe700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc29c153ce0 0x7fc29c0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc29bfff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc284003a60 0x7fc29c150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a0d9c700 1 -- 172.21.15.124:0/4179772735 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc29c153ce0 msgr2=0x7fc29c0b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a0d9c700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc29c153ce0 0x7fc29c0b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a0d9c700 1 -- 172.21.15.124:0/4179772735 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc284003a60 msgr2=0x7fc29c150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a0d9c700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc284003a60 0x7fc29c150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc2a0d9c700 1 -- 172.21.15.124:0/4179772735 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c169b50 con 0x7fc29c0b4590 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.929+0000 7fc29bfff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc284003a60 0x7fc29c150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.930+0000 7fc2a0d9c700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0b4590 0x7fc29c0b4a10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0b3000 tx=0x7fc294001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.930+0000 7fc283fff700 1 -- 172.21.15.124:0/4179772735 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294006e80 con 0x7fc29c0b4590 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.930+0000 7fc283fff700 1 -- 172.21.15.124:0/4179772735 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29400c570 con 0x7fc29c0b4590 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.930+0000 7fc2a27ff700 1 -- 172.21.15.124:0/4179772735 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c169e30 con 0x7fc29c0b4590 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.930+0000 7fc283fff700 1 -- 172.21.15.124:0/4179772735 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400c930 con 0x7fc29c0b4590 2023-10-06T04:44:43.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.930+0000 7fc2a27ff700 1 -- 172.21.15.124:0/4179772735 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c16a3f0 con 0x7fc29c0b4590 2023-10-06T04:44:43.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.931+0000 7fc2a27ff700 1 -- 172.21.15.124:0/4179772735 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c16a5b0 con 0x7fc29c0b4590 2023-10-06T04:44:43.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.932+0000 7fc283fff700 1 -- 172.21.15.124:0/4179772735 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc29400cca0 con 0x7fc29c0b4590 2023-10-06T04:44:43.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.933+0000 7fc283fff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc288066f30 0x7fc2880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.933+0000 7fc283fff700 1 -- 172.21.15.124:0/4179772735 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc294084000 con 0x7fc29c0b4590 2023-10-06T04:44:43.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.933+0000 7fc29bfff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc288066f30 0x7fc2880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.933+0000 7fc29bfff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc288066f30 0x7fc2880693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0091e0 tx=0x7fc28c01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:43.936+0000 7fc283fff700 1 -- 172.21.15.124:0/4179772735 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc294051110 con 0x7fc29c0b4590 2023-10-06T04:44:44.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.171+0000 7fc2a27ff700 1 -- 172.21.15.124:0/4179772735 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc29c16a910 con 0x7fc29c0b4590 2023-10-06T04:44:44.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.172+0000 7fc283fff700 1 -- 172.21.15.124:0/4179772735 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fc29c16a910 con 0x7fc29c0b4590 2023-10-06T04:44:44.175 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:44.175 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/3828511424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":3828511424},{"type":"v1","addr":"172.21.15.124:6836","nonce":3828511424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/1252041103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1252041103},{"type":"v1","addr":"172.21.15.158:6834","nonce":1252041103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/978440229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":978440229},{"type":"v1","addr":"172.21.15.124:6837","nonce":978440229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:27.635332+0000","modified":"2023-10-06T04:44:31.182630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6835/1693475602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":1693475602},{"type":"v1","addr":"172.21.15.158:6835","nonce":1693475602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:44:44.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 -- 172.21.15.124:0/4179772735 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc288066f30 msgr2=0x7fc2880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc288066f30 0x7fc2880693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0091e0 tx=0x7fc28c01a000 comp rx=0 tx=0).stop 2023-10-06T04:44:44.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 -- 172.21.15.124:0/4179772735 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0b4590 msgr2=0x7fc29c0b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0b4590 0x7fc29c0b4a10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0b3000 tx=0x7fc294001640 comp rx=0 tx=0).stop 2023-10-06T04:44:44.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 -- 172.21.15.124:0/4179772735 shutdown_connections 2023-10-06T04:44:44.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0b4590 0x7fc29c0b4a10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc284003a60 0x7fc29c150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc288066f30 0x7fc2880693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 --2- 172.21.15.124:0/4179772735 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc29c153ce0 0x7fc29c0b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 -- 172.21.15.124:0/4179772735 >> 172.21.15.124:0/4179772735 conn(0x7fc29c099710 msgr2=0x7fc29c158690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:44.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 -- 172.21.15.124:0/4179772735 shutdown_connections 2023-10-06T04:44:44.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.175+0000 7fc2a27ff700 1 -- 172.21.15.124:0/4179772735 wait complete. 2023-10-06T04:44:44.179 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2023-10-06T04:44:44.196 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:44.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.382+0000 7fdd977ff700 1 Processor -- start 2023-10-06T04:44:44.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.383+0000 7fdd977ff700 1 -- start start 2023-10-06T04:44:44.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.384+0000 7fdd977ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd9006ddc0 0x7fdd900b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.384+0000 7fdd977ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd90068bb0 0x7fdd9006e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.384+0000 7fdd977ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdd90159040 0x7fdd901594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.384+0000 7fdd977ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd900cc040 con 0x7fdd9006ddc0 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.384+0000 7fdd977ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9006e6d0 con 0x7fdd90159040 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.384+0000 7fdd977ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9006e990 con 0x7fdd90068bb0 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.384+0000 7fdd9559b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd9006ddc0 0x7fdd900b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.384+0000 7fdd9559b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd9006ddc0 0x7fdd900b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49366/0 (socket says 172.21.15.124:49366) 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.384+0000 7fdd9559b700 1 -- 172.21.15.124:0/988926546 learned_addr learned my addr 172.21.15.124:0/988926546 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd95d9c700 1 --2- 172.21.15.124:0/988926546 >> v2:172.21.15.158:3300/0 conn(0x7fdd90159040 0x7fdd901594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd94d9a700 1 --2- 172.21.15.124:0/988926546 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd90068bb0 0x7fdd9006e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd9559b700 1 -- 172.21.15.124:0/988926546 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd90068bb0 msgr2=0x7fdd9006e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:44.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd9559b700 1 --2- 172.21.15.124:0/988926546 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd90068bb0 0x7fdd9006e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd9559b700 1 -- 172.21.15.124:0/988926546 >> v2:172.21.15.158:3300/0 conn(0x7fdd90159040 msgr2=0x7fdd901594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd9559b700 1 --2- 172.21.15.124:0/988926546 >> v2:172.21.15.158:3300/0 conn(0x7fdd90159040 0x7fdd901594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd9559b700 1 -- 172.21.15.124:0/988926546 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd900cb9f0 con 0x7fdd9006ddc0 2023-10-06T04:44:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd95d9c700 1 --2- 172.21.15.124:0/988926546 >> v2:172.21.15.158:3300/0 conn(0x7fdd90159040 0x7fdd901594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd9559b700 1 --2- 172.21.15.124:0/988926546 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9006ddc0 0x7fdd900b1f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdd900b2490 tx=0x7fdd8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e263b05df4148de1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd87fff700 1 -- 172.21.15.124:0/988926546 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00b860 con 0x7fdd9006ddc0 2023-10-06T04:44:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd87fff700 1 -- 172.21.15.124:0/988926546 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00b9c0 con 0x7fdd9006ddc0 2023-10-06T04:44:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.385+0000 7fdd87fff700 1 -- 172.21.15.124:0/988926546 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00bd60 con 0x7fdd9006ddc0 2023-10-06T04:44:44.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.386+0000 7fdd977ff700 1 -- 172.21.15.124:0/988926546 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9006ddc0 msgr2=0x7fdd900b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.386+0000 7fdd977ff700 1 --2- 172.21.15.124:0/988926546 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9006ddc0 0x7fdd900b1f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdd900b2490 tx=0x7fdd8c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:44.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.386+0000 7fdd977ff700 1 -- 172.21.15.124:0/988926546 shutdown_connections 2023-10-06T04:44:44.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.386+0000 7fdd977ff700 1 --2- 172.21.15.124:0/988926546 >> v2:172.21.15.158:3300/0 conn(0x7fdd90159040 0x7fdd901594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.386+0000 7fdd977ff700 1 --2- 172.21.15.124:0/988926546 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd9006ddc0 0x7fdd900b1f50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.386+0000 7fdd977ff700 1 --2- 172.21.15.124:0/988926546 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd90068bb0 0x7fdd9006e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.386+0000 7fdd977ff700 1 -- 172.21.15.124:0/988926546 >> 172.21.15.124:0/988926546 conn(0x7fdd900cd390 msgr2=0x7fdd900b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.386+0000 7fdd977ff700 1 -- 172.21.15.124:0/988926546 shutdown_connections 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.386+0000 7fdd977ff700 1 -- 172.21.15.124:0/988926546 wait complete. 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.387+0000 7fdd977ff700 1 Processor -- start 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.388+0000 7fdd977ff700 1 -- start start 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.388+0000 7fdd977ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd90068bb0 0x7fdd900a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.388+0000 7fdd977ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9006ddc0 0x7fdd9015b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.388+0000 7fdd977ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd90159040 0x7fdd90169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.388+0000 7fdd977ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9016a1e0 con 0x7fdd90159040 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.388+0000 7fdd977ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd90159540 con 0x7fdd90068bb0 2023-10-06T04:44:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.388+0000 7fdd977ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd901597e0 con 0x7fdd9006ddc0 2023-10-06T04:44:44.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd95d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd90159040 0x7fdd90169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd95d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd90159040 0x7fdd90169ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49372/0 (socket says 172.21.15.124:49372) 2023-10-06T04:44:44.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd95d9c700 1 -- 172.21.15.124:0/1898202494 learned_addr learned my addr 172.21.15.124:0/1898202494 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:44.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd9559b700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd90068bb0 0x7fdd900a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd94d9a700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9006ddc0 0x7fdd9015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd95d9c700 1 -- 172.21.15.124:0/1898202494 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9006ddc0 msgr2=0x7fdd9015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd95d9c700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9006ddc0 0x7fdd9015b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd95d9c700 1 -- 172.21.15.124:0/1898202494 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd90068bb0 msgr2=0x7fdd900a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd95d9c700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd90068bb0 0x7fdd900a55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd95d9c700 1 -- 172.21.15.124:0/1898202494 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c0094f0 con 0x7fdd90159040 2023-10-06T04:44:44.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd94d9a700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9006ddc0 0x7fdd9015b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:44.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd95d9c700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd90159040 0x7fdd90169ca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009fc0 tx=0x7fdd880099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:44.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd857fa700 1 -- 172.21.15.124:0/1898202494 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8800dc90 con 0x7fdd90159040 2023-10-06T04:44:44.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd857fa700 1 -- 172.21.15.124:0/1898202494 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8800f040 con 0x7fdd90159040 2023-10-06T04:44:44.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd857fa700 1 -- 172.21.15.124:0/1898202494 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88015690 con 0x7fdd90159040 2023-10-06T04:44:44.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.389+0000 7fdd977ff700 1 -- 172.21.15.124:0/1898202494 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd90159ac0 con 0x7fdd90159040 2023-10-06T04:44:44.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.390+0000 7fdd977ff700 1 -- 172.21.15.124:0/1898202494 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd900a5c10 con 0x7fdd90159040 2023-10-06T04:44:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.391+0000 7fdd977ff700 1 -- 172.21.15.124:0/1898202494 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd900717a0 con 0x7fdd90159040 2023-10-06T04:44:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.391+0000 7fdd857fa700 1 -- 172.21.15.124:0/1898202494 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd8801e3b0 con 0x7fdd90159040 2023-10-06T04:44:44.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.393+0000 7fdd857fa700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd74066f30 0x7fdd740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.393+0000 7fdd857fa700 1 -- 172.21.15.124:0/1898202494 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdd88084bf0 con 0x7fdd90159040 2023-10-06T04:44:44.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.393+0000 7fdd9559b700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd74066f30 0x7fdd740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.393+0000 7fdd9559b700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd74066f30 0x7fdd740693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd900b2490 tx=0x7fdd8c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:44.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.397+0000 7fdd857fa700 1 -- 172.21.15.124:0/1898202494 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd88051c60 con 0x7fdd90159040 2023-10-06T04:44:44.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.592+0000 7fdd977ff700 1 -- 172.21.15.124:0/1898202494 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd900cbcd0 con 0x7fdd90159040 2023-10-06T04:44:44.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.593+0000 7fdd857fa700 1 -- 172.21.15.124:0/1898202494 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fdd8801a090 con 0x7fdd90159040 2023-10-06T04:44:44.595 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:44.596 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:44.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.595+0000 7fdd977ff700 1 -- 172.21.15.124:0/1898202494 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd74066f30 msgr2=0x7fdd740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.595+0000 7fdd977ff700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd74066f30 0x7fdd740693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd900b2490 tx=0x7fdd8c017000 comp rx=0 tx=0).stop 2023-10-06T04:44:44.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.595+0000 7fdd977ff700 1 -- 172.21.15.124:0/1898202494 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd90159040 msgr2=0x7fdd90169ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.595+0000 7fdd977ff700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd90159040 0x7fdd90169ca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009fc0 tx=0x7fdd880099b0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.596+0000 7fdd977ff700 1 -- 172.21.15.124:0/1898202494 shutdown_connections 2023-10-06T04:44:44.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.596+0000 7fdd977ff700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd90159040 0x7fdd90169ca0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.596+0000 7fdd977ff700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd90068bb0 0x7fdd900a55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.596+0000 7fdd977ff700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdd74066f30 0x7fdd740693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.596+0000 7fdd977ff700 1 --2- 172.21.15.124:0/1898202494 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdd9006ddc0 0x7fdd9015b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.596+0000 7fdd977ff700 1 -- 172.21.15.124:0/1898202494 >> 172.21.15.124:0/1898202494 conn(0x7fdd900cd390 msgr2=0x7fdd900b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:44.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.596+0000 7fdd977ff700 1 -- 172.21.15.124:0/1898202494 shutdown_connections 2023-10-06T04:44:44.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.596+0000 7fdd977ff700 1 -- 172.21.15.124:0/1898202494 wait complete. 2023-10-06T04:44:44.616 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:44.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.804+0000 7fa96b9ff700 1 Processor -- start 2023-10-06T04:44:44.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.804+0000 7fa96b9ff700 1 -- start start 2023-10-06T04:44:44.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.805+0000 7fa96b9ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa9640cb250 0x7fa9641591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.805+0000 7fa96b9ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9640c1d10 con 0x7fa9640cae80 2023-10-06T04:44:44.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.805+0000 7fa96b9ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa964159b70 con 0x7fa964159710 2023-10-06T04:44:44.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.805+0000 7fa96b9ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9640cd430 con 0x7fa9640cb250 2023-10-06T04:44:44.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.805+0000 7fa96979b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa9640cae80 0x7fa9640cc980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42874/0 (socket says 172.21.15.124:42874) 2023-10-06T04:44:44.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.806+0000 7fa96979b700 1 -- 172.21.15.124:0/246028131 learned_addr learned my addr 172.21.15.124:0/246028131 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:44.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.806+0000 7fa968f9a700 1 --2- 172.21.15.124:0/246028131 >> v2:172.21.15.124:3300/0 conn(0x7fa9640cb250 0x7fa9641591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.806+0000 7fa95bfff700 1 -- 172.21.15.124:0/246028131 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645581397 0 0) 0x7fa9640c1d10 con 0x7fa9640cae80 2023-10-06T04:44:44.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.806+0000 7fa95bfff700 1 -- 172.21.15.124:0/246028131 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa950003570 con 0x7fa9640cae80 2023-10-06T04:44:44.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.806+0000 7fa968f9a700 1 -- 172.21.15.124:0/246028131 >> v1:172.21.15.158:6789/0 conn(0x7fa964159710 legacy=0x7fa9640afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.806+0000 7fa968f9a700 1 -- 172.21.15.124:0/246028131 >> v1:172.21.15.124:6789/0 conn(0x7fa9640cae80 legacy=0x7fa9640cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.806+0000 7fa968f9a700 1 -- 172.21.15.124:0/246028131 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640688a0 con 0x7fa9640cb250 2023-10-06T04:44:44.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.806+0000 7fa968f9a700 1 --2- 172.21.15.124:0/246028131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cb250 0x7fa9641591d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa9540098e0 tx=0x7fa9540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145e7a2bbbd42b44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:44.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.806+0000 7fa95bfff700 1 -- 172.21.15.124:0/246028131 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95400b640 con 0x7fa9640cb250 2023-10-06T04:44:44.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.807+0000 7fa95bfff700 1 -- 172.21.15.124:0/246028131 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95400b7a0 con 0x7fa9640cb250 2023-10-06T04:44:44.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.807+0000 7fa95bfff700 1 -- 172.21.15.124:0/246028131 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95400bb20 con 0x7fa9640cb250 2023-10-06T04:44:44.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.807+0000 7fa96b9ff700 1 -- 172.21.15.124:0/246028131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cb250 msgr2=0x7fa9641591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.807+0000 7fa96b9ff700 1 --2- 172.21.15.124:0/246028131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cb250 0x7fa9641591d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa9540098e0 tx=0x7fa9540091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.807+0000 7fa96b9ff700 1 -- 172.21.15.124:0/246028131 shutdown_connections 2023-10-06T04:44:44.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.807+0000 7fa96b9ff700 1 --2- 172.21.15.124:0/246028131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cb250 0x7fa9641591d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.807+0000 7fa96b9ff700 1 -- 172.21.15.124:0/246028131 >> 172.21.15.124:0/246028131 conn(0x7fa9640974f0 msgr2=0x7fa9640639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:44.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.807+0000 7fa96b9ff700 1 -- 172.21.15.124:0/246028131 shutdown_connections 2023-10-06T04:44:44.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.807+0000 7fa96b9ff700 1 -- 172.21.15.124:0/246028131 wait complete. 2023-10-06T04:44:44.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.809+0000 7fa96b9ff700 1 Processor -- start 2023-10-06T04:44:44.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.809+0000 7fa96b9ff700 1 -- start start 2023-10-06T04:44:44.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96b9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cae80 0x7fa964158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96b9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9640cb250 0x7fa96415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96b9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa964159710 0x7fa9640c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96b9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96415d0a0 con 0x7fa9640cae80 2023-10-06T04:44:44.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96b9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa964169840 con 0x7fa9640cb250 2023-10-06T04:44:44.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96b9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa964158d80 con 0x7fa964159710 2023-10-06T04:44:44.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96979b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cae80 0x7fa964158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96979b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cae80 0x7fa964158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49382/0 (socket says 172.21.15.124:49382) 2023-10-06T04:44:44.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96979b700 1 -- 172.21.15.124:0/3039269684 learned_addr learned my addr 172.21.15.124:0/3039269684 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:44.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa968f9a700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9640cb250 0x7fa96415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96979b700 1 -- 172.21.15.124:0/3039269684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa964159710 msgr2=0x7fa9640c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa969f9c700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa964159710 0x7fa9640c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96979b700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa964159710 0x7fa9640c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96979b700 1 -- 172.21.15.124:0/3039269684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9640cb250 msgr2=0x7fa96415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96979b700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9640cb250 0x7fa96415beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa96979b700 1 -- 172.21.15.124:0/3039269684 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa954009420 con 0x7fa9640cae80 2023-10-06T04:44:44.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa968f9a700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9640cb250 0x7fa96415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:44.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.810+0000 7fa969f9c700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa964159710 0x7fa9640c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:44.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.811+0000 7fa96979b700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cae80 0x7fa964158840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c7c0 tx=0x7fa960007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:44.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.811+0000 7fa9597fa700 1 -- 172.21.15.124:0/3039269684 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960005b30 con 0x7fa9640cae80 2023-10-06T04:44:44.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.811+0000 7fa9597fa700 1 -- 172.21.15.124:0/3039269684 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa960005c90 con 0x7fa9640cae80 2023-10-06T04:44:44.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.811+0000 7fa9597fa700 1 -- 172.21.15.124:0/3039269684 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960007340 con 0x7fa9640cae80 2023-10-06T04:44:44.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.811+0000 7fa96b9ff700 1 -- 172.21.15.124:0/3039269684 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96415c800 con 0x7fa9640cae80 2023-10-06T04:44:44.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.811+0000 7fa96b9ff700 1 -- 172.21.15.124:0/3039269684 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96415ce40 con 0x7fa9640cae80 2023-10-06T04:44:44.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.812+0000 7fa96b9ff700 1 -- 172.21.15.124:0/3039269684 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9640717a0 con 0x7fa9640cae80 2023-10-06T04:44:44.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.813+0000 7fa9597fa700 1 -- 172.21.15.124:0/3039269684 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa96001b400 con 0x7fa9640cae80 2023-10-06T04:44:44.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.814+0000 7fa9597fa700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa948066f30 0x7fa9480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:44.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.814+0000 7fa9597fa700 1 -- 172.21.15.124:0/3039269684 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa9600841a0 con 0x7fa9640cae80 2023-10-06T04:44:44.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.814+0000 7fa968f9a700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa948066f30 0x7fa9480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:44.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.815+0000 7fa968f9a700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa948066f30 0x7fa9480693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa9640c9fd0 tx=0x7fa954017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:44.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:44.818+0000 7fa9597fa700 1 -- 172.21.15.124:0/3039269684 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa960051330 con 0x7fa9640cae80 2023-10-06T04:44:45.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.051+0000 7fa96b9ff700 1 -- 172.21.15.124:0/3039269684 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa964068b80 con 0x7fa9640cae80 2023-10-06T04:44:45.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.052+0000 7fa9597fa700 1 -- 172.21.15.124:0/3039269684 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fa960054950 con 0x7fa9640cae80 2023-10-06T04:44:45.055 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:45.055 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/3828511424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":3828511424},{"type":"v1","addr":"172.21.15.124:6836","nonce":3828511424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/1252041103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1252041103},{"type":"v1","addr":"172.21.15.158:6834","nonce":1252041103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/978440229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":978440229},{"type":"v1","addr":"172.21.15.124:6837","nonce":978440229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:27.635332+0000","modified":"2023-10-06T04:44:31.182630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6835/1693475602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":1693475602},{"type":"v1","addr":"172.21.15.158:6835","nonce":1693475602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:44:45.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.054+0000 7fa96b9ff700 1 -- 172.21.15.124:0/3039269684 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa948066f30 msgr2=0x7fa9480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.054+0000 7fa96b9ff700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa948066f30 0x7fa9480693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa9640c9fd0 tx=0x7fa954017000 comp rx=0 tx=0).stop 2023-10-06T04:44:45.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.054+0000 7fa96b9ff700 1 -- 172.21.15.124:0/3039269684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cae80 msgr2=0x7fa964158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.054+0000 7fa96b9ff700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cae80 0x7fa964158840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c7c0 tx=0x7fa960007e00 comp rx=0 tx=0).stop 2023-10-06T04:44:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.054+0000 7fa96b9ff700 1 -- 172.21.15.124:0/3039269684 shutdown_connections 2023-10-06T04:44:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.054+0000 7fa96b9ff700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa948066f30 0x7fa9480693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.054+0000 7fa96b9ff700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa964159710 0x7fa9640c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.054+0000 7fa96b9ff700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa9640cae80 0x7fa964158840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.054+0000 7fa96b9ff700 1 --2- 172.21.15.124:0/3039269684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9640cb250 0x7fa96415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.054+0000 7fa96b9ff700 1 -- 172.21.15.124:0/3039269684 >> 172.21.15.124:0/3039269684 conn(0x7fa9640974f0 msgr2=0x7fa964069560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.055+0000 7fa96b9ff700 1 -- 172.21.15.124:0/3039269684 shutdown_connections 2023-10-06T04:44:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.055+0000 7fa96b9ff700 1 -- 172.21.15.124:0/3039269684 wait complete. 2023-10-06T04:44:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2023-10-06T04:44:45.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:44:27.635332+0000', 'modified': '2023-10-06T04:44:31.182630+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.158:6835/1693475602', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6833', 'nonce': 1693475602}, {'type': 'v1', 'addr': '172.21.15.158:6835', 'nonce': 1693475602}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:44:45.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:44:45.477 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T04:44:45.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.666+0000 7f2b453ff700 1 Processor -- start 2023-10-06T04:44:45.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.666+0000 7f2b453ff700 1 -- start start 2023-10-06T04:44:45.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.667+0000 7f2b453ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2b401594b0 0x7f2b400b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.667+0000 7f2b453ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2b4015a580 0x7f2b400b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.667+0000 7f2b453ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b400b4410 con 0x7f2b400b59f0 2023-10-06T04:44:45.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.667+0000 7f2b453ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b400b46f0 con 0x7f2b4015a580 2023-10-06T04:44:45.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.667+0000 7f2b453ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b400b49d0 con 0x7f2b401594b0 2023-10-06T04:44:45.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3f7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2b400b59f0 0x7f2b400b1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42886/0 (socket says 172.21.15.124:42886) 2023-10-06T04:44:45.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3f7fe700 1 -- 172.21.15.124:0/3314622980 learned_addr learned my addr 172.21.15.124:0/3314622980 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:45.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/3314622980 >> v2:172.21.15.124:3300/0 conn(0x7f2b4015a580 0x7f2b400b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3effd700 1 --2- 172.21.15.124:0/3314622980 >> v2:172.21.15.158:3300/0 conn(0x7f2b401594b0 0x7f2b400b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3dffb700 1 -- 172.21.15.124:0/3314622980 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509083289 0 0) 0x7f2b400b4410 con 0x7f2b400b59f0 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3dffb700 1 -- 172.21.15.124:0/3314622980 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b28003570 con 0x7f2b400b59f0 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/3314622980 >> v2:172.21.15.158:3300/0 conn(0x7f2b401594b0 msgr2=0x7f2b400b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/3314622980 >> v2:172.21.15.158:3300/0 conn(0x7f2b401594b0 0x7f2b400b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/3314622980 >> v1:172.21.15.124:6789/0 conn(0x7f2b400b59f0 legacy=0x7f2b400b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/3314622980 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400b4cb0 con 0x7f2b4015a580 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.668+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/3314622980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b4015a580 0x7f2b400b54b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b40069340 tx=0x7f2b340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b739682b56ef917 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b3dffb700 1 -- 172.21.15.124:0/3314622980 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34011630 con 0x7f2b4015a580 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b3dffb700 1 -- 172.21.15.124:0/3314622980 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b340117b0 con 0x7f2b4015a580 2023-10-06T04:44:45.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b3dffb700 1 -- 172.21.15.124:0/3314622980 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34011b70 con 0x7f2b4015a580 2023-10-06T04:44:45.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b453ff700 1 -- 172.21.15.124:0/3314622980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b4015a580 msgr2=0x7f2b400b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b453ff700 1 --2- 172.21.15.124:0/3314622980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b4015a580 0x7f2b400b54b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b40069340 tx=0x7f2b340091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b453ff700 1 -- 172.21.15.124:0/3314622980 shutdown_connections 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b453ff700 1 --2- 172.21.15.124:0/3314622980 >> v2:172.21.15.158:3300/0 conn(0x7f2b401594b0 0x7f2b400b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b453ff700 1 --2- 172.21.15.124:0/3314622980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b4015a580 0x7f2b400b54b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b453ff700 1 -- 172.21.15.124:0/3314622980 >> 172.21.15.124:0/3314622980 conn(0x7f2b4006ed20 msgr2=0x7f2b4006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b453ff700 1 -- 172.21.15.124:0/3314622980 shutdown_connections 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.669+0000 7f2b453ff700 1 -- 172.21.15.124:0/3314622980 wait complete. 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.671+0000 7f2b453ff700 1 Processor -- start 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.671+0000 7f2b453ff700 1 -- start start 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b453ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b400b59f0 0x7f2b40144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b453ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b401594b0 0x7f2b4015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b453ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2b4015a580 0x7f2b4015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b453ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b401454f0 con 0x7f2b400b59f0 2023-10-06T04:44:45.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b453ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b40153830 con 0x7f2b401594b0 2023-10-06T04:44:45.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b453ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b40153b10 con 0x7f2b4015a580 2023-10-06T04:44:45.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b400b59f0 0x7f2b40144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b400b59f0 0x7f2b40144fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49390/0 (socket says 172.21.15.124:49390) 2023-10-06T04:44:45.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3effd700 1 -- 172.21.15.124:0/1006576966 learned_addr learned my addr 172.21.15.124:0/1006576966 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:45.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b401594b0 0x7f2b4015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3f7fe700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2b4015a580 0x7f2b4015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3effd700 1 -- 172.21.15.124:0/1006576966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2b4015a580 msgr2=0x7f2b4015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3effd700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2b4015a580 0x7f2b4015d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3effd700 1 -- 172.21.15.124:0/1006576966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b401594b0 msgr2=0x7f2b4015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3effd700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b401594b0 0x7f2b4015d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3effd700 1 -- 172.21.15.124:0/1006576966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b34009420 con 0x7f2b400b59f0 2023-10-06T04:44:45.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b401594b0 0x7f2b4015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:45.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.672+0000 7f2b3effd700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b400b59f0 0x7f2b40144fb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000ec80 tx=0x7f2b300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.673+0000 7f2b26ffd700 1 -- 172.21.15.124:0/1006576966 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3000c9d0 con 0x7f2b400b59f0 2023-10-06T04:44:45.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.673+0000 7f2b26ffd700 1 -- 172.21.15.124:0/1006576966 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3000cb30 con 0x7f2b400b59f0 2023-10-06T04:44:45.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.673+0000 7f2b453ff700 1 -- 172.21.15.124:0/1006576966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b40153df0 con 0x7f2b400b59f0 2023-10-06T04:44:45.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.673+0000 7f2b26ffd700 1 -- 172.21.15.124:0/1006576966 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30013470 con 0x7f2b400b59f0 2023-10-06T04:44:45.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.673+0000 7f2b453ff700 1 -- 172.21.15.124:0/1006576966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b401543b0 con 0x7f2b400b59f0 2023-10-06T04:44:45.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.675+0000 7f2b26ffd700 1 -- 172.21.15.124:0/1006576966 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b300137e0 con 0x7f2b400b59f0 2023-10-06T04:44:45.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.676+0000 7f2b26ffd700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2b2c066f30 0x7f2b2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.676+0000 7f2b26ffd700 1 -- 172.21.15.124:0/1006576966 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2b30084aa0 con 0x7f2b400b59f0 2023-10-06T04:44:45.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.676+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2b2c066f30 0x7f2b2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.677+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2b2c066f30 0x7f2b2c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2b40069340 tx=0x7f2b34017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.678+0000 7f2b53b68b80 1 Processor -- start 2023-10-06T04:44:45.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.678+0000 7f2b53b68b80 1 -- start start 2023-10-06T04:44:45.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654126fd450 0x5654126fd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x565412705f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654127064d0 0x565412706940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654125d0310 con 0x5654126e2f40 2023-10-06T04:44:45.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x56541260d130 con 0x5654127064d0 2023-10-06T04:44:45.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x56541260aaf0 con 0x5654126fd450 2023-10-06T04:44:45.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b3e7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x565412705f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b3e7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x565412705f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49394/0 (socket says 172.21.15.124:49394) 2023-10-06T04:44:45.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/1532716801 learned_addr learned my addr 172.21.15.124:0/1532716801 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:45.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/1532716801 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654126fd450 msgr2=0x5654126fd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:45.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/1532716801 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654126fd450 0x5654126fd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b3f7fe700 1 --2- 172.21.15.124:0/1532716801 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654127064d0 0x565412706940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/1532716801 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654127064d0 msgr2=0x565412706940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:45.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/1532716801 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654127064d0 0x565412706940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/1532716801 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56541240c790 con 0x5654126e2f40 2023-10-06T04:44:45.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.679+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/1532716801 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x565412705f90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b40088fd0 tx=0x7f2b34020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13122e57d0f8c2a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.680+0000 7f2b1ffff700 1 -- 172.21.15.124:0/1532716801 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3402c070 con 0x5654126e2f40 2023-10-06T04:44:45.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.680+0000 7f2b1ffff700 1 -- 172.21.15.124:0/1532716801 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34011a50 con 0x5654126e2f40 2023-10-06T04:44:45.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.680+0000 7f2b1ffff700 1 -- 172.21.15.124:0/1532716801 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34020070 con 0x5654126e2f40 2023-10-06T04:44:45.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.680+0000 7f2b53b68b80 1 -- 172.21.15.124:0/1532716801 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 msgr2=0x565412705f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.680+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/1532716801 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x565412705f90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b40088fd0 tx=0x7f2b34020000 comp rx=0 tx=0).stop 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.680+0000 7f2b53b68b80 1 -- 172.21.15.124:0/1532716801 shutdown_connections 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.680+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/1532716801 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654127064d0 0x565412706940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.680+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/1532716801 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654126fd450 0x5654126fd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.680+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/1532716801 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x565412705f90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.680+0000 7f2b53b68b80 1 -- 172.21.15.124:0/1532716801 >> 172.21.15.124:0/1532716801 conn(0x565412700880 msgr2=0x565412700c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.681+0000 7f2b53b68b80 1 -- 172.21.15.124:0/1532716801 shutdown_connections 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.681+0000 7f2b53b68b80 1 -- 172.21.15.124:0/1532716801 wait complete. 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.681+0000 7f2b53b68b80 1 -- start start 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.681+0000 7f2b53b68b80 1 Processor -- start 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.682+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x5654126d4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.682+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654126fd450 0x5654126daba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.682+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654127064d0 0x5654126fed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.682+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654126068e0 con 0x5654126e2f40 2023-10-06T04:44:45.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.682+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654125b2980 con 0x5654127064d0 2023-10-06T04:44:45.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.682+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654125b2620 con 0x5654126fd450 2023-10-06T04:44:45.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.682+0000 7f2b53b68b80 10 client.0 _ll_register_callbacks cb 0x565412415a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:44:45.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x5654126d4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x5654126d4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49402/0 (socket says 172.21.15.124:49402) 2023-10-06T04:44:45.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3effd700 1 -- 172.21.15.124:0/4217890614 learned_addr learned my addr 172.21.15.124:0/4217890614 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:45.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3f7fe700 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654127064d0 0x5654126fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654126fd450 0x5654126daba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3effd700 1 -- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654126fd450 msgr2=0x5654126daba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3effd700 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654126fd450 0x5654126daba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3effd700 1 -- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654127064d0 msgr2=0x5654126fed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3effd700 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654127064d0 0x5654126fed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3effd700 1 -- 172.21.15.124:0/4217890614 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b400b4cb0 con 0x5654126e2f40 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b3effd700 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x5654126d4510 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2b30051cd0 tx=0x7f2b30082d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8edb7589189772ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b1d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/4217890614 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30055830 con 0x5654126e2f40 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/4217890614 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2b30058a20 con 0x5654126e2f40 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.683+0000 7f2b53b68b80 1 -- 172.21.15.124:0/4217890614 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654126aad60 con 0x5654126e2f40 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/4217890614 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b3005c770 con 0x5654126e2f40 2023-10-06T04:44:45.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b53b68b80 10 client.4653 fetch_fsmap learned FSMap version 8 2023-10-06T04:44:45.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b53b68b80 1 -- 172.21.15.124:0/4217890614 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5654124f90a0 con 0x5654126e2f40 2023-10-06T04:44:45.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/4217890614 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b30081020 con 0x5654126e2f40 2023-10-06T04:44:45.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/4217890614 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2b300712a0 con 0x5654126e2f40 2023-10-06T04:44:45.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b53b68b80 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T04:44:45.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b53b68b80 10 client.4653 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T04:44:45.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b53b68b80 20 client.4653 populate_metadata read hostname 'smithi124' 2023-10-06T04:44:45.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:6833/1693475602,v1:172.21.15.158:6835/1693475602] conn(0x5654126b6590 0x5654126b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b53b68b80 4 client.4653 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:44:45.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b53b68b80 1 -- 172.21.15.124:0/4217890614 --> [v2:172.21.15.158:6833/1693475602,v1:172.21.15.158:6835/1693475602] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565412687b30 con 0x5654126b6590 2023-10-06T04:44:45.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.684+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:6833/1693475602,v1:172.21.15.158:6835/1693475602] conn(0x5654126b6590 0x5654126b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.685+0000 7f2b1d7fa700 10 client.4653 ms_handle_connect on v2:172.21.15.158:6833/1693475602 2023-10-06T04:44:45.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.685+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:6833/1693475602,v1:172.21.15.158:6835/1693475602] conn(0x5654126b6590 0x5654126b6960 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81393f81a60df007 server_cookie=b799921aa82ad653 in_seq=0 out_seq=0 2023-10-06T04:44:45.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/4217890614 <== mds.0 v2:172.21.15.158:6833/1693475602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x565412687b30 con 0x5654126b6590 2023-10-06T04:44:45.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b1d7fa700 10 client.4653 handle_command_reply: tid=0 2023-10-06T04:44:45.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 client.4653 shutdown 2023-10-06T04:44:45.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 -- 172.21.15.124:0/4217890614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 msgr2=0x5654126d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x5654126d4510 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2b30051cd0 tx=0x7f2b30082d20 comp rx=0 tx=0).stop 2023-10-06T04:44:45.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 -- 172.21.15.124:0/4217890614 shutdown_connections 2023-10-06T04:44:45.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654127064d0 0x5654126fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126e2f40 0x5654126d4510 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:6833/1693475602,v1:172.21.15.158:6835/1693475602] conn(0x5654126b6590 0x5654126b6960 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/4217890614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654126fd450 0x5654126daba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b1d7fa700 0 client.4653 ms_handle_reset on v2:172.21.15.158:6833/1693475602 2023-10-06T04:44:45.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 -- 172.21.15.124:0/4217890614 >> 172.21.15.124:0/4217890614 conn(0x565412700880 msgr2=0x5654126b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 -- 172.21.15.124:0/4217890614 shutdown_connections 2023-10-06T04:44:45.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.686+0000 7f2b53b68b80 1 -- 172.21.15.124:0/4217890614 wait complete. 2023-10-06T04:44:45.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.687+0000 7f2b53b68b80 20 client.4653 trim_cache size 0 max 16384 2023-10-06T04:44:45.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.703+0000 7f2b53b68b80 1 Processor -- start 2023-10-06T04:44:45.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.703+0000 7f2b53b68b80 1 -- start start 2023-10-06T04:44:45.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.704+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654126e2f40 0x5654126d6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.704+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126dd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.704+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654127064d0 0x5654126db440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.704+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x56541249e1e0 con 0x5654126fd450 2023-10-06T04:44:45.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.704+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654126d9f10 con 0x5654126e2f40 2023-10-06T04:44:45.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.704+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654126d9730 con 0x5654127064d0 2023-10-06T04:44:45.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.704+0000 7f2b3e7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.704+0000 7f2b3e7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126dd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49408/0 (socket says 172.21.15.124:49408) 2023-10-06T04:44:45.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.704+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/183908943 learned_addr learned my addr 172.21.15.124:0/183908943 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:45.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b3effd700 1 --2- 172.21.15.124:0/183908943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654126e2f40 0x5654126d6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b3f7fe700 1 --2- 172.21.15.124:0/183908943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654127064d0 0x5654126db440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/183908943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654127064d0 msgr2=0x5654126db440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:45.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/183908943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654127064d0 0x5654126db440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/183908943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654126e2f40 msgr2=0x5654126d6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:45.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/183908943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654126e2f40 0x5654126d6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/183908943 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654125d53c0 con 0x5654126fd450 2023-10-06T04:44:45.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/183908943 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126dd600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400a010 tx=0x7f2b34014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3a535aed8405dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b24ff9700 1 -- 172.21.15.124:0/183908943 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34043070 con 0x5654126fd450 2023-10-06T04:44:45.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b24ff9700 1 -- 172.21.15.124:0/183908943 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34011e30 con 0x5654126fd450 2023-10-06T04:44:45.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.705+0000 7f2b24ff9700 1 -- 172.21.15.124:0/183908943 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3402c040 con 0x5654126fd450 2023-10-06T04:44:45.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.706+0000 7f2b53b68b80 1 -- 172.21.15.124:0/183908943 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 msgr2=0x5654126dd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.706+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/183908943 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126dd600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400a010 tx=0x7f2b34014000 comp rx=0 tx=0).stop 2023-10-06T04:44:45.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.706+0000 7f2b53b68b80 1 -- 172.21.15.124:0/183908943 shutdown_connections 2023-10-06T04:44:45.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.706+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/183908943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654127064d0 0x5654126db440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.706+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/183908943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654126e2f40 0x5654126d6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.706+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/183908943 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126dd600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.706+0000 7f2b53b68b80 1 -- 172.21.15.124:0/183908943 >> 172.21.15.124:0/183908943 conn(0x565412700880 msgr2=0x5654126feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.706+0000 7f2b53b68b80 1 -- 172.21.15.124:0/183908943 shutdown_connections 2023-10-06T04:44:45.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.706+0000 7f2b53b68b80 1 -- 172.21.15.124:0/183908943 wait complete. 2023-10-06T04:44:45.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.706+0000 7f2b53b68b80 1 -- start start 2023-10-06T04:44:45.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.707+0000 7f2b53b68b80 1 Processor -- start 2023-10-06T04:44:45.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654126e2f40 0x5654126db440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126db980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b53b68b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654127064d0 0x565412761ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654126b3130 con 0x5654126fd450 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654127652b0 con 0x5654126e2f40 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b53b68b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x565412766110 con 0x5654127064d0 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b53b68b80 10 client.0 _ll_register_callbacks cb 0x565412415a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b3e7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126db980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b3e7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126db980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49410/0 (socket says 172.21.15.124:49410) 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/2855326701 learned_addr learned my addr 172.21.15.124:0/2855326701 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b3effd700 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654126e2f40 0x5654126db440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654127064d0 msgr2=0x565412761ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654127064d0 0x565412761ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654126e2f40 msgr2=0x5654126db440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:45.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654126e2f40 0x5654126db440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b3e7fc700 1 -- 172.21.15.124:0/2855326701 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56541240c790 con 0x5654126fd450 2023-10-06T04:44:45.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b3e7fc700 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126db980 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b34041040 tx=0x7f2b3403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64703444f3301a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.708+0000 7f2b1d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-06T04:44:45.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/2855326701 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3404d070 con 0x5654126fd450 2023-10-06T04:44:45.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/2855326701 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2b3403fad0 con 0x5654126fd450 2023-10-06T04:44:45.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b53b68b80 1 -- 172.21.15.124:0/2855326701 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b34011a50 con 0x5654126fd450 2023-10-06T04:44:45.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/2855326701 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b3402c040 con 0x5654126fd450 2023-10-06T04:44:45.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b53b68b80 10 client.4659 fetch_fsmap learned FSMap version 8 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b53b68b80 1 -- 172.21.15.124:0/2855326701 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56541246d1d0 con 0x5654126fd450 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/2855326701 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34011a50 con 0x5654126fd450 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/2855326701 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2b34050020 con 0x5654126fd450 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b53b68b80 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b53b68b80 10 client.4659 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b53b68b80 20 client.4659 populate_metadata read hostname 'smithi124' 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:6833/1693475602,v1:172.21.15.158:6835/1693475602] conn(0x5654126e0660 0x565412762420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b53b68b80 4 client.4659 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.709+0000 7f2b53b68b80 1 -- 172.21.15.124:0/2855326701 --> [v2:172.21.15.158:6833/1693475602,v1:172.21.15.158:6835/1693475602] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5654125a98d0 con 0x5654126e0660 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.710+0000 7f2b3effd700 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:6833/1693475602,v1:172.21.15.158:6835/1693475602] conn(0x5654126e0660 0x565412762420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.710+0000 7f2b3effd700 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:6833/1693475602,v1:172.21.15.158:6835/1693475602] conn(0x5654126e0660 0x565412762420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e6220ea9f373cc1 server_cookie=6e3d5358bf621a67 in_seq=0 out_seq=0 2023-10-06T04:44:45.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.710+0000 7f2b1d7fa700 10 client.4659 ms_handle_connect on v2:172.21.15.158:6833/1693475602 2023-10-06T04:44:45.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.710+0000 7f2b1d7fa700 1 -- 172.21.15.124:0/2855326701 <== mds.0 v2:172.21.15.158:6833/1693475602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5654125a98d0 con 0x5654126e0660 2023-10-06T04:44:45.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.710+0000 7f2b1d7fa700 10 client.4659 handle_command_reply: tid=0 2023-10-06T04:44:45.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.710+0000 7f2b53b68b80 1 client.4659 shutdown 2023-10-06T04:44:45.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 1 -- 172.21.15.124:0/2855326701 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 msgr2=0x5654126db980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126db980 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b34041040 tx=0x7f2b3403b000 comp rx=0 tx=0).stop 2023-10-06T04:44:45.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 1 -- 172.21.15.124:0/2855326701 shutdown_connections 2023-10-06T04:44:45.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:6833/1693475602,v1:172.21.15.158:6835/1693475602] conn(0x5654126e0660 0x565412762420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5654127064d0 0x565412761ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5654126e2f40 0x5654126db440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b1d7fa700 0 client.4659 ms_handle_reset on v2:172.21.15.158:6833/1693475602 2023-10-06T04:44:45.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 1 --2- 172.21.15.124:0/2855326701 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5654126fd450 0x5654126db980 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 1 -- 172.21.15.124:0/2855326701 >> 172.21.15.124:0/2855326701 conn(0x565412700880 msgr2=0x5654126d8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 1 -- 172.21.15.124:0/2855326701 shutdown_connections 2023-10-06T04:44:45.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 1 -- 172.21.15.124:0/2855326701 wait complete. 2023-10-06T04:44:45.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.711+0000 7f2b53b68b80 20 client.4659 trim_cache size 0 max 16384 2023-10-06T04:44:45.722 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:44:45.722 INFO:teuthology.orchestra.run.smithi124.stdout: "cluster_fsid": "8703c690-5fd4-410f-8b5d-95264116cbcb", 2023-10-06T04:44:45.723 INFO:teuthology.orchestra.run.smithi124.stdout: "whoami": 0, 2023-10-06T04:44:45.723 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 4291, 2023-10-06T04:44:45.723 INFO:teuthology.orchestra.run.smithi124.stdout: "want_state": "up:active", 2023-10-06T04:44:45.723 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "up:active", 2023-10-06T04:44:45.723 INFO:teuthology.orchestra.run.smithi124.stdout: "fs_name": "cephfs", 2023-10-06T04:44:45.723 INFO:teuthology.orchestra.run.smithi124.stdout: "rank_uptime": 17.545447977999999, 2023-10-06T04:44:45.723 INFO:teuthology.orchestra.run.smithi124.stdout: "mdsmap_epoch": 8, 2023-10-06T04:44:45.723 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch": 22, 2023-10-06T04:44:45.723 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch_barrier": 22, 2023-10-06T04:44:45.724 INFO:teuthology.orchestra.run.smithi124.stdout: "uptime": 23.711052848000001 2023-10-06T04:44:45.724 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:44:45.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 -- 172.21.15.124:0/1006576966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2b2c066f30 msgr2=0x7f2b2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2b2c066f30 0x7f2b2c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2b40069340 tx=0x7f2b34017000 comp rx=0 tx=0).stop 2023-10-06T04:44:45.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 -- 172.21.15.124:0/1006576966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b400b59f0 msgr2=0x7f2b40144fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b400b59f0 0x7f2b40144fb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000ec80 tx=0x7f2b300091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 -- 172.21.15.124:0/1006576966 shutdown_connections 2023-10-06T04:44:45.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2b2c066f30 0x7f2b2c0693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2b4015a580 0x7f2b4015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b400b59f0 0x7f2b40144fb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 --2- 172.21.15.124:0/1006576966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b401594b0 0x7f2b4015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 -- 172.21.15.124:0/1006576966 >> 172.21.15.124:0/1006576966 conn(0x7f2b4006ed20 msgr2=0x7f2b40155090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 -- 172.21.15.124:0/1006576966 shutdown_connections 2023-10-06T04:44:45.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:45.712+0000 7f2b453ff700 1 -- 172.21.15.124:0/1006576966 wait complete. 2023-10-06T04:44:45.730 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T04:44:45.753 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T04:44:45.753 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T04:44:45.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:45.754 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T04:44:45.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:45.802 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link delete ceph-brx 2023-10-06T04:44:45.876 INFO:teuthology.orchestra.run.smithi124.stderr:Cannot find device "ceph-brx" 2023-10-06T04:44:45.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:44:45.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:45.879 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T04:44:45.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:45.927 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link delete ceph-brx 2023-10-06T04:44:46.040 INFO:teuthology.orchestra.run.smithi124.stderr:Cannot find device "ceph-brx" 2023-10-06T04:44:46.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:44:46.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:46.043 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-06T04:44:46.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:46.095 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-06T04:44:46.170 INFO:teuthology.orchestra.run.smithi158.stderr:Cannot find device "ceph-brx" 2023-10-06T04:44:46.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:44:46.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:46.173 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-06T04:44:46.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:46.220 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-06T04:44:46.293 INFO:teuthology.orchestra.run.smithi158.stderr:Cannot find device "ceph-brx" 2023-10-06T04:44:46.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:44:46.296 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-06T04:44:46.297 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:44:46.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.485+0000 7facebdff700 1 Processor -- start 2023-10-06T04:44:46.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.485+0000 7facebdff700 1 -- start start 2023-10-06T04:44:46.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.486+0000 7facebdff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40b1a70 0x7face406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7facebdff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face406e870 con 0x7face406a140 2023-10-06T04:44:46.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7facebdff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face4069cb0 con 0x7face40ac3d0 2023-10-06T04:44:46.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7facebdff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face4156110 con 0x7face40b1a70 2023-10-06T04:44:46.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7facea39c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7face406a140 0x7face406a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42902/0 (socket says 172.21.15.124:42902) 2023-10-06T04:44:46.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7facea39c700 1 -- 172.21.15.124:0/23229712 learned_addr learned my addr 172.21.15.124:0/23229712 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:46.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7face939a700 1 --2- 172.21.15.124:0/23229712 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40b1a70 0x7face406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7face8b99700 1 -- 172.21.15.124:0/23229712 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236620207 0 0) 0x7face406e870 con 0x7face406a140 2023-10-06T04:44:46.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7face8b99700 1 -- 172.21.15.124:0/23229712 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd0003570 con 0x7face406a140 2023-10-06T04:44:46.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7face8b99700 1 -- 172.21.15.124:0/23229712 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143309535 0 0) 0x7face4069cb0 con 0x7face40ac3d0 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7face8b99700 1 -- 172.21.15.124:0/23229712 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face406e870 con 0x7face40ac3d0 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7face939a700 1 -- 172.21.15.124:0/23229712 >> v1:172.21.15.158:6789/0 conn(0x7face40ac3d0 legacy=0x7face40aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7face939a700 1 -- 172.21.15.124:0/23229712 >> v1:172.21.15.124:6789/0 conn(0x7face406a140 legacy=0x7face406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.487+0000 7face939a700 1 -- 172.21.15.124:0/23229712 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face406eaa0 con 0x7face40b1a70 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.488+0000 7face939a700 1 --2- 172.21.15.124:0/23229712 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40b1a70 0x7face406e330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7facd4009910 tx=0x7facd40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5fc524a190f656f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.488+0000 7face8b99700 1 -- 172.21.15.124:0/23229712 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd400b690 con 0x7face40b1a70 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.488+0000 7face8b99700 1 -- 172.21.15.124:0/23229712 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd400b7f0 con 0x7face40b1a70 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.488+0000 7face8b99700 1 -- 172.21.15.124:0/23229712 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd400bb90 con 0x7face40b1a70 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.488+0000 7facebdff700 1 -- 172.21.15.124:0/23229712 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40b1a70 msgr2=0x7face406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.488+0000 7facebdff700 1 --2- 172.21.15.124:0/23229712 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40b1a70 0x7face406e330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7facd4009910 tx=0x7facd40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.488+0000 7facebdff700 1 -- 172.21.15.124:0/23229712 shutdown_connections 2023-10-06T04:44:46.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.488+0000 7facebdff700 1 --2- 172.21.15.124:0/23229712 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40b1a70 0x7face406e330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.488+0000 7facebdff700 1 -- 172.21.15.124:0/23229712 >> 172.21.15.124:0/23229712 conn(0x7face40cc050 msgr2=0x7face40cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:46.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.489+0000 7facebdff700 1 -- 172.21.15.124:0/23229712 shutdown_connections 2023-10-06T04:44:46.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.489+0000 7facebdff700 1 -- 172.21.15.124:0/23229712 wait complete. 2023-10-06T04:44:46.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.490+0000 7facebdff700 1 Processor -- start 2023-10-06T04:44:46.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.490+0000 7facebdff700 1 -- start start 2023-10-06T04:44:46.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.491+0000 7facebdff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7face406a140 0x7face40c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.491+0000 7facebdff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40ac3d0 0x7face4157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.491+0000 7facebdff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7face40b1a70 0x7face4158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.491+0000 7facebdff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face4159320 con 0x7face406a140 2023-10-06T04:44:46.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.491+0000 7facebdff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face4158950 con 0x7face40b1a70 2023-10-06T04:44:46.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.491+0000 7facebdff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face4157d40 con 0x7face40ac3d0 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.491+0000 7face9b9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7face406a140 0x7face40c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.491+0000 7face9b9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7face406a140 0x7face40c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49414/0 (socket says 172.21.15.124:49414) 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.491+0000 7face9b9b700 1 -- 172.21.15.124:0/472038231 learned_addr learned my addr 172.21.15.124:0/472038231 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7facea39c700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7face40b1a70 0x7face4158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7face939a700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40ac3d0 0x7face4157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7face9b9b700 1 -- 172.21.15.124:0/472038231 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40ac3d0 msgr2=0x7face4157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7face9b9b700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40ac3d0 0x7face4157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7face9b9b700 1 -- 172.21.15.124:0/472038231 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7face40b1a70 msgr2=0x7face4158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7face9b9b700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7face40b1a70 0x7face4158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7face9b9b700 1 -- 172.21.15.124:0/472038231 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4009420 con 0x7face406a140 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7face939a700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40ac3d0 0x7face4157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7face9b9b700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7face406a140 0x7face40c9450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7face0002d70 tx=0x7face0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7facd9ffb700 1 -- 172.21.15.124:0/472038231 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0010780 con 0x7face406a140 2023-10-06T04:44:46.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7facd9ffb700 1 -- 172.21.15.124:0/472038231 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face0010920 con 0x7face406a140 2023-10-06T04:44:46.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7facebdff700 1 -- 172.21.15.124:0/472038231 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face4158020 con 0x7face406a140 2023-10-06T04:44:46.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7facd9ffb700 1 -- 172.21.15.124:0/472038231 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0010ce0 con 0x7face406a140 2023-10-06T04:44:46.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.492+0000 7facebdff700 1 -- 172.21.15.124:0/472038231 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face41585e0 con 0x7face406a140 2023-10-06T04:44:46.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.494+0000 7facebdff700 1 -- 172.21.15.124:0/472038231 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face40717a0 con 0x7face406a140 2023-10-06T04:44:46.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.494+0000 7facd9ffb700 1 -- 172.21.15.124:0/472038231 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7face0011680 con 0x7face406a140 2023-10-06T04:44:46.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.495+0000 7facd9ffb700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7facc8066f30 0x7facc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.495+0000 7facd9ffb700 1 -- 172.21.15.124:0/472038231 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7face0086670 con 0x7face406a140 2023-10-06T04:44:46.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.495+0000 7face939a700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7facc8066f30 0x7facc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.496+0000 7face939a700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7facc8066f30 0x7facc80693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7facd4009860 tx=0x7facd4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.499+0000 7facd9ffb700 1 -- 172.21.15.124:0/472038231 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7face0053780 con 0x7face406a140 2023-10-06T04:44:46.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.736+0000 7facebdff700 1 -- 172.21.15.124:0/472038231 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7face4158c30 con 0x7face406a140 2023-10-06T04:44:46.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.736+0000 7facd9ffb700 1 -- 172.21.15.124:0/472038231 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7face0056da0 con 0x7face406a140 2023-10-06T04:44:46.739 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:44:46.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.738+0000 7facebdff700 1 -- 172.21.15.124:0/472038231 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7facc8066f30 msgr2=0x7facc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.738+0000 7facebdff700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7facc8066f30 0x7facc80693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7facd4009860 tx=0x7facd4017000 comp rx=0 tx=0).stop 2023-10-06T04:44:46.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.738+0000 7facebdff700 1 -- 172.21.15.124:0/472038231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7face406a140 msgr2=0x7face40c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.738+0000 7facebdff700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7face406a140 0x7face40c9450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7face0002d70 tx=0x7face0007dd0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.739+0000 7facebdff700 1 -- 172.21.15.124:0/472038231 shutdown_connections 2023-10-06T04:44:46.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.739+0000 7facebdff700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7face40b1a70 0x7face4158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.739+0000 7facebdff700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7face406a140 0x7face40c9450 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.739+0000 7facebdff700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7facc8066f30 0x7facc80693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.739+0000 7facebdff700 1 --2- 172.21.15.124:0/472038231 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7face40ac3d0 0x7face4157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.739+0000 7facebdff700 1 -- 172.21.15.124:0/472038231 >> 172.21.15.124:0/472038231 conn(0x7face40cc050 msgr2=0x7face40697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:46.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.739+0000 7facebdff700 1 -- 172.21.15.124:0/472038231 shutdown_connections 2023-10-06T04:44:46.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:46.739+0000 7facebdff700 1 -- 172.21.15.124:0/472038231 wait complete. 2023-10-06T04:44:46.758 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:44:46.759 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:44:46.759 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2023-10-06T04:44:46.759 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:44:46.759 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:44:46.759 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:44:46.759 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:44:46.759 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:44:46.759 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:44:46.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:46.759 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2023-10-06T04:44:46.806 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:44:46.806 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:44:46.807 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:44:46.807 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:46.807 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-06T04:44:46.807 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:46.807 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:46.807 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f0 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f1 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42272sec preferred_lft 42272sec 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::ec4:7aff:fe8f:d5c5/64 scope link 2023-10-06T04:44:46.808 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:46.809 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:44:46.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:46.809 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:44:46.809 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:44:46.809 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:44:46.809 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip addr flush dev ceph-brx 2023-10-06T04:44:46.810 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set ceph-brx up 2023-10-06T04:44:46.810 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:44:46.810 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:44:47.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:47.265 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:44:47.337 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-06T04:44:47.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:47.341 DEBUG:teuthology.orchestra.run.smithi124:> route 2023-10-06T04:44:47.410 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2023-10-06T04:44:47.410 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:44:47.410 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:44:47.410 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:44:47.410 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:44:47.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:47.411 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:44:47.411 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:44:47.411 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:44:47.411 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:44:47.411 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:44:47.411 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:44:48.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:48.131 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T04:44:48.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:48.180 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list-id 2023-10-06T04:44:48.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:48.227 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:44:48.227 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:44:48.227 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:44:48.227 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T04:44:48.227 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:44:48.370 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T04:44:48.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:48.370 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:44:48.370 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:44:48.371 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T04:44:48.371 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:44:48.371 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T04:44:48.371 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T04:44:48.371 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T04:44:48.371 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:44:48.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:48.637 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:44:48.637 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:44:48.637 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.0 up 2023-10-06T04:44:48.637 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:44:48.637 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:44:48.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:44:48.810 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:44:48.856 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:44:48.857 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:44:48.857 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:44:48.942 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T04:44:48.942 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:44:48.943 DEBUG:teuthology.orchestra.run.smithi124:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:49.082 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:49.082 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:44:49.494 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:49.494 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:44:49.494 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-06T04:44:49.494 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 0@8703c690-5fd4-410f-8b5d-95264116cbcb.cephfs=/ 2023-10-06T04:44:49.494 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.124:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-06T04:44:49.498 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:44:49.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:49.498 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:44:49.570 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-06T04:44:49.570 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:44:49.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.756+0000 7fd700fff700 1 Processor -- start 2023-10-06T04:44:49.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.756+0000 7fd700fff700 1 -- start start 2023-10-06T04:44:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.757+0000 7fd700fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd6fc0cae80 0x7fd6fc0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.757+0000 7fd700fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc0c1d10 con 0x7fd6fc0ccec0 2023-10-06T04:44:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.757+0000 7fd700fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc0688a0 con 0x7fd6fc1598e0 2023-10-06T04:44:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.757+0000 7fd700fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc0cd430 con 0x7fd6fc0cae80 2023-10-06T04:44:49.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.758+0000 7fd6f9d9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd6fc0ccec0 0x7fd6fc1591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42910/0 (socket says 172.21.15.124:42910) 2023-10-06T04:44:49.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.758+0000 7fd6f9d9b700 1 -- 172.21.15.124:0/3538605005 learned_addr learned my addr 172.21.15.124:0/3538605005 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:49.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.758+0000 7fd6fa59c700 1 --2- 172.21.15.124:0/3538605005 >> v2:172.21.15.158:3300/0 conn(0x7fd6fc0cae80 0x7fd6fc0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.758+0000 7fd6f959a700 1 -- 172.21.15.124:0/3538605005 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007861631 0 0) 0x7fd6fc0c1d10 con 0x7fd6fc0ccec0 2023-10-06T04:44:49.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.758+0000 7fd6f959a700 1 -- 172.21.15.124:0/3538605005 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e4003570 con 0x7fd6fc0ccec0 2023-10-06T04:44:49.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.758+0000 7fd6fa59c700 1 -- 172.21.15.124:0/3538605005 >> v1:172.21.15.158:6789/0 conn(0x7fd6fc1598e0 legacy=0x7fd6fc0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.758+0000 7fd6fa59c700 1 -- 172.21.15.124:0/3538605005 >> v1:172.21.15.124:6789/0 conn(0x7fd6fc0ccec0 legacy=0x7fd6fc1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.758+0000 7fd6fa59c700 1 -- 172.21.15.124:0/3538605005 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc068b80 con 0x7fd6fc0cae80 2023-10-06T04:44:49.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.759+0000 7fd6fa59c700 1 --2- 172.21.15.124:0/3538605005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0cae80 0x7fd6fc0cc980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0098e0 tx=0x7fd6ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4b300f2553e2abc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.759+0000 7fd6f959a700 1 -- 172.21.15.124:0/3538605005 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00b640 con 0x7fd6fc0cae80 2023-10-06T04:44:49.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.759+0000 7fd6f959a700 1 -- 172.21.15.124:0/3538605005 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec00b7a0 con 0x7fd6fc0cae80 2023-10-06T04:44:49.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.759+0000 7fd6f959a700 1 -- 172.21.15.124:0/3538605005 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00bb40 con 0x7fd6fc0cae80 2023-10-06T04:44:49.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.759+0000 7fd700fff700 1 -- 172.21.15.124:0/3538605005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0cae80 msgr2=0x7fd6fc0cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.759+0000 7fd700fff700 1 --2- 172.21.15.124:0/3538605005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0cae80 0x7fd6fc0cc980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0098e0 tx=0x7fd6ec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.760+0000 7fd700fff700 1 -- 172.21.15.124:0/3538605005 shutdown_connections 2023-10-06T04:44:49.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.760+0000 7fd700fff700 1 --2- 172.21.15.124:0/3538605005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0cae80 0x7fd6fc0cc980 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.760+0000 7fd700fff700 1 -- 172.21.15.124:0/3538605005 >> 172.21.15.124:0/3538605005 conn(0x7fd6fc0974f0 msgr2=0x7fd6fc0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:49.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.760+0000 7fd700fff700 1 -- 172.21.15.124:0/3538605005 shutdown_connections 2023-10-06T04:44:49.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.760+0000 7fd700fff700 1 -- 172.21.15.124:0/3538605005 wait complete. 2023-10-06T04:44:49.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.762+0000 7fd700fff700 1 Processor -- start 2023-10-06T04:44:49.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.762+0000 7fd700fff700 1 -- start start 2023-10-06T04:44:49.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.763+0000 7fd700fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0cae80 0x7fd6fc0c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.763+0000 7fd700fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6fc0ccec0 0x7fd6fc0b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.763+0000 7fd700fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6fc1598e0 0x7fd6fc0c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.763+0000 7fd700fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c77d0 con 0x7fd6fc1598e0 2023-10-06T04:44:49.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.763+0000 7fd700fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c6bc0 con 0x7fd6fc0cae80 2023-10-06T04:44:49.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.763+0000 7fd700fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c6ea0 con 0x7fd6fc0ccec0 2023-10-06T04:44:49.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6fad9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6fc1598e0 0x7fd6fc0c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6fad9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6fc1598e0 0x7fd6fc0c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49422/0 (socket says 172.21.15.124:49422) 2023-10-06T04:44:49.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6fad9d700 1 -- 172.21.15.124:0/1314954966 learned_addr learned my addr 172.21.15.124:0/1314954966 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:49.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6fa59c700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0cae80 0x7fd6fc0c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6f9d9b700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6fc0ccec0 0x7fd6fc0b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6fad9d700 1 -- 172.21.15.124:0/1314954966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6fc0ccec0 msgr2=0x7fd6fc0b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6fad9d700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6fc0ccec0 0x7fd6fc0b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6fad9d700 1 -- 172.21.15.124:0/1314954966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0cae80 msgr2=0x7fd6fc0c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6fad9d700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0cae80 0x7fd6fc0c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6fad9d700 1 -- 172.21.15.124:0/1314954966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec009420 con 0x7fd6fc1598e0 2023-10-06T04:44:49.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6fad9d700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6fc1598e0 0x7fd6fc0c30c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c840 tx=0x7fd6f4001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6ea7fc700 1 -- 172.21.15.124:0/1314954966 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4012630 con 0x7fd6fc1598e0 2023-10-06T04:44:49.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd6ea7fc700 1 -- 172.21.15.124:0/1314954966 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f40127b0 con 0x7fd6fc1598e0 2023-10-06T04:44:49.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.764+0000 7fd700fff700 1 -- 172.21.15.124:0/1314954966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc0c7180 con 0x7fd6fc1598e0 2023-10-06T04:44:49.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.765+0000 7fd6ea7fc700 1 -- 172.21.15.124:0/1314954966 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4012b70 con 0x7fd6fc1598e0 2023-10-06T04:44:49.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.765+0000 7fd700fff700 1 -- 172.21.15.124:0/1314954966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc0b1fd0 con 0x7fd6fc1598e0 2023-10-06T04:44:49.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.766+0000 7fd700fff700 1 -- 172.21.15.124:0/1314954966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc0c7980 con 0x7fd6fc1598e0 2023-10-06T04:44:49.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.766+0000 7fd6ea7fc700 1 -- 172.21.15.124:0/1314954966 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6f4003030 con 0x7fd6fc1598e0 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.768+0000 7fd6ea7fc700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd6dc066f30 0x7fd6dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.768+0000 7fd6ea7fc700 1 -- 172.21.15.124:0/1314954966 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd6f4084690 con 0x7fd6fc1598e0 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.768+0000 7fd6fa59c700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd6dc066f30 0x7fd6dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.769+0000 7fd6fa59c700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd6dc066f30 0x7fd6dc0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0093f0 tx=0x7fd6ec017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:49.772+0000 7fd6ea7fc700 1 -- 172.21.15.124:0/1314954966 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6fc0c7980 con 0x7fd6fc1598e0 2023-10-06T04:44:50.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.011+0000 7fd700fff700 1 -- 172.21.15.124:0/1314954966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6fc0717a0 con 0x7fd6fc1598e0 2023-10-06T04:44:50.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.012+0000 7fd6ea7fc700 1 -- 172.21.15.124:0/1314954966 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd6f4055240 con 0x7fd6fc1598e0 2023-10-06T04:44:50.014 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:44:50.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 -- 172.21.15.124:0/1314954966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd6dc066f30 msgr2=0x7fd6dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd6dc066f30 0x7fd6dc0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0093f0 tx=0x7fd6ec017000 comp rx=0 tx=0).stop 2023-10-06T04:44:50.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 -- 172.21.15.124:0/1314954966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6fc1598e0 msgr2=0x7fd6fc0c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6fc1598e0 0x7fd6fc0c30c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c840 tx=0x7fd6f4001670 comp rx=0 tx=0).stop 2023-10-06T04:44:50.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 -- 172.21.15.124:0/1314954966 shutdown_connections 2023-10-06T04:44:50.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6fc1598e0 0x7fd6fc0c30c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0cae80 0x7fd6fc0c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd6dc066f30 0x7fd6dc0693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 --2- 172.21.15.124:0/1314954966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6fc0ccec0 0x7fd6fc0b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 -- 172.21.15.124:0/1314954966 >> 172.21.15.124:0/1314954966 conn(0x7fd6fc0974f0 msgr2=0x7fd6fc0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:50.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 -- 172.21.15.124:0/1314954966 shutdown_connections 2023-10-06T04:44:50.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:50.014+0000 7fd700fff700 1 -- 172.21.15.124:0/1314954966 wait complete. 2023-10-06T04:44:50.034 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:44:50.034 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:44:50.034 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2023-10-06T04:44:50.034 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T04:44:50.034 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T04:44:50.034 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:44:50.035 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:44:50.035 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:44:50.035 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:44:50.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:50.035 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2023-10-06T04:44:50.081 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:44:50.082 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:44:50.082 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:44:50.082 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.082 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-06T04:44:50.082 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.082 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:50.082 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:50.082 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f0 2023-10-06T04:44:50.082 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f1 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42269sec preferred_lft 42269sec 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::ec4:7aff:fe8f:d5c5/64 scope link 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 4e:9e:1a:d5:9e:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:50.083 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:44:50.084 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.084 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::c4a5:a6ff:fe18:bdf9/64 scope link 2023-10-06T04:44:50.084 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.084 INFO:teuthology.orchestra.run.smithi124.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:44:50.084 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 4e:9e:1a:d5:9e:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:44:50.084 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::4c9e:1aff:fed5:9e13/64 scope link tentative 2023-10-06T04:44:50.084 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:50.084 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:44:50.189 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-06T04:44:50.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:50.193 DEBUG:teuthology.orchestra.run.smithi124:> route 2023-10-06T04:44:50.241 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2023-10-06T04:44:50.241 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:44:50.241 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:44:50.241 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:44:50.242 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:44:50.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:50.243 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:44:50.243 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:44:50.243 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:44:50.243 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:44:50.243 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:44:50.243 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:44:50.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:50.411 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T04:44:50.458 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:44:50.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:50.459 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list-id 2023-10-06T04:44:50.544 INFO:teuthology.orchestra.run.smithi124.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T04:44:50.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:50.545 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:44:50.545 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:44:50.545 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:44:50.546 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T04:44:50.546 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:44:50.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:50.729 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:44:50.800 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:44:50.800 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:44:50.800 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:44:50.800 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.800 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-06T04:44:50.800 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.800 INFO:teuthology.orchestra.run.smithi124.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:44:50.801 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether f6:7a:28:e3:e4:1b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:44:50.801 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:44:50.801 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.801 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::f47a:28ff:fee3:e41b/64 scope link 2023-10-06T04:44:50.801 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:50.803 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:44:50.874 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:44:50.874 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:44:50.874 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:44:50.875 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.875 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-06T04:44:50.875 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.875 INFO:teuthology.orchestra.run.smithi124.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:44:50.875 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether f6:7a:28:e3:e4:1b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:44:50.875 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:44:50.875 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.876 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::f47a:28ff:fee3:e41b/64 scope link 2023-10-06T04:44:50.876 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:50.877 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T04:44:50.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:50.878 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:44:50.878 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:44:50.878 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T04:44:50.879 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:44:50.879 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T04:44:50.879 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T04:44:50.879 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T04:44:50.879 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:44:51.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:51.130 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:44:51.131 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:44:51.131 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.1 up 2023-10-06T04:44:51.131 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:44:51.131 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:44:51.304 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:44:51.304 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T04:44:51.350 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:44:51.350 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:44:51.350 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:44:51.435 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-06T04:44:51.435 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:44:51.436 DEBUG:teuthology.orchestra.run.smithi124:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:51.573 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:51.573 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:44:51.601 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:51.601 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:44:51.601 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-06T04:44:51.602 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 2@8703c690-5fd4-410f-8b5d-95264116cbcb.cephfs=/ 2023-10-06T04:44:51.602 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.124:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-06T04:44:51.606 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:44:51.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:51.607 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:44:51.677 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-06T04:44:51.677 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:44:51.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.864+0000 7f4d463ff700 1 Processor -- start 2023-10-06T04:44:51.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.864+0000 7f4d463ff700 1 -- start start 2023-10-06T04:44:51.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.865+0000 7f4d463ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4d4006ddc0 0x7f4d400b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.865+0000 7f4d463ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4d40068bb0 0x7f4d4006e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.865+0000 7f4d463ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d400cc040 con 0x7f4d40159040 2023-10-06T04:44:51.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.865+0000 7f4d463ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4006e6d0 con 0x7f4d40068bb0 2023-10-06T04:44:51.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.865+0000 7f4d463ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4006e990 con 0x7f4d4006ddc0 2023-10-06T04:44:51.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.865+0000 7f4d3f7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4d40068bb0 0x7f4d4006e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3f7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4d40068bb0 0x7f4d4006e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49436/0 (socket says 172.21.15.124:49436) 2023-10-06T04:44:51.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d4499c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f4d40159040 0x7f4d401594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42916/0 (socket says 172.21.15.124:42916) 2023-10-06T04:44:51.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3f7fe700 1 -- 172.21.15.124:0/1883431785 learned_addr learned my addr 172.21.15.124:0/1883431785 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:51.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3ffff700 1 --2- 172.21.15.124:0/1883431785 >> v2:172.21.15.158:3300/0 conn(0x7f4d4006ddc0 0x7f4d400b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3f7fe700 1 -- 172.21.15.124:0/1883431785 >> v2:172.21.15.158:3300/0 conn(0x7f4d4006ddc0 msgr2=0x7f4d400b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:51.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3f7fe700 1 --2- 172.21.15.124:0/1883431785 >> v2:172.21.15.158:3300/0 conn(0x7f4d4006ddc0 0x7f4d400b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3f7fe700 1 -- 172.21.15.124:0/1883431785 >> v1:172.21.15.124:6789/0 conn(0x7f4d40159040 legacy=0x7f4d401594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3f7fe700 1 -- 172.21.15.124:0/1883431785 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400cb9f0 con 0x7f4d40068bb0 2023-10-06T04:44:51.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3ffff700 1 --2- 172.21.15.124:0/1883431785 >> v2:172.21.15.158:3300/0 conn(0x7f4d4006ddc0 0x7f4d400b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:51.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3effd700 1 -- 172.21.15.124:0/1883431785 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977324977 0 0) 0x7f4d400cc040 con 0x7f4d40159040 2023-10-06T04:44:51.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3f7fe700 1 --2- 172.21.15.124:0/1883431785 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d40068bb0 0x7f4d4006e190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d40071390 tx=0x7f4d34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a8de8f4cb532db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3effd700 1 -- 172.21.15.124:0/1883431785 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400b860 con 0x7f4d40068bb0 2023-10-06T04:44:51.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.866+0000 7f4d3effd700 1 -- 172.21.15.124:0/1883431785 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3400b9c0 con 0x7f4d40068bb0 2023-10-06T04:44:51.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.867+0000 7f4d3effd700 1 -- 172.21.15.124:0/1883431785 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400bd60 con 0x7f4d40068bb0 2023-10-06T04:44:51.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.867+0000 7f4d463ff700 1 -- 172.21.15.124:0/1883431785 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d40068bb0 msgr2=0x7f4d4006e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.867+0000 7f4d463ff700 1 --2- 172.21.15.124:0/1883431785 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d40068bb0 0x7f4d4006e190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d40071390 tx=0x7f4d34009250 comp rx=0 tx=0).stop 2023-10-06T04:44:51.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.867+0000 7f4d463ff700 1 -- 172.21.15.124:0/1883431785 shutdown_connections 2023-10-06T04:44:51.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.867+0000 7f4d463ff700 1 --2- 172.21.15.124:0/1883431785 >> v2:172.21.15.158:3300/0 conn(0x7f4d4006ddc0 0x7f4d400b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.867+0000 7f4d463ff700 1 --2- 172.21.15.124:0/1883431785 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d40068bb0 0x7f4d4006e190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.867+0000 7f4d463ff700 1 -- 172.21.15.124:0/1883431785 >> 172.21.15.124:0/1883431785 conn(0x7f4d400cd390 msgr2=0x7f4d400b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:51.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.867+0000 7f4d463ff700 1 -- 172.21.15.124:0/1883431785 shutdown_connections 2023-10-06T04:44:51.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.867+0000 7f4d463ff700 1 -- 172.21.15.124:0/1883431785 wait complete. 2023-10-06T04:44:51.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.869+0000 7f4d463ff700 1 Processor -- start 2023-10-06T04:44:51.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.869+0000 7f4d463ff700 1 -- start start 2023-10-06T04:44:51.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d463ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d40068bb0 0x7f4d401442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d463ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d4006ddc0 0x7f4d40157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d463ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d40159040 0x7f4d4015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d463ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d401589a0 con 0x7f4d4006ddc0 2023-10-06T04:44:51.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d463ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400c5fd0 con 0x7f4d40159040 2023-10-06T04:44:51.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d463ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d401583e0 con 0x7f4d40068bb0 2023-10-06T04:44:51.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d4006ddc0 0x7f4d40157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d4006ddc0 0x7f4d40157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49448/0 (socket says 172.21.15.124:49448) 2023-10-06T04:44:51.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d3f7fe700 1 -- 172.21.15.124:0/752518958 learned_addr learned my addr 172.21.15.124:0/752518958 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:51.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d3ffff700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d40068bb0 0x7f4d401442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d4499c700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d40159040 0x7f4d4015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d3f7fe700 1 -- 172.21.15.124:0/752518958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d40068bb0 msgr2=0x7f4d401442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d3f7fe700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d40068bb0 0x7f4d401442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d3f7fe700 1 -- 172.21.15.124:0/752518958 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d40159040 msgr2=0x7f4d4015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d3f7fe700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d40159040 0x7f4d4015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d3f7fe700 1 -- 172.21.15.124:0/752518958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340094f0 con 0x7f4d4006ddc0 2023-10-06T04:44:51.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.870+0000 7f4d4499c700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d40159040 0x7f4d4015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:51.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.871+0000 7f4d3f7fe700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d4006ddc0 0x7f4d40157a10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4d340090b0 tx=0x7f4d34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.871+0000 7f4d27fff700 1 -- 172.21.15.124:0/752518958 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34011e60 con 0x7f4d4006ddc0 2023-10-06T04:44:51.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.871+0000 7f4d27fff700 1 -- 172.21.15.124:0/752518958 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3401f070 con 0x7f4d4006ddc0 2023-10-06T04:44:51.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.871+0000 7f4d463ff700 1 -- 172.21.15.124:0/752518958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d401586c0 con 0x7f4d4006ddc0 2023-10-06T04:44:51.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.871+0000 7f4d27fff700 1 -- 172.21.15.124:0/752518958 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3401a890 con 0x7f4d4006ddc0 2023-10-06T04:44:51.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.871+0000 7f4d463ff700 1 -- 172.21.15.124:0/752518958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d40144820 con 0x7f4d4006ddc0 2023-10-06T04:44:51.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.872+0000 7f4d463ff700 1 -- 172.21.15.124:0/752518958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d400c5ac0 con 0x7f4d4006ddc0 2023-10-06T04:44:51.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.873+0000 7f4d27fff700 1 -- 172.21.15.124:0/752518958 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d3401ac00 con 0x7f4d4006ddc0 2023-10-06T04:44:51.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.874+0000 7f4d27fff700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4d2c066f30 0x7f4d2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.874+0000 7f4d27fff700 1 -- 172.21.15.124:0/752518958 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4d34021070 con 0x7f4d4006ddc0 2023-10-06T04:44:51.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.874+0000 7f4d3ffff700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4d2c066f30 0x7f4d2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.874+0000 7f4d3ffff700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4d2c066f30 0x7f4d2c0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d30006f00 tx=0x7f4d30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:51.878+0000 7f4d27fff700 1 -- 172.21.15.124:0/752518958 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d400c5ac0 con 0x7f4d4006ddc0 2023-10-06T04:44:52.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.116+0000 7f4d463ff700 1 -- 172.21.15.124:0/752518958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4d400c5ac0 con 0x7f4d4006ddc0 2023-10-06T04:44:52.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.116+0000 7f4d27fff700 1 -- 172.21.15.124:0/752518958 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4d400c5ac0 con 0x7f4d4006ddc0 2023-10-06T04:44:52.119 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:44:52.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 -- 172.21.15.124:0/752518958 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4d2c066f30 msgr2=0x7f4d2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:52.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4d2c066f30 0x7f4d2c0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d30006f00 tx=0x7f4d30008040 comp rx=0 tx=0).stop 2023-10-06T04:44:52.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 -- 172.21.15.124:0/752518958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d4006ddc0 msgr2=0x7f4d40157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:52.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d4006ddc0 0x7f4d40157a10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4d340090b0 tx=0x7f4d34017000 comp rx=0 tx=0).stop 2023-10-06T04:44:52.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 -- 172.21.15.124:0/752518958 shutdown_connections 2023-10-06T04:44:52.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d40159040 0x7f4d4015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4d2c066f30 0x7f4d2c0693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d40068bb0 0x7f4d401442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 --2- 172.21.15.124:0/752518958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d4006ddc0 0x7f4d40157a10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 -- 172.21.15.124:0/752518958 >> 172.21.15.124:0/752518958 conn(0x7f4d400cd390 msgr2=0x7f4d40154250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:52.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.118+0000 7f4d463ff700 1 -- 172.21.15.124:0/752518958 shutdown_connections 2023-10-06T04:44:52.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:52.119+0000 7f4d463ff700 1 -- 172.21.15.124:0/752518958 wait complete. 2023-10-06T04:44:52.139 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:44:52.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:44:52.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-06T04:44:52.139 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T04:44:52.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T04:44:52.139 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:44:52.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:44:52.140 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:44:52.140 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:44:52.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:52.140 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-06T04:44:52.193 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:44:52.194 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:44:52.194 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:44:52.194 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:52.194 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-06T04:44:52.194 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:52.194 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:52.195 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:52.195 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-06T04:44:52.195 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:52.195 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:52.195 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-06T04:44:52.195 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:52.196 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:52.196 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:44:52.196 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:52.196 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:44:52.196 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42308sec preferred_lft 42308sec 2023-10-06T04:44:52.196 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-06T04:44:52.197 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:52.198 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:44:52.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:52.198 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T04:44:52.198 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T04:44:52.198 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:44:52.199 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr flush dev ceph-brx 2023-10-06T04:44:52.199 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set ceph-brx up 2023-10-06T04:44:52.199 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:44:52.199 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T04:44:52.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:52.643 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:44:52.723 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-06T04:44:52.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:52.726 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-06T04:44:52.793 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-06T04:44:52.793 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:44:52.793 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:44:52.793 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:44:52.794 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:44:52.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:52.795 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T04:44:52.795 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T04:44:52.795 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:44:52.795 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:44:52.795 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:44:52.795 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T04:44:53.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:53.491 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-06T04:44:53.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:53.542 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list-id 2023-10-06T04:44:53.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:53.590 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T04:44:53.590 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T04:44:53.590 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:44:53.590 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T04:44:53.590 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T04:44:53.732 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T04:44:53.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:53.733 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T04:44:53.733 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T04:44:53.733 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T04:44:53.733 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:44:53.733 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T04:44:53.733 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T04:44:53.733 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T04:44:53.733 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T04:44:54.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:54.002 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T04:44:54.003 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T04:44:54.003 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-06T04:44:54.003 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:44:54.003 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T04:44:54.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:44:54.177 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T04:44:54.223 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:44:54.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:44:54.223 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:44:54.308 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T04:44:54.309 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:44:54.309 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:54.449 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:54.449 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:44:54.918 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:54.918 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:44:54.918 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-06T04:44:54.918 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@8703c690-5fd4-410f-8b5d-95264116cbcb.cephfs=/ 2023-10-06T04:44:54.918 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.124:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-06T04:44:54.922 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:44:54.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:54.923 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:44:54.993 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-06T04:44:54.993 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:44:55.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.187+0000 7efdb4bff700 1 Processor -- start 2023-10-06T04:44:55.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.187+0000 7efdb4bff700 1 -- start start 2023-10-06T04:44:55.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.188+0000 7efdb4bff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efdb00b1a70 0x7efdb006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:55.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.188+0000 7efdb4bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efdb006a140 0x7efdb006a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:55.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.188+0000 7efdb4bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb006e870 con 0x7efdb00ac3d0 2023-10-06T04:44:55.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.188+0000 7efdb4bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb0069cb0 con 0x7efdb006a140 2023-10-06T04:44:55.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.188+0000 7efdb4bff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb0156110 con 0x7efdb00b1a70 2023-10-06T04:44:55.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.188+0000 7efdaed9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efdb006a140 0x7efdb006a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:55.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.188+0000 7efdaed9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efdb006a140 0x7efdb006a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54758/0 (socket says 172.21.15.124:54758) 2023-10-06T04:44:55.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.188+0000 7efdaed9d700 1 -- 172.21.15.124:0/126121748 learned_addr learned my addr 172.21.15.124:0/126121748 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:55.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.189+0000 7efdadd9b700 1 --2- 172.21.15.124:0/126121748 >> v2:172.21.15.158:3300/0 conn(0x7efdb00b1a70 0x7efdb006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:55.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.189+0000 7efdaed9d700 1 -- 172.21.15.124:0/126121748 >> v2:172.21.15.158:3300/0 conn(0x7efdb00b1a70 msgr2=0x7efdb006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:55.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.189+0000 7efdaed9d700 1 --2- 172.21.15.124:0/126121748 >> v2:172.21.15.158:3300/0 conn(0x7efdb00b1a70 0x7efdb006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.189+0000 7efdaed9d700 1 -- 172.21.15.124:0/126121748 >> v1:172.21.15.158:6789/0 conn(0x7efdb00ac3d0 legacy=0x7efdb00aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:55.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.189+0000 7efdaed9d700 1 -- 172.21.15.124:0/126121748 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb006aa80 con 0x7efdb006a140 2023-10-06T04:44:55.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.189+0000 7efdaed9d700 1 --2- 172.21.15.124:0/126121748 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 0x7efdb006a540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efdb00ab9a0 tx=0x7efda8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54becece232dcba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:55.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.189+0000 7efdad59a700 1 -- 172.21.15.124:0/126121748 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800e070 con 0x7efdb006a140 2023-10-06T04:44:55.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.189+0000 7efdad59a700 1 -- 172.21.15.124:0/126121748 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda800bab0 con 0x7efdb006a140 2023-10-06T04:44:55.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.189+0000 7efdad59a700 1 -- 172.21.15.124:0/126121748 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80092e0 con 0x7efdb006a140 2023-10-06T04:44:55.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.190+0000 7efdb4bff700 1 -- 172.21.15.124:0/126121748 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 msgr2=0x7efdb006a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:55.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.190+0000 7efdb4bff700 1 --2- 172.21.15.124:0/126121748 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 0x7efdb006a540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efdb00ab9a0 tx=0x7efda8009840 comp rx=0 tx=0).stop 2023-10-06T04:44:55.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.190+0000 7efdb4bff700 1 -- 172.21.15.124:0/126121748 shutdown_connections 2023-10-06T04:44:55.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.190+0000 7efdb4bff700 1 --2- 172.21.15.124:0/126121748 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 0x7efdb006a540 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.190+0000 7efdb4bff700 1 --2- 172.21.15.124:0/126121748 >> v2:172.21.15.158:3300/0 conn(0x7efdb00b1a70 0x7efdb006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.190+0000 7efdb4bff700 1 -- 172.21.15.124:0/126121748 >> 172.21.15.124:0/126121748 conn(0x7efdb00cc050 msgr2=0x7efdb00cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:55.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.190+0000 7efdb4bff700 1 -- 172.21.15.124:0/126121748 shutdown_connections 2023-10-06T04:44:55.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.190+0000 7efdb4bff700 1 -- 172.21.15.124:0/126121748 wait complete. 2023-10-06T04:44:55.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.192+0000 7efdb4bff700 1 Processor -- start 2023-10-06T04:44:55.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.192+0000 7efdb4bff700 1 -- start start 2023-10-06T04:44:55.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdb4bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 0x7efdb014a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:55.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdb4bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb00ac3d0 0x7efdb0098b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:55.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdb4bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdb00b1a70 0x7efdb00990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:55.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdb4bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb016a400 con 0x7efdb006a140 2023-10-06T04:44:55.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdb4bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb016ac30 con 0x7efdb00b1a70 2023-10-06T04:44:55.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdb4bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb0167b30 con 0x7efdb00ac3d0 2023-10-06T04:44:55.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdae59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 0x7efdb014a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:55.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdae59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 0x7efdb014a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54768/0 (socket says 172.21.15.124:54768) 2023-10-06T04:44:55.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdae59c700 1 -- 172.21.15.124:0/1024967244 learned_addr learned my addr 172.21.15.124:0/1024967244 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:55.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdaed9d700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdb00b1a70 0x7efdb00990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:55.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdadd9b700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb00ac3d0 0x7efdb0098b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:55.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdae59c700 1 -- 172.21.15.124:0/1024967244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb00ac3d0 msgr2=0x7efdb0098b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:55.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdae59c700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb00ac3d0 0x7efdb0098b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdae59c700 1 -- 172.21.15.124:0/1024967244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdb00b1a70 msgr2=0x7efdb00990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:55.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdae59c700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdb00b1a70 0x7efdb00990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdae59c700 1 -- 172.21.15.124:0/1024967244 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8009ae0 con 0x7efdb006a140 2023-10-06T04:44:55.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.194+0000 7efdae59c700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 0x7efdb014a3a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efda000c590 tx=0x7efda000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:55.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.195+0000 7efd9e7fc700 1 -- 172.21.15.124:0/1024967244 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0011590 con 0x7efdb006a140 2023-10-06T04:44:55.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.195+0000 7efd9e7fc700 1 -- 172.21.15.124:0/1024967244 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda0011710 con 0x7efdb006a140 2023-10-06T04:44:55.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.195+0000 7efdb4bff700 1 -- 172.21.15.124:0/1024967244 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb016a5e0 con 0x7efdb006a140 2023-10-06T04:44:55.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.195+0000 7efd9e7fc700 1 -- 172.21.15.124:0/1024967244 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0011ad0 con 0x7efdb006a140 2023-10-06T04:44:55.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.195+0000 7efdb4bff700 1 -- 172.21.15.124:0/1024967244 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb014a8e0 con 0x7efdb006a140 2023-10-06T04:44:55.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.196+0000 7efdb4bff700 1 -- 172.21.15.124:0/1024967244 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb00717a0 con 0x7efdb006a140 2023-10-06T04:44:55.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.197+0000 7efd9e7fc700 1 -- 172.21.15.124:0/1024967244 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efda001b3b0 con 0x7efdb006a140 2023-10-06T04:44:55.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.198+0000 7efd9e7fc700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd90066f30 0x7efd900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:55.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.198+0000 7efd9e7fc700 1 -- 172.21.15.124:0/1024967244 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efda0083b00 con 0x7efdb006a140 2023-10-06T04:44:55.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.198+0000 7efdadd9b700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd90066f30 0x7efd900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:55.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.199+0000 7efdadd9b700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd90066f30 0x7efd900693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efdb006e840 tx=0x7efda40091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:55.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.202+0000 7efd9e7fc700 1 -- 172.21.15.124:0/1024967244 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efda0050c10 con 0x7efdb006a140 2023-10-06T04:44:55.436 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.433+0000 7efdb4bff700 1 -- 172.21.15.124:0/1024967244 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efdb016af10 con 0x7efdb006a140 2023-10-06T04:44:55.436 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.434+0000 7efd9e7fc700 1 -- 172.21.15.124:0/1024967244 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7efda0017070 con 0x7efdb006a140 2023-10-06T04:44:55.436 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:44:55.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 -- 172.21.15.124:0/1024967244 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd90066f30 msgr2=0x7efd900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:55.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd90066f30 0x7efd900693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efdb006e840 tx=0x7efda40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 -- 172.21.15.124:0/1024967244 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 msgr2=0x7efdb014a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:55.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 0x7efdb014a3a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efda000c590 tx=0x7efda000c8a0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 -- 172.21.15.124:0/1024967244 shutdown_connections 2023-10-06T04:44:55.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdb00b1a70 0x7efdb00990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdb006a140 0x7efdb014a3a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd90066f30 0x7efd900693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 --2- 172.21.15.124:0/1024967244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb00ac3d0 0x7efdb0098b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:55.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 -- 172.21.15.124:0/1024967244 >> 172.21.15.124:0/1024967244 conn(0x7efdb00cc050 msgr2=0x7efdb0155660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:55.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 -- 172.21.15.124:0/1024967244 shutdown_connections 2023-10-06T04:44:55.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:55.436+0000 7efdb4bff700 1 -- 172.21.15.124:0/1024967244 wait complete. 2023-10-06T04:44:55.456 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:44:55.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:44:55.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-06T04:44:55.456 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T04:44:55.456 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T04:44:55.456 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:44:55.456 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:44:55.456 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:44:55.456 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:44:55.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:55.457 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-06T04:44:55.504 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:44:55.504 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:44:55.505 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:44:55.505 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:55.505 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-06T04:44:55.505 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:55.505 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:55.505 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:55.505 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-06T04:44:55.505 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:55.505 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:55.505 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-06T04:44:55.506 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:55.506 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:55.506 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:44:55.506 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:55.506 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:44:55.506 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42305sec preferred_lft 42305sec 2023-10-06T04:44:55.506 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-06T04:44:55.506 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:55.506 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:44:55.506 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether c6:b4:69:7b:ef:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:55.507 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:44:55.507 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:55.507 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::6c85:f9ff:feed:e766/64 scope link 2023-10-06T04:44:55.507 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:55.507 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:44:55.507 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether c6:b4:69:7b:ef:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:44:55.507 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c4b4:69ff:fe7b:ef18/64 scope link 2023-10-06T04:44:55.507 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:55.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:55.508 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:44:55.575 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-06T04:44:55.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:55.578 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-06T04:44:55.627 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-06T04:44:55.627 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:44:55.627 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:44:55.627 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:44:55.627 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:44:55.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:55.628 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T04:44:55.628 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T04:44:55.628 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:44:55.629 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:44:55.629 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:44:55.629 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T04:44:55.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:55.800 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-06T04:44:55.846 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:44:55.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:55.847 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list-id 2023-10-06T04:44:55.934 INFO:teuthology.orchestra.run.smithi158.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T04:44:55.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:55.935 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T04:44:55.935 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T04:44:55.935 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:44:55.935 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T04:44:55.935 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T04:44:56.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:56.081 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:44:56.152 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:44:56.153 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:44:56.153 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:44:56.153 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:56.153 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-06T04:44:56.153 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:56.153 INFO:teuthology.orchestra.run.smithi158.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:44:56.154 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 12:7e:0f:58:49:3a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:44:56.154 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:44:56.154 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:56.154 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::107e:fff:fe58:493a/64 scope link tentative 2023-10-06T04:44:56.154 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:56.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:56.155 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:44:56.226 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:44:56.226 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:44:56.226 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:44:56.227 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:56.227 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-06T04:44:56.227 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:56.227 INFO:teuthology.orchestra.run.smithi158.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:44:56.227 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 12:7e:0f:58:49:3a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:44:56.227 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:44:56.227 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:56.227 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::107e:fff:fe58:493a/64 scope link 2023-10-06T04:44:56.227 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:56.229 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T04:44:56.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:56.229 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T04:44:56.230 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T04:44:56.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T04:44:56.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:44:56.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T04:44:56.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T04:44:56.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T04:44:56.231 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T04:44:56.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:56.474 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T04:44:56.474 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T04:44:56.474 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.1 up 2023-10-06T04:44:56.474 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:44:56.474 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T04:44:56.647 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:44:56.647 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T04:44:56.694 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:44:56.694 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:44:56.694 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:44:56.780 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-06T04:44:56.780 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:44:56.780 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:56.919 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:56.919 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:44:56.944 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:44:56.944 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:44:56.944 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-06T04:44:56.945 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 3@8703c690-5fd4-410f-8b5d-95264116cbcb.cephfs=/ 2023-10-06T04:44:56.945 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.124:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-06T04:44:56.948 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:44:56.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:56.948 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:44:57.019 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T04:44:57.036 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:57.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.247+0000 7f7c36dff700 1 Processor -- start 2023-10-06T04:44:57.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.247+0000 7f7c36dff700 1 -- start start 2023-10-06T04:44:57.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c36dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c300cb250 0x7f7c301591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c36dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7c30159710 0x7f7c300afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c36dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c300c1d10 con 0x7f7c300cae80 2023-10-06T04:44:57.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c36dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c300cd430 con 0x7f7c30159710 2023-10-06T04:44:57.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c36dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c30159b70 con 0x7f7c300cb250 2023-10-06T04:44:57.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c3539c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7c30159710 0x7f7c300afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c3539c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7c30159710 0x7f7c300afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54772/0 (socket says 172.21.15.124:54772) 2023-10-06T04:44:57.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c3539c700 1 -- 172.21.15.124:0/3271521598 learned_addr learned my addr 172.21.15.124:0/3271521598 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:57.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c2ffff700 1 --2- 172.21.15.124:0/3271521598 >> v2:172.21.15.158:3300/0 conn(0x7f7c300cb250 0x7f7c301591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c3539c700 1 -- 172.21.15.124:0/3271521598 >> v2:172.21.15.158:3300/0 conn(0x7f7c300cb250 msgr2=0x7f7c301591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.249+0000 7f7c3539c700 1 --2- 172.21.15.124:0/3271521598 >> v2:172.21.15.158:3300/0 conn(0x7f7c300cb250 0x7f7c301591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.250+0000 7f7c3539c700 1 -- 172.21.15.124:0/3271521598 >> v1:172.21.15.158:6789/0 conn(0x7f7c300cae80 legacy=0x7f7c300cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.250+0000 7f7c3539c700 1 -- 172.21.15.124:0/3271521598 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300688a0 con 0x7f7c30159710 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.250+0000 7f7c3539c700 1 --2- 172.21.15.124:0/3271521598 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 0x7f7c300afe40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c30088750 tx=0x7f7c28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bd23b5bff3de70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.250+0000 7f7c2f7fe700 1 -- 172.21.15.124:0/3271521598 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800e070 con 0x7f7c30159710 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.250+0000 7f7c2f7fe700 1 -- 172.21.15.124:0/3271521598 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2800ba50 con 0x7f7c30159710 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.250+0000 7f7c2f7fe700 1 -- 172.21.15.124:0/3271521598 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280092e0 con 0x7f7c30159710 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.251+0000 7f7c36dff700 1 -- 172.21.15.124:0/3271521598 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 msgr2=0x7f7c300afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.251+0000 7f7c36dff700 1 --2- 172.21.15.124:0/3271521598 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 0x7f7c300afe40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c30088750 tx=0x7f7c28009840 comp rx=0 tx=0).stop 2023-10-06T04:44:57.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.251+0000 7f7c36dff700 1 -- 172.21.15.124:0/3271521598 shutdown_connections 2023-10-06T04:44:57.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.251+0000 7f7c36dff700 1 --2- 172.21.15.124:0/3271521598 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 0x7f7c300afe40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.251+0000 7f7c36dff700 1 --2- 172.21.15.124:0/3271521598 >> v2:172.21.15.158:3300/0 conn(0x7f7c300cb250 0x7f7c301591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.251+0000 7f7c36dff700 1 -- 172.21.15.124:0/3271521598 >> 172.21.15.124:0/3271521598 conn(0x7f7c300974f0 msgr2=0x7f7c300639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:57.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.251+0000 7f7c36dff700 1 -- 172.21.15.124:0/3271521598 shutdown_connections 2023-10-06T04:44:57.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.251+0000 7f7c36dff700 1 -- 172.21.15.124:0/3271521598 wait complete. 2023-10-06T04:44:57.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.252+0000 7f7c36dff700 1 Processor -- start 2023-10-06T04:44:57.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.252+0000 7f7c36dff700 1 -- start start 2023-10-06T04:44:57.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.253+0000 7f7c36dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c300cae80 0x7f7c30156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.253+0000 7f7c36dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c300cb250 0x7f7c301574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.253+0000 7f7c36dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 0x7f7c30157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.253+0000 7f7c36dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3009b640 con 0x7f7c30159710 2023-10-06T04:44:57.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.253+0000 7f7c36dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300c54d0 con 0x7f7c300cb250 2023-10-06T04:44:57.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.253+0000 7f7c36dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3009ada0 con 0x7f7c300cae80 2023-10-06T04:44:57.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c3539c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 0x7f7c30157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c3539c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 0x7f7c30157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54778/0 (socket says 172.21.15.124:54778) 2023-10-06T04:44:57.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c3539c700 1 -- 172.21.15.124:0/2222892151 learned_addr learned my addr 172.21.15.124:0/2222892151 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:57.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c2ffff700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c300cb250 0x7f7c301574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c34b9b700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c300cae80 0x7f7c30156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c3539c700 1 -- 172.21.15.124:0/2222892151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c300cae80 msgr2=0x7f7c30156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c3539c700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c300cae80 0x7f7c30156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c3539c700 1 -- 172.21.15.124:0/2222892151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c300cb250 msgr2=0x7f7c301574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c3539c700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c300cb250 0x7f7c301574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c3539c700 1 -- 172.21.15.124:0/2222892151 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28009ae0 con 0x7f7c30159710 2023-10-06T04:44:57.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c2ffff700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c300cb250 0x7f7c301574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:57.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.254+0000 7f7c3539c700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 0x7f7c30157a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7c300641d0 tx=0x7f7c28018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:57.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.255+0000 7f7c2cff9700 1 -- 172.21.15.124:0/2222892151 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800be60 con 0x7f7c30159710 2023-10-06T04:44:57.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.255+0000 7f7c2cff9700 1 -- 172.21.15.124:0/2222892151 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c28008d20 con 0x7f7c30159710 2023-10-06T04:44:57.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.255+0000 7f7c2cff9700 1 -- 172.21.15.124:0/2222892151 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280256b0 con 0x7f7c30159710 2023-10-06T04:44:57.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.255+0000 7f7c36dff700 1 -- 172.21.15.124:0/2222892151 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3009b080 con 0x7f7c30159710 2023-10-06T04:44:57.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.255+0000 7f7c36dff700 1 -- 172.21.15.124:0/2222892151 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c30156d70 con 0x7f7c30159710 2023-10-06T04:44:57.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.256+0000 7f7c36dff700 1 -- 172.21.15.124:0/2222892151 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c300c52a0 con 0x7f7c30159710 2023-10-06T04:44:57.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.257+0000 7f7c2cff9700 1 -- 172.21.15.124:0/2222892151 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c28003040 con 0x7f7c30159710 2023-10-06T04:44:57.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.258+0000 7f7c2cff9700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c14066f30 0x7f7c140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.258+0000 7f7c2cff9700 1 -- 172.21.15.124:0/2222892151 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7c28085cc0 con 0x7f7c30159710 2023-10-06T04:44:57.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.258+0000 7f7c34b9b700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c14066f30 0x7f7c140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.258+0000 7f7c34b9b700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c14066f30 0x7f7c140693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c24003a80 tx=0x7f7c24007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:57.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.262+0000 7f7c2cff9700 1 -- 172.21.15.124:0/2222892151 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c300c52a0 con 0x7f7c30159710 2023-10-06T04:44:57.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.457+0000 7f7c36dff700 1 -- 172.21.15.124:0/2222892151 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c300c52a0 con 0x7f7c30159710 2023-10-06T04:44:57.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.458+0000 7f7c2cff9700 1 -- 172.21.15.124:0/2222892151 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f7c300c52a0 con 0x7f7c30159710 2023-10-06T04:44:57.460 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:57.460 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 -- 172.21.15.124:0/2222892151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c14066f30 msgr2=0x7f7c140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c14066f30 0x7f7c140693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c24003a80 tx=0x7f7c24007ec0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 -- 172.21.15.124:0/2222892151 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 msgr2=0x7f7c30157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 0x7f7c30157a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7c300641d0 tx=0x7f7c28018000 comp rx=0 tx=0).stop 2023-10-06T04:44:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 -- 172.21.15.124:0/2222892151 shutdown_connections 2023-10-06T04:44:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c30159710 0x7f7c30157a30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7c14066f30 0x7f7c140693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c300cae80 0x7f7c30156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 --2- 172.21.15.124:0/2222892151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c300cb250 0x7f7c301574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 -- 172.21.15.124:0/2222892151 >> 172.21.15.124:0/2222892151 conn(0x7f7c300974f0 msgr2=0x7f7c30158680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:57.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 -- 172.21.15.124:0/2222892151 shutdown_connections 2023-10-06T04:44:57.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.461+0000 7f7c36dff700 1 -- 172.21.15.124:0/2222892151 wait complete. 2023-10-06T04:44:57.480 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:44:25.771714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:44:26.609661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:44:57.481 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:44:57.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.672+0000 7fa48a5ff700 1 Processor -- start 2023-10-06T04:44:57.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.672+0000 7fa48a5ff700 1 -- start start 2023-10-06T04:44:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.672+0000 7fa48a5ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa484069bd0 0x7fa484155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.672+0000 7fa48a5ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa4841596c0 0x7fa484156110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.672+0000 7fa48a5ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48406e240 con 0x7fa484155800 2023-10-06T04:44:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.672+0000 7fa48a5ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4841582a0 con 0x7fa484069bd0 2023-10-06T04:44:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.672+0000 7fa48a5ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48406d630 con 0x7fa4841596c0 2023-10-06T04:44:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.672+0000 7fa4837fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa484069bd0 0x7fa484155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa4837fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa484069bd0 0x7fa484155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54788/0 (socket says 172.21.15.124:54788) 2023-10-06T04:44:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa483fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa484155800 0x7fa4840694c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50186/0 (socket says 172.21.15.124:50186) 2023-10-06T04:44:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa4837fe700 1 -- 172.21.15.124:0/1274816472 learned_addr learned my addr 172.21.15.124:0/1274816472 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa488b9c700 1 --2- 172.21.15.124:0/1274816472 >> v2:172.21.15.158:3300/0 conn(0x7fa4841596c0 0x7fa484156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa4837fe700 1 -- 172.21.15.124:0/1274816472 >> v2:172.21.15.158:3300/0 conn(0x7fa4841596c0 msgr2=0x7fa484156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa4837fe700 1 --2- 172.21.15.124:0/1274816472 >> v2:172.21.15.158:3300/0 conn(0x7fa4841596c0 0x7fa484156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa4837fe700 1 -- 172.21.15.124:0/1274816472 >> v1:172.21.15.124:6789/0 conn(0x7fa484155800 legacy=0x7fa4840694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa4837fe700 1 -- 172.21.15.124:0/1274816472 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48406d910 con 0x7fa484069bd0 2023-10-06T04:44:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa482ffd700 1 -- 172.21.15.124:0/1274816472 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405229806 0 0) 0x7fa48406e240 con 0x7fa484155800 2023-10-06T04:44:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa4837fe700 1 --2- 172.21.15.124:0/1274816472 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 0x7fa484155bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa4840c8a30 tx=0x7fa478009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f9bcaf8dc01e97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa482ffd700 1 -- 172.21.15.124:0/1274816472 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478009e70 con 0x7fa484069bd0 2023-10-06T04:44:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.673+0000 7fa482ffd700 1 -- 172.21.15.124:0/1274816472 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47800c970 con 0x7fa484069bd0 2023-10-06T04:44:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.674+0000 7fa482ffd700 1 -- 172.21.15.124:0/1274816472 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800cd10 con 0x7fa484069bd0 2023-10-06T04:44:57.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.674+0000 7fa48a5ff700 1 -- 172.21.15.124:0/1274816472 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 msgr2=0x7fa484155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.674+0000 7fa48a5ff700 1 --2- 172.21.15.124:0/1274816472 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 0x7fa484155bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa4840c8a30 tx=0x7fa478009250 comp rx=0 tx=0).stop 2023-10-06T04:44:57.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.674+0000 7fa48a5ff700 1 -- 172.21.15.124:0/1274816472 shutdown_connections 2023-10-06T04:44:57.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.674+0000 7fa48a5ff700 1 --2- 172.21.15.124:0/1274816472 >> v2:172.21.15.158:3300/0 conn(0x7fa4841596c0 0x7fa484156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.674+0000 7fa48a5ff700 1 --2- 172.21.15.124:0/1274816472 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 0x7fa484155bd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.674+0000 7fa48a5ff700 1 -- 172.21.15.124:0/1274816472 >> 172.21.15.124:0/1274816472 conn(0x7fa4840680c0 msgr2=0x7fa4840cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:57.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.674+0000 7fa48a5ff700 1 -- 172.21.15.124:0/1274816472 shutdown_connections 2023-10-06T04:44:57.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.674+0000 7fa48a5ff700 1 -- 172.21.15.124:0/1274816472 wait complete. 2023-10-06T04:44:57.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.676+0000 7fa48a5ff700 1 Processor -- start 2023-10-06T04:44:57.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.676+0000 7fa48a5ff700 1 -- start start 2023-10-06T04:44:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa48a5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 0x7fa484147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa48a5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa484155800 0x7fa484156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa48a5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4841596c0 0x7fa4840af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa48a5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840c3020 con 0x7fa484069bd0 2023-10-06T04:44:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa48a5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa484157a10 con 0x7fa4841596c0 2023-10-06T04:44:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa48a5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa484157cf0 con 0x7fa484155800 2023-10-06T04:44:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa483fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 0x7fa484147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa483fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 0x7fa484147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54802/0 (socket says 172.21.15.124:54802) 2023-10-06T04:44:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa483fff700 1 -- 172.21.15.124:0/616475876 learned_addr learned my addr 172.21.15.124:0/616475876 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa4837fe700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa484155800 0x7fa484156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa488b9c700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4841596c0 0x7fa4840af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa483fff700 1 -- 172.21.15.124:0/616475876 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa484155800 msgr2=0x7fa484156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa483fff700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa484155800 0x7fa484156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa483fff700 1 -- 172.21.15.124:0/616475876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4841596c0 msgr2=0x7fa4840af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa483fff700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4841596c0 0x7fa4840af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.677+0000 7fa483fff700 1 -- 172.21.15.124:0/616475876 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4780094f0 con 0x7fa484069bd0 2023-10-06T04:44:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.678+0000 7fa483fff700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 0x7fa484147f80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa4740011e0 tx=0x7fa474007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.678+0000 7fa46bfff700 1 -- 172.21.15.124:0/616475876 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474005a70 con 0x7fa484069bd0 2023-10-06T04:44:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.678+0000 7fa46bfff700 1 -- 172.21.15.124:0/616475876 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa474005bd0 con 0x7fa484069bd0 2023-10-06T04:44:57.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.678+0000 7fa46bfff700 1 -- 172.21.15.124:0/616475876 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4740070d0 con 0x7fa484069bd0 2023-10-06T04:44:57.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.678+0000 7fa48a5ff700 1 -- 172.21.15.124:0/616475876 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4840a9940 con 0x7fa484069bd0 2023-10-06T04:44:57.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.678+0000 7fa48a5ff700 1 -- 172.21.15.124:0/616475876 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa484157fd0 con 0x7fa484069bd0 2023-10-06T04:44:57.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.679+0000 7fa48a5ff700 1 -- 172.21.15.124:0/616475876 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa484064850 con 0x7fa484069bd0 2023-10-06T04:44:57.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.680+0000 7fa46bfff700 1 -- 172.21.15.124:0/616475876 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa474007480 con 0x7fa484069bd0 2023-10-06T04:44:57.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.681+0000 7fa46bfff700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa470066f30 0x7fa4700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:57.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.681+0000 7fa46bfff700 1 -- 172.21.15.124:0/616475876 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa474083b40 con 0x7fa484069bd0 2023-10-06T04:44:57.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.681+0000 7fa4837fe700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa470066f30 0x7fa4700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:57.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.682+0000 7fa4837fe700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa470066f30 0x7fa4700693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4840c8a30 tx=0x7fa478018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:57.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.685+0000 7fa46bfff700 1 -- 172.21.15.124:0/616475876 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa474050c50 con 0x7fa484069bd0 2023-10-06T04:44:57.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.875+0000 7fa48a5ff700 1 -- 172.21.15.124:0/616475876 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa48404c380 con 0x7fa484069bd0 2023-10-06T04:44:57.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.876+0000 7fa46bfff700 1 -- 172.21.15.124:0/616475876 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa474017070 con 0x7fa484069bd0 2023-10-06T04:44:57.878 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:44:57.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 -- 172.21.15.124:0/616475876 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa470066f30 msgr2=0x7fa4700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa470066f30 0x7fa4700693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4840c8a30 tx=0x7fa478018000 comp rx=0 tx=0).stop 2023-10-06T04:44:57.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 -- 172.21.15.124:0/616475876 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 msgr2=0x7fa484147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:57.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 0x7fa484147f80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa4740011e0 tx=0x7fa474007e10 comp rx=0 tx=0).stop 2023-10-06T04:44:57.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 -- 172.21.15.124:0/616475876 shutdown_connections 2023-10-06T04:44:57.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4841596c0 0x7fa4840af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa484069bd0 0x7fa484147f80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa470066f30 0x7fa4700693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 --2- 172.21.15.124:0/616475876 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa484155800 0x7fa484156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:57.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 -- 172.21.15.124:0/616475876 >> 172.21.15.124:0/616475876 conn(0x7fa4840680c0 msgr2=0x7fa4840ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:57.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 -- 172.21.15.124:0/616475876 shutdown_connections 2023-10-06T04:44:57.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:57.879+0000 7fa48a5ff700 1 -- 172.21.15.124:0/616475876 wait complete. 2023-10-06T04:44:57.898 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:44:58.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.093+0000 7ff5e93ff700 1 Processor -- start 2023-10-06T04:44:58.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.093+0000 7ff5e93ff700 1 -- start start 2023-10-06T04:44:58.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.094+0000 7ff5e93ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff5e40cca10 0x7ff5e40c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.094+0000 7ff5e93ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff5e40c6af0 0x7ff5e40adc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.094+0000 7ff5e93ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e40ad790 con 0x7ff5e41562b0 2023-10-06T04:44:58.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.094+0000 7ff5e93ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e40acb80 con 0x7ff5e40c6af0 2023-10-06T04:44:58.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.094+0000 7ff5e93ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e40ace60 con 0x7ff5e40cca10 2023-10-06T04:44:58.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e37fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff5e40c6af0 0x7ff5e40adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e37fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff5e40c6af0 0x7ff5e40adc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54810/0 (socket says 172.21.15.124:54810) 2023-10-06T04:44:58.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e37fe700 1 -- 172.21.15.124:0/3447174908 learned_addr learned my addr 172.21.15.124:0/3447174908 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:58.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e27fc700 1 --2- 172.21.15.124:0/3447174908 >> v2:172.21.15.158:3300/0 conn(0x7ff5e40cca10 0x7ff5e40c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e37fe700 1 -- 172.21.15.124:0/3447174908 >> v2:172.21.15.158:3300/0 conn(0x7ff5e40cca10 msgr2=0x7ff5e40c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:58.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e37fe700 1 --2- 172.21.15.124:0/3447174908 >> v2:172.21.15.158:3300/0 conn(0x7ff5e40cca10 0x7ff5e40c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e37fe700 1 -- 172.21.15.124:0/3447174908 >> v1:172.21.15.158:6789/0 conn(0x7ff5e41562b0 legacy=0x7ff5e415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e37fe700 1 -- 172.21.15.124:0/3447174908 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e40ad140 con 0x7ff5e40c6af0 2023-10-06T04:44:58.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e37fe700 1 --2- 172.21.15.124:0/3447174908 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 0x7ff5e40adc20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4068570 tx=0x7ff5dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8ddf78e4621f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:58.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e1ffb700 1 -- 172.21.15.124:0/3447174908 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc00e070 con 0x7ff5e40c6af0 2023-10-06T04:44:58.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e1ffb700 1 -- 172.21.15.124:0/3447174908 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc00ba20 con 0x7ff5e40c6af0 2023-10-06T04:44:58.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e1ffb700 1 -- 172.21.15.124:0/3447174908 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0092e0 con 0x7ff5e40c6af0 2023-10-06T04:44:58.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e93ff700 1 -- 172.21.15.124:0/3447174908 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 msgr2=0x7ff5e40adc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e93ff700 1 --2- 172.21.15.124:0/3447174908 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 0x7ff5e40adc20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4068570 tx=0x7ff5dc009840 comp rx=0 tx=0).stop 2023-10-06T04:44:58.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e93ff700 1 -- 172.21.15.124:0/3447174908 shutdown_connections 2023-10-06T04:44:58.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e93ff700 1 --2- 172.21.15.124:0/3447174908 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 0x7ff5e40adc20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e93ff700 1 --2- 172.21.15.124:0/3447174908 >> v2:172.21.15.158:3300/0 conn(0x7ff5e40cca10 0x7ff5e40c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e93ff700 1 -- 172.21.15.124:0/3447174908 >> 172.21.15.124:0/3447174908 conn(0x7ff5e40680c0 msgr2=0x7ff5e40cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:58.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e93ff700 1 -- 172.21.15.124:0/3447174908 shutdown_connections 2023-10-06T04:44:58.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.096+0000 7ff5e93ff700 1 -- 172.21.15.124:0/3447174908 wait complete. 2023-10-06T04:44:58.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.098+0000 7ff5e93ff700 1 Processor -- start 2023-10-06T04:44:58.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.098+0000 7ff5e93ff700 1 -- start start 2023-10-06T04:44:58.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e93ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 0x7ff5e4150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e93ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5e40cca10 0x7ff5e414ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e93ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41562b0 0x7ff5e414f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e93ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e414bda0 con 0x7ff5e40c6af0 2023-10-06T04:44:58.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e93ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e4151120 con 0x7ff5e41562b0 2023-10-06T04:44:58.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e93ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e414bf00 con 0x7ff5e40cca10 2023-10-06T04:44:58.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e2ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 0x7ff5e4150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e2ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 0x7ff5e4150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54824/0 (socket says 172.21.15.124:54824) 2023-10-06T04:44:58.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e2ffd700 1 -- 172.21.15.124:0/1621689584 learned_addr learned my addr 172.21.15.124:0/1621689584 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:58.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e37fe700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41562b0 0x7ff5e414f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e27fc700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5e40cca10 0x7ff5e414ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e2ffd700 1 -- 172.21.15.124:0/1621689584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5e40cca10 msgr2=0x7ff5e414ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e2ffd700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5e40cca10 0x7ff5e414ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e2ffd700 1 -- 172.21.15.124:0/1621689584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41562b0 msgr2=0x7ff5e414f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e2ffd700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41562b0 0x7ff5e414f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e2ffd700 1 -- 172.21.15.124:0/1621689584 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc009ae0 con 0x7ff5e40c6af0 2023-10-06T04:44:58.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.099+0000 7ff5e27fc700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5e40cca10 0x7ff5e414ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:58.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.100+0000 7ff5e2ffd700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 0x7ff5e4150940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c510 tx=0x7ff5d400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:58.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.100+0000 7ff5caffd700 1 -- 172.21.15.124:0/1621689584 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4011590 con 0x7ff5e40c6af0 2023-10-06T04:44:58.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.100+0000 7ff5caffd700 1 -- 172.21.15.124:0/1621689584 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d4011710 con 0x7ff5e40c6af0 2023-10-06T04:44:58.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.100+0000 7ff5caffd700 1 -- 172.21.15.124:0/1621689584 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4011ad0 con 0x7ff5e40c6af0 2023-10-06T04:44:58.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.100+0000 7ff5e93ff700 1 -- 172.21.15.124:0/1621689584 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e4150e80 con 0x7ff5e40c6af0 2023-10-06T04:44:58.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.100+0000 7ff5e93ff700 1 -- 172.21.15.124:0/1621689584 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e40c53d0 con 0x7ff5e40c6af0 2023-10-06T04:44:58.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.101+0000 7ff5e93ff700 1 -- 172.21.15.124:0/1621689584 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e40c8340 con 0x7ff5e40c6af0 2023-10-06T04:44:58.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.102+0000 7ff5caffd700 1 -- 172.21.15.124:0/1621689584 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5d401b3b0 con 0x7ff5e40c6af0 2023-10-06T04:44:58.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.103+0000 7ff5caffd700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff5d0066f30 0x7ff5d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.103+0000 7ff5caffd700 1 -- 172.21.15.124:0/1621689584 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff5d4083b10 con 0x7ff5e40c6af0 2023-10-06T04:44:58.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.104+0000 7ff5e27fc700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff5d0066f30 0x7ff5d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.104+0000 7ff5e27fc700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff5d0066f30 0x7ff5d00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40ccde0 tx=0x7ff5d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:58.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.108+0000 7ff5caffd700 1 -- 172.21.15.124:0/1621689584 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5d4050c20 con 0x7ff5e40c6af0 2023-10-06T04:44:58.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.296+0000 7ff5e93ff700 1 -- 172.21.15.124:0/1621689584 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5e4064850 con 0x7ff5e40c6af0 2023-10-06T04:44:58.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.297+0000 7ff5caffd700 1 -- 172.21.15.124:0/1621689584 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5d4017070 con 0x7ff5e40c6af0 2023-10-06T04:44:58.300 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:44:58.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 -- 172.21.15.124:0/1621689584 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff5d0066f30 msgr2=0x7ff5d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff5d0066f30 0x7ff5d00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40ccde0 tx=0x7ff5d8008040 comp rx=0 tx=0).stop 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 -- 172.21.15.124:0/1621689584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 msgr2=0x7ff5e4150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 0x7ff5e4150940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c510 tx=0x7ff5d400c820 comp rx=0 tx=0).stop 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 -- 172.21.15.124:0/1621689584 shutdown_connections 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41562b0 0x7ff5e414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff5e40c6af0 0x7ff5e4150940 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff5d0066f30 0x7ff5d00693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 --2- 172.21.15.124:0/1621689584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5e40cca10 0x7ff5e414ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 -- 172.21.15.124:0/1621689584 >> 172.21.15.124:0/1621689584 conn(0x7ff5e40680c0 msgr2=0x7ff5e406d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 -- 172.21.15.124:0/1621689584 shutdown_connections 2023-10-06T04:44:58.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.299+0000 7ff5e93ff700 1 -- 172.21.15.124:0/1621689584 wait complete. 2023-10-06T04:44:58.319 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:44:58.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.509+0000 7efc5afff700 1 Processor -- start 2023-10-06T04:44:58.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.510+0000 7efc5afff700 1 -- start start 2023-10-06T04:44:58.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.511+0000 7efc5afff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efc54156680 0x7efc540adc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.511+0000 7efc5afff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc540ad790 con 0x7efc540cca10 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.511+0000 7efc5afff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc540acb80 con 0x7efc541562b0 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.511+0000 7efc5afff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc540ace60 con 0x7efc54156680 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.511+0000 7efc5959c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efc54156680 0x7efc540adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.511+0000 7efc53fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7efc540cca10 0x7efc540c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50190/0 (socket says 172.21.15.124:50190) 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.511+0000 7efc53fff700 1 -- 172.21.15.124:0/3098538126 learned_addr learned my addr 172.21.15.124:0/3098538126 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.512+0000 7efc5959c700 1 -- 172.21.15.124:0/3098538126 >> v1:172.21.15.158:6789/0 conn(0x7efc541562b0 legacy=0x7efc5415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.512+0000 7efc5959c700 1 -- 172.21.15.124:0/3098538126 >> v1:172.21.15.124:6789/0 conn(0x7efc540cca10 legacy=0x7efc540c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.512+0000 7efc5959c700 1 -- 172.21.15.124:0/3098538126 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540ad140 con 0x7efc54156680 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.512+0000 7efc5959c700 1 --2- 172.21.15.124:0/3098538126 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc54156680 0x7efc540adc20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009e60 tx=0x7efc4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd9faa0cc4387df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.512+0000 7efc537fe700 1 -- 172.21.15.124:0/3098538126 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00e070 con 0x7efc54156680 2023-10-06T04:44:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.512+0000 7efc537fe700 1 -- 172.21.15.124:0/3098538126 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c00bbf0 con 0x7efc54156680 2023-10-06T04:44:58.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.512+0000 7efc537fe700 1 -- 172.21.15.124:0/3098538126 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c012430 con 0x7efc54156680 2023-10-06T04:44:58.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.513+0000 7efc5afff700 1 -- 172.21.15.124:0/3098538126 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc54156680 msgr2=0x7efc540adc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.513+0000 7efc5afff700 1 --2- 172.21.15.124:0/3098538126 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc54156680 0x7efc540adc20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009e60 tx=0x7efc4c009780 comp rx=0 tx=0).stop 2023-10-06T04:44:58.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.513+0000 7efc5afff700 1 -- 172.21.15.124:0/3098538126 shutdown_connections 2023-10-06T04:44:58.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.513+0000 7efc5afff700 1 --2- 172.21.15.124:0/3098538126 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc54156680 0x7efc540adc20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.513+0000 7efc5afff700 1 -- 172.21.15.124:0/3098538126 >> 172.21.15.124:0/3098538126 conn(0x7efc540680c0 msgr2=0x7efc540cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:58.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.513+0000 7efc5afff700 1 -- 172.21.15.124:0/3098538126 shutdown_connections 2023-10-06T04:44:58.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.513+0000 7efc5afff700 1 -- 172.21.15.124:0/3098538126 wait complete. 2023-10-06T04:44:58.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.515+0000 7efc5afff700 1 Processor -- start 2023-10-06T04:44:58.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.515+0000 7efc5afff700 1 -- start start 2023-10-06T04:44:58.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc5afff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc540cca10 0x7efc540c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc5afff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc541562b0 0x7efc5414f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc5afff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc54156680 0x7efc540c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc5afff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc540c5f10 con 0x7efc541562b0 2023-10-06T04:44:58.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc5afff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc540c5ce0 con 0x7efc540cca10 2023-10-06T04:44:58.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc5afff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc541546b0 con 0x7efc54156680 2023-10-06T04:44:58.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc53fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc541562b0 0x7efc5414f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc53fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc541562b0 0x7efc5414f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54844/0 (socket says 172.21.15.124:54844) 2023-10-06T04:44:58.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc53fff700 1 -- 172.21.15.124:0/3689733215 learned_addr learned my addr 172.21.15.124:0/3689733215 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc5959c700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc54156680 0x7efc540c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc58d9b700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc540cca10 0x7efc540c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc53fff700 1 -- 172.21.15.124:0/3689733215 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc54156680 msgr2=0x7efc540c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc53fff700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc54156680 0x7efc540c6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc53fff700 1 -- 172.21.15.124:0/3689733215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc540cca10 msgr2=0x7efc540c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc53fff700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc540cca10 0x7efc540c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc53fff700 1 -- 172.21.15.124:0/3689733215 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c009a20 con 0x7efc541562b0 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc5959c700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc54156680 0x7efc540c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc53fff700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc541562b0 0x7efc5414f880 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efc4000c790 tx=0x7efc40007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc50ff9700 1 -- 172.21.15.124:0/3689733215 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40005b30 con 0x7efc541562b0 2023-10-06T04:44:58.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc50ff9700 1 -- 172.21.15.124:0/3689733215 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40005c90 con 0x7efc541562b0 2023-10-06T04:44:58.522 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc50ff9700 1 -- 172.21.15.124:0/3689733215 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40004a80 con 0x7efc541562b0 2023-10-06T04:44:58.522 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.517+0000 7efc5afff700 1 -- 172.21.15.124:0/3689733215 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc54154990 con 0x7efc541562b0 2023-10-06T04:44:58.522 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.518+0000 7efc5afff700 1 -- 172.21.15.124:0/3689733215 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc54154f50 con 0x7efc541562b0 2023-10-06T04:44:58.522 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.519+0000 7efc5afff700 1 -- 172.21.15.124:0/3689733215 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc54064850 con 0x7efc541562b0 2023-10-06T04:44:58.522 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.519+0000 7efc50ff9700 1 -- 172.21.15.124:0/3689733215 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc400070d0 con 0x7efc541562b0 2023-10-06T04:44:58.523 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.521+0000 7efc50ff9700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efc38066f30 0x7efc380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.523 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.521+0000 7efc50ff9700 1 -- 172.21.15.124:0/3689733215 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efc40083ab0 con 0x7efc541562b0 2023-10-06T04:44:58.523 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.521+0000 7efc58d9b700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efc38066f30 0x7efc380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.524 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.522+0000 7efc58d9b700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efc38066f30 0x7efc380693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efc48003a30 tx=0x7efc48007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:58.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.526+0000 7efc50ff9700 1 -- 172.21.15.124:0/3689733215 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc4004b5a0 con 0x7efc541562b0 2023-10-06T04:44:58.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.715+0000 7efc5afff700 1 -- 172.21.15.124:0/3689733215 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc5404c380 con 0x7efc541562b0 2023-10-06T04:44:58.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.716+0000 7efc50ff9700 1 -- 172.21.15.124:0/3689733215 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc40050b20 con 0x7efc541562b0 2023-10-06T04:44:58.717 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-06T04:44:58.718 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:44:58.723 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:44:58.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 -- 172.21.15.124:0/3689733215 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efc38066f30 msgr2=0x7efc380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efc38066f30 0x7efc380693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efc48003a30 tx=0x7efc48007ea0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 -- 172.21.15.124:0/3689733215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc541562b0 msgr2=0x7efc5414f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc541562b0 0x7efc5414f880 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efc4000c790 tx=0x7efc40007f40 comp rx=0 tx=0).stop 2023-10-06T04:44:58.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 -- 172.21.15.124:0/3689733215 shutdown_connections 2023-10-06T04:44:58.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efc38066f30 0x7efc380693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc54156680 0x7efc540c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc540cca10 0x7efc540c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 --2- 172.21.15.124:0/3689733215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc541562b0 0x7efc5414f880 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 -- 172.21.15.124:0/3689733215 >> 172.21.15.124:0/3689733215 conn(0x7efc540680c0 msgr2=0x7efc54152b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:58.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 -- 172.21.15.124:0/3689733215 shutdown_connections 2023-10-06T04:44:58.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.718+0000 7efc5afff700 1 -- 172.21.15.124:0/3689733215 wait complete. 2023-10-06T04:44:58.739 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:44:58.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.971+0000 7f85c09ff700 1 Processor -- start 2023-10-06T04:44:58.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.971+0000 7f85c09ff700 1 -- start start 2023-10-06T04:44:58.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.972+0000 7f85c09ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc159680 0x7f85bc0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.972+0000 7f85c09ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f85bc0cc780 0x7f85bc0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.972+0000 7f85c09ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc15d620 con 0x7f85bc1592b0 2023-10-06T04:44:58.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.972+0000 7f85c09ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc15d0d0 con 0x7f85bc0cc780 2023-10-06T04:44:58.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.972+0000 7f85c09ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0b2ed0 con 0x7f85bc159680 2023-10-06T04:44:58.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.973+0000 7f85bad9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f85bc0cc780 0x7f85bc0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.973+0000 7f85bad9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f85bc0cc780 0x7f85bc0ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54850/0 (socket says 172.21.15.124:54850) 2023-10-06T04:44:58.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.973+0000 7f85bad9d700 1 -- 172.21.15.124:0/2309403031 learned_addr learned my addr 172.21.15.124:0/2309403031 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:58.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.973+0000 7f85b9d9b700 1 --2- 172.21.15.124:0/2309403031 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc159680 0x7f85bc0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.973+0000 7f85bad9d700 1 -- 172.21.15.124:0/2309403031 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc159680 msgr2=0x7f85bc0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:58.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.973+0000 7f85bad9d700 1 --2- 172.21.15.124:0/2309403031 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc159680 0x7f85bc0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.973+0000 7f85bad9d700 1 -- 172.21.15.124:0/2309403031 >> v1:172.21.15.158:6789/0 conn(0x7f85bc1592b0 legacy=0x7f85bc15dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.973+0000 7f85bad9d700 1 -- 172.21.15.124:0/2309403031 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc0ccc00 con 0x7f85bc0cc780 2023-10-06T04:44:58.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.973+0000 7f85bad9d700 1 --2- 172.21.15.124:0/2309403031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc0cc780 0x7f85bc0ccea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009f20 tx=0x7f85b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab26b6074858efc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:58.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85b959a700 1 -- 172.21.15.124:0/2309403031 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b400e070 con 0x7f85bc0cc780 2023-10-06T04:44:58.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85b959a700 1 -- 172.21.15.124:0/2309403031 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b400b9d0 con 0x7f85bc0cc780 2023-10-06T04:44:58.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85b959a700 1 -- 172.21.15.124:0/2309403031 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40092e0 con 0x7f85bc0cc780 2023-10-06T04:44:58.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85c09ff700 1 -- 172.21.15.124:0/2309403031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc0cc780 msgr2=0x7f85bc0ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85c09ff700 1 --2- 172.21.15.124:0/2309403031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc0cc780 0x7f85bc0ccea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009f20 tx=0x7f85b4009840 comp rx=0 tx=0).stop 2023-10-06T04:44:58.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85c09ff700 1 -- 172.21.15.124:0/2309403031 shutdown_connections 2023-10-06T04:44:58.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85c09ff700 1 --2- 172.21.15.124:0/2309403031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc0cc780 0x7f85bc0ccea0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85c09ff700 1 --2- 172.21.15.124:0/2309403031 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc159680 0x7f85bc0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85c09ff700 1 -- 172.21.15.124:0/2309403031 >> 172.21.15.124:0/2309403031 conn(0x7f85bc06ed20 msgr2=0x7f85bc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:58.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85c09ff700 1 -- 172.21.15.124:0/2309403031 shutdown_connections 2023-10-06T04:44:58.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.974+0000 7f85c09ff700 1 -- 172.21.15.124:0/2309403031 wait complete. 2023-10-06T04:44:58.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.976+0000 7f85c09ff700 1 Processor -- start 2023-10-06T04:44:58.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.976+0000 7f85c09ff700 1 -- start start 2023-10-06T04:44:58.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85c09ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc0cc780 0x7f85bc16a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85c09ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85bc1592b0 0x7f85bc157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85c09ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc159680 0x7f85bc16a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85c09ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0c7f80 con 0x7f85bc159680 2023-10-06T04:44:58.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85c09ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0c7650 con 0x7f85bc1592b0 2023-10-06T04:44:58.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85c09ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0c7930 con 0x7f85bc0cc780 2023-10-06T04:44:58.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85bad9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc159680 0x7f85bc16a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85bad9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc159680 0x7f85bc16a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54856/0 (socket says 172.21.15.124:54856) 2023-10-06T04:44:58.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85bad9d700 1 -- 172.21.15.124:0/1730293434 learned_addr learned my addr 172.21.15.124:0/1730293434 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:58.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85b9d9b700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85bc1592b0 0x7f85bc157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.977+0000 7f85ba59c700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc0cc780 0x7f85bc16a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85bad9d700 1 -- 172.21.15.124:0/1730293434 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc0cc780 msgr2=0x7f85bc16a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85bad9d700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc0cc780 0x7f85bc16a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85bad9d700 1 -- 172.21.15.124:0/1730293434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85bc1592b0 msgr2=0x7f85bc157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85bad9d700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85bc1592b0 0x7f85bc157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85bad9d700 1 -- 172.21.15.124:0/1730293434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4009ae0 con 0x7f85bc159680 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85ba59c700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc0cc780 0x7f85bc16a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85bad9d700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc159680 0x7f85bc16a9b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f85bc063e60 tx=0x7f85b4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85aa7fc700 1 -- 172.21.15.124:0/1730293434 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40094e0 con 0x7f85bc159680 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85aa7fc700 1 -- 172.21.15.124:0/1730293434 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4008c70 con 0x7f85bc159680 2023-10-06T04:44:58.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85c09ff700 1 -- 172.21.15.124:0/1730293434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc0c7c10 con 0x7f85bc159680 2023-10-06T04:44:58.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85aa7fc700 1 -- 172.21.15.124:0/1730293434 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4026460 con 0x7f85bc159680 2023-10-06T04:44:58.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.978+0000 7f85c09ff700 1 -- 172.21.15.124:0/1730293434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc0cf760 con 0x7f85bc159680 2023-10-06T04:44:58.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.979+0000 7f85c09ff700 1 -- 172.21.15.124:0/1730293434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc04c380 con 0x7f85bc159680 2023-10-06T04:44:58.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.980+0000 7f85aa7fc700 1 -- 172.21.15.124:0/1730293434 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85b4003040 con 0x7f85bc159680 2023-10-06T04:44:58.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.981+0000 7f85aa7fc700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f859c066f30 0x7f859c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:58.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.981+0000 7f85aa7fc700 1 -- 172.21.15.124:0/1730293434 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f85b4086630 con 0x7f85bc159680 2023-10-06T04:44:58.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.981+0000 7f85ba59c700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f859c066f30 0x7f859c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:58.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.982+0000 7f85ba59c700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f859c066f30 0x7f859c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85bc157c20 tx=0x7f85ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:58.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:58.985+0000 7f85aa7fc700 1 -- 172.21.15.124:0/1730293434 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85b40537f0 con 0x7f85bc159680 2023-10-06T04:44:59.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.177+0000 7f85c09ff700 1 -- 172.21.15.124:0/1730293434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85bc0b0760 con 0x7f85bc159680 2023-10-06T04:44:59.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.178+0000 7f85aa7fc700 1 -- 172.21.15.124:0/1730293434 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85b4056e10 con 0x7f85bc159680 2023-10-06T04:44:59.179 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-06T04:44:59.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 -- 172.21.15.124:0/1730293434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f859c066f30 msgr2=0x7f859c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f859c066f30 0x7f859c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85bc157c20 tx=0x7f85ac009040 comp rx=0 tx=0).stop 2023-10-06T04:44:59.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 -- 172.21.15.124:0/1730293434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc159680 msgr2=0x7f85bc16a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc159680 0x7f85bc16a9b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f85bc063e60 tx=0x7f85b4018000 comp rx=0 tx=0).stop 2023-10-06T04:44:59.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 -- 172.21.15.124:0/1730293434 shutdown_connections 2023-10-06T04:44:59.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85bc159680 0x7f85bc16a9b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f859c066f30 0x7f859c0693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85bc0cc780 0x7f85bc16a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 --2- 172.21.15.124:0/1730293434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85bc1592b0 0x7f85bc157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 -- 172.21.15.124:0/1730293434 >> 172.21.15.124:0/1730293434 conn(0x7f85bc06ed20 msgr2=0x7f85bc0b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:59.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 -- 172.21.15.124:0/1730293434 shutdown_connections 2023-10-06T04:44:59.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.180+0000 7f85c09ff700 1 -- 172.21.15.124:0/1730293434 wait complete. 2023-10-06T04:44:59.200 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:59.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.387+0000 7f94605ff700 1 Processor -- start 2023-10-06T04:44:59.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.387+0000 7f94605ff700 1 -- start start 2023-10-06T04:44:59.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.388+0000 7f94605ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580cdfe0 0x7f94580ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.388+0000 7f94605ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f94580ccf80 0x7f94580cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.388+0000 7f94605ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94580cf6b0 con 0x7f94580ccbb0 2023-10-06T04:44:59.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.388+0000 7f94605ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94580d0250 con 0x7f94580ccf80 2023-10-06T04:44:59.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.388+0000 7f94605ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94580ceaa0 con 0x7f94580cdfe0 2023-10-06T04:44:59.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945eb9c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f94580ccf80 0x7f94580cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945db9a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580cdfe0 0x7f94580ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945eb9c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f94580ccf80 0x7f94580cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:44390/0 (socket says 172.21.15.124:44390) 2023-10-06T04:44:59.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945eb9c700 1 -- 172.21.15.124:0/354876264 learned_addr learned my addr 172.21.15.124:0/354876264 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:59.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945e39b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f94580ccbb0 0x7f94580cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:37956/0 (socket says 172.21.15.124:37956) 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945d399700 1 -- 172.21.15.124:0/354876264 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395430769 0 0) 0x7f94580cf6b0 con 0x7f94580ccbb0 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945d399700 1 -- 172.21.15.124:0/354876264 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9444003570 con 0x7f94580ccbb0 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945db9a700 1 -- 172.21.15.124:0/354876264 >> v2:172.21.15.158:3300/0 conn(0x7f94580ccf80 msgr2=0x7f94580cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945db9a700 1 --2- 172.21.15.124:0/354876264 >> v2:172.21.15.158:3300/0 conn(0x7f94580ccf80 0x7f94580cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945db9a700 1 -- 172.21.15.124:0/354876264 >> v1:172.21.15.158:6789/0 conn(0x7f94580ccbb0 legacy=0x7f94580cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945db9a700 1 -- 172.21.15.124:0/354876264 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94580ced80 con 0x7f94580cdfe0 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.389+0000 7f945eb9c700 1 --2- 172.21.15.124:0/354876264 >> v2:172.21.15.158:3300/0 conn(0x7f94580ccf80 0x7f94580cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.390+0000 7f945db9a700 1 --2- 172.21.15.124:0/354876264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580cdfe0 0x7f94580ce450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94480098e0 tx=0x7f94480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3cede8f35b2378d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.390+0000 7f945d399700 1 -- 172.21.15.124:0/354876264 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448011630 con 0x7f94580cdfe0 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.390+0000 7f945d399700 1 -- 172.21.15.124:0/354876264 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9448011790 con 0x7f94580cdfe0 2023-10-06T04:44:59.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.390+0000 7f945d399700 1 -- 172.21.15.124:0/354876264 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448011b30 con 0x7f94580cdfe0 2023-10-06T04:44:59.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.391+0000 7f94605ff700 1 -- 172.21.15.124:0/354876264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580cdfe0 msgr2=0x7f94580ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.391+0000 7f94605ff700 1 --2- 172.21.15.124:0/354876264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580cdfe0 0x7f94580ce450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94480098e0 tx=0x7f94480091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.391+0000 7f94605ff700 1 -- 172.21.15.124:0/354876264 shutdown_connections 2023-10-06T04:44:59.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.391+0000 7f94605ff700 1 --2- 172.21.15.124:0/354876264 >> v2:172.21.15.158:3300/0 conn(0x7f94580ccf80 0x7f94580cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.391+0000 7f94605ff700 1 --2- 172.21.15.124:0/354876264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580cdfe0 0x7f94580ce450 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.391+0000 7f94605ff700 1 -- 172.21.15.124:0/354876264 >> 172.21.15.124:0/354876264 conn(0x7f9458099710 msgr2=0x7f945806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:59.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.391+0000 7f94605ff700 1 -- 172.21.15.124:0/354876264 shutdown_connections 2023-10-06T04:44:59.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.391+0000 7f94605ff700 1 -- 172.21.15.124:0/354876264 wait complete. 2023-10-06T04:44:59.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.392+0000 7f94605ff700 1 Processor -- start 2023-10-06T04:44:59.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.392+0000 7f94605ff700 1 -- start start 2023-10-06T04:44:59.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.393+0000 7f94605ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94580ccbb0 0x7f94581539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.393+0000 7f94605ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580ccf80 0x7f9458154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.393+0000 7f94605ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94580cdfe0 0x7f94581551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.393+0000 7f94605ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9458153ee0 con 0x7f94580cdfe0 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.393+0000 7f94605ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94581526b0 con 0x7f94580ccbb0 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.393+0000 7f94605ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9458152900 con 0x7f94580ccf80 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.393+0000 7f945eb9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94580cdfe0 0x7f94581551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f945eb9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94580cdfe0 0x7f94581551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54862/0 (socket says 172.21.15.124:54862) 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f945eb9c700 1 -- 172.21.15.124:0/4292050524 learned_addr learned my addr 172.21.15.124:0/4292050524 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f945e39b700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94580ccbb0 0x7f94581539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f945db9a700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580ccf80 0x7f9458154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f945eb9c700 1 -- 172.21.15.124:0/4292050524 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580ccf80 msgr2=0x7f9458154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f945eb9c700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580ccf80 0x7f9458154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f945eb9c700 1 -- 172.21.15.124:0/4292050524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94580ccbb0 msgr2=0x7f94581539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f945eb9c700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94580ccbb0 0x7f94581539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f945eb9c700 1 -- 172.21.15.124:0/4292050524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450009ae0 con 0x7f94580cdfe0 2023-10-06T04:44:59.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f945eb9c700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94580cdfe0 0x7f94581551a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9450009fd0 tx=0x7f945000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:59.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.394+0000 7f944e7fc700 1 -- 172.21.15.124:0/4292050524 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450018070 con 0x7f94580cdfe0 2023-10-06T04:44:59.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.395+0000 7f944e7fc700 1 -- 172.21.15.124:0/4292050524 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945000f040 con 0x7f94580cdfe0 2023-10-06T04:44:59.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.395+0000 7f94605ff700 1 -- 172.21.15.124:0/4292050524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9448009420 con 0x7f94580cdfe0 2023-10-06T04:44:59.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.395+0000 7f944e7fc700 1 -- 172.21.15.124:0/4292050524 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945000cbd0 con 0x7f94580cdfe0 2023-10-06T04:44:59.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.395+0000 7f94605ff700 1 -- 172.21.15.124:0/4292050524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9458152ec0 con 0x7f94580cdfe0 2023-10-06T04:44:59.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.396+0000 7f94605ff700 1 -- 172.21.15.124:0/4292050524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94580717a0 con 0x7f94580cdfe0 2023-10-06T04:44:59.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.396+0000 7f944e7fc700 1 -- 172.21.15.124:0/4292050524 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9450003020 con 0x7f94580cdfe0 2023-10-06T04:44:59.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.397+0000 7f944e7fc700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f943c066f30 0x7f943c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.397+0000 7f944e7fc700 1 -- 172.21.15.124:0/4292050524 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9450084b50 con 0x7f94580cdfe0 2023-10-06T04:44:59.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.397+0000 7f945e39b700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f943c066f30 0x7f943c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.398+0000 7f945e39b700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f943c066f30 0x7f943c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9458152440 tx=0x7f9454007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:59.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.401+0000 7f944e7fc700 1 -- 172.21.15.124:0/4292050524 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9450051bc0 con 0x7f94580cdfe0 2023-10-06T04:44:59.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.593+0000 7f94605ff700 1 -- 172.21.15.124:0/4292050524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94580cf060 con 0x7f94580cdfe0 2023-10-06T04:44:59.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.594+0000 7f944e7fc700 1 -- 172.21.15.124:0/4292050524 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f94500551e0 con 0x7f94580cdfe0 2023-10-06T04:44:59.596 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:44:59.596 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:59.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.596+0000 7f94605ff700 1 -- 172.21.15.124:0/4292050524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f943c066f30 msgr2=0x7f943c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.596+0000 7f94605ff700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f943c066f30 0x7f943c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9458152440 tx=0x7f9454007d40 comp rx=0 tx=0).stop 2023-10-06T04:44:59.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.596+0000 7f94605ff700 1 -- 172.21.15.124:0/4292050524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94580cdfe0 msgr2=0x7f94581551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.596+0000 7f94605ff700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94580cdfe0 0x7f94581551a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9450009fd0 tx=0x7f945000b040 comp rx=0 tx=0).stop 2023-10-06T04:44:59.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.596+0000 7f94605ff700 1 -- 172.21.15.124:0/4292050524 shutdown_connections 2023-10-06T04:44:59.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.596+0000 7f94605ff700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94580cdfe0 0x7f94581551a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.596+0000 7f94605ff700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94580ccbb0 0x7f94581539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.596+0000 7f94605ff700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f943c066f30 0x7f943c0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.596+0000 7f94605ff700 1 --2- 172.21.15.124:0/4292050524 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94580ccf80 0x7f9458154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.596+0000 7f94605ff700 1 -- 172.21.15.124:0/4292050524 >> 172.21.15.124:0/4292050524 conn(0x7f9458099710 msgr2=0x7f94580ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:59.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.597+0000 7f94605ff700 1 -- 172.21.15.124:0/4292050524 shutdown_connections 2023-10-06T04:44:59.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.597+0000 7f94605ff700 1 -- 172.21.15.124:0/4292050524 wait complete. 2023-10-06T04:44:59.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:44:25.771714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:44:26.609661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:44:59.616 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:44:59.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.807+0000 7f2a56bff700 1 Processor -- start 2023-10-06T04:44:59.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.807+0000 7f2a56bff700 1 -- start start 2023-10-06T04:44:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.808+0000 7f2a56bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2a501592b0 0x7f2a500b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.808+0000 7f2a56bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a500cc780 0x7f2a500ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.808+0000 7f2a56bff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5015d620 con 0x7f2a50159680 2023-10-06T04:44:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.808+0000 7f2a56bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5015d0d0 con 0x7f2a501592b0 2023-10-06T04:44:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.808+0000 7f2a56bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500b2ed0 con 0x7f2a500cc780 2023-10-06T04:44:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a5499b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2a501592b0 0x7f2a500b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a4ffff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2a50159680 0x7f2a5015dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50194/0 (socket says 172.21.15.124:50194) 2023-10-06T04:44:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a4ffff700 1 -- 172.21.15.124:0/2558043587 learned_addr learned my addr 172.21.15.124:0/2558043587 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:44:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a5519c700 1 --2- 172.21.15.124:0/2558043587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a500cc780 0x7f2a500ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a5499b700 1 -- 172.21.15.124:0/2558043587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a500cc780 msgr2=0x7f2a500ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a5499b700 1 --2- 172.21.15.124:0/2558043587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a500cc780 0x7f2a500ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a4f7fe700 1 -- 172.21.15.124:0/2558043587 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755271920 0 0) 0x7f2a5015d620 con 0x7f2a50159680 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a5499b700 1 -- 172.21.15.124:0/2558043587 >> v1:172.21.15.124:6789/0 conn(0x7f2a50159680 legacy=0x7f2a5015dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a5499b700 1 -- 172.21.15.124:0/2558043587 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a500ccc00 con 0x7f2a501592b0 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a5519c700 1 --2- 172.21.15.124:0/2558043587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a500cc780 0x7f2a500ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.809+0000 7f2a5499b700 1 --2- 172.21.15.124:0/2558043587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a501592b0 0x7f2a500b0080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a440098e0 tx=0x7f2a440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2462a4b50214fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a4f7fe700 1 -- 172.21.15.124:0/2558043587 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44009e80 con 0x7f2a501592b0 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a4f7fe700 1 -- 172.21.15.124:0/2558043587 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4400b860 con 0x7f2a501592b0 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a4f7fe700 1 -- 172.21.15.124:0/2558043587 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400bbe0 con 0x7f2a501592b0 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a56bff700 1 -- 172.21.15.124:0/2558043587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a501592b0 msgr2=0x7f2a500b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a56bff700 1 --2- 172.21.15.124:0/2558043587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a501592b0 0x7f2a500b0080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a440098e0 tx=0x7f2a440091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a56bff700 1 -- 172.21.15.124:0/2558043587 shutdown_connections 2023-10-06T04:44:59.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a56bff700 1 --2- 172.21.15.124:0/2558043587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a500cc780 0x7f2a500ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a56bff700 1 --2- 172.21.15.124:0/2558043587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a501592b0 0x7f2a500b0080 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a56bff700 1 -- 172.21.15.124:0/2558043587 >> 172.21.15.124:0/2558043587 conn(0x7f2a5006ed20 msgr2=0x7f2a5006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:59.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a56bff700 1 -- 172.21.15.124:0/2558043587 shutdown_connections 2023-10-06T04:44:59.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.810+0000 7f2a56bff700 1 -- 172.21.15.124:0/2558043587 wait complete. 2023-10-06T04:44:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.812+0000 7f2a56bff700 1 Processor -- start 2023-10-06T04:44:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.812+0000 7f2a56bff700 1 -- start start 2023-10-06T04:44:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a56bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500cc780 0x7f2a50153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a56bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a501592b0 0x7f2a500c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a56bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a50159680 0x7f2a500c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a56bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500c4df0 con 0x7f2a500cc780 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a56bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5016dcb0 con 0x7f2a50159680 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a56bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5016d100 con 0x7f2a501592b0 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a5499b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500cc780 0x7f2a50153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a5499b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500cc780 0x7f2a50153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54878/0 (socket says 172.21.15.124:54878) 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a5499b700 1 -- 172.21.15.124:0/976753434 learned_addr learned my addr 172.21.15.124:0/976753434 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a4ffff700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a501592b0 0x7f2a500c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a5519c700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a50159680 0x7f2a500c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a5499b700 1 -- 172.21.15.124:0/976753434 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a501592b0 msgr2=0x7f2a500c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a5499b700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a501592b0 0x7f2a500c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a5499b700 1 -- 172.21.15.124:0/976753434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a50159680 msgr2=0x7f2a500c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a5499b700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a50159680 0x7f2a500c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a5499b700 1 -- 172.21.15.124:0/976753434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009420 con 0x7f2a500cc780 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.813+0000 7f2a5519c700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a50159680 0x7f2a500c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.814+0000 7f2a5499b700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500cc780 0x7f2a50153a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400b3c0 tx=0x7f2a44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.814+0000 7f2a4cff9700 1 -- 172.21.15.124:0/976753434 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4401f070 con 0x7f2a500cc780 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.814+0000 7f2a4cff9700 1 -- 172.21.15.124:0/976753434 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44000cc0 con 0x7f2a500cc780 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.814+0000 7f2a4cff9700 1 -- 172.21.15.124:0/976753434 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400bbe0 con 0x7f2a500cc780 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.814+0000 7f2a56bff700 1 -- 172.21.15.124:0/976753434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5016d380 con 0x7f2a500cc780 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.814+0000 7f2a56bff700 1 -- 172.21.15.124:0/976753434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5016d940 con 0x7f2a500cc780 2023-10-06T04:44:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.815+0000 7f2a56bff700 1 -- 172.21.15.124:0/976753434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5004c380 con 0x7f2a500cc780 2023-10-06T04:44:59.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.816+0000 7f2a4cff9700 1 -- 172.21.15.124:0/976753434 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a44011900 con 0x7f2a500cc780 2023-10-06T04:44:59.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.817+0000 7f2a4cff9700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a34066f30 0x7f2a340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:59.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.817+0000 7f2a4cff9700 1 -- 172.21.15.124:0/976753434 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2a44085c00 con 0x7f2a500cc780 2023-10-06T04:44:59.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.817+0000 7f2a4ffff700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a34066f30 0x7f2a340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:59.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.818+0000 7f2a4ffff700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a34066f30 0x7f2a340693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2a500c3ea0 tx=0x7f2a3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:59.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:44:59.821+0000 7f2a4cff9700 1 -- 172.21.15.124:0/976753434 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a4408c080 con 0x7f2a500cc780 2023-10-06T04:45:00.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.011+0000 7f2a56bff700 1 -- 172.21.15.124:0/976753434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a500b0760 con 0x7f2a500cc780 2023-10-06T04:45:00.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.011+0000 7f2a4cff9700 1 -- 172.21.15.124:0/976753434 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a440280a0 con 0x7f2a500cc780 2023-10-06T04:45:00.013 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:45:00.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 -- 172.21.15.124:0/976753434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a34066f30 msgr2=0x7f2a340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a34066f30 0x7f2a340693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2a500c3ea0 tx=0x7f2a3c009040 comp rx=0 tx=0).stop 2023-10-06T04:45:00.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 -- 172.21.15.124:0/976753434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500cc780 msgr2=0x7f2a50153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500cc780 0x7f2a50153a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400b3c0 tx=0x7f2a44017000 comp rx=0 tx=0).stop 2023-10-06T04:45:00.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 -- 172.21.15.124:0/976753434 shutdown_connections 2023-10-06T04:45:00.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a50159680 0x7f2a500c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500cc780 0x7f2a50153a80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a34066f30 0x7f2a340693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 --2- 172.21.15.124:0/976753434 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a501592b0 0x7f2a500c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 -- 172.21.15.124:0/976753434 >> 172.21.15.124:0/976753434 conn(0x7f2a5006ed20 msgr2=0x7f2a501572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:00.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 -- 172.21.15.124:0/976753434 shutdown_connections 2023-10-06T04:45:00.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.014+0000 7f2a56bff700 1 -- 172.21.15.124:0/976753434 wait complete. 2023-10-06T04:45:00.032 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:45:00.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.227+0000 7f827e3ff700 1 Processor -- start 2023-10-06T04:45:00.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.227+0000 7f827e3ff700 1 -- start start 2023-10-06T04:45:00.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.228+0000 7f827e3ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f82781562b0 0x7f827815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.228+0000 7f827e3ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8278156680 0x7f82780adc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.228+0000 7f827e3ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780ad790 con 0x7f82780cca10 2023-10-06T04:45:00.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.228+0000 7f827e3ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827815af90 con 0x7f8278156680 2023-10-06T04:45:00.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.228+0000 7f827e3ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780acb80 con 0x7f82781562b0 2023-10-06T04:45:00.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f827c99c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8278156680 0x7f82780adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f82777fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f82780cca10 0x7f82780c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50204/0 (socket says 172.21.15.124:50204) 2023-10-06T04:45:00.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f82777fe700 1 -- 172.21.15.124:0/3081475434 learned_addr learned my addr 172.21.15.124:0/3081475434 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f827c99c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8278156680 0x7f82780adc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54894/0 (socket says 172.21.15.124:54894) 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f8277fff700 1 --2- 172.21.15.124:0/3081475434 >> v2:172.21.15.158:3300/0 conn(0x7f82781562b0 0x7f827815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f827c99c700 1 -- 172.21.15.124:0/3081475434 >> v2:172.21.15.158:3300/0 conn(0x7f82781562b0 msgr2=0x7f827815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f827c99c700 1 --2- 172.21.15.124:0/3081475434 >> v2:172.21.15.158:3300/0 conn(0x7f82781562b0 0x7f827815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f827c99c700 1 -- 172.21.15.124:0/3081475434 >> v1:172.21.15.124:6789/0 conn(0x7f82780cca10 legacy=0x7f82780c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f827c99c700 1 -- 172.21.15.124:0/3081475434 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780ace60 con 0x7f8278156680 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f8276ffd700 1 -- 172.21.15.124:0/3081475434 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173311012 0 0) 0x7f82780ad790 con 0x7f82780cca10 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.229+0000 7f827c99c700 1 --2- 172.21.15.124:0/3081475434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8278156680 0x7f82780adc20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f827806f920 tx=0x7f8270009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb35eec536ed4cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f8276ffd700 1 -- 172.21.15.124:0/3081475434 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000e070 con 0x7f8278156680 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f8276ffd700 1 -- 172.21.15.124:0/3081475434 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827000bb60 con 0x7f8278156680 2023-10-06T04:45:00.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f8276ffd700 1 -- 172.21.15.124:0/3081475434 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270012430 con 0x7f8278156680 2023-10-06T04:45:00.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f827e3ff700 1 -- 172.21.15.124:0/3081475434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8278156680 msgr2=0x7f82780adc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f827e3ff700 1 --2- 172.21.15.124:0/3081475434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8278156680 0x7f82780adc20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f827806f920 tx=0x7f8270009780 comp rx=0 tx=0).stop 2023-10-06T04:45:00.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f827e3ff700 1 -- 172.21.15.124:0/3081475434 shutdown_connections 2023-10-06T04:45:00.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f827e3ff700 1 --2- 172.21.15.124:0/3081475434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8278156680 0x7f82780adc20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f827e3ff700 1 --2- 172.21.15.124:0/3081475434 >> v2:172.21.15.158:3300/0 conn(0x7f82781562b0 0x7f827815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f827e3ff700 1 -- 172.21.15.124:0/3081475434 >> 172.21.15.124:0/3081475434 conn(0x7f82780680c0 msgr2=0x7f82780cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:00.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f827e3ff700 1 -- 172.21.15.124:0/3081475434 shutdown_connections 2023-10-06T04:45:00.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.230+0000 7f827e3ff700 1 -- 172.21.15.124:0/3081475434 wait complete. 2023-10-06T04:45:00.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.232+0000 7f827e3ff700 1 Processor -- start 2023-10-06T04:45:00.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.232+0000 7f827e3ff700 1 -- start start 2023-10-06T04:45:00.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f827e3ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82780cca10 0x7f82780c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f827e3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82781562b0 0x7f82780afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f827e3ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8278156680 0x7f8278169ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f827e3ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780b0860 con 0x7f82780cca10 2023-10-06T04:45:00.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f827e3ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780b0b40 con 0x7f8278156680 2023-10-06T04:45:00.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f827e3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780b0e20 con 0x7f82781562b0 2023-10-06T04:45:00.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f8277fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82780cca10 0x7f82780c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f8277fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82780cca10 0x7f82780c40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54898/0 (socket says 172.21.15.124:54898) 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f8277fff700 1 -- 172.21.15.124:0/1713633574 learned_addr learned my addr 172.21.15.124:0/1713633574 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f827c99c700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8278156680 0x7f8278169ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f82777fe700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82781562b0 0x7f82780afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f8277fff700 1 -- 172.21.15.124:0/1713633574 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82781562b0 msgr2=0x7f82780afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f8277fff700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82781562b0 0x7f82780afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f8277fff700 1 -- 172.21.15.124:0/1713633574 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8278156680 msgr2=0x7f8278169ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f8277fff700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8278156680 0x7f8278169ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.233+0000 7f8277fff700 1 -- 172.21.15.124:0/1713633574 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8270009a20 con 0x7f82780cca10 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.234+0000 7f8277fff700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82780cca10 0x7f82780c40a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f826800ec80 tx=0x7f82680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.234+0000 7f825ffff700 1 -- 172.21.15.124:0/1713633574 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826800c850 con 0x7f82780cca10 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.234+0000 7f825ffff700 1 -- 172.21.15.124:0/1713633574 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826800c9b0 con 0x7f82780cca10 2023-10-06T04:45:00.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.234+0000 7f825ffff700 1 -- 172.21.15.124:0/1713633574 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826800cd50 con 0x7f82780cca10 2023-10-06T04:45:00.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.234+0000 7f827e3ff700 1 -- 172.21.15.124:0/1713633574 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82780b1100 con 0x7f82780cca10 2023-10-06T04:45:00.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.234+0000 7f827e3ff700 1 -- 172.21.15.124:0/1713633574 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82780b1620 con 0x7f82780cca10 2023-10-06T04:45:00.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.235+0000 7f827e3ff700 1 -- 172.21.15.124:0/1713633574 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8278064850 con 0x7f82780cca10 2023-10-06T04:45:00.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.236+0000 7f825ffff700 1 -- 172.21.15.124:0/1713633574 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8268013680 con 0x7f82780cca10 2023-10-06T04:45:00.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.237+0000 7f825ffff700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8264066f30 0x7f82640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.237+0000 7f825ffff700 1 -- 172.21.15.124:0/1713633574 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8268084d60 con 0x7f82780cca10 2023-10-06T04:45:00.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.237+0000 7f82777fe700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8264066f30 0x7f82640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.238+0000 7f82777fe700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8264066f30 0x7f82640693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f826c0011e0 tx=0x7f826c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:00.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.241+0000 7f825ffff700 1 -- 172.21.15.124:0/1713633574 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8268051dd0 con 0x7f82780cca10 2023-10-06T04:45:00.434 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.433+0000 7f827e3ff700 1 -- 172.21.15.124:0/1713633574 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82780b1470 con 0x7f82780cca10 2023-10-06T04:45:00.435 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.433+0000 7f825ffff700 1 -- 172.21.15.124:0/1713633574 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82680170a0 con 0x7f82780cca10 2023-10-06T04:45:00.435 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:45:00.437 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 -- 172.21.15.124:0/1713633574 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8264066f30 msgr2=0x7f82640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.437 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8264066f30 0x7f82640693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f826c0011e0 tx=0x7f826c009040 comp rx=0 tx=0).stop 2023-10-06T04:45:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 -- 172.21.15.124:0/1713633574 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82780cca10 msgr2=0x7f82780c40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82780cca10 0x7f82780c40a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f826800ec80 tx=0x7f82680091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 -- 172.21.15.124:0/1713633574 shutdown_connections 2023-10-06T04:45:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8278156680 0x7f8278169ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82780cca10 0x7f82780c40a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8264066f30 0x7f82640693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 --2- 172.21.15.124:0/1713633574 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82781562b0 0x7f82780afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 -- 172.21.15.124:0/1713633574 >> 172.21.15.124:0/1713633574 conn(0x7f82780680c0 msgr2=0x7f82780c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 -- 172.21.15.124:0/1713633574 shutdown_connections 2023-10-06T04:45:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.436+0000 7f827e3ff700 1 -- 172.21.15.124:0/1713633574 wait complete. 2023-10-06T04:45:00.454 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:45:00.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.651+0000 7fc697dff700 1 Processor -- start 2023-10-06T04:45:00.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.651+0000 7fc697dff700 1 -- start start 2023-10-06T04:45:00.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.652+0000 7fc697dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc6900ca530 0x7fc69015b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.652+0000 7fc697dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900b0080 con 0x7fc69006d060 2023-10-06T04:45:00.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.652+0000 7fc697dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900b0360 con 0x7fc6900ca900 2023-10-06T04:45:00.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.652+0000 7fc697dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900b0640 con 0x7fc6900ca530 2023-10-06T04:45:00.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.653+0000 7fc695b9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc6900ca530 0x7fc69015b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.653+0000 7fc695b9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc6900ca530 0x7fc69015b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54908/0 (socket says 172.21.15.124:54908) 2023-10-06T04:45:00.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.653+0000 7fc69639c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc69006d060 0x7fc69006d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50208/0 (socket says 172.21.15.124:50208) 2023-10-06T04:45:00.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.653+0000 7fc695b9b700 1 -- 172.21.15.124:0/2990255823 learned_addr learned my addr 172.21.15.124:0/2990255823 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:00.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.653+0000 7fc695b9b700 1 -- 172.21.15.124:0/2990255823 >> v1:172.21.15.158:6789/0 conn(0x7fc6900ca900 legacy=0x7fc6900af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:00.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.653+0000 7fc695b9b700 1 -- 172.21.15.124:0/2990255823 >> v1:172.21.15.124:6789/0 conn(0x7fc69006d060 legacy=0x7fc69006d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.653+0000 7fc695b9b700 1 -- 172.21.15.124:0/2990255823 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900b0920 con 0x7fc6900ca530 2023-10-06T04:45:00.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.654+0000 7fc695b9b700 1 --2- 172.21.15.124:0/2990255823 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca530 0x7fc69015b920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0099b0 tx=0x7fc68c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca176490e33ca4b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:00.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.654+0000 7fc694b99700 1 -- 172.21.15.124:0/2990255823 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c00b820 con 0x7fc6900ca530 2023-10-06T04:45:00.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.654+0000 7fc694b99700 1 -- 172.21.15.124:0/2990255823 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c00b980 con 0x7fc6900ca530 2023-10-06T04:45:00.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.654+0000 7fc694b99700 1 -- 172.21.15.124:0/2990255823 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c00bd20 con 0x7fc6900ca530 2023-10-06T04:45:00.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.654+0000 7fc697dff700 1 -- 172.21.15.124:0/2990255823 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca530 msgr2=0x7fc69015b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.654+0000 7fc697dff700 1 --2- 172.21.15.124:0/2990255823 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca530 0x7fc69015b920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0099b0 tx=0x7fc68c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:00.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.655+0000 7fc697dff700 1 -- 172.21.15.124:0/2990255823 shutdown_connections 2023-10-06T04:45:00.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.655+0000 7fc697dff700 1 --2- 172.21.15.124:0/2990255823 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca530 0x7fc69015b920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.655+0000 7fc697dff700 1 -- 172.21.15.124:0/2990255823 >> 172.21.15.124:0/2990255823 conn(0x7fc690063cc0 msgr2=0x7fc6900ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:00.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.655+0000 7fc697dff700 1 -- 172.21.15.124:0/2990255823 shutdown_connections 2023-10-06T04:45:00.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.655+0000 7fc697dff700 1 -- 172.21.15.124:0/2990255823 wait complete. 2023-10-06T04:45:00.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.656+0000 7fc697dff700 1 Processor -- start 2023-10-06T04:45:00.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.656+0000 7fc697dff700 1 -- start start 2023-10-06T04:45:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.657+0000 7fc697dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc69006d060 0x7fc69016a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.657+0000 7fc697dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6900ca530 0x7fc690156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.657+0000 7fc697dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca900 0x7fc6900b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.657+0000 7fc697dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900aa550 con 0x7fc6900ca900 2023-10-06T04:45:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.657+0000 7fc697dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69016af30 con 0x7fc6900ca530 2023-10-06T04:45:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.657+0000 7fc697dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6901569c0 con 0x7fc69006d060 2023-10-06T04:45:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.657+0000 7fc69639c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca900 0x7fc6900b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc69639c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca900 0x7fc6900b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54922/0 (socket says 172.21.15.124:54922) 2023-10-06T04:45:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc69639c700 1 -- 172.21.15.124:0/3256919098 learned_addr learned my addr 172.21.15.124:0/3256919098 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc695b9b700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc69006d060 0x7fc69016a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc69539a700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6900ca530 0x7fc690156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc69639c700 1 -- 172.21.15.124:0/3256919098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc69006d060 msgr2=0x7fc69016a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc69639c700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc69006d060 0x7fc69016a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc69639c700 1 -- 172.21.15.124:0/3256919098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6900ca530 msgr2=0x7fc690156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc69639c700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6900ca530 0x7fc690156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc69639c700 1 -- 172.21.15.124:0/3256919098 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0094f0 con 0x7fc6900ca900 2023-10-06T04:45:00.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc69539a700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6900ca530 0x7fc690156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:00.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc69639c700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca900 0x7fc6900b2b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc68800cc70 tx=0x7fc688001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:00.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc685ffb700 1 -- 172.21.15.124:0/3256919098 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800ce80 con 0x7fc6900ca900 2023-10-06T04:45:00.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc685ffb700 1 -- 172.21.15.124:0/3256919098 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc688005df0 con 0x7fc6900ca900 2023-10-06T04:45:00.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc697dff700 1 -- 172.21.15.124:0/3256919098 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900a9940 con 0x7fc6900ca900 2023-10-06T04:45:00.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.658+0000 7fc685ffb700 1 -- 172.21.15.124:0/3256919098 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800ab30 con 0x7fc6900ca900 2023-10-06T04:45:00.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.659+0000 7fc697dff700 1 -- 172.21.15.124:0/3256919098 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900a9f00 con 0x7fc6900ca900 2023-10-06T04:45:00.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.660+0000 7fc697dff700 1 -- 172.21.15.124:0/3256919098 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69004c380 con 0x7fc6900ca900 2023-10-06T04:45:00.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.661+0000 7fc685ffb700 1 -- 172.21.15.124:0/3256919098 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6880070f0 con 0x7fc6900ca900 2023-10-06T04:45:00.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.661+0000 7fc685ffb700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc674066f30 0x7fc6740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:00.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.661+0000 7fc685ffb700 1 -- 172.21.15.124:0/3256919098 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc6880847e0 con 0x7fc6900ca900 2023-10-06T04:45:00.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.662+0000 7fc695b9b700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc674066f30 0x7fc6740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:00.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.662+0000 7fc695b9b700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc674066f30 0x7fc6740693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0099b0 tx=0x7fc68c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:00.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.665+0000 7fc685ffb700 1 -- 172.21.15.124:0/3256919098 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6880518d0 con 0x7fc6900ca900 2023-10-06T04:45:00.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.853+0000 7fc697dff700 1 -- 172.21.15.124:0/3256919098 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6900ae2f0 con 0x7fc6900ca900 2023-10-06T04:45:00.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.854+0000 7fc685ffb700 1 -- 172.21.15.124:0/3256919098 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc688054ef0 con 0x7fc6900ca900 2023-10-06T04:45:00.856 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-06T04:45:00.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 -- 172.21.15.124:0/3256919098 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc674066f30 msgr2=0x7fc6740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc674066f30 0x7fc6740693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0099b0 tx=0x7fc68c016000 comp rx=0 tx=0).stop 2023-10-06T04:45:00.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 -- 172.21.15.124:0/3256919098 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca900 msgr2=0x7fc6900b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:00.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca900 0x7fc6900b2b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc68800cc70 tx=0x7fc688001a40 comp rx=0 tx=0).stop 2023-10-06T04:45:00.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 -- 172.21.15.124:0/3256919098 shutdown_connections 2023-10-06T04:45:00.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6900ca900 0x7fc6900b2b60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc674066f30 0x7fc6740693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc69006d060 0x7fc69016a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 --2- 172.21.15.124:0/3256919098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6900ca530 0x7fc690156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:00.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 -- 172.21.15.124:0/3256919098 >> 172.21.15.124:0/3256919098 conn(0x7fc690063cc0 msgr2=0x7fc6900acc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:00.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 -- 172.21.15.124:0/3256919098 shutdown_connections 2023-10-06T04:45:00.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:00.856+0000 7fc697dff700 1 -- 172.21.15.124:0/3256919098 wait complete. 2023-10-06T04:45:00.875 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:45:01.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.068+0000 7fa2c6dff700 1 Processor -- start 2023-10-06T04:45:01.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.068+0000 7fa2c6dff700 1 -- start start 2023-10-06T04:45:01.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.069+0000 7fa2c6dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa2c015dce0 0x7fa2c006d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2c6dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c006d5a0 0x7fa2c0069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2c6dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c0068700 con 0x7fa2c0159480 2023-10-06T04:45:01.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2c6dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c006da20 con 0x7fa2c015dce0 2023-10-06T04:45:01.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2c6dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c9030 con 0x7fa2c006d5a0 2023-10-06T04:45:01.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2c4b9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa2c0159480 0x7fa2c00c8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50218/0 (socket says 172.21.15.124:50218) 2023-10-06T04:45:01.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2c4b9b700 1 -- 172.21.15.124:0/560791439 learned_addr learned my addr 172.21.15.124:0/560791439 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:01.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2c539c700 1 --2- 172.21.15.124:0/560791439 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c006d5a0 0x7fa2c0069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2bffff700 1 --2- 172.21.15.124:0/560791439 >> v2:172.21.15.158:3300/0 conn(0x7fa2c015dce0 0x7fa2c006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2bf7fe700 1 -- 172.21.15.124:0/560791439 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198044280 0 0) 0x7fa2c0068700 con 0x7fa2c0159480 2023-10-06T04:45:01.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2bf7fe700 1 -- 172.21.15.124:0/560791439 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2b0003570 con 0x7fa2c0159480 2023-10-06T04:45:01.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2bffff700 1 -- 172.21.15.124:0/560791439 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c006d5a0 msgr2=0x7fa2c0069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:01.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2bffff700 1 --2- 172.21.15.124:0/560791439 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c006d5a0 0x7fa2c0069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2bffff700 1 -- 172.21.15.124:0/560791439 >> v1:172.21.15.124:6789/0 conn(0x7fa2c0159480 legacy=0x7fa2c00c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2bffff700 1 -- 172.21.15.124:0/560791439 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0068950 con 0x7fa2c015dce0 2023-10-06T04:45:01.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.070+0000 7fa2c539c700 1 --2- 172.21.15.124:0/560791439 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c006d5a0 0x7fa2c0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:01.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.071+0000 7fa2bffff700 1 --2- 172.21.15.124:0/560791439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2c015dce0 0x7fa2c006d060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0098e0 tx=0x7fa2ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba2e36257728691 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:01.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.071+0000 7fa2bf7fe700 1 -- 172.21.15.124:0/560791439 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011630 con 0x7fa2c015dce0 2023-10-06T04:45:01.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.071+0000 7fa2bf7fe700 1 -- 172.21.15.124:0/560791439 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac011790 con 0x7fa2c015dce0 2023-10-06T04:45:01.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.071+0000 7fa2bf7fe700 1 -- 172.21.15.124:0/560791439 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011b30 con 0x7fa2c015dce0 2023-10-06T04:45:01.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.071+0000 7fa2c6dff700 1 -- 172.21.15.124:0/560791439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2c015dce0 msgr2=0x7fa2c006d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.071+0000 7fa2c6dff700 1 --2- 172.21.15.124:0/560791439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2c015dce0 0x7fa2c006d060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0098e0 tx=0x7fa2ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.072+0000 7fa2c6dff700 1 -- 172.21.15.124:0/560791439 shutdown_connections 2023-10-06T04:45:01.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.072+0000 7fa2c6dff700 1 --2- 172.21.15.124:0/560791439 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c006d5a0 0x7fa2c0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.072+0000 7fa2c6dff700 1 --2- 172.21.15.124:0/560791439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2c015dce0 0x7fa2c006d060 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.072+0000 7fa2c6dff700 1 -- 172.21.15.124:0/560791439 >> 172.21.15.124:0/560791439 conn(0x7fa2c0063cc0 msgr2=0x7fa2c00ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:01.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.072+0000 7fa2c6dff700 1 -- 172.21.15.124:0/560791439 shutdown_connections 2023-10-06T04:45:01.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.072+0000 7fa2c6dff700 1 -- 172.21.15.124:0/560791439 wait complete. 2023-10-06T04:45:01.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.073+0000 7fa2c6dff700 1 Processor -- start 2023-10-06T04:45:01.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.073+0000 7fa2c6dff700 1 -- start start 2023-10-06T04:45:01.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.074+0000 7fa2c6dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2c006d5a0 0x7fa2c00c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.074+0000 7fa2c6dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2c0159480 0x7fa2c00b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.074+0000 7fa2c6dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c015dce0 0x7fa2c0158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.074+0000 7fa2c6dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c5e10 con 0x7fa2c0159480 2023-10-06T04:45:01.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.074+0000 7fa2c6dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00b3fb0 con 0x7fa2c006d5a0 2023-10-06T04:45:01.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.074+0000 7fa2c6dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c54e0 con 0x7fa2c015dce0 2023-10-06T04:45:01.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.074+0000 7fa2bffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2c0159480 0x7fa2c00b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.074+0000 7fa2bffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2c0159480 0x7fa2c00b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54930/0 (socket says 172.21.15.124:54930) 2023-10-06T04:45:01.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.074+0000 7fa2bffff700 1 -- 172.21.15.124:0/893738442 learned_addr learned my addr 172.21.15.124:0/893738442 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:01.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2c4b9b700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2c006d5a0 0x7fa2c00c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2c539c700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c015dce0 0x7fa2c0158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2bffff700 1 -- 172.21.15.124:0/893738442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c015dce0 msgr2=0x7fa2c0158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2bffff700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c015dce0 0x7fa2c0158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2bffff700 1 -- 172.21.15.124:0/893738442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2c006d5a0 msgr2=0x7fa2c00c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2bffff700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2c006d5a0 0x7fa2c00c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2bffff700 1 -- 172.21.15.124:0/893738442 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b8009a20 con 0x7fa2c0159480 2023-10-06T04:45:01.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2bffff700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2c0159480 0x7fa2c00b34b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009ed0 tx=0x7fa2ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:01.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2bcff9700 1 -- 172.21.15.124:0/893738442 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011900 con 0x7fa2c0159480 2023-10-06T04:45:01.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2bcff9700 1 -- 172.21.15.124:0/893738442 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac011a60 con 0x7fa2c0159480 2023-10-06T04:45:01.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2c6dff700 1 -- 172.21.15.124:0/893738442 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac009420 con 0x7fa2c0159480 2023-10-06T04:45:01.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.075+0000 7fa2bcff9700 1 -- 172.21.15.124:0/893738442 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac025670 con 0x7fa2c0159480 2023-10-06T04:45:01.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.076+0000 7fa2c6dff700 1 -- 172.21.15.124:0/893738442 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c00c5aa0 con 0x7fa2c0159480 2023-10-06T04:45:01.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.077+0000 7fa2c6dff700 1 -- 172.21.15.124:0/893738442 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c004c380 con 0x7fa2c0159480 2023-10-06T04:45:01.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.077+0000 7fa2bcff9700 1 -- 172.21.15.124:0/893738442 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2ac023070 con 0x7fa2c0159480 2023-10-06T04:45:01.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.079+0000 7fa2bcff9700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa2a4066f30 0x7fa2a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.079+0000 7fa2bcff9700 1 -- 172.21.15.124:0/893738442 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa2ac085c00 con 0x7fa2c0159480 2023-10-06T04:45:01.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.079+0000 7fa2c4b9b700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa2a4066f30 0x7fa2a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.079+0000 7fa2c4b9b700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa2a4066f30 0x7fa2a40693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40058d0 tx=0x7fa2b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:01.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.083+0000 7fa2bcff9700 1 -- 172.21.15.124:0/893738442 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2ac08c080 con 0x7fa2c0159480 2023-10-06T04:45:01.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.271+0000 7fa2c6dff700 1 -- 172.21.15.124:0/893738442 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2c0068c30 con 0x7fa2c0159480 2023-10-06T04:45:01.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.271+0000 7fa2bcff9700 1 -- 172.21.15.124:0/893738442 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2ac02a0a0 con 0x7fa2c0159480 2023-10-06T04:45:01.273 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-06T04:45:01.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 -- 172.21.15.124:0/893738442 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa2a4066f30 msgr2=0x7fa2a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa2a4066f30 0x7fa2a40693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40058d0 tx=0x7fa2b4009040 comp rx=0 tx=0).stop 2023-10-06T04:45:01.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 -- 172.21.15.124:0/893738442 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2c0159480 msgr2=0x7fa2c00b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2c0159480 0x7fa2c00b34b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009ed0 tx=0x7fa2ac017000 comp rx=0 tx=0).stop 2023-10-06T04:45:01.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 -- 172.21.15.124:0/893738442 shutdown_connections 2023-10-06T04:45:01.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa2a4066f30 0x7fa2a40693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2c015dce0 0x7fa2c0158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2c006d5a0 0x7fa2c00c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 --2- 172.21.15.124:0/893738442 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2c0159480 0x7fa2c00b34b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 -- 172.21.15.124:0/893738442 >> 172.21.15.124:0/893738442 conn(0x7fa2c0063cc0 msgr2=0x7fa2c01545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:01.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 -- 172.21.15.124:0/893738442 shutdown_connections 2023-10-06T04:45:01.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.274+0000 7fa2c6dff700 1 -- 172.21.15.124:0/893738442 wait complete. 2023-10-06T04:45:01.293 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:01.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.481+0000 7f857edff700 1 Processor -- start 2023-10-06T04:45:01.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.481+0000 7f857edff700 1 -- start start 2023-10-06T04:45:01.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.483+0000 7f857edff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85780abb60 0x7f85780abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.483+0000 7f857edff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f85780690b0 0x7f8578099610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.483+0000 7f857edff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85780acc40 con 0x7f85780ccd30 2023-10-06T04:45:01.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.483+0000 7f857edff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85780ad0d0 con 0x7f85780690b0 2023-10-06T04:45:01.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.483+0000 7f857edff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857806ae30 con 0x7f85780abb60 2023-10-06T04:45:01.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.483+0000 7f857d39c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f85780690b0 0x7f8578099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.483+0000 7f857d39c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f85780690b0 0x7f8578099610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54934/0 (socket says 172.21.15.124:54934) 2023-10-06T04:45:01.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.483+0000 7f857d39c700 1 -- 172.21.15.124:0/3772746615 learned_addr learned my addr 172.21.15.124:0/3772746615 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:01.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.483+0000 7f857cb9b700 1 --2- 172.21.15.124:0/3772746615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85780abb60 0x7f85780abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.484+0000 7f857d39c700 1 -- 172.21.15.124:0/3772746615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85780abb60 msgr2=0x7f85780abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:01.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.484+0000 7f857d39c700 1 --2- 172.21.15.124:0/3772746615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85780abb60 0x7f85780abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.484+0000 7f857d39c700 1 -- 172.21.15.124:0/3772746615 >> v1:172.21.15.158:6789/0 conn(0x7f85780ccd30 legacy=0x7f8578098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.484+0000 7f857d39c700 1 -- 172.21.15.124:0/3772746615 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780ac5f0 con 0x7f85780690b0 2023-10-06T04:45:01.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.484+0000 7f857d39c700 1 --2- 172.21.15.124:0/3772746615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780690b0 0x7f8578099610 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8570009f20 tx=0x7f8570009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd17c0ff10abeec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:01.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.484+0000 7f85777fe700 1 -- 172.21.15.124:0/3772746615 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857000e070 con 0x7f85780690b0 2023-10-06T04:45:01.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.484+0000 7f85777fe700 1 -- 172.21.15.124:0/3772746615 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857000b9d0 con 0x7f85780690b0 2023-10-06T04:45:01.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.484+0000 7f85777fe700 1 -- 172.21.15.124:0/3772746615 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700092e0 con 0x7f85780690b0 2023-10-06T04:45:01.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.485+0000 7f857edff700 1 -- 172.21.15.124:0/3772746615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780690b0 msgr2=0x7f8578099610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.485+0000 7f857edff700 1 --2- 172.21.15.124:0/3772746615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780690b0 0x7f8578099610 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8570009f20 tx=0x7f8570009840 comp rx=0 tx=0).stop 2023-10-06T04:45:01.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.485+0000 7f857edff700 1 -- 172.21.15.124:0/3772746615 shutdown_connections 2023-10-06T04:45:01.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.485+0000 7f857edff700 1 --2- 172.21.15.124:0/3772746615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780690b0 0x7f8578099610 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.485+0000 7f857edff700 1 --2- 172.21.15.124:0/3772746615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85780abb60 0x7f85780abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.485+0000 7f857edff700 1 -- 172.21.15.124:0/3772746615 >> 172.21.15.124:0/3772746615 conn(0x7f85780cc050 msgr2=0x7f85780cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:01.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.485+0000 7f857edff700 1 -- 172.21.15.124:0/3772746615 shutdown_connections 2023-10-06T04:45:01.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.485+0000 7f857edff700 1 -- 172.21.15.124:0/3772746615 wait complete. 2023-10-06T04:45:01.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.486+0000 7f857edff700 1 Processor -- start 2023-10-06T04:45:01.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.486+0000 7f857edff700 1 -- start start 2023-10-06T04:45:01.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.487+0000 7f857edff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85780690b0 0x7f8578169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.487+0000 7f857edff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780abb60 0x7f85780a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.487+0000 7f857edff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85780ccd30 0x7f8578157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.487+0000 7f857edff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780a9f80 con 0x7f85780abb60 2023-10-06T04:45:01.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.487+0000 7f857edff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857816a360 con 0x7f85780ccd30 2023-10-06T04:45:01.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.487+0000 7f857edff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85780a7590 con 0x7f85780690b0 2023-10-06T04:45:01.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.487+0000 7f8577fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780abb60 0x7f85780a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.487+0000 7f8577fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780abb60 0x7f85780a9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54936/0 (socket says 172.21.15.124:54936) 2023-10-06T04:45:01.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.487+0000 7f8577fff700 1 -- 172.21.15.124:0/2214576965 learned_addr learned my addr 172.21.15.124:0/2214576965 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:01.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f857cb9b700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85780690b0 0x7f8578169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f857d39c700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85780ccd30 0x7f8578157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f8577fff700 1 -- 172.21.15.124:0/2214576965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85780690b0 msgr2=0x7f8578169e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f8577fff700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85780690b0 0x7f8578169e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f8577fff700 1 -- 172.21.15.124:0/2214576965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85780ccd30 msgr2=0x7f8578157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f8577fff700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85780ccd30 0x7f8578157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f8577fff700 1 -- 172.21.15.124:0/2214576965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8570009ae0 con 0x7f85780abb60 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f8577fff700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780abb60 0x7f85780a9340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f856400c4e0 tx=0x7f856400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f8574ff9700 1 -- 172.21.15.124:0/2214576965 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564011590 con 0x7f85780abb60 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f8574ff9700 1 -- 172.21.15.124:0/2214576965 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8564011710 con 0x7f85780abb60 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f8574ff9700 1 -- 172.21.15.124:0/2214576965 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564011ad0 con 0x7f85780abb60 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.488+0000 7f857edff700 1 -- 172.21.15.124:0/2214576965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85780a7870 con 0x7f85780abb60 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.489+0000 7f857edff700 1 -- 172.21.15.124:0/2214576965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85780a7e30 con 0x7f85780abb60 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.489+0000 7f857edff700 1 -- 172.21.15.124:0/2214576965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85780717a0 con 0x7f85780abb60 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.490+0000 7f8574ff9700 1 -- 172.21.15.124:0/2214576965 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f856401b3b0 con 0x7f85780abb60 2023-10-06T04:45:01.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.491+0000 7f8574ff9700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f855c066f30 0x7f855c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.491+0000 7f8574ff9700 1 -- 172.21.15.124:0/2214576965 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8564083af0 con 0x7f85780abb60 2023-10-06T04:45:01.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.492+0000 7f857cb9b700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f855c066f30 0x7f855c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.492+0000 7f857cb9b700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f855c066f30 0x7f855c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f856c009d10 tx=0x7f856c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:01.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.495+0000 7f8574ff9700 1 -- 172.21.15.124:0/2214576965 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8564050b60 con 0x7f85780abb60 2023-10-06T04:45:01.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.686+0000 7f857edff700 1 -- 172.21.15.124:0/2214576965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85780ca720 con 0x7f85780abb60 2023-10-06T04:45:01.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.687+0000 7f8574ff9700 1 -- 172.21.15.124:0/2214576965 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f8564017070 con 0x7f85780abb60 2023-10-06T04:45:01.688 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:01.688 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:01.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 -- 172.21.15.124:0/2214576965 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f855c066f30 msgr2=0x7f855c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f855c066f30 0x7f855c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f856c009d10 tx=0x7f856c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 -- 172.21.15.124:0/2214576965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780abb60 msgr2=0x7f85780a9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780abb60 0x7f85780a9340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f856400c4e0 tx=0x7f856400c7f0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 -- 172.21.15.124:0/2214576965 shutdown_connections 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85780ccd30 0x7f8578157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f855c066f30 0x7f855c0693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f85780690b0 0x7f8578169e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 --2- 172.21.15.124:0/2214576965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85780abb60 0x7f85780a9340 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 -- 172.21.15.124:0/2214576965 >> 172.21.15.124:0/2214576965 conn(0x7f85780cc050 msgr2=0x7f85780aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 -- 172.21.15.124:0/2214576965 shutdown_connections 2023-10-06T04:45:01.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.689+0000 7f857edff700 1 -- 172.21.15.124:0/2214576965 wait complete. 2023-10-06T04:45:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:44:25.771714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:44:26.609661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:45:01.710 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:45:01.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.902+0000 7f832b1ff700 1 Processor -- start 2023-10-06T04:45:01.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.902+0000 7f832b1ff700 1 -- start start 2023-10-06T04:45:01.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.903+0000 7f832b1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83241592b0 0x7f83240b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.903+0000 7f832b1ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f83240cc780 0x7f83240ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.903+0000 7f832b1ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832415d620 con 0x7f8324159680 2023-10-06T04:45:01.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.903+0000 7f832b1ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832415d0d0 con 0x7f83240cc780 2023-10-06T04:45:01.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.903+0000 7f832b1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83240b2ed0 con 0x7f83241592b0 2023-10-06T04:45:01.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.903+0000 7f8323fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f8324159680 0x7f832415dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50226/0 (socket says 172.21.15.124:50226) 2023-10-06T04:45:01.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.903+0000 7f8323fff700 1 -- 172.21.15.124:0/4143946386 learned_addr learned my addr 172.21.15.124:0/4143946386 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:01.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.904+0000 7f8328f9b700 1 --2- 172.21.15.124:0/4143946386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83241592b0 0x7f83240b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.904+0000 7f832979c700 1 --2- 172.21.15.124:0/4143946386 >> v2:172.21.15.158:3300/0 conn(0x7f83240cc780 0x7f83240ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.904+0000 7f83237fe700 1 -- 172.21.15.124:0/4143946386 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800465490 0 0) 0x7f832415d620 con 0x7f8324159680 2023-10-06T04:45:01.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.904+0000 7f83237fe700 1 -- 172.21.15.124:0/4143946386 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8314003570 con 0x7f8324159680 2023-10-06T04:45:01.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.904+0000 7f8328f9b700 1 -- 172.21.15.124:0/4143946386 >> v2:172.21.15.158:3300/0 conn(0x7f83240cc780 msgr2=0x7f83240ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:01.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.904+0000 7f8328f9b700 1 --2- 172.21.15.124:0/4143946386 >> v2:172.21.15.158:3300/0 conn(0x7f83240cc780 0x7f83240ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.904+0000 7f8328f9b700 1 -- 172.21.15.124:0/4143946386 >> v1:172.21.15.124:6789/0 conn(0x7f8324159680 legacy=0x7f832415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.904+0000 7f8328f9b700 1 -- 172.21.15.124:0/4143946386 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83240ccc20 con 0x7f83241592b0 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.904+0000 7f8328f9b700 1 --2- 172.21.15.124:0/4143946386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83241592b0 0x7f83240b0080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f83180098e0 tx=0x7f83180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eca7073ce1001384 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f83237fe700 1 -- 172.21.15.124:0/4143946386 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8318011630 con 0x7f83241592b0 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f83237fe700 1 -- 172.21.15.124:0/4143946386 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8318011790 con 0x7f83241592b0 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f83237fe700 1 -- 172.21.15.124:0/4143946386 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8318011b30 con 0x7f83241592b0 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f832b1ff700 1 -- 172.21.15.124:0/4143946386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83241592b0 msgr2=0x7f83240b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f832b1ff700 1 --2- 172.21.15.124:0/4143946386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83241592b0 0x7f83240b0080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f83180098e0 tx=0x7f83180091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f832b1ff700 1 -- 172.21.15.124:0/4143946386 shutdown_connections 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f832b1ff700 1 --2- 172.21.15.124:0/4143946386 >> v2:172.21.15.158:3300/0 conn(0x7f83240cc780 0x7f83240ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f832b1ff700 1 --2- 172.21.15.124:0/4143946386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83241592b0 0x7f83240b0080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f832b1ff700 1 -- 172.21.15.124:0/4143946386 >> 172.21.15.124:0/4143946386 conn(0x7f832406ed20 msgr2=0x7f832406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:01.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f832b1ff700 1 -- 172.21.15.124:0/4143946386 shutdown_connections 2023-10-06T04:45:01.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.905+0000 7f832b1ff700 1 -- 172.21.15.124:0/4143946386 wait complete. 2023-10-06T04:45:01.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.907+0000 7f832b1ff700 1 Processor -- start 2023-10-06T04:45:01.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.907+0000 7f832b1ff700 1 -- start start 2023-10-06T04:45:01.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f832b1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83240cc780 0x7f83240c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f832b1ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83241592b0 0x7f83240c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f832b1ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8324159680 0x7f8324169fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f832b1ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8324156de0 con 0x7f8324159680 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f832b1ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83240ca000 con 0x7f83241592b0 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f832b1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83240ca2e0 con 0x7f83240cc780 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f832979c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8324159680 0x7f8324169fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f832979c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8324159680 0x7f8324169fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54940/0 (socket says 172.21.15.124:54940) 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f832979c700 1 -- 172.21.15.124:0/1805636440 learned_addr learned my addr 172.21.15.124:0/1805636440 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f8328f9b700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83240cc780 0x7f83240c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.908+0000 7f8323fff700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83241592b0 0x7f83240c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.909+0000 7f832979c700 1 -- 172.21.15.124:0/1805636440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83240cc780 msgr2=0x7f83240c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.909+0000 7f832979c700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83240cc780 0x7f83240c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.909+0000 7f832979c700 1 -- 172.21.15.124:0/1805636440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83241592b0 msgr2=0x7f83240c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:01.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.909+0000 7f832979c700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83241592b0 0x7f83240c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:01.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.909+0000 7f832979c700 1 -- 172.21.15.124:0/1805636440 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318009420 con 0x7f8324159680 2023-10-06T04:45:01.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.909+0000 7f832979c700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8324159680 0x7f8324169fc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f831c009e90 tx=0x7f831c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:01.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.909+0000 7f8320ff9700 1 -- 172.21.15.124:0/1805636440 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00cb70 con 0x7f8324159680 2023-10-06T04:45:01.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.909+0000 7f8320ff9700 1 -- 172.21.15.124:0/1805636440 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00f040 con 0x7f8324159680 2023-10-06T04:45:01.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.909+0000 7f8320ff9700 1 -- 172.21.15.124:0/1805636440 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c014480 con 0x7f8324159680 2023-10-06T04:45:01.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.909+0000 7f832b1ff700 1 -- 172.21.15.124:0/1805636440 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83240ca5c0 con 0x7f8324159680 2023-10-06T04:45:01.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.910+0000 7f832b1ff700 1 -- 172.21.15.124:0/1805636440 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83240c6b10 con 0x7f8324159680 2023-10-06T04:45:01.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.911+0000 7f832b1ff700 1 -- 172.21.15.124:0/1805636440 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83240b5260 con 0x7f8324159680 2023-10-06T04:45:01.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.911+0000 7f8320ff9700 1 -- 172.21.15.124:0/1805636440 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f831c014830 con 0x7f8324159680 2023-10-06T04:45:01.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.912+0000 7f8320ff9700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8308066f30 0x7f83080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:01.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.912+0000 7f8320ff9700 1 -- 172.21.15.124:0/1805636440 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f831c0850c0 con 0x7f8324159680 2023-10-06T04:45:01.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.912+0000 7f8328f9b700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8308066f30 0x7f83080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:01.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.913+0000 7f8328f9b700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8308066f30 0x7f83080693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f83180091e0 tx=0x7f8318017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:01.918 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:01.916+0000 7f8320ff9700 1 -- 172.21.15.124:0/1805636440 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f831c0521d0 con 0x7f8324159680 2023-10-06T04:45:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.112+0000 7f832b1ff700 1 -- 172.21.15.124:0/1805636440 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83240b6410 con 0x7f8324159680 2023-10-06T04:45:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.113+0000 7f8320ff9700 1 -- 172.21.15.124:0/1805636440 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f831c0557f0 con 0x7f8324159680 2023-10-06T04:45:02.115 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:45:02.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 -- 172.21.15.124:0/1805636440 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8308066f30 msgr2=0x7f83080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8308066f30 0x7f83080693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f83180091e0 tx=0x7f8318017000 comp rx=0 tx=0).stop 2023-10-06T04:45:02.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 -- 172.21.15.124:0/1805636440 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8324159680 msgr2=0x7f8324169fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8324159680 0x7f8324169fc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f831c009e90 tx=0x7f831c00b040 comp rx=0 tx=0).stop 2023-10-06T04:45:02.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 -- 172.21.15.124:0/1805636440 shutdown_connections 2023-10-06T04:45:02.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8324159680 0x7f8324169fc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8308066f30 0x7f83080693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83240cc780 0x7f83240c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 --2- 172.21.15.124:0/1805636440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83241592b0 0x7f83240c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 -- 172.21.15.124:0/1805636440 >> 172.21.15.124:0/1805636440 conn(0x7f832406ed20 msgr2=0x7f83241560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:02.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 -- 172.21.15.124:0/1805636440 shutdown_connections 2023-10-06T04:45:02.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.115+0000 7f832b1ff700 1 -- 172.21.15.124:0/1805636440 wait complete. 2023-10-06T04:45:02.135 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:45:02.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.326+0000 7fb86cbff700 1 Processor -- start 2023-10-06T04:45:02.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.327+0000 7fb86cbff700 1 -- start start 2023-10-06T04:45:02.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb86cbff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb868159480 0x7fb86815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb86cbff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb8680c8840 0x7fb86806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb86cbff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb86806d5a0 0x7fb86806b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb86cbff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86806da00 con 0x7fb8680c8840 2023-10-06T04:45:02.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb86cbff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb868068700 con 0x7fb868159480 2023-10-06T04:45:02.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb86cbff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680c9030 con 0x7fb86806d5a0 2023-10-06T04:45:02.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb865d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb8680c8840 0x7fb86806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb865d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb8680c8840 0x7fb86806d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54944/0 (socket says 172.21.15.124:54944) 2023-10-06T04:45:02.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb865d9b700 1 -- 172.21.15.124:0/2801401707 learned_addr learned my addr 172.21.15.124:0/2801401707 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:02.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb86659c700 1 --2- 172.21.15.124:0/2801401707 >> v2:172.21.15.158:3300/0 conn(0x7fb868159480 0x7fb86815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.328+0000 7fb866d9d700 1 --2- 172.21.15.124:0/2801401707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb86806d5a0 0x7fb86806b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb865d9b700 1 -- 172.21.15.124:0/2801401707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb86806d5a0 msgr2=0x7fb86806b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:02.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb865d9b700 1 --2- 172.21.15.124:0/2801401707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb86806d5a0 0x7fb86806b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb865d9b700 1 -- 172.21.15.124:0/2801401707 >> v2:172.21.15.158:3300/0 conn(0x7fb868159480 msgr2=0x7fb86815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:02.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb865d9b700 1 --2- 172.21.15.124:0/2801401707 >> v2:172.21.15.158:3300/0 conn(0x7fb868159480 0x7fb86815dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb865d9b700 1 -- 172.21.15.124:0/2801401707 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb868068950 con 0x7fb8680c8840 2023-10-06T04:45:02.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb86659c700 1 --2- 172.21.15.124:0/2801401707 >> v2:172.21.15.158:3300/0 conn(0x7fb868159480 0x7fb86815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:02.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb866d9d700 1 --2- 172.21.15.124:0/2801401707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb86806d5a0 0x7fb86806b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:02.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb865d9b700 1 --2- 172.21.15.124:0/2801401707 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8680c8840 0x7fb86806d060 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb8680cdf00 tx=0x7fb85c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d232dabdc8a5dd06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:02.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb86559a700 1 -- 172.21.15.124:0/2801401707 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00b860 con 0x7fb8680c8840 2023-10-06T04:45:02.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb86559a700 1 -- 172.21.15.124:0/2801401707 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c00b9c0 con 0x7fb8680c8840 2023-10-06T04:45:02.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.329+0000 7fb86559a700 1 -- 172.21.15.124:0/2801401707 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00bd60 con 0x7fb8680c8840 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.330+0000 7fb86cbff700 1 -- 172.21.15.124:0/2801401707 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8680c8840 msgr2=0x7fb86806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.330+0000 7fb86cbff700 1 --2- 172.21.15.124:0/2801401707 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8680c8840 0x7fb86806d060 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb8680cdf00 tx=0x7fb85c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.330+0000 7fb86cbff700 1 -- 172.21.15.124:0/2801401707 shutdown_connections 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.330+0000 7fb86cbff700 1 --2- 172.21.15.124:0/2801401707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb86806d5a0 0x7fb86806b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.330+0000 7fb86cbff700 1 --2- 172.21.15.124:0/2801401707 >> v2:172.21.15.158:3300/0 conn(0x7fb868159480 0x7fb86815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.330+0000 7fb86cbff700 1 --2- 172.21.15.124:0/2801401707 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8680c8840 0x7fb86806d060 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.330+0000 7fb86cbff700 1 -- 172.21.15.124:0/2801401707 >> 172.21.15.124:0/2801401707 conn(0x7fb868063cc0 msgr2=0x7fb8680ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.330+0000 7fb86cbff700 1 -- 172.21.15.124:0/2801401707 shutdown_connections 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.330+0000 7fb86cbff700 1 -- 172.21.15.124:0/2801401707 wait complete. 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.331+0000 7fb86cbff700 1 Processor -- start 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.331+0000 7fb86cbff700 1 -- start start 2023-10-06T04:45:02.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.332+0000 7fb86cbff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb86806d5a0 0x7fb8680c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.332+0000 7fb86cbff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8680c8840 0x7fb868159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.332+0000 7fb86cbff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb868159480 0x7fb8680c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.332+0000 7fb86cbff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8681576c0 con 0x7fb86806d5a0 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.332+0000 7fb86cbff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680c4f80 con 0x7fb868159480 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.332+0000 7fb86cbff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680c4b50 con 0x7fb8680c8840 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.332+0000 7fb86659c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb86806d5a0 0x7fb8680c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb86659c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb86806d5a0 0x7fb8680c3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54952/0 (socket says 172.21.15.124:54952) 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb86659c700 1 -- 172.21.15.124:0/1845542830 learned_addr learned my addr 172.21.15.124:0/1845542830 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb866d9d700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb868159480 0x7fb8680c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb865d9b700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8680c8840 0x7fb868159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb86659c700 1 -- 172.21.15.124:0/1845542830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8680c8840 msgr2=0x7fb868159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb86659c700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8680c8840 0x7fb868159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb86659c700 1 -- 172.21.15.124:0/1845542830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb868159480 msgr2=0x7fb8680c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb86659c700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb868159480 0x7fb8680c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb86659c700 1 -- 172.21.15.124:0/1845542830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0094f0 con 0x7fb86806d5a0 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb866d9d700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb868159480 0x7fb8680c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb865d9b700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8680c8840 0x7fb868159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb86659c700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb86806d5a0 0x7fb8680c3eb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb85800e850 tx=0x7fb858008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb8567fc700 1 -- 172.21.15.124:0/1845542830 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858013410 con 0x7fb86806d5a0 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb8567fc700 1 -- 172.21.15.124:0/1845542830 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858013570 con 0x7fb86806d5a0 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb86cbff700 1 -- 172.21.15.124:0/1845542830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb868159d90 con 0x7fb86806d5a0 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.333+0000 7fb8567fc700 1 -- 172.21.15.124:0/1845542830 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858013910 con 0x7fb86806d5a0 2023-10-06T04:45:02.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.334+0000 7fb86cbff700 1 -- 172.21.15.124:0/1845542830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8680c4870 con 0x7fb86806d5a0 2023-10-06T04:45:02.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.334+0000 7fb86cbff700 1 -- 172.21.15.124:0/1845542830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8680ca740 con 0x7fb86806d5a0 2023-10-06T04:45:02.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.335+0000 7fb8567fc700 1 -- 172.21.15.124:0/1845542830 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb858013d00 con 0x7fb86806d5a0 2023-10-06T04:45:02.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.336+0000 7fb8567fc700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb848066f30 0x7fb8480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.336+0000 7fb8567fc700 1 -- 172.21.15.124:0/1845542830 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb858084480 con 0x7fb86806d5a0 2023-10-06T04:45:02.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.337+0000 7fb865d9b700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb848066f30 0x7fb8480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.337+0000 7fb865d9b700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb848066f30 0x7fb8480693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8680cdf00 tx=0x7fb85c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:02.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.340+0000 7fb8567fc700 1 -- 172.21.15.124:0/1845542830 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8580514f0 con 0x7fb86806d5a0 2023-10-06T04:45:02.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.529+0000 7fb86cbff700 1 -- 172.21.15.124:0/1845542830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb86804c380 con 0x7fb86806d5a0 2023-10-06T04:45:02.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.529+0000 7fb8567fc700 1 -- 172.21.15.124:0/1845542830 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb858054b10 con 0x7fb86806d5a0 2023-10-06T04:45:02.531 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:45:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 -- 172.21.15.124:0/1845542830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb848066f30 msgr2=0x7fb8480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb848066f30 0x7fb8480693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8680cdf00 tx=0x7fb85c017000 comp rx=0 tx=0).stop 2023-10-06T04:45:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 -- 172.21.15.124:0/1845542830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb86806d5a0 msgr2=0x7fb8680c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb86806d5a0 0x7fb8680c3eb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb85800e850 tx=0x7fb858008040 comp rx=0 tx=0).stop 2023-10-06T04:45:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 -- 172.21.15.124:0/1845542830 shutdown_connections 2023-10-06T04:45:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb868159480 0x7fb8680c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb86806d5a0 0x7fb8680c3eb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb848066f30 0x7fb8480693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 --2- 172.21.15.124:0/1845542830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8680c8840 0x7fb868159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 -- 172.21.15.124:0/1845542830 >> 172.21.15.124:0/1845542830 conn(0x7fb868063cc0 msgr2=0x7fb868153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:02.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 -- 172.21.15.124:0/1845542830 shutdown_connections 2023-10-06T04:45:02.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.532+0000 7fb86cbff700 1 -- 172.21.15.124:0/1845542830 wait complete. 2023-10-06T04:45:02.551 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:45:02.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.742+0000 7f2e9c3ff700 1 Processor -- start 2023-10-06T04:45:02.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.742+0000 7f2e9c3ff700 1 -- start start 2023-10-06T04:45:02.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.743+0000 7f2e9c3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e941592b0 0x7f2e940b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.743+0000 7f2e9c3ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9415d620 con 0x7f2e940cc780 2023-10-06T04:45:02.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.743+0000 7f2e9c3ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e940ccc20 con 0x7f2e94159680 2023-10-06T04:45:02.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.743+0000 7f2e9c3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9415d0d0 con 0x7f2e941592b0 2023-10-06T04:45:02.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.744+0000 7f2e9a99c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2e940cc780 0x7f2e940ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50232/0 (socket says 172.21.15.124:50232) 2023-10-06T04:45:02.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.744+0000 7f2e9a99c700 1 -- 172.21.15.124:0/3537888544 learned_addr learned my addr 172.21.15.124:0/3537888544 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:02.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.744+0000 7f2e9a19b700 1 --2- 172.21.15.124:0/3537888544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e941592b0 0x7f2e940b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.744+0000 7f2e99199700 1 -- 172.21.15.124:0/3537888544 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603362558 0 0) 0x7f2e9415d620 con 0x7f2e940cc780 2023-10-06T04:45:02.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.744+0000 7f2e99199700 1 -- 172.21.15.124:0/3537888544 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e80003570 con 0x7f2e940cc780 2023-10-06T04:45:02.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.744+0000 7f2e99199700 1 -- 172.21.15.124:0/3537888544 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053080067 0 0) 0x7f2e940ccc20 con 0x7f2e94159680 2023-10-06T04:45:02.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.744+0000 7f2e99199700 1 -- 172.21.15.124:0/3537888544 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e9415d620 con 0x7f2e94159680 2023-10-06T04:45:02.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.744+0000 7f2e9a19b700 1 -- 172.21.15.124:0/3537888544 >> v1:172.21.15.158:6789/0 conn(0x7f2e94159680 legacy=0x7f2e9415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.744+0000 7f2e9a19b700 1 -- 172.21.15.124:0/3537888544 >> v1:172.21.15.124:6789/0 conn(0x7f2e940cc780 legacy=0x7f2e940ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.744+0000 7f2e9a19b700 1 -- 172.21.15.124:0/3537888544 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e940b0760 con 0x7f2e941592b0 2023-10-06T04:45:02.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.745+0000 7f2e9a19b700 1 --2- 172.21.15.124:0/3537888544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e941592b0 0x7f2e940b0080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009910 tx=0x7f2e900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=167f0207fec1070a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:02.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.745+0000 7f2e99199700 1 -- 172.21.15.124:0/3537888544 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90011630 con 0x7f2e941592b0 2023-10-06T04:45:02.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.745+0000 7f2e99199700 1 -- 172.21.15.124:0/3537888544 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e90011790 con 0x7f2e941592b0 2023-10-06T04:45:02.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.745+0000 7f2e99199700 1 -- 172.21.15.124:0/3537888544 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90011b10 con 0x7f2e941592b0 2023-10-06T04:45:02.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.745+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/3537888544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e941592b0 msgr2=0x7f2e940b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.745+0000 7f2e9c3ff700 1 --2- 172.21.15.124:0/3537888544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e941592b0 0x7f2e940b0080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009910 tx=0x7f2e900091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.746+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/3537888544 shutdown_connections 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.746+0000 7f2e9c3ff700 1 --2- 172.21.15.124:0/3537888544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e941592b0 0x7f2e940b0080 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.746+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/3537888544 >> 172.21.15.124:0/3537888544 conn(0x7f2e9406ed20 msgr2=0x7f2e9406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.746+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/3537888544 shutdown_connections 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.746+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/3537888544 wait complete. 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.747+0000 7f2e9c3ff700 1 Processor -- start 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.747+0000 7f2e9c3ff700 1 -- start start 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.748+0000 7f2e9c3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e940cc780 0x7f2e9414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.748+0000 7f2e9c3ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e941592b0 0x7f2e94158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.748+0000 7f2e9c3ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e94159680 0x7f2e94158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.748+0000 7f2e9c3ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9415a7f0 con 0x7f2e941592b0 2023-10-06T04:45:02.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.748+0000 7f2e9c3ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9415a500 con 0x7f2e94159680 2023-10-06T04:45:02.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.748+0000 7f2e9c3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e941504d0 con 0x7f2e940cc780 2023-10-06T04:45:02.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.748+0000 7f2e9999a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e941592b0 0x7f2e94158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.748+0000 7f2e9999a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e941592b0 0x7f2e94158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54962/0 (socket says 172.21.15.124:54962) 2023-10-06T04:45:02.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.748+0000 7f2e9999a700 1 -- 172.21.15.124:0/336759151 learned_addr learned my addr 172.21.15.124:0/336759151 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:02.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e9a19b700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e940cc780 0x7f2e9414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e9a99c700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e94159680 0x7f2e94158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e9999a700 1 -- 172.21.15.124:0/336759151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e940cc780 msgr2=0x7f2e9414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e9999a700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e940cc780 0x7f2e9414ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e9999a700 1 -- 172.21.15.124:0/336759151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e94159680 msgr2=0x7f2e94158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e9999a700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e94159680 0x7f2e94158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e9999a700 1 -- 172.21.15.124:0/336759151 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90009420 con 0x7f2e941592b0 2023-10-06T04:45:02.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e9999a700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e941592b0 0x7f2e94158320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400c790 tx=0x7f2e84007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:02.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e8a7fc700 1 -- 172.21.15.124:0/336759151 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84010510 con 0x7f2e941592b0 2023-10-06T04:45:02.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e8a7fc700 1 -- 172.21.15.124:0/336759151 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84010670 con 0x7f2e941592b0 2023-10-06T04:45:02.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/336759151 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e940c9ed0 con 0x7f2e941592b0 2023-10-06T04:45:02.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.749+0000 7f2e8a7fc700 1 -- 172.21.15.124:0/336759151 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84010a10 con 0x7f2e941592b0 2023-10-06T04:45:02.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.750+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/336759151 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e940c9ba0 con 0x7f2e941592b0 2023-10-06T04:45:02.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.750+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/336759151 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9404c380 con 0x7f2e941592b0 2023-10-06T04:45:02.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.751+0000 7f2e8a7fc700 1 -- 172.21.15.124:0/336759151 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e8401b3b0 con 0x7f2e941592b0 2023-10-06T04:45:02.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.752+0000 7f2e8a7fc700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e78066f30 0x7f2e780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:02.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.752+0000 7f2e8a7fc700 1 -- 172.21.15.124:0/336759151 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e84083fd0 con 0x7f2e941592b0 2023-10-06T04:45:02.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.752+0000 7f2e9a19b700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e78066f30 0x7f2e780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:02.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.753+0000 7f2e9a19b700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e78066f30 0x7f2e780693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009860 tx=0x7f2e90017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:02.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.756+0000 7f2e8a7fc700 1 -- 172.21.15.124:0/336759151 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e84051040 con 0x7f2e941592b0 2023-10-06T04:45:02.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.944+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/336759151 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e9415a930 con 0x7f2e941592b0 2023-10-06T04:45:02.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.944+0000 7f2e8a7fc700 1 -- 172.21.15.124:0/336759151 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e840170a0 con 0x7f2e941592b0 2023-10-06T04:45:02.946 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-06T04:45:02.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/336759151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e78066f30 msgr2=0x7f2e780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e78066f30 0x7f2e780693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009860 tx=0x7f2e90017000 comp rx=0 tx=0).stop 2023-10-06T04:45:02.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/336759151 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e941592b0 msgr2=0x7f2e94158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:02.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e941592b0 0x7f2e94158320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400c790 tx=0x7f2e84007e10 comp rx=0 tx=0).stop 2023-10-06T04:45:02.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/336759151 shutdown_connections 2023-10-06T04:45:02.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e94159680 0x7f2e94158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e78066f30 0x7f2e780693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e940cc780 0x7f2e9414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 --2- 172.21.15.124:0/336759151 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e941592b0 0x7f2e94158320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:02.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/336759151 >> 172.21.15.124:0/336759151 conn(0x7f2e9406ed20 msgr2=0x7f2e940ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:02.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/336759151 shutdown_connections 2023-10-06T04:45:02.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:02.947+0000 7f2e9c3ff700 1 -- 172.21.15.124:0/336759151 wait complete. 2023-10-06T04:45:02.966 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:45:03.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.158+0000 7ffbbf1ff700 1 Processor -- start 2023-10-06T04:45:03.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.158+0000 7ffbbf1ff700 1 -- start start 2023-10-06T04:45:03.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbbf1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb81592b0 0x7ffbb80b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbbf1ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ffbb80cc780 0x7ffbb80ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbbf1ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb815d620 con 0x7ffbb8159680 2023-10-06T04:45:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbbf1ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb815d0d0 con 0x7ffbb80cc780 2023-10-06T04:45:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbbf1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80b2ed0 con 0x7ffbb81592b0 2023-10-06T04:45:03.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbbd79c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ffbb80cc780 0x7ffbb80ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbbcf9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb81592b0 0x7ffbb80b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbbd79c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ffbb80cc780 0x7ffbb80ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:33134/0 (socket says 172.21.15.124:33134) 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbbd79c700 1 -- 172.21.15.124:0/3035820590 learned_addr learned my addr 172.21.15.124:0/3035820590 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbbcf9b700 1 --2- 172.21.15.124:0/3035820590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb81592b0 0x7ffbb80b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:36578/0 (socket says 172.21.15.124:36578) 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.159+0000 7ffbb7fff700 1 --1- 172.21.15.124:0/3035820590 >> v1:172.21.15.158:6789/0 conn(0x7ffbb8159680 0x7ffbb815dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:45288/0 (socket says 172.21.15.124:45288) 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.160+0000 7ffbbd79c700 1 -- 172.21.15.124:0/3035820590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb81592b0 msgr2=0x7ffbb80b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.160+0000 7ffbbd79c700 1 --2- 172.21.15.124:0/3035820590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb81592b0 0x7ffbb80b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.160+0000 7ffbbd79c700 1 -- 172.21.15.124:0/3035820590 >> v1:172.21.15.158:6789/0 conn(0x7ffbb8159680 legacy=0x7ffbb815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.160+0000 7ffbbd79c700 1 -- 172.21.15.124:0/3035820590 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb80ccc20 con 0x7ffbb80cc780 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.160+0000 7ffbb77fe700 1 -- 172.21.15.124:0/3035820590 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250749520 0 0) 0x7ffbb815d620 con 0x7ffbb8159680 2023-10-06T04:45:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.160+0000 7ffbbd79c700 1 --2- 172.21.15.124:0/3035820590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbb80cc780 0x7ffbb80ccea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009f20 tx=0x7ffbb0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c914e16c4f66cbf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.160+0000 7ffbb77fe700 1 -- 172.21.15.124:0/3035820590 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000e070 con 0x7ffbb80cc780 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.160+0000 7ffbb77fe700 1 -- 172.21.15.124:0/3035820590 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb000b9d0 con 0x7ffbb80cc780 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.160+0000 7ffbb77fe700 1 -- 172.21.15.124:0/3035820590 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00092e0 con 0x7ffbb80cc780 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.161+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/3035820590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbb80cc780 msgr2=0x7ffbb80ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.161+0000 7ffbbf1ff700 1 --2- 172.21.15.124:0/3035820590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbb80cc780 0x7ffbb80ccea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009f20 tx=0x7ffbb0009840 comp rx=0 tx=0).stop 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.161+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/3035820590 shutdown_connections 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.161+0000 7ffbbf1ff700 1 --2- 172.21.15.124:0/3035820590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbb80cc780 0x7ffbb80ccea0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.161+0000 7ffbbf1ff700 1 --2- 172.21.15.124:0/3035820590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb81592b0 0x7ffbb80b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.161+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/3035820590 >> 172.21.15.124:0/3035820590 conn(0x7ffbb806ed20 msgr2=0x7ffbb806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.161+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/3035820590 shutdown_connections 2023-10-06T04:45:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.161+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/3035820590 wait complete. 2023-10-06T04:45:03.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.163+0000 7ffbbf1ff700 1 Processor -- start 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.163+0000 7ffbbf1ff700 1 -- start start 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbbf1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb80cc780 0x7ffbb80c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbbf1ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffbb81592b0 0x7ffbb81698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbbf1ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbb8159680 0x7ffbb80c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbbf1ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80ce170 con 0x7ffbb81592b0 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbbf1ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80ce450 con 0x7ffbb8159680 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbbf1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80ce730 con 0x7ffbb80cc780 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbb7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffbb81592b0 0x7ffbb81698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbb7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffbb81592b0 0x7ffbb81698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:34970/0 (socket says 172.21.15.124:34970) 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbb7fff700 1 -- 172.21.15.124:0/1024806353 learned_addr learned my addr 172.21.15.124:0/1024806353 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:03.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbbcf9b700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb80cc780 0x7ffbb80c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbbd79c700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbb8159680 0x7ffbb80c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbb7fff700 1 -- 172.21.15.124:0/1024806353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb80cc780 msgr2=0x7ffbb80c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbb7fff700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb80cc780 0x7ffbb80c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbb7fff700 1 -- 172.21.15.124:0/1024806353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbb8159680 msgr2=0x7ffbb80c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbb7fff700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbb8159680 0x7ffbb80c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.164+0000 7ffbb7fff700 1 -- 172.21.15.124:0/1024806353 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb0009ae0 con 0x7ffbb81592b0 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.165+0000 7ffbb7fff700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffbb81592b0 0x7ffbb81698a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffba400c5b0 tx=0x7ffba4001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.165+0000 7ffbb4ff9700 1 -- 172.21.15.124:0/1024806353 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4005a70 con 0x7ffbb81592b0 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.165+0000 7ffbb4ff9700 1 -- 172.21.15.124:0/1024806353 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba4005bd0 con 0x7ffbb81592b0 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.165+0000 7ffbb4ff9700 1 -- 172.21.15.124:0/1024806353 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba40070d0 con 0x7ffbb81592b0 2023-10-06T04:45:03.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.165+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/1024806353 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb80cea10 con 0x7ffbb81592b0 2023-10-06T04:45:03.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.165+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/1024806353 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb80c9970 con 0x7ffbb81592b0 2023-10-06T04:45:03.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.166+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/1024806353 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb80c9b90 con 0x7ffbb81592b0 2023-10-06T04:45:03.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.167+0000 7ffbb4ff9700 1 -- 172.21.15.124:0/1024806353 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffba4007480 con 0x7ffbb81592b0 2023-10-06T04:45:03.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.168+0000 7ffbb4ff9700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ffb9c066f30 0x7ffb9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.168+0000 7ffbb4ff9700 1 -- 172.21.15.124:0/1024806353 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffba4083b80 con 0x7ffbb81592b0 2023-10-06T04:45:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.168+0000 7ffbbcf9b700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ffb9c066f30 0x7ffb9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.169+0000 7ffbbcf9b700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ffb9c066f30 0x7ffb9c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009db0 tx=0x7ffbac0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:03.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.172+0000 7ffbb4ff9700 1 -- 172.21.15.124:0/1024806353 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffba4050bf0 con 0x7ffbb81592b0 2023-10-06T04:45:03.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.362+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/1024806353 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffbb80cef30 con 0x7ffbb81592b0 2023-10-06T04:45:03.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.362+0000 7ffbb4ff9700 1 -- 172.21.15.124:0/1024806353 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffbb80cef30 con 0x7ffbb81592b0 2023-10-06T04:45:03.365 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-06T04:45:03.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/1024806353 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ffb9c066f30 msgr2=0x7ffb9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ffb9c066f30 0x7ffb9c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009db0 tx=0x7ffbac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/1024806353 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffbb81592b0 msgr2=0x7ffbb81698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffbb81592b0 0x7ffbb81698a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffba400c5b0 tx=0x7ffba4001040 comp rx=0 tx=0).stop 2023-10-06T04:45:03.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/1024806353 shutdown_connections 2023-10-06T04:45:03.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbb8159680 0x7ffbb80c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ffb9c066f30 0x7ffb9c0693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbb80cc780 0x7ffbb80c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 --2- 172.21.15.124:0/1024806353 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffbb81592b0 0x7ffbb81698a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/1024806353 >> 172.21.15.124:0/1024806353 conn(0x7ffbb806ed20 msgr2=0x7ffbb815d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:03.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/1024806353 shutdown_connections 2023-10-06T04:45:03.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.365+0000 7ffbbf1ff700 1 -- 172.21.15.124:0/1024806353 wait complete. 2023-10-06T04:45:03.385 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:03.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.573+0000 7f0881bff700 1 Processor -- start 2023-10-06T04:45:03.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.573+0000 7f0881bff700 1 -- start start 2023-10-06T04:45:03.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.574+0000 7f0881bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f087c15a750 0x7f087c0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.574+0000 7f0881bff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f087c0cd1b0 0x7f087c0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.574+0000 7f0881bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f087c0cb1a0 0x7f087c15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.574+0000 7f0881bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c0cbf10 con 0x7f087c15a750 2023-10-06T04:45:03.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.574+0000 7f0881bff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c15b230 con 0x7f087c0cd1b0 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.574+0000 7f0881bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0cd650 con 0x7f087c0cb1a0 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.574+0000 7f087b7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f087c15a750 0x7f087c0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.574+0000 7f087b7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f087c15a750 0x7f087c0ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:34976/0 (socket says 172.21.15.124:34976) 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.574+0000 7f087b7fe700 1 -- 172.21.15.124:0/1742515248 learned_addr learned my addr 172.21.15.124:0/1742515248 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087affd700 1 --2- 172.21.15.124:0/1742515248 >> v2:172.21.15.158:3300/0 conn(0x7f087c0cd1b0 0x7f087c0cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087bfff700 1 --2- 172.21.15.124:0/1742515248 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f087c0cb1a0 0x7f087c15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087b7fe700 1 -- 172.21.15.124:0/1742515248 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f087c0cb1a0 msgr2=0x7f087c15b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087b7fe700 1 --2- 172.21.15.124:0/1742515248 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f087c0cb1a0 0x7f087c15b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087b7fe700 1 -- 172.21.15.124:0/1742515248 >> v2:172.21.15.158:3300/0 conn(0x7f087c0cd1b0 msgr2=0x7f087c0cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087b7fe700 1 --2- 172.21.15.124:0/1742515248 >> v2:172.21.15.158:3300/0 conn(0x7f087c0cd1b0 0x7f087c0cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087b7fe700 1 -- 172.21.15.124:0/1742515248 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c0cb950 con 0x7f087c15a750 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087b7fe700 1 --2- 172.21.15.124:0/1742515248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c15a750 0x7f087c0ccc70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f087c088740 tx=0x7f086c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9621ee2ac2d8fe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087a7fc700 1 -- 172.21.15.124:0/1742515248 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00b860 con 0x7f087c15a750 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087a7fc700 1 -- 172.21.15.124:0/1742515248 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c00b9c0 con 0x7f087c15a750 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.575+0000 7f087a7fc700 1 -- 172.21.15.124:0/1742515248 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00bd60 con 0x7f087c15a750 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.576+0000 7f0881bff700 1 -- 172.21.15.124:0/1742515248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c15a750 msgr2=0x7f087c0ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.576+0000 7f0881bff700 1 --2- 172.21.15.124:0/1742515248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c15a750 0x7f087c0ccc70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f087c088740 tx=0x7f086c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.576+0000 7f0881bff700 1 -- 172.21.15.124:0/1742515248 shutdown_connections 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.576+0000 7f0881bff700 1 --2- 172.21.15.124:0/1742515248 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f087c0cb1a0 0x7f087c15b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.576+0000 7f0881bff700 1 --2- 172.21.15.124:0/1742515248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c15a750 0x7f087c0ccc70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.576+0000 7f0881bff700 1 --2- 172.21.15.124:0/1742515248 >> v2:172.21.15.158:3300/0 conn(0x7f087c0cd1b0 0x7f087c0cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.576+0000 7f0881bff700 1 -- 172.21.15.124:0/1742515248 >> 172.21.15.124:0/1742515248 conn(0x7f087c099710 msgr2=0x7f087c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:03.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.576+0000 7f0881bff700 1 -- 172.21.15.124:0/1742515248 shutdown_connections 2023-10-06T04:45:03.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.576+0000 7f0881bff700 1 -- 172.21.15.124:0/1742515248 wait complete. 2023-10-06T04:45:03.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.577+0000 7f0881bff700 1 Processor -- start 2023-10-06T04:45:03.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.578+0000 7f0881bff700 1 -- start start 2023-10-06T04:45:03.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.578+0000 7f0881bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f087c0cb1a0 0x7f087c0c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.578+0000 7f0881bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c0cd1b0 0x7f087c1532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.578+0000 7f0881bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f087c15a750 0x7f087c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f0881bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c153830 con 0x7f087c0cd1b0 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f0881bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0c9210 con 0x7f087c0cb1a0 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f0881bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0c94f0 con 0x7f087c15a750 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c0cd1b0 0x7f087c1532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c0cd1b0 0x7f087c1532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:34984/0 (socket says 172.21.15.124:34984) 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087affd700 1 -- 172.21.15.124:0/4044973550 learned_addr learned my addr 172.21.15.124:0/4044973550 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087b7fe700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f087c0cb1a0 0x7f087c0c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087bfff700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f087c15a750 0x7f087c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087affd700 1 -- 172.21.15.124:0/4044973550 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f087c15a750 msgr2=0x7f087c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087affd700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f087c15a750 0x7f087c0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087affd700 1 -- 172.21.15.124:0/4044973550 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f087c0cb1a0 msgr2=0x7f087c0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087affd700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f087c0cb1a0 0x7f087c0c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087affd700 1 -- 172.21.15.124:0/4044973550 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0094f0 con 0x7f087c0cd1b0 2023-10-06T04:45:03.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.579+0000 7f087affd700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c0cd1b0 0x7f087c1532f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f087000d860 tx=0x7f0870008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:03.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.580+0000 7f08637fe700 1 -- 172.21.15.124:0/4044973550 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870009610 con 0x7f087c0cd1b0 2023-10-06T04:45:03.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.580+0000 7f08637fe700 1 -- 172.21.15.124:0/4044973550 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870009770 con 0x7f087c0cd1b0 2023-10-06T04:45:03.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.580+0000 7f08637fe700 1 -- 172.21.15.124:0/4044973550 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870009b30 con 0x7f087c0cd1b0 2023-10-06T04:45:03.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.580+0000 7f0881bff700 1 -- 172.21.15.124:0/4044973550 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087c0c97d0 con 0x7f087c0cd1b0 2023-10-06T04:45:03.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.580+0000 7f0881bff700 1 -- 172.21.15.124:0/4044973550 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087c0c9d90 con 0x7f087c0cd1b0 2023-10-06T04:45:03.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.581+0000 7f0881bff700 1 -- 172.21.15.124:0/4044973550 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087c0c9f50 con 0x7f087c0cd1b0 2023-10-06T04:45:03.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.582+0000 7f08637fe700 1 -- 172.21.15.124:0/4044973550 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f087001e460 con 0x7f087c0cd1b0 2023-10-06T04:45:03.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.582+0000 7f08637fe700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.583+0000 7f08637fe700 1 -- 172.21.15.124:0/4044973550 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0870084da0 con 0x7f087c0cd1b0 2023-10-06T04:45:03.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.583+0000 7f087b7fe700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.583+0000 7f087b7fe700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0868066f30 0x7f08680693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f087c088740 tx=0x7f086c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:03.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.587+0000 7f08637fe700 1 -- 172.21.15.124:0/4044973550 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0870051e10 con 0x7f087c0cd1b0 2023-10-06T04:45:03.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.775+0000 7f0881bff700 1 -- 172.21.15.124:0/4044973550 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f087c0717a0 con 0x7f087c0cd1b0 2023-10-06T04:45:03.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.776+0000 7f08637fe700 1 -- 172.21.15.124:0/4044973550 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f0870055430 con 0x7f087c0cd1b0 2023-10-06T04:45:03.778 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:03.779 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:03.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.778+0000 7f0881bff700 1 -- 172.21.15.124:0/4044973550 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0868066f30 msgr2=0x7f08680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.778+0000 7f0881bff700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0868066f30 0x7f08680693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f087c088740 tx=0x7f086c017000 comp rx=0 tx=0).stop 2023-10-06T04:45:03.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.778+0000 7f0881bff700 1 -- 172.21.15.124:0/4044973550 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c0cd1b0 msgr2=0x7f087c1532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.778+0000 7f0881bff700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c0cd1b0 0x7f087c1532f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f087000d860 tx=0x7f0870008040 comp rx=0 tx=0).stop 2023-10-06T04:45:03.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.778+0000 7f0881bff700 1 -- 172.21.15.124:0/4044973550 shutdown_connections 2023-10-06T04:45:03.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.778+0000 7f0881bff700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.778+0000 7f0881bff700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f087c15a750 0x7f087c0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.778+0000 7f0881bff700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f087c0cb1a0 0x7f087c0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.778+0000 7f0881bff700 1 --2- 172.21.15.124:0/4044973550 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f087c0cd1b0 0x7f087c1532f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.779+0000 7f0881bff700 1 -- 172.21.15.124:0/4044973550 >> 172.21.15.124:0/4044973550 conn(0x7f087c099710 msgr2=0x7f087c158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:03.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.779+0000 7f0881bff700 1 -- 172.21.15.124:0/4044973550 shutdown_connections 2023-10-06T04:45:03.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.779+0000 7f0881bff700 1 -- 172.21.15.124:0/4044973550 wait complete. 2023-10-06T04:45:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:44:25.771714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:44:26.609661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:45:03.799 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:45:03.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.992+0000 7f221abff700 1 Processor -- start 2023-10-06T04:45:03.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.992+0000 7f221abff700 1 -- start start 2023-10-06T04:45:03.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.993+0000 7f221abff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2214069bd0 0x7f2214155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.993+0000 7f221abff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f22141596c0 0x7f2214156110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:03.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.993+0000 7f221abff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221406e240 con 0x7f2214155800 2023-10-06T04:45:03.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.993+0000 7f221abff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22141582a0 con 0x7f22141596c0 2023-10-06T04:45:03.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.993+0000 7f221abff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221406d630 con 0x7f2214069bd0 2023-10-06T04:45:03.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.993+0000 7f2213fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2214069bd0 0x7f2214155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.993+0000 7f221919c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f22141596c0 0x7f2214156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:03.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.993+0000 7f2213fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2214069bd0 0x7f2214155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:36624/0 (socket says 172.21.15.124:36624) 2023-10-06T04:45:03.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.993+0000 7f2213fff700 1 -- 172.21.15.124:0/9962989 learned_addr learned my addr 172.21.15.124:0/9962989 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:03.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.994+0000 7f2213fff700 1 -- 172.21.15.124:0/9962989 >> v2:172.21.15.158:3300/0 conn(0x7f22141596c0 msgr2=0x7f2214156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:03.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.994+0000 7f2213fff700 1 --2- 172.21.15.124:0/9962989 >> v2:172.21.15.158:3300/0 conn(0x7f22141596c0 0x7f2214156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.994+0000 7f2213fff700 1 -- 172.21.15.124:0/9962989 >> v1:172.21.15.158:6789/0 conn(0x7f2214155800 legacy=0x7f22140694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.994+0000 7f2213fff700 1 -- 172.21.15.124:0/9962989 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221406d910 con 0x7f2214069bd0 2023-10-06T04:45:03.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.994+0000 7f2213fff700 1 --2- 172.21.15.124:0/9962989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2214069bd0 0x7f2214155bd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22000099b0 tx=0x7f2200009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=321641d2de1eb6ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:03.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.994+0000 7f22137fe700 1 -- 172.21.15.124:0/9962989 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200009ea0 con 0x7f2214069bd0 2023-10-06T04:45:03.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.994+0000 7f22137fe700 1 -- 172.21.15.124:0/9962989 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220000b860 con 0x7f2214069bd0 2023-10-06T04:45:03.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.994+0000 7f22137fe700 1 -- 172.21.15.124:0/9962989 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000bc00 con 0x7f2214069bd0 2023-10-06T04:45:03.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.995+0000 7f221abff700 1 -- 172.21.15.124:0/9962989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2214069bd0 msgr2=0x7f2214155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:03.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.995+0000 7f221abff700 1 --2- 172.21.15.124:0/9962989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2214069bd0 0x7f2214155bd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22000099b0 tx=0x7f2200009250 comp rx=0 tx=0).stop 2023-10-06T04:45:03.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.995+0000 7f221abff700 1 -- 172.21.15.124:0/9962989 shutdown_connections 2023-10-06T04:45:03.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.995+0000 7f221abff700 1 --2- 172.21.15.124:0/9962989 >> v2:172.21.15.158:3300/0 conn(0x7f22141596c0 0x7f2214156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.995+0000 7f221abff700 1 --2- 172.21.15.124:0/9962989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2214069bd0 0x7f2214155bd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:03.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.995+0000 7f221abff700 1 -- 172.21.15.124:0/9962989 >> 172.21.15.124:0/9962989 conn(0x7f22140680c0 msgr2=0x7f22140cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:03.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.995+0000 7f221abff700 1 -- 172.21.15.124:0/9962989 shutdown_connections 2023-10-06T04:45:03.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.995+0000 7f221abff700 1 -- 172.21.15.124:0/9962989 wait complete. 2023-10-06T04:45:04.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.997+0000 7f221abff700 1 Processor -- start 2023-10-06T04:45:04.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.997+0000 7f221abff700 1 -- start start 2023-10-06T04:45:04.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.998+0000 7f221abff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2214069bd0 0x7f22140b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.998+0000 7f221abff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2214155800 0x7f22140c0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.998+0000 7f221abff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f22141596c0 0x7f22141504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.998+0000 7f221abff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214167760 con 0x7f2214155800 2023-10-06T04:45:04.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.998+0000 7f221abff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22140c0200 con 0x7f2214069bd0 2023-10-06T04:45:04.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.998+0000 7f221abff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22140bf910 con 0x7f22141596c0 2023-10-06T04:45:04.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.998+0000 7f2213fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2214155800 0x7f22140c0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.998+0000 7f2213fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2214155800 0x7f22140c0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:34986/0 (socket says 172.21.15.124:34986) 2023-10-06T04:45:04.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.998+0000 7f2213fff700 1 -- 172.21.15.124:0/4203307004 learned_addr learned my addr 172.21.15.124:0/4203307004 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:04.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f221919c700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f22141596c0 0x7f22141504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f2213fff700 1 -- 172.21.15.124:0/4203307004 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f22141596c0 msgr2=0x7f22141504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f221899b700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2214069bd0 0x7f22140b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f2213fff700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f22141596c0 0x7f22141504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f2213fff700 1 -- 172.21.15.124:0/4203307004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2214069bd0 msgr2=0x7f22140b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f2213fff700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2214069bd0 0x7f22140b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f2213fff700 1 -- 172.21.15.124:0/4203307004 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22000094f0 con 0x7f2214155800 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f221899b700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2214069bd0 0x7f22140b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f2213fff700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2214155800 0x7f22140c0990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f221406d770 tx=0x7f2200017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f2210ff9700 1 -- 172.21.15.124:0/4203307004 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000bbe0 con 0x7f2214155800 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f2210ff9700 1 -- 172.21.15.124:0/4203307004 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2200011420 con 0x7f2214155800 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f221abff700 1 -- 172.21.15.124:0/4203307004 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22140bfbb0 con 0x7f2214155800 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f2210ff9700 1 -- 172.21.15.124:0/4203307004 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000117e0 con 0x7f2214155800 2023-10-06T04:45:04.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:03.999+0000 7f221abff700 1 -- 172.21.15.124:0/4203307004 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22140c0690 con 0x7f2214155800 2023-10-06T04:45:04.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.000+0000 7f21fe7fc700 1 -- 172.21.15.124:0/4203307004 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2214064850 con 0x7f2214155800 2023-10-06T04:45:04.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.001+0000 7f2210ff9700 1 -- 172.21.15.124:0/4203307004 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2200011b50 con 0x7f2214155800 2023-10-06T04:45:04.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.002+0000 7f2210ff9700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21f8066f30 0x7f21f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.002+0000 7f2210ff9700 1 -- 172.21.15.124:0/4203307004 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f22000860a0 con 0x7f2214155800 2023-10-06T04:45:04.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.002+0000 7f221899b700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21f8066f30 0x7f21f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.003+0000 7f221899b700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21f8066f30 0x7f21f80693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f22140c6020 tx=0x7f2208009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:04.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.006+0000 7f2210ff9700 1 -- 172.21.15.124:0/4203307004 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2200053110 con 0x7f2214155800 2023-10-06T04:45:04.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.200+0000 7f21fe7fc700 1 -- 172.21.15.124:0/4203307004 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f22140c0370 con 0x7f2214155800 2023-10-06T04:45:04.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.201+0000 7f2210ff9700 1 -- 172.21.15.124:0/4203307004 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2200056730 con 0x7f2214155800 2023-10-06T04:45:04.203 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:45:04.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 -- 172.21.15.124:0/4203307004 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21f8066f30 msgr2=0x7f21f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21f8066f30 0x7f21f80693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f22140c6020 tx=0x7f2208009040 comp rx=0 tx=0).stop 2023-10-06T04:45:04.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 -- 172.21.15.124:0/4203307004 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2214155800 msgr2=0x7f22140c0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2214155800 0x7f22140c0990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f221406d770 tx=0x7f2200017000 comp rx=0 tx=0).stop 2023-10-06T04:45:04.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 -- 172.21.15.124:0/4203307004 shutdown_connections 2023-10-06T04:45:04.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21f8066f30 0x7f21f80693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f22141596c0 0x7f22141504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2214069bd0 0x7f22140b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 --2- 172.21.15.124:0/4203307004 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2214155800 0x7f22140c0990 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 -- 172.21.15.124:0/4203307004 >> 172.21.15.124:0/4203307004 conn(0x7f22140680c0 msgr2=0x7f22140c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:04.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 -- 172.21.15.124:0/4203307004 shutdown_connections 2023-10-06T04:45:04.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.203+0000 7f21fe7fc700 1 -- 172.21.15.124:0/4203307004 wait complete. 2023-10-06T04:45:04.222 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:45:04.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.413+0000 7f03929ff700 1 Processor -- start 2023-10-06T04:45:04.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.413+0000 7f03929ff700 1 -- start start 2023-10-06T04:45:04.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f03929ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f038c159680 0x7f038c0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f03929ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f038c0cc780 0x7f038c0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f03929ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038c15d620 con 0x7f038c1592b0 2023-10-06T04:45:04.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f03929ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038c15d0d0 con 0x7f038c0cc780 2023-10-06T04:45:04.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f03929ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0b2ed0 con 0x7f038c159680 2023-10-06T04:45:04.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f0390f9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f038c0cc780 0x7f038c0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f0390f9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f038c0cc780 0x7f038c0ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:34988/0 (socket says 172.21.15.124:34988) 2023-10-06T04:45:04.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f0390f9c700 1 -- 172.21.15.124:0/2347614992 learned_addr learned my addr 172.21.15.124:0/2347614992 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:04.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f0383fff700 1 --2- 172.21.15.124:0/2347614992 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f038c159680 0x7f038c0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f0390f9c700 1 -- 172.21.15.124:0/2347614992 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f038c159680 msgr2=0x7f038c0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:04.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f0390f9c700 1 --2- 172.21.15.124:0/2347614992 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f038c159680 0x7f038c0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f0390f9c700 1 -- 172.21.15.124:0/2347614992 >> v1:172.21.15.158:6789/0 conn(0x7f038c1592b0 legacy=0x7f038c15dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.415+0000 7f0390f9c700 1 -- 172.21.15.124:0/2347614992 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0ccc00 con 0x7f038c0cc780 2023-10-06T04:45:04.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.416+0000 7f0390f9c700 1 --2- 172.21.15.124:0/2347614992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c0cc780 0x7f038c0ccea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0384009f20 tx=0x7f0384009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987ac9b468b813a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:04.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.416+0000 7f038b7fe700 1 -- 172.21.15.124:0/2347614992 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400e070 con 0x7f038c0cc780 2023-10-06T04:45:04.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.416+0000 7f038b7fe700 1 -- 172.21.15.124:0/2347614992 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038400ba80 con 0x7f038c0cc780 2023-10-06T04:45:04.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.416+0000 7f038b7fe700 1 -- 172.21.15.124:0/2347614992 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03840092e0 con 0x7f038c0cc780 2023-10-06T04:45:04.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.416+0000 7f03929ff700 1 -- 172.21.15.124:0/2347614992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c0cc780 msgr2=0x7f038c0ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.416+0000 7f03929ff700 1 --2- 172.21.15.124:0/2347614992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c0cc780 0x7f038c0ccea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0384009f20 tx=0x7f0384009840 comp rx=0 tx=0).stop 2023-10-06T04:45:04.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.417+0000 7f03929ff700 1 -- 172.21.15.124:0/2347614992 shutdown_connections 2023-10-06T04:45:04.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.417+0000 7f03929ff700 1 --2- 172.21.15.124:0/2347614992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c0cc780 0x7f038c0ccea0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.417+0000 7f03929ff700 1 --2- 172.21.15.124:0/2347614992 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f038c159680 0x7f038c0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.417+0000 7f03929ff700 1 -- 172.21.15.124:0/2347614992 >> 172.21.15.124:0/2347614992 conn(0x7f038c06ed20 msgr2=0x7f038c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:04.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.417+0000 7f03929ff700 1 -- 172.21.15.124:0/2347614992 shutdown_connections 2023-10-06T04:45:04.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.417+0000 7f03929ff700 1 -- 172.21.15.124:0/2347614992 wait complete. 2023-10-06T04:45:04.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.419+0000 7f03929ff700 1 Processor -- start 2023-10-06T04:45:04.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.419+0000 7f03929ff700 1 -- start start 2023-10-06T04:45:04.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.420+0000 7f03929ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f038c0cc780 0x7f038c16a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.420+0000 7f03929ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c1592b0 0x7f038c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.420+0000 7f03929ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f038c159680 0x7f038c16a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.420+0000 7f03929ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0c7f80 con 0x7f038c1592b0 2023-10-06T04:45:04.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.420+0000 7f03929ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0c7650 con 0x7f038c0cc780 2023-10-06T04:45:04.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.420+0000 7f03929ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0c7930 con 0x7f038c159680 2023-10-06T04:45:04.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.420+0000 7f0383fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c1592b0 0x7f038c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.420+0000 7f0383fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c1592b0 0x7f038c157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35004/0 (socket says 172.21.15.124:35004) 2023-10-06T04:45:04.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.420+0000 7f0383fff700 1 -- 172.21.15.124:0/2428402636 learned_addr learned my addr 172.21.15.124:0/2428402636 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:04.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.420+0000 7f038bfff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f038c0cc780 0x7f038c16a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f0390f9c700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f038c159680 0x7f038c16a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f0383fff700 1 -- 172.21.15.124:0/2428402636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f038c159680 msgr2=0x7f038c16a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f0383fff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f038c159680 0x7f038c16a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f0383fff700 1 -- 172.21.15.124:0/2428402636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f038c0cc780 msgr2=0x7f038c16a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f0383fff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f038c0cc780 0x7f038c16a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f0383fff700 1 -- 172.21.15.124:0/2428402636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384009ae0 con 0x7f038c1592b0 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f0383fff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c1592b0 0x7f038c157290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f037400d860 tx=0x7f0374008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f0388ff9700 1 -- 172.21.15.124:0/2428402636 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374009610 con 0x7f038c1592b0 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f0388ff9700 1 -- 172.21.15.124:0/2428402636 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0374009770 con 0x7f038c1592b0 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f03929ff700 1 -- 172.21.15.124:0/2428402636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c0c7c10 con 0x7f038c1592b0 2023-10-06T04:45:04.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f0388ff9700 1 -- 172.21.15.124:0/2428402636 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374009b30 con 0x7f038c1592b0 2023-10-06T04:45:04.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.421+0000 7f03929ff700 1 -- 172.21.15.124:0/2428402636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c0cf760 con 0x7f038c1592b0 2023-10-06T04:45:04.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.422+0000 7f03929ff700 1 -- 172.21.15.124:0/2428402636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c0c80f0 con 0x7f038c1592b0 2023-10-06T04:45:04.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.423+0000 7f0388ff9700 1 -- 172.21.15.124:0/2428402636 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f037401e460 con 0x7f038c1592b0 2023-10-06T04:45:04.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.424+0000 7f0388ff9700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f036c066f30 0x7f036c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.424+0000 7f0388ff9700 1 -- 172.21.15.124:0/2428402636 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0374084c90 con 0x7f038c1592b0 2023-10-06T04:45:04.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.425+0000 7f038bfff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f036c066f30 0x7f036c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.425+0000 7f038bfff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f036c066f30 0x7f036c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f038c157c20 tx=0x7f037c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:04.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.428+0000 7f0388ff9700 1 -- 172.21.15.124:0/2428402636 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0374051d00 con 0x7f038c1592b0 2023-10-06T04:45:04.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.617+0000 7f03929ff700 1 -- 172.21.15.124:0/2428402636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f038c04c380 con 0x7f038c1592b0 2023-10-06T04:45:04.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.618+0000 7f0388ff9700 1 -- 172.21.15.124:0/2428402636 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0374055320 con 0x7f038c1592b0 2023-10-06T04:45:04.619 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:45:04.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 -- 172.21.15.124:0/2428402636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f036c066f30 msgr2=0x7f036c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f036c066f30 0x7f036c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f038c157c20 tx=0x7f037c009040 comp rx=0 tx=0).stop 2023-10-06T04:45:04.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 -- 172.21.15.124:0/2428402636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c1592b0 msgr2=0x7f038c157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c1592b0 0x7f038c157290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f037400d860 tx=0x7f0374008040 comp rx=0 tx=0).stop 2023-10-06T04:45:04.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 -- 172.21.15.124:0/2428402636 shutdown_connections 2023-10-06T04:45:04.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f036c066f30 0x7f036c0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f038c159680 0x7f038c16a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f038c0cc780 0x7f038c16a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 --2- 172.21.15.124:0/2428402636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f038c1592b0 0x7f038c157290 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 -- 172.21.15.124:0/2428402636 >> 172.21.15.124:0/2428402636 conn(0x7f038c06ed20 msgr2=0x7f038c0b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:04.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 -- 172.21.15.124:0/2428402636 shutdown_connections 2023-10-06T04:45:04.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.620+0000 7f03929ff700 1 -- 172.21.15.124:0/2428402636 wait complete. 2023-10-06T04:45:04.639 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:45:04.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.830+0000 7f10f2bff700 1 Processor -- start 2023-10-06T04:45:04.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.831+0000 7f10f2bff700 1 -- start start 2023-10-06T04:45:04.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10f2bff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f10ec1592b0 0x7f10ec0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10f2bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f10ec159680 0x7f10ec0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10f2bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec15d620 con 0x7f10ec15dab0 2023-10-06T04:45:04.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10f2bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec15d0d0 con 0x7f10ec159680 2023-10-06T04:45:04.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10f2bff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec0b2ed0 con 0x7f10ec1592b0 2023-10-06T04:45:04.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10ebfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f10ec159680 0x7f10ec0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10ebfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f10ec159680 0x7f10ec0cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35016/0 (socket says 172.21.15.124:35016) 2023-10-06T04:45:04.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10ebfff700 1 -- 172.21.15.124:0/225606154 learned_addr learned my addr 172.21.15.124:0/225606154 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:04.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10f099b700 1 --2- 172.21.15.124:0/225606154 >> v2:172.21.15.158:3300/0 conn(0x7f10ec1592b0 0x7f10ec0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10ebfff700 1 -- 172.21.15.124:0/225606154 >> v2:172.21.15.158:3300/0 conn(0x7f10ec1592b0 msgr2=0x7f10ec0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:04.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10ebfff700 1 --2- 172.21.15.124:0/225606154 >> v2:172.21.15.158:3300/0 conn(0x7f10ec1592b0 0x7f10ec0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10ebfff700 1 -- 172.21.15.124:0/225606154 >> v1:172.21.15.158:6789/0 conn(0x7f10ec15dab0 legacy=0x7f10ec0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.832+0000 7f10ebfff700 1 -- 172.21.15.124:0/225606154 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec0b0760 con 0x7f10ec159680 2023-10-06T04:45:04.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.833+0000 7f10ebfff700 1 --2- 172.21.15.124:0/225606154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec159680 0x7f10ec0cc780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0cdb70 tx=0x7f10d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b32be7b5425a658 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:04.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.833+0000 7f10eb7fe700 1 -- 172.21.15.124:0/225606154 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8009e70 con 0x7f10ec159680 2023-10-06T04:45:04.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.833+0000 7f10eb7fe700 1 -- 172.21.15.124:0/225606154 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d800b860 con 0x7f10ec159680 2023-10-06T04:45:04.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.833+0000 7f10eb7fe700 1 -- 172.21.15.124:0/225606154 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d800bc00 con 0x7f10ec159680 2023-10-06T04:45:04.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.833+0000 7f10f2bff700 1 -- 172.21.15.124:0/225606154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec159680 msgr2=0x7f10ec0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.833+0000 7f10f2bff700 1 --2- 172.21.15.124:0/225606154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec159680 0x7f10ec0cc780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0cdb70 tx=0x7f10d8009250 comp rx=0 tx=0).stop 2023-10-06T04:45:04.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.834+0000 7f10f2bff700 1 -- 172.21.15.124:0/225606154 shutdown_connections 2023-10-06T04:45:04.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.834+0000 7f10f2bff700 1 --2- 172.21.15.124:0/225606154 >> v2:172.21.15.158:3300/0 conn(0x7f10ec1592b0 0x7f10ec0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.834+0000 7f10f2bff700 1 --2- 172.21.15.124:0/225606154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec159680 0x7f10ec0cc780 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.834+0000 7f10f2bff700 1 -- 172.21.15.124:0/225606154 >> 172.21.15.124:0/225606154 conn(0x7f10ec06ed20 msgr2=0x7f10ec06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:04.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.834+0000 7f10f2bff700 1 -- 172.21.15.124:0/225606154 shutdown_connections 2023-10-06T04:45:04.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.834+0000 7f10f2bff700 1 -- 172.21.15.124:0/225606154 wait complete. 2023-10-06T04:45:04.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.835+0000 7f10f2bff700 1 Processor -- start 2023-10-06T04:45:04.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.835+0000 7f10f2bff700 1 -- start start 2023-10-06T04:45:04.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.836+0000 7f10f2bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec1592b0 0x7f10ec14c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.836+0000 7f10f2bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10ec159680 0x7f10ec0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.836+0000 7f10f2bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10ec15dab0 0x7f10ec0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.836+0000 7f10f2bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0c6a00 con 0x7f10ec1592b0 2023-10-06T04:45:04.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.836+0000 7f10f2bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec14ce20 con 0x7f10ec159680 2023-10-06T04:45:04.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.836+0000 7f10f2bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0c5b50 con 0x7f10ec15dab0 2023-10-06T04:45:04.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.836+0000 7f10f099b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec1592b0 0x7f10ec14c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10f099b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec1592b0 0x7f10ec14c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35032/0 (socket says 172.21.15.124:35032) 2023-10-06T04:45:04.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10f099b700 1 -- 172.21.15.124:0/1038931812 learned_addr learned my addr 172.21.15.124:0/1038931812 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:04.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10ebfff700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10ec159680 0x7f10ec0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10f119c700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10ec15dab0 0x7f10ec0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10f099b700 1 -- 172.21.15.124:0/1038931812 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10ec15dab0 msgr2=0x7f10ec0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10f099b700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10ec15dab0 0x7f10ec0b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10f099b700 1 -- 172.21.15.124:0/1038931812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10ec159680 msgr2=0x7f10ec0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:04.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10f099b700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10ec159680 0x7f10ec0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:04.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10f099b700 1 -- 172.21.15.124:0/1038931812 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d80094f0 con 0x7f10ec1592b0 2023-10-06T04:45:04.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10ebfff700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10ec159680 0x7f10ec0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:04.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10f099b700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec1592b0 0x7f10ec14c8e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f10e000e930 tx=0x7f10e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:04.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10e8ff9700 1 -- 172.21.15.124:0/1038931812 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e000eed0 con 0x7f10ec1592b0 2023-10-06T04:45:04.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10e8ff9700 1 -- 172.21.15.124:0/1038931812 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e000c850 con 0x7f10ec1592b0 2023-10-06T04:45:04.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10f2bff700 1 -- 172.21.15.124:0/1038931812 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec0c5df0 con 0x7f10ec1592b0 2023-10-06T04:45:04.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.837+0000 7f10e8ff9700 1 -- 172.21.15.124:0/1038931812 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e000cbf0 con 0x7f10ec1592b0 2023-10-06T04:45:04.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.838+0000 7f10f2bff700 1 -- 172.21.15.124:0/1038931812 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec0c63b0 con 0x7f10ec1592b0 2023-10-06T04:45:04.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.838+0000 7f10f2bff700 1 -- 172.21.15.124:0/1038931812 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec04c380 con 0x7f10ec1592b0 2023-10-06T04:45:04.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.839+0000 7f10e8ff9700 1 -- 172.21.15.124:0/1038931812 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10e0013470 con 0x7f10ec1592b0 2023-10-06T04:45:04.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.840+0000 7f10e8ff9700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d0066f30 0x7f10d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:04.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.840+0000 7f10e8ff9700 1 -- 172.21.15.124:0/1038931812 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f10e00849a0 con 0x7f10ec1592b0 2023-10-06T04:45:04.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.840+0000 7f10ebfff700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d0066f30 0x7f10d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:04.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.841+0000 7f10ebfff700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d0066f30 0x7f10d00693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0cdb70 tx=0x7f10d8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:04.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:04.844+0000 7f10e8ff9700 1 -- 172.21.15.124:0/1038931812 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10e0051a10 con 0x7f10ec1592b0 2023-10-06T04:45:05.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.038+0000 7f10f2bff700 1 -- 172.21.15.124:0/1038931812 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10ec0c6ce0 con 0x7f10ec1592b0 2023-10-06T04:45:05.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.038+0000 7f10e8ff9700 1 -- 172.21.15.124:0/1038931812 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10e0055030 con 0x7f10ec1592b0 2023-10-06T04:45:05.040 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-06T04:45:05.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.040+0000 7f10f2bff700 1 -- 172.21.15.124:0/1038931812 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d0066f30 msgr2=0x7f10d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.040+0000 7f10f2bff700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d0066f30 0x7f10d00693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0cdb70 tx=0x7f10d8017000 comp rx=0 tx=0).stop 2023-10-06T04:45:05.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.040+0000 7f10f2bff700 1 -- 172.21.15.124:0/1038931812 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec1592b0 msgr2=0x7f10ec14c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.040+0000 7f10f2bff700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec1592b0 0x7f10ec14c8e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f10e000e930 tx=0x7f10e00091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.041+0000 7f10f2bff700 1 -- 172.21.15.124:0/1038931812 shutdown_connections 2023-10-06T04:45:05.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.041+0000 7f10f2bff700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d0066f30 0x7f10d00693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.041+0000 7f10f2bff700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10ec15dab0 0x7f10ec0b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.041+0000 7f10f2bff700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10ec1592b0 0x7f10ec14c8e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.041+0000 7f10f2bff700 1 --2- 172.21.15.124:0/1038931812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10ec159680 0x7f10ec0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.041+0000 7f10f2bff700 1 -- 172.21.15.124:0/1038931812 >> 172.21.15.124:0/1038931812 conn(0x7f10ec06ed20 msgr2=0x7f10ec0ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:05.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.041+0000 7f10f2bff700 1 -- 172.21.15.124:0/1038931812 shutdown_connections 2023-10-06T04:45:05.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.041+0000 7f10f2bff700 1 -- 172.21.15.124:0/1038931812 wait complete. 2023-10-06T04:45:05.060 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:45:05.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.251+0000 7f65e959d700 1 Processor -- start 2023-10-06T04:45:05.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.251+0000 7f65e959d700 1 -- start start 2023-10-06T04:45:05.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.252+0000 7f65e959d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f65e41593c0 0x7f65e40b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.252+0000 7f65e959d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f65e40afbb0 0x7f65e40b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.252+0000 7f65e959d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e40b0c50 con 0x7f65e40b4250 2023-10-06T04:45:05.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.252+0000 7f65e959d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e40b6170 con 0x7f65e40afbb0 2023-10-06T04:45:05.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.252+0000 7f65e959d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e40b46f0 con 0x7f65e41593c0 2023-10-06T04:45:05.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e37fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f65e40afbb0 0x7f65e40b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e37fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f65e40afbb0 0x7f65e40b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35040/0 (socket says 172.21.15.124:35040) 2023-10-06T04:45:05.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e37fe700 1 -- 172.21.15.124:0/415543636 learned_addr learned my addr 172.21.15.124:0/415543636 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:05.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e3fff700 1 --2- 172.21.15.124:0/415543636 >> v2:172.21.15.158:3300/0 conn(0x7f65e41593c0 0x7f65e40b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e37fe700 1 -- 172.21.15.124:0/415543636 >> v2:172.21.15.158:3300/0 conn(0x7f65e41593c0 msgr2=0x7f65e40b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:05.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e37fe700 1 --2- 172.21.15.124:0/415543636 >> v2:172.21.15.158:3300/0 conn(0x7f65e41593c0 0x7f65e40b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e37fe700 1 -- 172.21.15.124:0/415543636 >> v1:172.21.15.158:6789/0 conn(0x7f65e40b4250 legacy=0x7f65e40b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e37fe700 1 -- 172.21.15.124:0/415543636 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40b2c00 con 0x7f65e40afbb0 2023-10-06T04:45:05.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e3fff700 1 --2- 172.21.15.124:0/415543636 >> v2:172.21.15.158:3300/0 conn(0x7f65e41593c0 0x7f65e40b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:05.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e37fe700 1 --2- 172.21.15.124:0/415543636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e40afbb0 0x7f65e40b3d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f65e4088db0 tx=0x7f65d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769409528791ab39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:05.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.253+0000 7f65e2ffd700 1 -- 172.21.15.124:0/415543636 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d800b860 con 0x7f65e40afbb0 2023-10-06T04:45:05.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.254+0000 7f65e2ffd700 1 -- 172.21.15.124:0/415543636 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d800b9c0 con 0x7f65e40afbb0 2023-10-06T04:45:05.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.254+0000 7f65e2ffd700 1 -- 172.21.15.124:0/415543636 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d800bd60 con 0x7f65e40afbb0 2023-10-06T04:45:05.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.254+0000 7f65e959d700 1 -- 172.21.15.124:0/415543636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e40afbb0 msgr2=0x7f65e40b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.254+0000 7f65e959d700 1 --2- 172.21.15.124:0/415543636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e40afbb0 0x7f65e40b3d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f65e4088db0 tx=0x7f65d8009250 comp rx=0 tx=0).stop 2023-10-06T04:45:05.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.254+0000 7f65e959d700 1 -- 172.21.15.124:0/415543636 shutdown_connections 2023-10-06T04:45:05.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.254+0000 7f65e959d700 1 --2- 172.21.15.124:0/415543636 >> v2:172.21.15.158:3300/0 conn(0x7f65e41593c0 0x7f65e40b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.254+0000 7f65e959d700 1 --2- 172.21.15.124:0/415543636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e40afbb0 0x7f65e40b3d10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.254+0000 7f65e959d700 1 -- 172.21.15.124:0/415543636 >> 172.21.15.124:0/415543636 conn(0x7f65e4099660 msgr2=0x7f65e406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:05.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.254+0000 7f65e959d700 1 -- 172.21.15.124:0/415543636 shutdown_connections 2023-10-06T04:45:05.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.254+0000 7f65e959d700 1 -- 172.21.15.124:0/415543636 wait complete. 2023-10-06T04:45:05.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.256+0000 7f65e959d700 1 Processor -- start 2023-10-06T04:45:05.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.256+0000 7f65e959d700 1 -- start start 2023-10-06T04:45:05.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e959d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65e40afbb0 0x7f65e415f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e959d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65e40b4250 0x7f65e414c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e959d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e41593c0 0x7f65e4154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e959d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4155bf0 con 0x7f65e41593c0 2023-10-06T04:45:05.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e959d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e414d370 con 0x7f65e40afbb0 2023-10-06T04:45:05.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e959d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e414ce30 con 0x7f65e40b4250 2023-10-06T04:45:05.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e8d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e41593c0 0x7f65e4154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e8d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e41593c0 0x7f65e4154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35054/0 (socket says 172.21.15.124:35054) 2023-10-06T04:45:05.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e8d9c700 1 -- 172.21.15.124:0/976385577 learned_addr learned my addr 172.21.15.124:0/976385577 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:05.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e3fff700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65e40afbb0 0x7f65e415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e37fe700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65e40b4250 0x7f65e414c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e8d9c700 1 -- 172.21.15.124:0/976385577 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65e40b4250 msgr2=0x7f65e414c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e8d9c700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65e40b4250 0x7f65e414c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e8d9c700 1 -- 172.21.15.124:0/976385577 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65e40afbb0 msgr2=0x7f65e415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e8d9c700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65e40afbb0 0x7f65e415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e8d9c700 1 -- 172.21.15.124:0/976385577 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d80094f0 con 0x7f65e41593c0 2023-10-06T04:45:05.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.257+0000 7f65e37fe700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65e40b4250 0x7f65e414c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:05.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.258+0000 7f65e8d9c700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e41593c0 0x7f65e4154ac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00c8e0 tx=0x7f65dc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:05.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.258+0000 7f65cbfff700 1 -- 172.21.15.124:0/976385577 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc00ce80 con 0x7f65e41593c0 2023-10-06T04:45:05.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.258+0000 7f65cbfff700 1 -- 172.21.15.124:0/976385577 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc00a7e0 con 0x7f65e41593c0 2023-10-06T04:45:05.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.258+0000 7f65e959d700 1 -- 172.21.15.124:0/976385577 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e414d040 con 0x7f65e41593c0 2023-10-06T04:45:05.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.258+0000 7f65cbfff700 1 -- 172.21.15.124:0/976385577 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc00ab80 con 0x7f65e41593c0 2023-10-06T04:45:05.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.258+0000 7f65e959d700 1 -- 172.21.15.124:0/976385577 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e4155630 con 0x7f65e41593c0 2023-10-06T04:45:05.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.259+0000 7f65e959d700 1 -- 172.21.15.124:0/976385577 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e414d500 con 0x7f65e41593c0 2023-10-06T04:45:05.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.260+0000 7f65cbfff700 1 -- 172.21.15.124:0/976385577 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65dc012420 con 0x7f65e41593c0 2023-10-06T04:45:05.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.260+0000 7f65cbfff700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f65d0066f30 0x7f65d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.261+0000 7f65cbfff700 1 -- 172.21.15.124:0/976385577 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f65dc084a20 con 0x7f65e41593c0 2023-10-06T04:45:05.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.261+0000 7f65e3fff700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f65d0066f30 0x7f65d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.261+0000 7f65e3fff700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f65d0066f30 0x7f65d00693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65d4006ea0 tx=0x7f65d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:05.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.264+0000 7f65cbfff700 1 -- 172.21.15.124:0/976385577 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65dc051a90 con 0x7f65e41593c0 2023-10-06T04:45:05.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.454+0000 7f65e959d700 1 -- 172.21.15.124:0/976385577 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65e404c380 con 0x7f65e41593c0 2023-10-06T04:45:05.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.454+0000 7f65cbfff700 1 -- 172.21.15.124:0/976385577 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65dc0550b0 con 0x7f65e41593c0 2023-10-06T04:45:05.456 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-06T04:45:05.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.456+0000 7f65e959d700 1 -- 172.21.15.124:0/976385577 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f65d0066f30 msgr2=0x7f65d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.456+0000 7f65e959d700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f65d0066f30 0x7f65d00693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65d4006ea0 tx=0x7f65d4008040 comp rx=0 tx=0).stop 2023-10-06T04:45:05.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.456+0000 7f65e959d700 1 -- 172.21.15.124:0/976385577 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e41593c0 msgr2=0x7f65e4154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.456+0000 7f65e959d700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e41593c0 0x7f65e4154ac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00c8e0 tx=0x7f65dc001710 comp rx=0 tx=0).stop 2023-10-06T04:45:05.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.457+0000 7f65e959d700 1 -- 172.21.15.124:0/976385577 shutdown_connections 2023-10-06T04:45:05.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.457+0000 7f65e959d700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65e41593c0 0x7f65e4154ac0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.457+0000 7f65e959d700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65e40afbb0 0x7f65e415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.457+0000 7f65e959d700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f65d0066f30 0x7f65d00693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.457+0000 7f65e959d700 1 --2- 172.21.15.124:0/976385577 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65e40b4250 0x7f65e414c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.457+0000 7f65e959d700 1 -- 172.21.15.124:0/976385577 >> 172.21.15.124:0/976385577 conn(0x7f65e4099660 msgr2=0x7f65e4159c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:05.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.457+0000 7f65e959d700 1 -- 172.21.15.124:0/976385577 shutdown_connections 2023-10-06T04:45:05.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.457+0000 7f65e959d700 1 -- 172.21.15.124:0/976385577 wait complete. 2023-10-06T04:45:05.497 INFO:tasks.cephfs_test_runner:Starting test: test_basic (tasks.cephfs.test_dump_tree.TestDumpTree) 2023-10-06T04:45:05.498 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic' 2023-10-06T04:45:05.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.686+0000 7f550efff700 1 Processor -- start 2023-10-06T04:45:05.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.687+0000 7f550efff700 1 -- start start 2023-10-06T04:45:05.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.688+0000 7f550efff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f55080cdfe0 0x7f55080ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.688+0000 7f550efff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 0x7f55080cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.688+0000 7f550efff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55080cf6b0 con 0x7f55080ccbb0 2023-10-06T04:45:05.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.688+0000 7f550efff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55080d0250 con 0x7f55080cdfe0 2023-10-06T04:45:05.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.688+0000 7f550efff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55080ceaa0 con 0x7f55080ccf80 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.689+0000 7f5507fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f55080cdfe0 0x7f55080ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.689+0000 7f550cd9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f55080ccbb0 0x7f55080cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:37132/0 (socket says 172.21.15.124:37132) 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.689+0000 7f550cd9b700 1 -- 172.21.15.124:0/1917273589 learned_addr learned my addr 172.21.15.124:0/1917273589 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.689+0000 7f550d59c700 1 --2- 172.21.15.124:0/1917273589 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 0x7f55080cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.689+0000 7f5507fff700 1 -- 172.21.15.124:0/1917273589 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 msgr2=0x7f55080cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.689+0000 7f5507fff700 1 --2- 172.21.15.124:0/1917273589 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 0x7f55080cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.689+0000 7f5507fff700 1 -- 172.21.15.124:0/1917273589 >> v1:172.21.15.124:6789/0 conn(0x7f55080ccbb0 legacy=0x7f55080cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.689+0000 7f5507fff700 1 -- 172.21.15.124:0/1917273589 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55080ced80 con 0x7f55080cdfe0 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.689+0000 7f55077fe700 1 -- 172.21.15.124:0/1917273589 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247580225 0 0) 0x7f55080cf6b0 con 0x7f55080ccbb0 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.689+0000 7f5507fff700 1 --2- 172.21.15.124:0/1917273589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 0x7f55080ce450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f54f40098e0 tx=0x7f54f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae084b7e0d0a0c20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f55077fe700 1 -- 172.21.15.124:0/1917273589 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4009e80 con 0x7f55080cdfe0 2023-10-06T04:45:05.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f55077fe700 1 -- 172.21.15.124:0/1917273589 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f400b860 con 0x7f55080cdfe0 2023-10-06T04:45:05.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f55077fe700 1 -- 172.21.15.124:0/1917273589 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f400bbe0 con 0x7f55080cdfe0 2023-10-06T04:45:05.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f550efff700 1 -- 172.21.15.124:0/1917273589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 msgr2=0x7f55080ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f550efff700 1 --2- 172.21.15.124:0/1917273589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 0x7f55080ce450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f54f40098e0 tx=0x7f54f40091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f550efff700 1 -- 172.21.15.124:0/1917273589 shutdown_connections 2023-10-06T04:45:05.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f550efff700 1 --2- 172.21.15.124:0/1917273589 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 0x7f55080cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f550efff700 1 --2- 172.21.15.124:0/1917273589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 0x7f55080ce450 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f550efff700 1 -- 172.21.15.124:0/1917273589 >> 172.21.15.124:0/1917273589 conn(0x7f5508099710 msgr2=0x7f550806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f550efff700 1 -- 172.21.15.124:0/1917273589 shutdown_connections 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.690+0000 7f550efff700 1 -- 172.21.15.124:0/1917273589 wait complete. 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.692+0000 7f550efff700 1 Processor -- start 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.692+0000 7f550efff700 1 -- start start 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f550efff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55080ccbb0 0x7f550816a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f550efff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 0x7f55081569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f550efff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 0x7f550809a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f550efff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550816a770 con 0x7f55080cdfe0 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f550efff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550809aff0 con 0x7f55080ccbb0 2023-10-06T04:45:05.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f550efff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550809c480 con 0x7f55080ccf80 2023-10-06T04:45:05.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f550d59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 0x7f550809a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f550d59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 0x7f550809a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35082/0 (socket says 172.21.15.124:35082) 2023-10-06T04:45:05.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f550d59c700 1 -- 172.21.15.124:0/3094871991 learned_addr learned my addr 172.21.15.124:0/3094871991 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:05.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f550cd9b700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55080ccbb0 0x7f550816a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.693+0000 7f5507fff700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 0x7f55081569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f550d59c700 1 -- 172.21.15.124:0/3094871991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 msgr2=0x7f55081569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f550d59c700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 0x7f55081569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f550d59c700 1 -- 172.21.15.124:0/3094871991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55080ccbb0 msgr2=0x7f550816a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:05.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f550d59c700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55080ccbb0 0x7f550816a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f550d59c700 1 -- 172.21.15.124:0/3094871991 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4009420 con 0x7f55080cdfe0 2023-10-06T04:45:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f5507fff700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 0x7f55081569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f550cd9b700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55080ccbb0 0x7f550816a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f550d59c700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 0x7f550809a180 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5500009fa0 tx=0x7f5500009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f5504ff9700 1 -- 172.21.15.124:0/3094871991 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000ecc0 con 0x7f55080cdfe0 2023-10-06T04:45:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f5504ff9700 1 -- 172.21.15.124:0/3094871991 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550000ee20 con 0x7f55080cdfe0 2023-10-06T04:45:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f5504ff9700 1 -- 172.21.15.124:0/3094871991 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500014670 con 0x7f55080cdfe0 2023-10-06T04:45:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f550efff700 1 -- 172.21.15.124:0/3094871991 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5508156ee0 con 0x7f55080cdfe0 2023-10-06T04:45:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.694+0000 7f550efff700 1 -- 172.21.15.124:0/3094871991 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550809bbd0 con 0x7f55080cdfe0 2023-10-06T04:45:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.695+0000 7f550efff700 1 -- 172.21.15.124:0/3094871991 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55080717a0 con 0x7f55080cdfe0 2023-10-06T04:45:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.696+0000 7f5504ff9700 1 -- 172.21.15.124:0/3094871991 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55000149e0 con 0x7f55080cdfe0 2023-10-06T04:45:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.697+0000 7f5504ff9700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f54ec066f30 0x7f54ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.697+0000 7f5504ff9700 1 -- 172.21.15.124:0/3094871991 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5500084e40 con 0x7f55080cdfe0 2023-10-06T04:45:05.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.697+0000 7f550cd9b700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f54ec066f30 0x7f54ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:05.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.698+0000 7f550cd9b700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f54ec066f30 0x7f54ec0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f55080b51b0 tx=0x7f54fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:05.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.701+0000 7f5504ff9700 1 -- 172.21.15.124:0/3094871991 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5500051f50 con 0x7f55080cdfe0 2023-10-06T04:45:05.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:05.970+0000 7f550efff700 1 -- 172.21.15.124:0/3094871991 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]} v 0) v1 -- 0x7f55080cf060 con 0x7f55080cdfe0 2023-10-06T04:45:06.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.060+0000 7f5504ff9700 1 -- 172.21.15.124:0/3094871991 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]}]=0 v56) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5500055570 con 0x7f55080cdfe0 2023-10-06T04:45:06.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 -- 172.21.15.124:0/3094871991 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f54ec066f30 msgr2=0x7f54ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:06.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f54ec066f30 0x7f54ec0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f55080b51b0 tx=0x7f54fc009040 comp rx=0 tx=0).stop 2023-10-06T04:45:06.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 -- 172.21.15.124:0/3094871991 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 msgr2=0x7f550809a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:06.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 0x7f550809a180 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5500009fa0 tx=0x7f5500009900 comp rx=0 tx=0).stop 2023-10-06T04:45:06.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 -- 172.21.15.124:0/3094871991 shutdown_connections 2023-10-06T04:45:06.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55080cdfe0 0x7f550809a180 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55080ccbb0 0x7f550816a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f54ec066f30 0x7f54ec0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 --2- 172.21.15.124:0/3094871991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55080ccf80 0x7f55081569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 -- 172.21.15.124:0/3094871991 >> 172.21.15.124:0/3094871991 conn(0x7f5508099710 msgr2=0x7f55080adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:06.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 -- 172.21.15.124:0/3094871991 shutdown_connections 2023-10-06T04:45:06.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.063+0000 7f550efff700 1 -- 172.21.15.124:0/3094871991 wait complete. 2023-10-06T04:45:06.081 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T04:45:06.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.275+0000 7f033b3ff700 1 Processor -- start 2023-10-06T04:45:06.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.275+0000 7f033b3ff700 1 -- start start 2023-10-06T04:45:06.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033b3ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f03341592b0 0x7f03340b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:06.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033b3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03340cc780 0x7f03340ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:06.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033b3ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033415d620 con 0x7f0334159680 2023-10-06T04:45:06.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033b3ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033415d0d0 con 0x7f03341592b0 2023-10-06T04:45:06.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033b3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03340b2ed0 con 0x7f03340cc780 2023-10-06T04:45:06.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033919b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f03341592b0 0x7f03340b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:06.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033999c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03340cc780 0x7f03340ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:06.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033919b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f03341592b0 0x7f03340b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:33222/0 (socket says 172.21.15.124:33222) 2023-10-06T04:45:06.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033999c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03340cc780 0x7f03340ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:36704/0 (socket says 172.21.15.124:36704) 2023-10-06T04:45:06.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033919b700 1 -- 172.21.15.124:0/3016000028 learned_addr learned my addr 172.21.15.124:0/3016000028 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:06.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.276+0000 7f033899a700 1 --1- 172.21.15.124:0/3016000028 >> v1:172.21.15.158:6789/0 conn(0x7f0334159680 0x7f033415dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:45330/0 (socket says 172.21.15.124:45330) 2023-10-06T04:45:06.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.277+0000 7f033999c700 1 -- 172.21.15.124:0/3016000028 >> v2:172.21.15.158:3300/0 conn(0x7f03341592b0 msgr2=0x7f03340b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:06.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.277+0000 7f033999c700 1 --2- 172.21.15.124:0/3016000028 >> v2:172.21.15.158:3300/0 conn(0x7f03341592b0 0x7f03340b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.277+0000 7f033999c700 1 -- 172.21.15.124:0/3016000028 >> v1:172.21.15.158:6789/0 conn(0x7f0334159680 legacy=0x7f033415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:06.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.277+0000 7f033999c700 1 -- 172.21.15.124:0/3016000028 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03340ccc00 con 0x7f03340cc780 2023-10-06T04:45:06.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.277+0000 7f032bfff700 1 -- 172.21.15.124:0/3016000028 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442758768 0 0) 0x7f033415d620 con 0x7f0334159680 2023-10-06T04:45:06.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.277+0000 7f033919b700 1 --2- 172.21.15.124:0/3016000028 >> v2:172.21.15.158:3300/0 conn(0x7f03341592b0 0x7f03340b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:06.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.277+0000 7f033999c700 1 --2- 172.21.15.124:0/3016000028 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03340cc780 0x7f03340ccea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f032c009e60 tx=0x7f032c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7650f7bfa2305d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:06.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.277+0000 7f032bfff700 1 -- 172.21.15.124:0/3016000028 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00e070 con 0x7f03340cc780 2023-10-06T04:45:06.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.278+0000 7f032bfff700 1 -- 172.21.15.124:0/3016000028 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c00bb60 con 0x7f03340cc780 2023-10-06T04:45:06.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.278+0000 7f032bfff700 1 -- 172.21.15.124:0/3016000028 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c012430 con 0x7f03340cc780 2023-10-06T04:45:06.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.278+0000 7f033b3ff700 1 -- 172.21.15.124:0/3016000028 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03340cc780 msgr2=0x7f03340ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:06.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.278+0000 7f033b3ff700 1 --2- 172.21.15.124:0/3016000028 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03340cc780 0x7f03340ccea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f032c009e60 tx=0x7f032c009780 comp rx=0 tx=0).stop 2023-10-06T04:45:06.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.278+0000 7f033b3ff700 1 -- 172.21.15.124:0/3016000028 shutdown_connections 2023-10-06T04:45:06.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.278+0000 7f033b3ff700 1 --2- 172.21.15.124:0/3016000028 >> v2:172.21.15.158:3300/0 conn(0x7f03341592b0 0x7f03340b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.278+0000 7f033b3ff700 1 --2- 172.21.15.124:0/3016000028 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03340cc780 0x7f03340ccea0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.278+0000 7f033b3ff700 1 -- 172.21.15.124:0/3016000028 >> 172.21.15.124:0/3016000028 conn(0x7f033406ed20 msgr2=0x7f033406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:06.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.278+0000 7f033b3ff700 1 -- 172.21.15.124:0/3016000028 shutdown_connections 2023-10-06T04:45:06.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.278+0000 7f033b3ff700 1 -- 172.21.15.124:0/3016000028 wait complete. 2023-10-06T04:45:06.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.280+0000 7f033b3ff700 1 Processor -- start 2023-10-06T04:45:06.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.280+0000 7f033b3ff700 1 -- start start 2023-10-06T04:45:06.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033b3ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f03340cc780 0x7f03340c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033b3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03341592b0 0x7f03340c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033b3ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0334159680 0x7f03340c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033b3ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340c9790 con 0x7f03340cc780 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033b3ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340c8b80 con 0x7f0334159680 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033b3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03340c8e60 con 0x7f03341592b0 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033919b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f03340cc780 0x7f03340c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033919b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f03340cc780 0x7f03340c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35098/0 (socket says 172.21.15.124:35098) 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033919b700 1 -- 172.21.15.124:0/684391709 learned_addr learned my addr 172.21.15.124:0/684391709 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033899a700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03341592b0 0x7f03340c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033999c700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0334159680 0x7f03340c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:06.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033919b700 1 -- 172.21.15.124:0/684391709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03341592b0 msgr2=0x7f03340c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:06.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033919b700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03341592b0 0x7f03340c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033919b700 1 -- 172.21.15.124:0/684391709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0334159680 msgr2=0x7f03340c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:06.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033919b700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0334159680 0x7f03340c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.281+0000 7f033919b700 1 -- 172.21.15.124:0/684391709 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300094f0 con 0x7f03340cc780 2023-10-06T04:45:06.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.282+0000 7f033919b700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f03340cc780 0x7f03340c40c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f033000ec50 tx=0x7f0330009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:06.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.282+0000 7f03297fa700 1 -- 172.21.15.124:0/684391709 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033000c850 con 0x7f03340cc780 2023-10-06T04:45:06.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.282+0000 7f03297fa700 1 -- 172.21.15.124:0/684391709 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033000c9b0 con 0x7f03340cc780 2023-10-06T04:45:06.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.282+0000 7f03297fa700 1 -- 172.21.15.124:0/684391709 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033000cd50 con 0x7f03340cc780 2023-10-06T04:45:06.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.282+0000 7f033b3ff700 1 -- 172.21.15.124:0/684391709 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c009a20 con 0x7f03340cc780 2023-10-06T04:45:06.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.282+0000 7f033b3ff700 1 -- 172.21.15.124:0/684391709 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03340c9420 con 0x7f03340cc780 2023-10-06T04:45:06.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.283+0000 7f033b3ff700 1 -- 172.21.15.124:0/684391709 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033404c380 con 0x7f03340cc780 2023-10-06T04:45:06.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.284+0000 7f03297fa700 1 -- 172.21.15.124:0/684391709 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0330013680 con 0x7f03340cc780 2023-10-06T04:45:06.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.285+0000 7f03297fa700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0318066f30 0x7f03180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:06.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.285+0000 7f03297fa700 1 -- 172.21.15.124:0/684391709 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f03300847a0 con 0x7f03340cc780 2023-10-06T04:45:06.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.285+0000 7f033899a700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0318066f30 0x7f03180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:06.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.285+0000 7f033899a700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0318066f30 0x7f03180693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f03340cfef0 tx=0x7f0324007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:06.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.289+0000 7f03297fa700 1 -- 172.21.15.124:0/684391709 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0330051810 con 0x7f03340cc780 2023-10-06T04:45:06.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.479+0000 7f033b3ff700 1 -- 172.21.15.124:0/684391709 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f03340b0760 con 0x7f03340cc780 2023-10-06T04:45:06.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.483+0000 7f03297fa700 1 -- 172.21.15.124:0/684391709 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0330054e30 con 0x7f03340cc780 2023-10-06T04:45:06.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 -- 172.21.15.124:0/684391709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0318066f30 msgr2=0x7f03180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0318066f30 0x7f03180693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f03340cfef0 tx=0x7f0324007ef0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 -- 172.21.15.124:0/684391709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f03340cc780 msgr2=0x7f03340c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f03340cc780 0x7f03340c40c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f033000ec50 tx=0x7f0330009250 comp rx=0 tx=0).stop 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 -- 172.21.15.124:0/684391709 shutdown_connections 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0334159680 0x7f03340c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f03340cc780 0x7f03340c40c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0318066f30 0x7f03180693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 --2- 172.21.15.124:0/684391709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03341592b0 0x7f03340c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 -- 172.21.15.124:0/684391709 >> 172.21.15.124:0/684391709 conn(0x7f033406ed20 msgr2=0x7f03341586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 -- 172.21.15.124:0/684391709 shutdown_connections 2023-10-06T04:45:06.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:06.486+0000 7f033b3ff700 1 -- 172.21.15.124:0/684391709 wait complete. 2023-10-06T04:45:06.504 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:45:06.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:45:06.609 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:45:06.723 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:45:06.724 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:45:06.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:06.724 DEBUG:teuthology.orchestra.run.smithi124:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T04:45:06.806 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:45:06.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:06.807 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:45:06.874 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T04:45:06.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:06.875 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T04:45:06.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:45:06.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:06.963 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T04:45:07.019 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T04:45:07.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:07.019 DEBUG:teuthology.orchestra.run.smithi124:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T04:45:07.109 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:45:07.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:07.110 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T04:45:07.156 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T04:45:07.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:07.157 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T04:45:07.244 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:45:07.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:07.244 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T04:45:07.291 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T04:45:07.292 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:07.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.479+0000 7f35ab5ff700 1 Processor -- start 2023-10-06T04:45:07.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.479+0000 7f35ab5ff700 1 -- start start 2023-10-06T04:45:07.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.481+0000 7f35ab5ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f35a40ccbb0 0x7f35a40cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.481+0000 7f35ab5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 0x7f35a40ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.481+0000 7f35ab5ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a40cf6b0 con 0x7f35a40ccf80 2023-10-06T04:45:07.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.481+0000 7f35ab5ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40cdb10 con 0x7f35a40ccbb0 2023-10-06T04:45:07.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.481+0000 7f35ab5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40ceaa0 con 0x7f35a40cdfe0 2023-10-06T04:45:07.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.481+0000 7f35a939b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f35a40ccbb0 0x7f35a40cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.481+0000 7f35a8b9a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 0x7f35a40ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.481+0000 7f35a8b9a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 0x7f35a40ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:36720/0 (socket says 172.21.15.124:36720) 2023-10-06T04:45:07.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.481+0000 7f35a939b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f35a40ccbb0 0x7f35a40cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:33226/0 (socket says 172.21.15.124:33226) 2023-10-06T04:45:07.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.481+0000 7f35a8b9a700 1 -- 172.21.15.124:0/2564524035 learned_addr learned my addr 172.21.15.124:0/2564524035 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:07.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f359bfff700 1 -- 172.21.15.124:0/2564524035 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607024047 0 0) 0x7f35a40cf6b0 con 0x7f35a40ccf80 2023-10-06T04:45:07.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f359bfff700 1 -- 172.21.15.124:0/2564524035 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3590003570 con 0x7f35a40ccf80 2023-10-06T04:45:07.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f35a8b9a700 1 -- 172.21.15.124:0/2564524035 >> v2:172.21.15.158:3300/0 conn(0x7f35a40ccbb0 msgr2=0x7f35a40cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:07.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f35a8b9a700 1 --2- 172.21.15.124:0/2564524035 >> v2:172.21.15.158:3300/0 conn(0x7f35a40ccbb0 0x7f35a40cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f35a8b9a700 1 -- 172.21.15.124:0/2564524035 >> v1:172.21.15.158:6789/0 conn(0x7f35a40ccf80 legacy=0x7f35a40cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:07.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f35a8b9a700 1 -- 172.21.15.124:0/2564524035 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40ced80 con 0x7f35a40cdfe0 2023-10-06T04:45:07.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f35a939b700 1 --2- 172.21.15.124:0/2564524035 >> v2:172.21.15.158:3300/0 conn(0x7f35a40ccbb0 0x7f35a40cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:07.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f35a8b9a700 1 --2- 172.21.15.124:0/2564524035 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 0x7f35a40ce450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f35940099b0 tx=0x7f3594009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d61cacf090df338 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:07.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f359bfff700 1 -- 172.21.15.124:0/2564524035 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400b680 con 0x7f35a40cdfe0 2023-10-06T04:45:07.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f359bfff700 1 -- 172.21.15.124:0/2564524035 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359400b7e0 con 0x7f35a40cdfe0 2023-10-06T04:45:07.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.482+0000 7f359bfff700 1 -- 172.21.15.124:0/2564524035 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400bb80 con 0x7f35a40cdfe0 2023-10-06T04:45:07.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.483+0000 7f35ab5ff700 1 -- 172.21.15.124:0/2564524035 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 msgr2=0x7f35a40ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:07.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.483+0000 7f35ab5ff700 1 --2- 172.21.15.124:0/2564524035 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 0x7f35a40ce450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f35940099b0 tx=0x7f3594009250 comp rx=0 tx=0).stop 2023-10-06T04:45:07.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.483+0000 7f35ab5ff700 1 -- 172.21.15.124:0/2564524035 shutdown_connections 2023-10-06T04:45:07.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.483+0000 7f35ab5ff700 1 --2- 172.21.15.124:0/2564524035 >> v2:172.21.15.158:3300/0 conn(0x7f35a40ccbb0 0x7f35a40cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.483+0000 7f35ab5ff700 1 --2- 172.21.15.124:0/2564524035 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 0x7f35a40ce450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.483+0000 7f35ab5ff700 1 -- 172.21.15.124:0/2564524035 >> 172.21.15.124:0/2564524035 conn(0x7f35a4099710 msgr2=0x7f35a406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:07.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.483+0000 7f35ab5ff700 1 -- 172.21.15.124:0/2564524035 shutdown_connections 2023-10-06T04:45:07.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.483+0000 7f35ab5ff700 1 -- 172.21.15.124:0/2564524035 wait complete. 2023-10-06T04:45:07.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.484+0000 7f35ab5ff700 1 Processor -- start 2023-10-06T04:45:07.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.485+0000 7f35ab5ff700 1 -- start start 2023-10-06T04:45:07.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.485+0000 7f35ab5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f35a40ccbb0 0x7f35a40b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.485+0000 7f35ab5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35a40ccf80 0x7f35a40b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35ab5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 0x7f35a40b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35ab5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40b13e0 con 0x7f35a40ccbb0 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35ab5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40b0ab0 con 0x7f35a40ccf80 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35ab5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40b0d90 con 0x7f35a40cdfe0 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a939b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f35a40ccbb0 0x7f35a40b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a939b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f35a40ccbb0 0x7f35a40b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35102/0 (socket says 172.21.15.124:35102) 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a939b700 1 -- 172.21.15.124:0/926474115 learned_addr learned my addr 172.21.15.124:0/926474115 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a8b9a700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35a40ccf80 0x7f35a40b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a9b9c700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 0x7f35a40b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a939b700 1 -- 172.21.15.124:0/926474115 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 msgr2=0x7f35a40b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a939b700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 0x7f35a40b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a939b700 1 -- 172.21.15.124:0/926474115 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35a40ccf80 msgr2=0x7f35a40b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a939b700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35a40ccf80 0x7f35a40b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a939b700 1 -- 172.21.15.124:0/926474115 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a0009420 con 0x7f35a40ccbb0 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.486+0000 7f35a8b9a700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35a40ccf80 0x7f35a40b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.487+0000 7f35a939b700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f35a40ccbb0 0x7f35a40b1870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f35a000ec80 tx=0x7f35a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.487+0000 7f35997fa700 1 -- 172.21.15.124:0/926474115 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000c920 con 0x7f35a40ccbb0 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.487+0000 7f35997fa700 1 -- 172.21.15.124:0/926474115 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a000ca80 con 0x7f35a40ccbb0 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.487+0000 7f35997fa700 1 -- 172.21.15.124:0/926474115 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000ce00 con 0x7f35a40ccbb0 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.487+0000 7f35ab5ff700 1 -- 172.21.15.124:0/926474115 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35940094f0 con 0x7f35a40ccbb0 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.487+0000 7f35ab5ff700 1 -- 172.21.15.124:0/926474115 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a409db30 con 0x7f35a40ccbb0 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.488+0000 7f35ab5ff700 1 -- 172.21.15.124:0/926474115 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a40717a0 con 0x7f35a40ccbb0 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.489+0000 7f35997fa700 1 -- 172.21.15.124:0/926474115 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35a0013680 con 0x7f35a40ccbb0 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.490+0000 7f35997fa700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3588066f30 0x7f35880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.490+0000 7f35997fa700 1 -- 172.21.15.124:0/926474115 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f35a0084b10 con 0x7f35a40ccbb0 2023-10-06T04:45:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.490+0000 7f35a8b9a700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3588066f30 0x7f35880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.490+0000 7f35a8b9a700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3588066f30 0x7f35880693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f35940099b0 tx=0x7f3594017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:07.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.494+0000 7f35997fa700 1 -- 172.21.15.124:0/926474115 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35a0051b80 con 0x7f35a40ccbb0 2023-10-06T04:45:07.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.727+0000 7f35ab5ff700 1 -- 172.21.15.124:0/926474115 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35a40cf060 con 0x7f35a40ccbb0 2023-10-06T04:45:07.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.728+0000 7f35997fa700 1 -- 172.21.15.124:0/926474115 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f35a00551a0 con 0x7f35a40ccbb0 2023-10-06T04:45:07.730 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:07.730 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/3828511424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":3828511424},{"type":"v1","addr":"172.21.15.124:6836","nonce":3828511424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/1252041103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1252041103},{"type":"v1","addr":"172.21.15.158:6834","nonce":1252041103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/978440229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":978440229},{"type":"v1","addr":"172.21.15.124:6837","nonce":978440229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:27.635332+0000","modified":"2023-10-06T04:44:31.182630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6835/1693475602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":1693475602},{"type":"v1","addr":"172.21.15.158:6835","nonce":1693475602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:45:07.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 -- 172.21.15.124:0/926474115 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3588066f30 msgr2=0x7f35880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:07.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3588066f30 0x7f35880693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f35940099b0 tx=0x7f3594017000 comp rx=0 tx=0).stop 2023-10-06T04:45:07.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 -- 172.21.15.124:0/926474115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f35a40ccbb0 msgr2=0x7f35a40b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:07.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f35a40ccbb0 0x7f35a40b1870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f35a000ec80 tx=0x7f35a00091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 -- 172.21.15.124:0/926474115 shutdown_connections 2023-10-06T04:45:07.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3588066f30 0x7f35880693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35a40cdfe0 0x7f35a40b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f35a40ccbb0 0x7f35a40b1870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 --2- 172.21.15.124:0/926474115 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35a40ccf80 0x7f35a40b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 -- 172.21.15.124:0/926474115 >> 172.21.15.124:0/926474115 conn(0x7f35a4099710 msgr2=0x7f35a41588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:07.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 -- 172.21.15.124:0/926474115 shutdown_connections 2023-10-06T04:45:07.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.730+0000 7f35ab5ff700 1 -- 172.21.15.124:0/926474115 wait complete. 2023-10-06T04:45:07.734 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2023-10-06T04:45:07.750 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:07.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.938+0000 7fa1a01ff700 1 Processor -- start 2023-10-06T04:45:07.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.939+0000 7fa1a01ff700 1 -- start start 2023-10-06T04:45:07.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.940+0000 7fa1a01ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980ccbb0 0x7fa1980cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.940+0000 7fa1a01ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa1980cdfe0 0x7fa1980ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.940+0000 7fa1a01ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1980cf6b0 con 0x7fa1980ccf80 2023-10-06T04:45:07.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.940+0000 7fa1a01ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1980cdb10 con 0x7fa1980cdfe0 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.940+0000 7fa1a01ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980ceaa0 con 0x7fa1980ccbb0 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.940+0000 7fa19d79a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa1980cdfe0 0x7fa1980ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.940+0000 7fa19e79c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa1980ccf80 0x7fa1980cd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:37142/0 (socket says 172.21.15.124:37142) 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.940+0000 7fa19e79c700 1 -- 172.21.15.124:0/2484620198 learned_addr learned my addr 172.21.15.124:0/2484620198 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.940+0000 7fa19df9b700 1 --2- 172.21.15.124:0/2484620198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980ccbb0 0x7fa1980cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.941+0000 7fa19d79a700 1 -- 172.21.15.124:0/2484620198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980ccbb0 msgr2=0x7fa1980cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.941+0000 7fa19d79a700 1 --2- 172.21.15.124:0/2484620198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980ccbb0 0x7fa1980cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.941+0000 7fa19d79a700 1 -- 172.21.15.124:0/2484620198 >> v1:172.21.15.124:6789/0 conn(0x7fa1980ccf80 legacy=0x7fa1980cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.941+0000 7fa19d79a700 1 -- 172.21.15.124:0/2484620198 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980ced80 con 0x7fa1980cdfe0 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.941+0000 7fa19cf99700 1 -- 172.21.15.124:0/2484620198 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335174487 0 0) 0x7fa1980cf6b0 con 0x7fa1980ccf80 2023-10-06T04:45:07.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.941+0000 7fa19d79a700 1 --2- 172.21.15.124:0/2484620198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 0x7fa1980ce450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa1880098e0 tx=0x7fa1880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d9914b843f040f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:07.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.941+0000 7fa19cf99700 1 -- 172.21.15.124:0/2484620198 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188009e80 con 0x7fa1980cdfe0 2023-10-06T04:45:07.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.941+0000 7fa19cf99700 1 -- 172.21.15.124:0/2484620198 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18800b860 con 0x7fa1980cdfe0 2023-10-06T04:45:07.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.941+0000 7fa19cf99700 1 -- 172.21.15.124:0/2484620198 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800bbe0 con 0x7fa1980cdfe0 2023-10-06T04:45:07.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.942+0000 7fa1a01ff700 1 -- 172.21.15.124:0/2484620198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 msgr2=0x7fa1980ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:07.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.942+0000 7fa1a01ff700 1 --2- 172.21.15.124:0/2484620198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 0x7fa1980ce450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa1880098e0 tx=0x7fa1880091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.942+0000 7fa1a01ff700 1 -- 172.21.15.124:0/2484620198 shutdown_connections 2023-10-06T04:45:07.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.942+0000 7fa1a01ff700 1 --2- 172.21.15.124:0/2484620198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980ccbb0 0x7fa1980cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.942+0000 7fa1a01ff700 1 --2- 172.21.15.124:0/2484620198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 0x7fa1980ce450 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.942+0000 7fa1a01ff700 1 -- 172.21.15.124:0/2484620198 >> 172.21.15.124:0/2484620198 conn(0x7fa198099710 msgr2=0x7fa19806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:07.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.942+0000 7fa1a01ff700 1 -- 172.21.15.124:0/2484620198 shutdown_connections 2023-10-06T04:45:07.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.942+0000 7fa1a01ff700 1 -- 172.21.15.124:0/2484620198 wait complete. 2023-10-06T04:45:07.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.944+0000 7fa1a01ff700 1 Processor -- start 2023-10-06T04:45:07.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.944+0000 7fa1a01ff700 1 -- start start 2023-10-06T04:45:07.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.945+0000 7fa1a01ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980ccbb0 0x7fa198154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.945+0000 7fa1a01ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980ccf80 0x7fa1980b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.945+0000 7fa1a01ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 0x7fa1980c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.945+0000 7fa1a01ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa198155d90 con 0x7fa1980cdfe0 2023-10-06T04:45:07.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.945+0000 7fa1a01ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa198155460 con 0x7fa1980ccf80 2023-10-06T04:45:07.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.945+0000 7fa1a01ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa198155740 con 0x7fa1980ccbb0 2023-10-06T04:45:07.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.945+0000 7fa19e79c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 0x7fa1980c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa19e79c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 0x7fa1980c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35108/0 (socket says 172.21.15.124:35108) 2023-10-06T04:45:07.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa19e79c700 1 -- 172.21.15.124:0/1473225398 learned_addr learned my addr 172.21.15.124:0/1473225398 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:07.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa19df9b700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980ccbb0 0x7fa198154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa19d79a700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980ccf80 0x7fa1980b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa19e79c700 1 -- 172.21.15.124:0/1473225398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980ccbb0 msgr2=0x7fa198154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:07.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa19e79c700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980ccbb0 0x7fa198154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa19e79c700 1 -- 172.21.15.124:0/1473225398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980ccf80 msgr2=0x7fa1980b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:07.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa19e79c700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980ccf80 0x7fa1980b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:07.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa19e79c700 1 -- 172.21.15.124:0/1473225398 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009420 con 0x7fa1980cdfe0 2023-10-06T04:45:07.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa19e79c700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 0x7fa1980c74c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa19000cc90 tx=0x7fa190001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:07.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa18dffb700 1 -- 172.21.15.124:0/1473225398 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19000a8b0 con 0x7fa1980cdfe0 2023-10-06T04:45:07.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa18dffb700 1 -- 172.21.15.124:0/1473225398 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19000aa10 con 0x7fa1980cdfe0 2023-10-06T04:45:07.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa1a01ff700 1 -- 172.21.15.124:0/1473225398 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa198155a20 con 0x7fa1980cdfe0 2023-10-06T04:45:07.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.946+0000 7fa18dffb700 1 -- 172.21.15.124:0/1473225398 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19000add0 con 0x7fa1980cdfe0 2023-10-06T04:45:07.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.947+0000 7fa1a01ff700 1 -- 172.21.15.124:0/1473225398 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1980b0b80 con 0x7fa1980cdfe0 2023-10-06T04:45:07.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.948+0000 7fa1a01ff700 1 -- 172.21.15.124:0/1473225398 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa198155f00 con 0x7fa1980cdfe0 2023-10-06T04:45:07.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.948+0000 7fa18dffb700 1 -- 172.21.15.124:0/1473225398 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa190007300 con 0x7fa1980cdfe0 2023-10-06T04:45:07.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.949+0000 7fa18dffb700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa17c066f30 0x7fa17c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:07.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.949+0000 7fa18dffb700 1 -- 172.21.15.124:0/1473225398 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa190084ad0 con 0x7fa1980cdfe0 2023-10-06T04:45:07.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.949+0000 7fa19df9b700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa17c066f30 0x7fa17c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:07.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.950+0000 7fa19df9b700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa17c066f30 0x7fa17c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa194006fd0 tx=0x7fa194008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:07.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:07.953+0000 7fa18dffb700 1 -- 172.21.15.124:0/1473225398 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa190051b40 con 0x7fa1980cdfe0 2023-10-06T04:45:08.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.146+0000 7fa1a01ff700 1 -- 172.21.15.124:0/1473225398 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1980717a0 con 0x7fa1980cdfe0 2023-10-06T04:45:08.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.147+0000 7fa18dffb700 1 -- 172.21.15.124:0/1473225398 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fa190055160 con 0x7fa1980cdfe0 2023-10-06T04:45:08.149 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:08.149 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:08.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.149+0000 7fa1a01ff700 1 -- 172.21.15.124:0/1473225398 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa17c066f30 msgr2=0x7fa17c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.149+0000 7fa1a01ff700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa17c066f30 0x7fa17c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa194006fd0 tx=0x7fa194008040 comp rx=0 tx=0).stop 2023-10-06T04:45:08.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.149+0000 7fa1a01ff700 1 -- 172.21.15.124:0/1473225398 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 msgr2=0x7fa1980c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.149+0000 7fa1a01ff700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 0x7fa1980c74c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa19000cc90 tx=0x7fa190001a80 comp rx=0 tx=0).stop 2023-10-06T04:45:08.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.149+0000 7fa1a01ff700 1 -- 172.21.15.124:0/1473225398 shutdown_connections 2023-10-06T04:45:08.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.149+0000 7fa1a01ff700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1980cdfe0 0x7fa1980c74c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.150+0000 7fa1a01ff700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa17c066f30 0x7fa17c0693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.150+0000 7fa1a01ff700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980ccbb0 0x7fa198154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.150+0000 7fa1a01ff700 1 --2- 172.21.15.124:0/1473225398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980ccf80 0x7fa1980b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.150+0000 7fa1a01ff700 1 -- 172.21.15.124:0/1473225398 >> 172.21.15.124:0/1473225398 conn(0x7fa198099710 msgr2=0x7fa1980ae500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.150+0000 7fa1a01ff700 1 -- 172.21.15.124:0/1473225398 shutdown_connections 2023-10-06T04:45:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.150+0000 7fa1a01ff700 1 -- 172.21.15.124:0/1473225398 wait complete. 2023-10-06T04:45:08.169 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:44:25.771714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:44:26.609661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:45:08.170 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:45:08.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.363+0000 7fa5c39ff700 1 Processor -- start 2023-10-06T04:45:08.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.363+0000 7fa5c39ff700 1 -- start start 2023-10-06T04:45:08.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.364+0000 7fa5c39ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5bc1562b0 0x7fa5bc15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.364+0000 7fa5c39ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa5bc0cca10 0x7fa5bc0c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.364+0000 7fa5c39ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0ad790 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.364+0000 7fa5c39ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc15af90 con 0x7fa5bc0cca10 2023-10-06T04:45:08.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.364+0000 7fa5c39ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0acb80 con 0x7fa5bc1562b0 2023-10-06T04:45:08.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5c1f9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa5bc0c6af0 0x7fa5bc0adc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:37152/0 (socket says 172.21.15.124:37152) 2023-10-06T04:45:08.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5c1f9c700 1 -- 172.21.15.124:0/3863845326 learned_addr learned my addr 172.21.15.124:0/3863845326 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:08.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5c179b700 1 --2- 172.21.15.124:0/3863845326 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5bc1562b0 0x7fa5bc15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5c0f9a700 1 --2- 172.21.15.124:0/3863845326 >> v2:172.21.15.158:3300/0 conn(0x7fa5bc0cca10 0x7fa5bc0c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5b3fff700 1 -- 172.21.15.124:0/3863845326 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506269611 0 0) 0x7fa5bc0ad790 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5b3fff700 1 -- 172.21.15.124:0/3863845326 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a8003570 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5b3fff700 1 -- 172.21.15.124:0/3863845326 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 629402155 0 0) 0x7fa5a8003570 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5c179b700 1 -- 172.21.15.124:0/3863845326 >> v2:172.21.15.158:3300/0 conn(0x7fa5bc0cca10 msgr2=0x7fa5bc0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:08.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5c179b700 1 --2- 172.21.15.124:0/3863845326 >> v2:172.21.15.158:3300/0 conn(0x7fa5bc0cca10 0x7fa5bc0c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5c179b700 1 -- 172.21.15.124:0/3863845326 >> v1:172.21.15.124:6789/0 conn(0x7fa5bc0c6af0 legacy=0x7fa5bc0adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.365+0000 7fa5c179b700 1 -- 172.21.15.124:0/3863845326 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0ace60 con 0x7fa5bc1562b0 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.366+0000 7fa5c179b700 1 --2- 172.21.15.124:0/3863845326 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5bc1562b0 0x7fa5bc15aa50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80098e0 tx=0x7fa5b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98127e4d6c2d4bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.366+0000 7fa5b3fff700 1 -- 172.21.15.124:0/3863845326 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40017f0 con 0x7fa5bc1562b0 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.366+0000 7fa5b3fff700 1 -- 172.21.15.124:0/3863845326 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b8011420 con 0x7fa5bc1562b0 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.366+0000 7fa5b3fff700 1 -- 172.21.15.124:0/3863845326 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80117c0 con 0x7fa5bc1562b0 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.366+0000 7fa5c39ff700 1 -- 172.21.15.124:0/3863845326 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5bc1562b0 msgr2=0x7fa5bc15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.366+0000 7fa5c39ff700 1 --2- 172.21.15.124:0/3863845326 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5bc1562b0 0x7fa5bc15aa50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80098e0 tx=0x7fa5b80091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.366+0000 7fa5c39ff700 1 -- 172.21.15.124:0/3863845326 shutdown_connections 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.366+0000 7fa5c39ff700 1 --2- 172.21.15.124:0/3863845326 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5bc1562b0 0x7fa5bc15aa50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.366+0000 7fa5c39ff700 1 --2- 172.21.15.124:0/3863845326 >> v2:172.21.15.158:3300/0 conn(0x7fa5bc0cca10 0x7fa5bc0c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.366+0000 7fa5c39ff700 1 -- 172.21.15.124:0/3863845326 >> 172.21.15.124:0/3863845326 conn(0x7fa5bc0680c0 msgr2=0x7fa5bc0cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:08.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.367+0000 7fa5c39ff700 1 -- 172.21.15.124:0/3863845326 shutdown_connections 2023-10-06T04:45:08.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.367+0000 7fa5c39ff700 1 -- 172.21.15.124:0/3863845326 wait complete. 2023-10-06T04:45:08.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.368+0000 7fa5c39ff700 1 Processor -- start 2023-10-06T04:45:08.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.368+0000 7fa5c39ff700 1 -- start start 2023-10-06T04:45:08.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.369+0000 7fa5c39ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5bc0c6af0 0x7fa5bc1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.369+0000 7fa5c39ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa5bc0cca10 0x7fa5bc0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.369+0000 7fa5c39ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5bc1562b0 0x7fa5bc0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.369+0000 7fa5c39ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0b1c50 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.369+0000 7fa5c39ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0c3530 con 0x7fa5bc0cca10 2023-10-06T04:45:08.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.369+0000 7fa5c39ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0b1690 con 0x7fa5bc1562b0 2023-10-06T04:45:08.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.369+0000 7fa5c179b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5bc0c6af0 0x7fa5bc1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.369+0000 7fa5c179b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5bc0c6af0 0x7fa5bc1533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35114/0 (socket says 172.21.15.124:35114) 2023-10-06T04:45:08.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.369+0000 7fa5c179b700 1 -- 172.21.15.124:0/2333187261 learned_addr learned my addr 172.21.15.124:0/2333187261 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:08.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5c179b700 1 -- 172.21.15.124:0/2333187261 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5bc1562b0 msgr2=0x7fa5bc0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5c179b700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5bc1562b0 0x7fa5bc0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5c179b700 1 -- 172.21.15.124:0/2333187261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa5bc0cca10 msgr2=0x7fa5bc0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5c179b700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa5bc0cca10 0x7fa5bc0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5c179b700 1 -- 172.21.15.124:0/2333187261 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8009420 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5c179b700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5bc0c6af0 0x7fa5bc1533f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80030c0 tx=0x7fa5b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:08.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5b17fa700 1 -- 172.21.15.124:0/2333187261 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b801cc90 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5b17fa700 1 -- 172.21.15.124:0/2333187261 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b801ce10 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5b17fa700 1 -- 172.21.15.124:0/2333187261 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b801a6a0 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5c39ff700 1 -- 172.21.15.124:0/2333187261 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc0b1970 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.370+0000 7fa5c39ff700 1 -- 172.21.15.124:0/2333187261 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc153930 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.371+0000 7fa5c39ff700 1 -- 172.21.15.124:0/2333187261 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc0c3020 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.372+0000 7fa5b17fa700 1 -- 172.21.15.124:0/2333187261 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5b801aad0 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.373+0000 7fa5b17fa700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa5a0066fb0 0x7fa5a0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.373+0000 7fa5b17fa700 1 -- 172.21.15.124:0/2333187261 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa5b80860b0 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.373+0000 7fa5c0f9a700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa5a0066fb0 0x7fa5a0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.374+0000 7fa5c0f9a700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa5a0066fb0 0x7fa5a0069460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0cb570 tx=0x7fa5ac0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:08.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.377+0000 7fa5b17fa700 1 -- 172.21.15.124:0/2333187261 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5bc0c3020 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.565+0000 7fa5c39ff700 1 -- 172.21.15.124:0/2333187261 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa5bc0c3020 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.565+0000 7fa5b17fa700 1 -- 172.21.15.124:0/2333187261 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa5bc0c3020 con 0x7fa5bc0c6af0 2023-10-06T04:45:08.567 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:45:08.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.567+0000 7fa5c39ff700 1 -- 172.21.15.124:0/2333187261 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa5a0066fb0 msgr2=0x7fa5a0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.567+0000 7fa5c39ff700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa5a0066fb0 0x7fa5a0069460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0cb570 tx=0x7fa5ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.567+0000 7fa5c39ff700 1 -- 172.21.15.124:0/2333187261 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5bc0c6af0 msgr2=0x7fa5bc1533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.567+0000 7fa5c39ff700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5bc0c6af0 0x7fa5bc1533f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80030c0 tx=0x7fa5b8016000 comp rx=0 tx=0).stop 2023-10-06T04:45:08.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.567+0000 7fa5c39ff700 1 -- 172.21.15.124:0/2333187261 shutdown_connections 2023-10-06T04:45:08.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.567+0000 7fa5c39ff700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa5a0066fb0 0x7fa5a0069460 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.567+0000 7fa5c39ff700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5bc1562b0 0x7fa5bc0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.567+0000 7fa5c39ff700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5bc0c6af0 0x7fa5bc1533f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.567+0000 7fa5c39ff700 1 --2- 172.21.15.124:0/2333187261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa5bc0cca10 0x7fa5bc0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.567+0000 7fa5c39ff700 1 -- 172.21.15.124:0/2333187261 >> 172.21.15.124:0/2333187261 conn(0x7fa5bc0680c0 msgr2=0x7fa5bc0ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:08.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.568+0000 7fa5c39ff700 1 -- 172.21.15.124:0/2333187261 shutdown_connections 2023-10-06T04:45:08.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.568+0000 7fa5c39ff700 1 -- 172.21.15.124:0/2333187261 wait complete. 2023-10-06T04:45:08.586 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:45:08.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.775+0000 7fe485fff700 1 Processor -- start 2023-10-06T04:45:08.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.776+0000 7fe485fff700 1 -- start start 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.777+0000 7fe485fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe4800a9cf0 0x7fe480069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.777+0000 7fe485fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4800aa0c0 0x7fe48006a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.777+0000 7fe485fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe4800675f0 0x7fe480067a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.777+0000 7fe485fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4800ab310 con 0x7fe4800675f0 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.777+0000 7fe485fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48015df90 con 0x7fe4800a9cf0 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.777+0000 7fe485fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48006aa00 con 0x7fe4800aa0c0 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.777+0000 7fe47ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe4800675f0 0x7fe480067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.777+0000 7fe47ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe4800675f0 0x7fe480067a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35116/0 (socket says 172.21.15.124:35116) 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.777+0000 7fe47ffff700 1 -- 172.21.15.124:0/1972883640 learned_addr learned my addr 172.21.15.124:0/1972883640 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe477fff700 1 --2- 172.21.15.124:0/1972883640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4800aa0c0 0x7fe48006a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe47f7fe700 1 --2- 172.21.15.124:0/1972883640 >> v2:172.21.15.158:3300/0 conn(0x7fe4800a9cf0 0x7fe480069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe47ffff700 1 -- 172.21.15.124:0/1972883640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4800aa0c0 msgr2=0x7fe48006a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:08.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe47ffff700 1 --2- 172.21.15.124:0/1972883640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4800aa0c0 0x7fe48006a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe47ffff700 1 -- 172.21.15.124:0/1972883640 >> v2:172.21.15.158:3300/0 conn(0x7fe4800a9cf0 msgr2=0x7fe480069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:08.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe47ffff700 1 --2- 172.21.15.124:0/1972883640 >> v2:172.21.15.158:3300/0 conn(0x7fe4800a9cf0 0x7fe480069f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe47ffff700 1 -- 172.21.15.124:0/1972883640 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48015d380 con 0x7fe4800675f0 2023-10-06T04:45:08.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe47ffff700 1 --2- 172.21.15.124:0/1972883640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800675f0 0x7fe480067a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe48006d3d0 tx=0x7fe478009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad188edf9a91ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:08.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe47effd700 1 -- 172.21.15.124:0/1972883640 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47800e070 con 0x7fe4800675f0 2023-10-06T04:45:08.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe47effd700 1 -- 172.21.15.124:0/1972883640 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47800b930 con 0x7fe4800675f0 2023-10-06T04:45:08.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.778+0000 7fe47effd700 1 -- 172.21.15.124:0/1972883640 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780092e0 con 0x7fe4800675f0 2023-10-06T04:45:08.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.779+0000 7fe485fff700 1 -- 172.21.15.124:0/1972883640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800675f0 msgr2=0x7fe480067a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.779+0000 7fe485fff700 1 --2- 172.21.15.124:0/1972883640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800675f0 0x7fe480067a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe48006d3d0 tx=0x7fe478009840 comp rx=0 tx=0).stop 2023-10-06T04:45:08.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.779+0000 7fe485fff700 1 -- 172.21.15.124:0/1972883640 shutdown_connections 2023-10-06T04:45:08.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.779+0000 7fe485fff700 1 --2- 172.21.15.124:0/1972883640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800675f0 0x7fe480067a70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.779+0000 7fe485fff700 1 --2- 172.21.15.124:0/1972883640 >> v2:172.21.15.158:3300/0 conn(0x7fe4800a9cf0 0x7fe480069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.779+0000 7fe485fff700 1 --2- 172.21.15.124:0/1972883640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4800aa0c0 0x7fe48006a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.779+0000 7fe485fff700 1 -- 172.21.15.124:0/1972883640 >> 172.21.15.124:0/1972883640 conn(0x7fe48006bf10 msgr2=0x7fe4800ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:08.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.779+0000 7fe485fff700 1 -- 172.21.15.124:0/1972883640 shutdown_connections 2023-10-06T04:45:08.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.779+0000 7fe485fff700 1 -- 172.21.15.124:0/1972883640 wait complete. 2023-10-06T04:45:08.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.781+0000 7fe485fff700 1 Processor -- start 2023-10-06T04:45:08.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.781+0000 7fe485fff700 1 -- start start 2023-10-06T04:45:08.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe485fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4800675f0 0x7fe4801598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe485fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800a9cf0 0x7fe480159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe485fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4800aa0c0 0x7fe480169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe485fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48015ced0 con 0x7fe4800a9cf0 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe485fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48015c390 con 0x7fe4800aa0c0 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe485fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48015c630 con 0x7fe4800675f0 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe477fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800a9cf0 0x7fe480159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe477fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800a9cf0 0x7fe480159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35126/0 (socket says 172.21.15.124:35126) 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe477fff700 1 -- 172.21.15.124:0/357067880 learned_addr learned my addr 172.21.15.124:0/357067880 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe47f7fe700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4800675f0 0x7fe4801598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe47ffff700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4800aa0c0 0x7fe480169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe477fff700 1 -- 172.21.15.124:0/357067880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4800675f0 msgr2=0x7fe4801598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe477fff700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4800675f0 0x7fe4801598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe477fff700 1 -- 172.21.15.124:0/357067880 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4800aa0c0 msgr2=0x7fe480169b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe477fff700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4800aa0c0 0x7fe480169b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe477fff700 1 -- 172.21.15.124:0/357067880 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478009ae0 con 0x7fe4800a9cf0 2023-10-06T04:45:08.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.782+0000 7fe477fff700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800a9cf0 0x7fe480159e20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe46800e930 tx=0x7fe4680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:08.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.783+0000 7fe4777fe700 1 -- 172.21.15.124:0/357067880 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468013680 con 0x7fe4800a9cf0 2023-10-06T04:45:08.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.783+0000 7fe4777fe700 1 -- 172.21.15.124:0/357067880 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4680137e0 con 0x7fe4800a9cf0 2023-10-06T04:45:08.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.783+0000 7fe4777fe700 1 -- 172.21.15.124:0/357067880 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468013b80 con 0x7fe4800a9cf0 2023-10-06T04:45:08.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.783+0000 7fe485fff700 1 -- 172.21.15.124:0/357067880 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48015c910 con 0x7fe4800a9cf0 2023-10-06T04:45:08.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.783+0000 7fe485fff700 1 -- 172.21.15.124:0/357067880 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe480145950 con 0x7fe4800a9cf0 2023-10-06T04:45:08.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.784+0000 7fe485fff700 1 -- 172.21.15.124:0/357067880 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48004c380 con 0x7fe4800a9cf0 2023-10-06T04:45:08.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.785+0000 7fe4777fe700 1 -- 172.21.15.124:0/357067880 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe46800c460 con 0x7fe4800a9cf0 2023-10-06T04:45:08.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.786+0000 7fe4777fe700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe460066f30 0x7fe4600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:08.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.786+0000 7fe4777fe700 1 -- 172.21.15.124:0/357067880 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe468084800 con 0x7fe4800a9cf0 2023-10-06T04:45:08.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.786+0000 7fe47f7fe700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe460066f30 0x7fe4600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:08.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.787+0000 7fe47f7fe700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe460066f30 0x7fe4600693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe470009db0 tx=0x7fe4700091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:08.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.790+0000 7fe4777fe700 1 -- 172.21.15.124:0/357067880 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe468051910 con 0x7fe4800a9cf0 2023-10-06T04:45:08.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.978+0000 7fe485fff700 1 -- 172.21.15.124:0/357067880 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe48015d660 con 0x7fe4800a9cf0 2023-10-06T04:45:08.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.978+0000 7fe4777fe700 1 -- 172.21.15.124:0/357067880 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe468054f30 con 0x7fe4800a9cf0 2023-10-06T04:45:08.980 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:45:08.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.980+0000 7fe485fff700 1 -- 172.21.15.124:0/357067880 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe460066f30 msgr2=0x7fe4600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.980+0000 7fe485fff700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe460066f30 0x7fe4600693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe470009db0 tx=0x7fe4700091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.980+0000 7fe485fff700 1 -- 172.21.15.124:0/357067880 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800a9cf0 msgr2=0x7fe480159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:08.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.980+0000 7fe485fff700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800a9cf0 0x7fe480159e20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe46800e930 tx=0x7fe4680091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.980+0000 7fe485fff700 1 -- 172.21.15.124:0/357067880 shutdown_connections 2023-10-06T04:45:08.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.980+0000 7fe485fff700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4800aa0c0 0x7fe480169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.980+0000 7fe485fff700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe460066f30 0x7fe4600693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.980+0000 7fe485fff700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4800675f0 0x7fe4801598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.980+0000 7fe485fff700 1 --2- 172.21.15.124:0/357067880 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe4800a9cf0 0x7fe480159e20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:08.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.980+0000 7fe485fff700 1 -- 172.21.15.124:0/357067880 >> 172.21.15.124:0/357067880 conn(0x7fe48006bf10 msgr2=0x7fe480068250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:08.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.981+0000 7fe485fff700 1 -- 172.21.15.124:0/357067880 shutdown_connections 2023-10-06T04:45:08.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:08.981+0000 7fe485fff700 1 -- 172.21.15.124:0/357067880 wait complete. 2023-10-06T04:45:08.999 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:45:09.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.191+0000 7f6ae33ff700 1 Processor -- start 2023-10-06T04:45:09.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.191+0000 7f6ae33ff700 1 -- start start 2023-10-06T04:45:09.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.193+0000 7f6ae33ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6adc06a3d0 0x7f6adc0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.193+0000 7f6ae33ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc157ad0 con 0x7f6adc0694c0 2023-10-06T04:45:09.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.193+0000 7f6ae33ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc06db30 con 0x7f6adc157700 2023-10-06T04:45:09.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.193+0000 7f6ae33ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc06de10 con 0x7f6adc06a3d0 2023-10-06T04:45:09.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.193+0000 7f6ae199c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6adc0694c0 0x7f6adc06ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:37158/0 (socket says 172.21.15.124:37158) 2023-10-06T04:45:09.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.193+0000 7f6ae199c700 1 -- 172.21.15.124:0/3181946594 learned_addr learned my addr 172.21.15.124:0/3181946594 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:09.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.193+0000 7f6ae099a700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6adc06a3d0 0x7f6adc0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.193+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833354008 0 0) 0x7f6adc157ad0 con 0x7f6adc0694c0 2023-10-06T04:45:09.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.193+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac8003570 con 0x7f6adc0694c0 2023-10-06T04:45:09.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842014599 0 0) 0x7f6adc06db30 con 0x7f6adc157700 2023-10-06T04:45:09.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc157ad0 con 0x7f6adc157700 2023-10-06T04:45:09.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 147084854 0 0) 0x7f6ac8003570 con 0x7f6adc0694c0 2023-10-06T04:45:09.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6adc06a3d0 msgr2=0x7f6adc0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:09.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6adc06a3d0 0x7f6adc0aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 >> v1:172.21.15.158:6789/0 conn(0x7f6adc157700 legacy=0x7f6adc06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc06e0f0 con 0x7f6adc0694c0 2023-10-06T04:45:09.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f6ad40017f0 con 0x7f6adc0694c0 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 >> v1:172.21.15.124:6789/0 conn(0x7f6adc0694c0 legacy=0x7f6adc06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ac8003c20 0x7f6ac8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ac8004810 0x7f6ac8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ac80051c0 0x7f6ac800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc06de10 con 0x7f6ac80051c0 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac800c020 con 0x7f6ac8003c20 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac800c1e0 con 0x7f6ac8004810 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ae099a700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6adc06a3d0 0x7f6adc0aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ae199c700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ac80051c0 0x7f6ac800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ae119b700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ac8003c20 0x7f6ac8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.194+0000 7f6ae099a700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ac8004810 0x7f6ac8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ae199c700 1 -- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ac8004810 msgr2=0x7f6ac8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ae199c700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ac8004810 0x7f6ac8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ae199c700 1 -- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ac8003c20 msgr2=0x7f6ac8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ae199c700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ac8003c20 0x7f6ac8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ae199c700 1 -- 172.21.15.124:0/3181946594 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac8003570 con 0x7f6ac80051c0 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ae099a700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ac8004810 0x7f6ac8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ae119b700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ac8003c20 0x7f6ac8004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ae199c700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ac80051c0 0x7f6ac800ba60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400a8f0 tx=0x7f6ad4002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07d99ea2a14f40c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40070d0 con 0x7f6ac80051c0 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4007250 con 0x7f6ac80051c0 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.195+0000 7f6ad3fff700 1 -- 172.21.15.124:0/3181946594 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4007610 con 0x7f6ac80051c0 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.196+0000 7f6ae33ff700 1 -- 172.21.15.124:0/3181946594 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ac80051c0 msgr2=0x7f6ac800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.196+0000 7f6ae33ff700 1 --2- 172.21.15.124:0/3181946594 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ac80051c0 0x7f6ac800ba60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400a8f0 tx=0x7f6ad4002190 comp rx=0 tx=0).stop 2023-10-06T04:45:09.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.196+0000 7f6ae199c700 1 -- 172.21.15.124:0/3181946594 reap_dead start 2023-10-06T04:45:09.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.196+0000 7f6ae33ff700 1 -- 172.21.15.124:0/3181946594 shutdown_connections 2023-10-06T04:45:09.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.196+0000 7f6ae33ff700 1 -- 172.21.15.124:0/3181946594 >> 172.21.15.124:0/3181946594 conn(0x7f6adc0680c0 msgr2=0x7f6adc0cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:09.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.196+0000 7f6ae33ff700 1 -- 172.21.15.124:0/3181946594 shutdown_connections 2023-10-06T04:45:09.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.196+0000 7f6ae33ff700 1 -- 172.21.15.124:0/3181946594 wait complete. 2023-10-06T04:45:09.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.197+0000 7f6ae33ff700 1 Processor -- start 2023-10-06T04:45:09.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.197+0000 7f6ae33ff700 1 -- start start 2023-10-06T04:45:09.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.198+0000 7f6ae33ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6adc155c70 0x7f6adc0bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.198+0000 7f6ae33ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6adc0bfb10 0x7f6adc0c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.198+0000 7f6ae33ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6adc0c40a0 0x7f6adc0c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.198+0000 7f6ae33ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0c0d30 con 0x7f6adc0c40a0 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.198+0000 7f6ae33ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0c4510 con 0x7f6adc0bfb10 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.198+0000 7f6ae33ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc16a140 con 0x7f6adc155c70 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae199c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6adc0c40a0 0x7f6adc0c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae199c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6adc0c40a0 0x7f6adc0c1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35146/0 (socket says 172.21.15.124:35146) 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae199c700 1 -- 172.21.15.124:0/4037568871 learned_addr learned my addr 172.21.15.124:0/4037568871 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae119b700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6adc155c70 0x7f6adc0bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae099a700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6adc0bfb10 0x7f6adc0c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae199c700 1 -- 172.21.15.124:0/4037568871 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6adc155c70 msgr2=0x7f6adc0bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae199c700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6adc155c70 0x7f6adc0bf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae199c700 1 -- 172.21.15.124:0/4037568871 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6adc0bfb10 msgr2=0x7f6adc0c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae199c700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6adc0bfb10 0x7f6adc0c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae199c700 1 -- 172.21.15.124:0/4037568871 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0c0120 con 0x7f6adc0c40a0 2023-10-06T04:45:09.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae099a700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6adc0bfb10 0x7f6adc0c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:09.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.199+0000 7f6ae199c700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6adc0c40a0 0x7f6adc0c1330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800bff0 tx=0x7f6ad4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:09.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.200+0000 7f6ad17fa700 1 -- 172.21.15.124:0/4037568871 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4023070 con 0x7f6adc0c40a0 2023-10-06T04:45:09.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.200+0000 7f6ad17fa700 1 -- 172.21.15.124:0/4037568871 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad40070d0 con 0x7f6adc0c40a0 2023-10-06T04:45:09.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.200+0000 7f6ad17fa700 1 -- 172.21.15.124:0/4037568871 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4001eb0 con 0x7f6adc0c40a0 2023-10-06T04:45:09.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.200+0000 7f6ae33ff700 1 -- 172.21.15.124:0/4037568871 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc0c0400 con 0x7f6adc0c40a0 2023-10-06T04:45:09.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.200+0000 7f6ae33ff700 1 -- 172.21.15.124:0/4037568871 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc0c09c0 con 0x7f6adc0c40a0 2023-10-06T04:45:09.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.201+0000 7f6ae33ff700 1 -- 172.21.15.124:0/4037568871 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc0bfee0 con 0x7f6adc0c40a0 2023-10-06T04:45:09.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.202+0000 7f6ad17fa700 1 -- 172.21.15.124:0/4037568871 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ad40073c0 con 0x7f6adc0c40a0 2023-10-06T04:45:09.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.202+0000 7f6ad17fa700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ac0066f30 0x7f6ac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.203+0000 7f6ad17fa700 1 -- 172.21.15.124:0/4037568871 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ad40867f0 con 0x7f6adc0c40a0 2023-10-06T04:45:09.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.203+0000 7f6ae119b700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ac0066f30 0x7f6ac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.203+0000 7f6ae119b700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ac0066f30 0x7f6ac00693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6adc06f630 tx=0x7f6ad800c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:09.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.207+0000 7f6ad17fa700 1 -- 172.21.15.124:0/4037568871 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6adc0bfee0 con 0x7f6adc0c40a0 2023-10-06T04:45:09.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.395+0000 7f6ae33ff700 1 -- 172.21.15.124:0/4037568871 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6adc0bfee0 con 0x7f6adc0c40a0 2023-10-06T04:45:09.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.395+0000 7f6ad17fa700 1 -- 172.21.15.124:0/4037568871 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6adc0bfee0 con 0x7f6adc0c40a0 2023-10-06T04:45:09.397 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-06T04:45:09.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 -- 172.21.15.124:0/4037568871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ac0066f30 msgr2=0x7f6ac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ac0066f30 0x7f6ac00693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6adc06f630 tx=0x7f6ad800c040 comp rx=0 tx=0).stop 2023-10-06T04:45:09.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 -- 172.21.15.124:0/4037568871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6adc0c40a0 msgr2=0x7f6adc0c1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6adc0c40a0 0x7f6adc0c1330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800bff0 tx=0x7f6ad4016000 comp rx=0 tx=0).stop 2023-10-06T04:45:09.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 -- 172.21.15.124:0/4037568871 shutdown_connections 2023-10-06T04:45:09.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6adc0c40a0 0x7f6adc0c1330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ac0066f30 0x7f6ac00693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6adc155c70 0x7f6adc0bf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 --2- 172.21.15.124:0/4037568871 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6adc0bfb10 0x7f6adc0c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 -- 172.21.15.124:0/4037568871 >> 172.21.15.124:0/4037568871 conn(0x7f6adc0680c0 msgr2=0x7f6adc06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:09.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 -- 172.21.15.124:0/4037568871 shutdown_connections 2023-10-06T04:45:09.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.397+0000 7f6ae33ff700 1 -- 172.21.15.124:0/4037568871 wait complete. 2023-10-06T04:45:09.416 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:45:09.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.606+0000 7f39e89ff700 1 Processor -- start 2023-10-06T04:45:09.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.606+0000 7f39e89ff700 1 -- start start 2023-10-06T04:45:09.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.607+0000 7f39e89ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f39e4157700 0x7f39e406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.607+0000 7f39e89ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39e40694c0 0x7f39e4069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.607+0000 7f39e89ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e4157ad0 con 0x7f39e406a3d0 2023-10-06T04:45:09.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.607+0000 7f39e89ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e4069e40 con 0x7f39e4157700 2023-10-06T04:45:09.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.607+0000 7f39e89ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e406db30 con 0x7f39e40694c0 2023-10-06T04:45:09.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.608+0000 7f39e259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f39e4157700 0x7f39e406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.608+0000 7f39e1d9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f39e406a3d0 0x7f39e40aede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:37172/0 (socket says 172.21.15.124:37172) 2023-10-06T04:45:09.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.608+0000 7f39e1d9b700 1 -- 172.21.15.124:0/1860086073 learned_addr learned my addr 172.21.15.124:0/1860086073 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:09.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.608+0000 7f39e2d9d700 1 --2- 172.21.15.124:0/1860086073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39e40694c0 0x7f39e4069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.608+0000 7f39e259c700 1 -- 172.21.15.124:0/1860086073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39e40694c0 msgr2=0x7f39e4069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:09.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.608+0000 7f39e259c700 1 --2- 172.21.15.124:0/1860086073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39e40694c0 0x7f39e4069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.608+0000 7f39e259c700 1 -- 172.21.15.124:0/1860086073 >> v1:172.21.15.124:6789/0 conn(0x7f39e406a3d0 legacy=0x7f39e40aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.608+0000 7f39e159a700 1 -- 172.21.15.124:0/1860086073 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605952181 0 0) 0x7f39e4157ad0 con 0x7f39e406a3d0 2023-10-06T04:45:09.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.608+0000 7f39e259c700 1 -- 172.21.15.124:0/1860086073 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e406de10 con 0x7f39e4157700 2023-10-06T04:45:09.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.608+0000 7f39e259c700 1 --2- 172.21.15.124:0/1860086073 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e4157700 0x7f39e406d2e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f39d40098e0 tx=0x7f39d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63695d04a70fdf04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e159a700 1 -- 172.21.15.124:0/1860086073 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d400b640 con 0x7f39e4157700 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e159a700 1 -- 172.21.15.124:0/1860086073 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d400b7a0 con 0x7f39e4157700 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e159a700 1 -- 172.21.15.124:0/1860086073 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d400bb40 con 0x7f39e4157700 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e89ff700 1 -- 172.21.15.124:0/1860086073 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e4157700 msgr2=0x7f39e406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e89ff700 1 --2- 172.21.15.124:0/1860086073 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e4157700 0x7f39e406d2e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f39d40098e0 tx=0x7f39d40091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e89ff700 1 -- 172.21.15.124:0/1860086073 shutdown_connections 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e89ff700 1 --2- 172.21.15.124:0/1860086073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39e40694c0 0x7f39e4069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e89ff700 1 --2- 172.21.15.124:0/1860086073 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e4157700 0x7f39e406d2e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e89ff700 1 -- 172.21.15.124:0/1860086073 >> 172.21.15.124:0/1860086073 conn(0x7f39e40680c0 msgr2=0x7f39e40cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e89ff700 1 -- 172.21.15.124:0/1860086073 shutdown_connections 2023-10-06T04:45:09.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.609+0000 7f39e89ff700 1 -- 172.21.15.124:0/1860086073 wait complete. 2023-10-06T04:45:09.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.611+0000 7f39e89ff700 1 Processor -- start 2023-10-06T04:45:09.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.611+0000 7f39e89ff700 1 -- start start 2023-10-06T04:45:09.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e89ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e40694c0 0x7f39e415a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e89ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39e406a3d0 0x7f39e4148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e89ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39e4157700 0x7f39e40b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e89ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40c06e0 con 0x7f39e40694c0 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e89ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40b1790 con 0x7f39e4157700 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e89ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40b1a70 con 0x7f39e406a3d0 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e40694c0 0x7f39e415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e40694c0 0x7f39e415a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35164/0 (socket says 172.21.15.124:35164) 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e259c700 1 -- 172.21.15.124:0/500026819 learned_addr learned my addr 172.21.15.124:0/500026819 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e259c700 1 -- 172.21.15.124:0/500026819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39e406a3d0 msgr2=0x7f39e4148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e259c700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39e406a3d0 0x7f39e4148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e259c700 1 -- 172.21.15.124:0/500026819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39e4157700 msgr2=0x7f39e40b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e2d9d700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39e4157700 0x7f39e40b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e259c700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39e4157700 0x7f39e40b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e259c700 1 -- 172.21.15.124:0/500026819 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d4009420 con 0x7f39e40694c0 2023-10-06T04:45:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.612+0000 7f39e2d9d700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39e4157700 0x7f39e40b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.613+0000 7f39e259c700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e40694c0 0x7f39e415a740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f39e406cee0 tx=0x7f39d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.613+0000 7f39d27fc700 1 -- 172.21.15.124:0/500026819 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d400bb20 con 0x7f39e40694c0 2023-10-06T04:45:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.613+0000 7f39d27fc700 1 -- 172.21.15.124:0/500026819 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d4011420 con 0x7f39e40694c0 2023-10-06T04:45:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.613+0000 7f39d27fc700 1 -- 172.21.15.124:0/500026819 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d40117a0 con 0x7f39e40694c0 2023-10-06T04:45:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.613+0000 7f39e89ff700 1 -- 172.21.15.124:0/500026819 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e40b1d50 con 0x7f39e40694c0 2023-10-06T04:45:09.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.613+0000 7f39e89ff700 1 -- 172.21.15.124:0/500026819 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e4148940 con 0x7f39e40694c0 2023-10-06T04:45:09.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.614+0000 7f39e89ff700 1 -- 172.21.15.124:0/500026819 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e4064850 con 0x7f39e40694c0 2023-10-06T04:45:09.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.615+0000 7f39d27fc700 1 -- 172.21.15.124:0/500026819 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39d4011b50 con 0x7f39e40694c0 2023-10-06T04:45:09.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.616+0000 7f39d27fc700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c4066f30 0x7f39c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:09.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.616+0000 7f39d27fc700 1 -- 172.21.15.124:0/500026819 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39d4085de0 con 0x7f39e40694c0 2023-10-06T04:45:09.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.616+0000 7f39e1d9b700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c4066f30 0x7f39c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:09.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.617+0000 7f39e1d9b700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c4066f30 0x7f39c40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39d80011e0 tx=0x7f39d80079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:09.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.620+0000 7f39d27fc700 1 -- 172.21.15.124:0/500026819 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39d4052e50 con 0x7f39e40694c0 2023-10-06T04:45:09.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.808+0000 7f39e89ff700 1 -- 172.21.15.124:0/500026819 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39e404c380 con 0x7f39e40694c0 2023-10-06T04:45:09.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.809+0000 7f39d27fc700 1 -- 172.21.15.124:0/500026819 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39d4056470 con 0x7f39e40694c0 2023-10-06T04:45:09.810 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-06T04:45:09.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 -- 172.21.15.124:0/500026819 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c4066f30 msgr2=0x7f39c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c4066f30 0x7f39c40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39d80011e0 tx=0x7f39d80079d0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 -- 172.21.15.124:0/500026819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e40694c0 msgr2=0x7f39e415a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:09.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e40694c0 0x7f39e415a740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f39e406cee0 tx=0x7f39d4017000 comp rx=0 tx=0).stop 2023-10-06T04:45:09.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 -- 172.21.15.124:0/500026819 shutdown_connections 2023-10-06T04:45:09.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39e4157700 0x7f39e40b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39e40694c0 0x7f39e415a740 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f39c4066f30 0x7f39c40693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 --2- 172.21.15.124:0/500026819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39e406a3d0 0x7f39e4148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:09.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 -- 172.21.15.124:0/500026819 >> 172.21.15.124:0/500026819 conn(0x7f39e40680c0 msgr2=0x7f39e4156500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:09.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 -- 172.21.15.124:0/500026819 shutdown_connections 2023-10-06T04:45:09.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:09.811+0000 7f39e89ff700 1 -- 172.21.15.124:0/500026819 wait complete. 2023-10-06T04:45:09.829 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:10.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.019+0000 7fa75e5ff700 1 Processor -- start 2023-10-06T04:45:10.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.019+0000 7fa75e5ff700 1 -- start start 2023-10-06T04:45:10.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.020+0000 7fa75e5ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa7580ccd30 0x7fa758099610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.020+0000 7fa75e5ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa7580690b0 0x7fa7580abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.020+0000 7fa75e5ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7580acc40 con 0x7fa7580abb60 2023-10-06T04:45:10.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa75e5ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7580ad0d0 con 0x7fa7580690b0 2023-10-06T04:45:10.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa75e5ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75806ae30 con 0x7fa7580ccd30 2023-10-06T04:45:10.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa75cb9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa7580690b0 0x7fa7580abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa75cb9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa7580690b0 0x7fa7580abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35166/0 (socket says 172.21.15.124:35166) 2023-10-06T04:45:10.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa75cb9c700 1 -- 172.21.15.124:0/1383267349 learned_addr learned my addr 172.21.15.124:0/1383267349 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:10.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa7577fe700 1 --2- 172.21.15.124:0/1383267349 >> v2:172.21.15.158:3300/0 conn(0x7fa7580ccd30 0x7fa758099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa75cb9c700 1 -- 172.21.15.124:0/1383267349 >> v2:172.21.15.158:3300/0 conn(0x7fa7580ccd30 msgr2=0x7fa758099610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:10.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa75cb9c700 1 --2- 172.21.15.124:0/1383267349 >> v2:172.21.15.158:3300/0 conn(0x7fa7580ccd30 0x7fa758099610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa75cb9c700 1 -- 172.21.15.124:0/1383267349 >> v1:172.21.15.158:6789/0 conn(0x7fa7580abb60 legacy=0x7fa758098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:10.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa75cb9c700 1 -- 172.21.15.124:0/1383267349 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7580ac5f0 con 0x7fa7580690b0 2023-10-06T04:45:10.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.021+0000 7fa75cb9c700 1 --2- 172.21.15.124:0/1383267349 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 0x7fa7580abf30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa758099f90 tx=0x7fa750009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ea98e776121762 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:10.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa756ffd700 1 -- 172.21.15.124:0/1383267349 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75000e070 con 0x7fa7580690b0 2023-10-06T04:45:10.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa756ffd700 1 -- 172.21.15.124:0/1383267349 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75000ba10 con 0x7fa7580690b0 2023-10-06T04:45:10.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa756ffd700 1 -- 172.21.15.124:0/1383267349 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7500092e0 con 0x7fa7580690b0 2023-10-06T04:45:10.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1383267349 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 msgr2=0x7fa7580abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa75e5ff700 1 --2- 172.21.15.124:0/1383267349 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 0x7fa7580abf30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa758099f90 tx=0x7fa750009840 comp rx=0 tx=0).stop 2023-10-06T04:45:10.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1383267349 shutdown_connections 2023-10-06T04:45:10.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa75e5ff700 1 --2- 172.21.15.124:0/1383267349 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 0x7fa7580abf30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa75e5ff700 1 --2- 172.21.15.124:0/1383267349 >> v2:172.21.15.158:3300/0 conn(0x7fa7580ccd30 0x7fa758099610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1383267349 >> 172.21.15.124:0/1383267349 conn(0x7fa7580cc050 msgr2=0x7fa7580cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:10.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1383267349 shutdown_connections 2023-10-06T04:45:10.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.022+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1383267349 wait complete. 2023-10-06T04:45:10.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.024+0000 7fa75e5ff700 1 Processor -- start 2023-10-06T04:45:10.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.024+0000 7fa75e5ff700 1 -- start start 2023-10-06T04:45:10.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa75e5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 0x7fa75815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa75e5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7580abb60 0x7fa75815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa75e5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7580ccd30 0x7fa7580989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa75e5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75815b270 con 0x7fa7580690b0 2023-10-06T04:45:10.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa75e5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75815b550 con 0x7fa7580abb60 2023-10-06T04:45:10.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa75e5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75815b830 con 0x7fa7580ccd30 2023-10-06T04:45:10.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa757fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 0x7fa75815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa757fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 0x7fa75815abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35182/0 (socket says 172.21.15.124:35182) 2023-10-06T04:45:10.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa757fff700 1 -- 172.21.15.124:0/1409175572 learned_addr learned my addr 172.21.15.124:0/1409175572 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:10.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa757fff700 1 -- 172.21.15.124:0/1409175572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7580ccd30 msgr2=0x7fa7580989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa757fff700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7580ccd30 0x7fa7580989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa757fff700 1 -- 172.21.15.124:0/1409175572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7580abb60 msgr2=0x7fa75815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa757fff700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7580abb60 0x7fa75815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.025+0000 7fa757fff700 1 -- 172.21.15.124:0/1409175572 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750009ae0 con 0x7fa7580690b0 2023-10-06T04:45:10.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.026+0000 7fa757fff700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 0x7fa75815abe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c5d0 tx=0x7fa748007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:10.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.026+0000 7fa73ffff700 1 -- 172.21.15.124:0/1409175572 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748011590 con 0x7fa7580690b0 2023-10-06T04:45:10.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.026+0000 7fa73ffff700 1 -- 172.21.15.124:0/1409175572 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748011710 con 0x7fa7580690b0 2023-10-06T04:45:10.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.026+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1409175572 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75815bb10 con 0x7fa7580690b0 2023-10-06T04:45:10.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.026+0000 7fa73ffff700 1 -- 172.21.15.124:0/1409175572 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748011ad0 con 0x7fa7580690b0 2023-10-06T04:45:10.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.026+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1409175572 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75815d240 con 0x7fa7580690b0 2023-10-06T04:45:10.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.027+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1409175572 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75815e1f0 con 0x7fa7580690b0 2023-10-06T04:45:10.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.028+0000 7fa73ffff700 1 -- 172.21.15.124:0/1409175572 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa74801c460 con 0x7fa7580690b0 2023-10-06T04:45:10.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.029+0000 7fa73ffff700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa744066f30 0x7fa7440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.029+0000 7fa73ffff700 1 -- 172.21.15.124:0/1409175572 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa748084490 con 0x7fa7580690b0 2023-10-06T04:45:10.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.029+0000 7fa7577fe700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa744066f30 0x7fa7440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.030+0000 7fa7577fe700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa744066f30 0x7fa7440693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa7580b1c40 tx=0x7fa74c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:10.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.033+0000 7fa73ffff700 1 -- 172.21.15.124:0/1409175572 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7480515a0 con 0x7fa7580690b0 2023-10-06T04:45:10.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.271+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1409175572 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7580717a0 con 0x7fa7580690b0 2023-10-06T04:45:10.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.272+0000 7fa73ffff700 1 -- 172.21.15.124:0/1409175572 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fa748054bc0 con 0x7fa7580690b0 2023-10-06T04:45:10.273 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:10.274 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/3828511424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":3828511424},{"type":"v1","addr":"172.21.15.124:6836","nonce":3828511424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/1252041103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1252041103},{"type":"v1","addr":"172.21.15.158:6834","nonce":1252041103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/978440229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":978440229},{"type":"v1","addr":"172.21.15.124:6837","nonce":978440229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:27.635332+0000","modified":"2023-10-06T04:44:31.182630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6835/1693475602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":1693475602},{"type":"v1","addr":"172.21.15.158:6835","nonce":1693475602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:45:10.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.274+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1409175572 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa744066f30 msgr2=0x7fa7440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.274+0000 7fa75e5ff700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa744066f30 0x7fa7440693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa7580b1c40 tx=0x7fa74c008040 comp rx=0 tx=0).stop 2023-10-06T04:45:10.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.274+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1409175572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 msgr2=0x7fa75815abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.274+0000 7fa75e5ff700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 0x7fa75815abe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c5d0 tx=0x7fa748007f60 comp rx=0 tx=0).stop 2023-10-06T04:45:10.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.274+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1409175572 shutdown_connections 2023-10-06T04:45:10.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.274+0000 7fa75e5ff700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa744066f30 0x7fa7440693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.274+0000 7fa75e5ff700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7580ccd30 0x7fa7580989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.274+0000 7fa75e5ff700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7580690b0 0x7fa75815abe0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.274+0000 7fa75e5ff700 1 --2- 172.21.15.124:0/1409175572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7580abb60 0x7fa75815cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.274+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1409175572 >> 172.21.15.124:0/1409175572 conn(0x7fa7580cc050 msgr2=0x7fa7580cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:10.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.275+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1409175572 shutdown_connections 2023-10-06T04:45:10.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.275+0000 7fa75e5ff700 1 -- 172.21.15.124:0/1409175572 wait complete. 2023-10-06T04:45:10.277 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2023-10-06T04:45:10.293 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:10.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.481+0000 7f09ddbff700 1 Processor -- start 2023-10-06T04:45:10.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.481+0000 7f09ddbff700 1 -- start start 2023-10-06T04:45:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.482+0000 7f09ddbff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80cdfe0 0x7f09d80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.482+0000 7f09ddbff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f09d80ccf80 0x7f09d80cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.482+0000 7f09ddbff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d80cf6b0 con 0x7f09d80ccbb0 2023-10-06T04:45:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.482+0000 7f09ddbff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d80d0250 con 0x7f09d80ccf80 2023-10-06T04:45:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.482+0000 7f09ddbff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80ceaa0 con 0x7f09d80cdfe0 2023-10-06T04:45:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.483+0000 7f09d77fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f09d80ccbb0 0x7f09d80cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:37184/0 (socket says 172.21.15.124:37184) 2023-10-06T04:45:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.483+0000 7f09d77fe700 1 -- 172.21.15.124:0/2399687518 learned_addr learned my addr 172.21.15.124:0/2399687518 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.483+0000 7f09d7fff700 1 --2- 172.21.15.124:0/2399687518 >> v2:172.21.15.124:3300/0 conn(0x7f09d80ccf80 0x7f09d80cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.483+0000 7f09d6ffd700 1 --2- 172.21.15.124:0/2399687518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80cdfe0 0x7f09d80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.483+0000 7f09d67fc700 1 -- 172.21.15.124:0/2399687518 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565030937 0 0) 0x7f09d80cf6b0 con 0x7f09d80ccbb0 2023-10-06T04:45:10.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.483+0000 7f09d67fc700 1 -- 172.21.15.124:0/2399687518 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09c0003570 con 0x7f09d80ccbb0 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.483+0000 7f09d7fff700 1 -- 172.21.15.124:0/2399687518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80cdfe0 msgr2=0x7f09d80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.483+0000 7f09d7fff700 1 --2- 172.21.15.124:0/2399687518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80cdfe0 0x7f09d80ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.483+0000 7f09d7fff700 1 -- 172.21.15.124:0/2399687518 >> v1:172.21.15.124:6789/0 conn(0x7f09d80ccbb0 legacy=0x7f09d80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.483+0000 7f09d7fff700 1 -- 172.21.15.124:0/2399687518 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d80ced80 con 0x7f09d80ccf80 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09d7fff700 1 --2- 172.21.15.124:0/2399687518 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 0x7f09d80cd400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009e60 tx=0x7f09d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308f56f562ef7893 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09d67fc700 1 -- 172.21.15.124:0/2399687518 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d000e070 con 0x7f09d80ccf80 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09d67fc700 1 -- 172.21.15.124:0/2399687518 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d000bb60 con 0x7f09d80ccf80 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09d67fc700 1 -- 172.21.15.124:0/2399687518 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0012430 con 0x7f09d80ccf80 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09ddbff700 1 -- 172.21.15.124:0/2399687518 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 msgr2=0x7f09d80cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09ddbff700 1 --2- 172.21.15.124:0/2399687518 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 0x7f09d80cd400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009e60 tx=0x7f09d0009780 comp rx=0 tx=0).stop 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09ddbff700 1 -- 172.21.15.124:0/2399687518 shutdown_connections 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09ddbff700 1 --2- 172.21.15.124:0/2399687518 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 0x7f09d80cd400 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09ddbff700 1 --2- 172.21.15.124:0/2399687518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80cdfe0 0x7f09d80ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09ddbff700 1 -- 172.21.15.124:0/2399687518 >> 172.21.15.124:0/2399687518 conn(0x7f09d8099710 msgr2=0x7f09d806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:10.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09ddbff700 1 -- 172.21.15.124:0/2399687518 shutdown_connections 2023-10-06T04:45:10.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.484+0000 7f09ddbff700 1 -- 172.21.15.124:0/2399687518 wait complete. 2023-10-06T04:45:10.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.486+0000 7f09ddbff700 1 Processor -- start 2023-10-06T04:45:10.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.487+0000 7f09ddbff700 1 -- start start 2023-10-06T04:45:10.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09ddbff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80ccbb0 0x7f09d80c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09ddbff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 0x7f09d80b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09ddbff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09d80cdfe0 0x7f09d80b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09ddbff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80c9a90 con 0x7f09d80ccf80 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09ddbff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d809ae20 con 0x7f09d80cdfe0 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09ddbff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d809b100 con 0x7f09d80ccbb0 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09d6ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 0x7f09d80b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09d6ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 0x7f09d80b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35202/0 (socket says 172.21.15.124:35202) 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09d6ffd700 1 -- 172.21.15.124:0/1871982469 learned_addr learned my addr 172.21.15.124:0/1871982469 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09d77fe700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80ccbb0 0x7f09d80c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.488+0000 7f09d7fff700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09d80cdfe0 0x7f09d80b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09d6ffd700 1 -- 172.21.15.124:0/1871982469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80ccbb0 msgr2=0x7f09d80c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09d6ffd700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80ccbb0 0x7f09d80c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09d6ffd700 1 -- 172.21.15.124:0/1871982469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09d80cdfe0 msgr2=0x7f09d80b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09d6ffd700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09d80cdfe0 0x7f09d80b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09d6ffd700 1 -- 172.21.15.124:0/1871982469 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0009a20 con 0x7f09d80ccf80 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09d77fe700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80ccbb0 0x7f09d80c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09d6ffd700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 0x7f09d80b1dd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00d860 tx=0x7f09cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09bf7fe700 1 -- 172.21.15.124:0/1871982469 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc009610 con 0x7f09d80ccf80 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09bf7fe700 1 -- 172.21.15.124:0/1871982469 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc009770 con 0x7f09d80ccf80 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09ddbff700 1 -- 172.21.15.124:0/1871982469 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d80c9440 con 0x7f09d80ccf80 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09bf7fe700 1 -- 172.21.15.124:0/1871982469 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc009b30 con 0x7f09d80ccf80 2023-10-06T04:45:10.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.489+0000 7f09ddbff700 1 -- 172.21.15.124:0/1871982469 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d80c6e30 con 0x7f09d80ccf80 2023-10-06T04:45:10.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.490+0000 7f09ddbff700 1 -- 172.21.15.124:0/1871982469 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d80c9c40 con 0x7f09d80ccf80 2023-10-06T04:45:10.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.491+0000 7f09bf7fe700 1 -- 172.21.15.124:0/1871982469 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09cc01e460 con 0x7f09d80ccf80 2023-10-06T04:45:10.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.492+0000 7f09bf7fe700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f09c4066f30 0x7f09c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.492+0000 7f09bf7fe700 1 -- 172.21.15.124:0/1871982469 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f09cc084d50 con 0x7f09d80ccf80 2023-10-06T04:45:10.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.492+0000 7f09d77fe700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f09c4066f30 0x7f09c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.492+0000 7f09d77fe700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f09c4066f30 0x7f09c40693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f09c80058d0 tx=0x7f09c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:10.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.496+0000 7f09bf7fe700 1 -- 172.21.15.124:0/1871982469 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09d80c9c40 con 0x7f09d80ccf80 2023-10-06T04:45:10.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.687+0000 7f09ddbff700 1 -- 172.21.15.124:0/1871982469 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09d80717a0 con 0x7f09d80ccf80 2023-10-06T04:45:10.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.689+0000 7f09bf7fe700 1 -- 172.21.15.124:0/1871982469 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f09cc051dc0 con 0x7f09d80ccf80 2023-10-06T04:45:10.690 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:10.691 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:10.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 -- 172.21.15.124:0/1871982469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f09c4066f30 msgr2=0x7f09c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f09c4066f30 0x7f09c40693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f09c80058d0 tx=0x7f09c8009040 comp rx=0 tx=0).stop 2023-10-06T04:45:10.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 -- 172.21.15.124:0/1871982469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 msgr2=0x7f09d80b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 0x7f09d80b1dd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00d860 tx=0x7f09cc008040 comp rx=0 tx=0).stop 2023-10-06T04:45:10.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 -- 172.21.15.124:0/1871982469 shutdown_connections 2023-10-06T04:45:10.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09d80cdfe0 0x7f09d80b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f09c4066f30 0x7f09c40693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09d80ccbb0 0x7f09d80c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 --2- 172.21.15.124:0/1871982469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09d80ccf80 0x7f09d80b1dd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 -- 172.21.15.124:0/1871982469 >> 172.21.15.124:0/1871982469 conn(0x7f09d8099710 msgr2=0x7f09d8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:10.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 -- 172.21.15.124:0/1871982469 shutdown_connections 2023-10-06T04:45:10.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.691+0000 7f09ddbff700 1 -- 172.21.15.124:0/1871982469 wait complete. 2023-10-06T04:45:10.710 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:45:10.710 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:10.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.899+0000 7fb2469ff700 1 Processor -- start 2023-10-06T04:45:10.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.899+0000 7fb2469ff700 1 -- start start 2023-10-06T04:45:10.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.900+0000 7fb2469ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb24006ddc0 0x7fb2400b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.900+0000 7fb2469ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb240068bb0 0x7fb24006e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.900+0000 7fb2469ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2400cc040 con 0x7fb240159040 2023-10-06T04:45:10.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.900+0000 7fb2469ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24006e6d0 con 0x7fb24006ddc0 2023-10-06T04:45:10.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.900+0000 7fb2469ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24006e990 con 0x7fb240068bb0 2023-10-06T04:45:10.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.901+0000 7fb23ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb24006ddc0 0x7fb2400b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.901+0000 7fb244f9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb240159040 0x7fb2401594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:37192/0 (socket says 172.21.15.124:37192) 2023-10-06T04:45:10.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.901+0000 7fb244f9c700 1 -- 172.21.15.124:0/2569239920 learned_addr learned my addr 172.21.15.124:0/2569239920 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:10.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.901+0000 7fb23f7fe700 1 --2- 172.21.15.124:0/2569239920 >> v2:172.21.15.158:3300/0 conn(0x7fb240068bb0 0x7fb24006e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.901+0000 7fb23ffff700 1 -- 172.21.15.124:0/2569239920 >> v2:172.21.15.158:3300/0 conn(0x7fb240068bb0 msgr2=0x7fb24006e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:10.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.901+0000 7fb23ffff700 1 --2- 172.21.15.124:0/2569239920 >> v2:172.21.15.158:3300/0 conn(0x7fb240068bb0 0x7fb24006e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.901+0000 7fb23ffff700 1 -- 172.21.15.124:0/2569239920 >> v1:172.21.15.124:6789/0 conn(0x7fb240159040 legacy=0x7fb2401594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.901+0000 7fb23ffff700 1 -- 172.21.15.124:0/2569239920 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2400cb9f0 con 0x7fb24006ddc0 2023-10-06T04:45:10.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.901+0000 7fb23ffff700 1 --2- 172.21.15.124:0/2569239920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 0x7fb2400b1f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb24006b310 tx=0x7fb2300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bcc5de49d5e01f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:10.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb23effd700 1 -- 172.21.15.124:0/2569239920 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230011630 con 0x7fb24006ddc0 2023-10-06T04:45:10.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb23effd700 1 -- 172.21.15.124:0/2569239920 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb230011790 con 0x7fb24006ddc0 2023-10-06T04:45:10.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb23effd700 1 -- 172.21.15.124:0/2569239920 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230011b30 con 0x7fb24006ddc0 2023-10-06T04:45:10.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb2469ff700 1 -- 172.21.15.124:0/2569239920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 msgr2=0x7fb2400b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb2469ff700 1 --2- 172.21.15.124:0/2569239920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 0x7fb2400b1f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb24006b310 tx=0x7fb2300091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb2469ff700 1 -- 172.21.15.124:0/2569239920 shutdown_connections 2023-10-06T04:45:10.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb2469ff700 1 --2- 172.21.15.124:0/2569239920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 0x7fb2400b1f50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb2469ff700 1 --2- 172.21.15.124:0/2569239920 >> v2:172.21.15.158:3300/0 conn(0x7fb240068bb0 0x7fb24006e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb2469ff700 1 -- 172.21.15.124:0/2569239920 >> 172.21.15.124:0/2569239920 conn(0x7fb2400cd390 msgr2=0x7fb2400b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:10.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb2469ff700 1 -- 172.21.15.124:0/2569239920 shutdown_connections 2023-10-06T04:45:10.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.902+0000 7fb2469ff700 1 -- 172.21.15.124:0/2569239920 wait complete. 2023-10-06T04:45:10.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.904+0000 7fb2469ff700 1 Processor -- start 2023-10-06T04:45:10.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.904+0000 7fb2469ff700 1 -- start start 2023-10-06T04:45:10.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb2469ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb240068bb0 0x7fb2400a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb2469ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 0x7fb240152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb2469ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240159040 0x7fb2401699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb2469ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400c6a40 con 0x7fb24006ddc0 2023-10-06T04:45:10.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb2469ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400c6d20 con 0x7fb240159040 2023-10-06T04:45:10.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb2469ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400c7000 con 0x7fb240068bb0 2023-10-06T04:45:10.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb23f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 0x7fb240152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb23f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 0x7fb240152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35212/0 (socket says 172.21.15.124:35212) 2023-10-06T04:45:10.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb23f7fe700 1 -- 172.21.15.124:0/1337839608 learned_addr learned my addr 172.21.15.124:0/1337839608 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:10.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb23ffff700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb240068bb0 0x7fb2400a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb244f9c700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240159040 0x7fb2401699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb23f7fe700 1 -- 172.21.15.124:0/1337839608 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb240068bb0 msgr2=0x7fb2400a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb23f7fe700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb240068bb0 0x7fb2400a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb23f7fe700 1 -- 172.21.15.124:0/1337839608 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240159040 msgr2=0x7fb2401699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:10.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb23f7fe700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240159040 0x7fb2401699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:10.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.905+0000 7fb23f7fe700 1 -- 172.21.15.124:0/1337839608 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb230009420 con 0x7fb24006ddc0 2023-10-06T04:45:10.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.906+0000 7fb23f7fe700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 0x7fb240152da0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb23400ec50 tx=0x7fb2340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:10.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.906+0000 7fb227fff700 1 -- 172.21.15.124:0/1337839608 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23400c9d0 con 0x7fb24006ddc0 2023-10-06T04:45:10.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.906+0000 7fb227fff700 1 -- 172.21.15.124:0/1337839608 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23400cb30 con 0x7fb24006ddc0 2023-10-06T04:45:10.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.906+0000 7fb2469ff700 1 -- 172.21.15.124:0/1337839608 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2400c72e0 con 0x7fb24006ddc0 2023-10-06T04:45:10.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.906+0000 7fb227fff700 1 -- 172.21.15.124:0/1337839608 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234013470 con 0x7fb24006ddc0 2023-10-06T04:45:10.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.906+0000 7fb2469ff700 1 -- 172.21.15.124:0/1337839608 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2400a5f20 con 0x7fb24006ddc0 2023-10-06T04:45:10.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.907+0000 7fb2469ff700 1 -- 172.21.15.124:0/1337839608 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2400717a0 con 0x7fb24006ddc0 2023-10-06T04:45:10.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.908+0000 7fb227fff700 1 -- 172.21.15.124:0/1337839608 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb234013860 con 0x7fb24006ddc0 2023-10-06T04:45:10.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.909+0000 7fb227fff700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb22c066f30 0x7fb22c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:10.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.909+0000 7fb227fff700 1 -- 172.21.15.124:0/1337839608 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb234084a30 con 0x7fb24006ddc0 2023-10-06T04:45:10.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.909+0000 7fb23ffff700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb22c066f30 0x7fb22c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:10.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.910+0000 7fb23ffff700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb22c066f30 0x7fb22c0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb2300093f0 tx=0x7fb230017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:10.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:10.913+0000 7fb227fff700 1 -- 172.21.15.124:0/1337839608 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb234051aa0 con 0x7fb24006ddc0 2023-10-06T04:45:11.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.146+0000 7fb2469ff700 1 -- 172.21.15.124:0/1337839608 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2400cbcd0 con 0x7fb24006ddc0 2023-10-06T04:45:11.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.147+0000 7fb227fff700 1 -- 172.21.15.124:0/1337839608 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fb234084020 con 0x7fb24006ddc0 2023-10-06T04:45:11.149 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:11.149 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/3828511424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":3828511424},{"type":"v1","addr":"172.21.15.124:6836","nonce":3828511424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/1252041103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1252041103},{"type":"v1","addr":"172.21.15.158:6834","nonce":1252041103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/978440229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":978440229},{"type":"v1","addr":"172.21.15.124:6837","nonce":978440229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:27.635332+0000","modified":"2023-10-06T04:44:31.182630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6835/1693475602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":1693475602},{"type":"v1","addr":"172.21.15.158:6835","nonce":1693475602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:45:11.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.149+0000 7fb2469ff700 1 -- 172.21.15.124:0/1337839608 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb22c066f30 msgr2=0x7fb22c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.149+0000 7fb2469ff700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb22c066f30 0x7fb22c0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb2300093f0 tx=0x7fb230017000 comp rx=0 tx=0).stop 2023-10-06T04:45:11.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.149+0000 7fb2469ff700 1 -- 172.21.15.124:0/1337839608 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 msgr2=0x7fb240152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.149+0000 7fb2469ff700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 0x7fb240152da0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb23400ec50 tx=0x7fb2340091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.149+0000 7fb2469ff700 1 -- 172.21.15.124:0/1337839608 shutdown_connections 2023-10-06T04:45:11.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.149+0000 7fb2469ff700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240159040 0x7fb2401699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.149+0000 7fb2469ff700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb22c066f30 0x7fb22c0693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.149+0000 7fb2469ff700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb240068bb0 0x7fb2400a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.149+0000 7fb2469ff700 1 --2- 172.21.15.124:0/1337839608 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb24006ddc0 0x7fb240152da0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.149+0000 7fb2469ff700 1 -- 172.21.15.124:0/1337839608 >> 172.21.15.124:0/1337839608 conn(0x7fb2400cd390 msgr2=0x7fb2400b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:11.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.150+0000 7fb2469ff700 1 -- 172.21.15.124:0/1337839608 shutdown_connections 2023-10-06T04:45:11.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.150+0000 7fb2469ff700 1 -- 172.21.15.124:0/1337839608 wait complete. 2023-10-06T04:45:11.153 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2023-10-06T04:45:11.168 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:11.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.356+0000 7fbbd95ff700 1 Processor -- start 2023-10-06T04:45:11.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.357+0000 7fbbd95ff700 1 -- start start 2023-10-06T04:45:11.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.358+0000 7fbbd95ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbbd41573e0 0x7fbbd41577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.358+0000 7fbbd95ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd40ab910 con 0x7fbbd40ad770 2023-10-06T04:45:11.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.358+0000 7fbbd95ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd40abbf0 con 0x7fbbd40a6c60 2023-10-06T04:45:11.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.358+0000 7fbbd95ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd406a4a0 con 0x7fbbd41573e0 2023-10-06T04:45:11.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.358+0000 7fbbd2ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbbd41573e0 0x7fbbd41577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.358+0000 7fbbd37fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fbbd40ad770 0x7fbbd40adb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:37196/0 (socket says 172.21.15.124:37196) 2023-10-06T04:45:11.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.358+0000 7fbbd37fe700 1 -- 172.21.15.124:0/1297714206 learned_addr learned my addr 172.21.15.124:0/1297714206 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:11.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.359+0000 7fbbd2ffd700 1 -- 172.21.15.124:0/1297714206 >> v1:172.21.15.158:6789/0 conn(0x7fbbd40a6c60 legacy=0x7fbbd4069a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:11.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.359+0000 7fbbd2ffd700 1 -- 172.21.15.124:0/1297714206 >> v1:172.21.15.124:6789/0 conn(0x7fbbd40ad770 legacy=0x7fbbd40adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.359+0000 7fbbd2ffd700 1 -- 172.21.15.124:0/1297714206 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd406a780 con 0x7fbbd41573e0 2023-10-06T04:45:11.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.359+0000 7fbbd2ffd700 1 --2- 172.21.15.124:0/1297714206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 0x7fbbd41577b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40098e0 tx=0x7fbbc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a9920e3ec1fa8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:11.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.359+0000 7fbbd27fc700 1 -- 172.21.15.124:0/1297714206 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4009e80 con 0x7fbbd41573e0 2023-10-06T04:45:11.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.359+0000 7fbbd27fc700 1 -- 172.21.15.124:0/1297714206 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc400b860 con 0x7fbbd41573e0 2023-10-06T04:45:11.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.359+0000 7fbbd27fc700 1 -- 172.21.15.124:0/1297714206 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400bbe0 con 0x7fbbd41573e0 2023-10-06T04:45:11.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.360+0000 7fbbd95ff700 1 -- 172.21.15.124:0/1297714206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 msgr2=0x7fbbd41577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.360+0000 7fbbd95ff700 1 --2- 172.21.15.124:0/1297714206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 0x7fbbd41577b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40098e0 tx=0x7fbbc40091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.360+0000 7fbbd95ff700 1 -- 172.21.15.124:0/1297714206 shutdown_connections 2023-10-06T04:45:11.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.360+0000 7fbbd95ff700 1 --2- 172.21.15.124:0/1297714206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 0x7fbbd41577b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.360+0000 7fbbd95ff700 1 -- 172.21.15.124:0/1297714206 >> 172.21.15.124:0/1297714206 conn(0x7fbbd40cc050 msgr2=0x7fbbd40cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:11.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.360+0000 7fbbd95ff700 1 -- 172.21.15.124:0/1297714206 shutdown_connections 2023-10-06T04:45:11.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.360+0000 7fbbd95ff700 1 -- 172.21.15.124:0/1297714206 wait complete. 2023-10-06T04:45:11.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.361+0000 7fbbd95ff700 1 Processor -- start 2023-10-06T04:45:11.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.361+0000 7fbbd95ff700 1 -- start start 2023-10-06T04:45:11.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.362+0000 7fbbd95ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbd40ad770 0x7fbbd41563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.362+0000 7fbbd95ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 0x7fbbd4098b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.362+0000 7fbbd95ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbd40990b0 0x7fbbd40a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.362+0000 7fbbd95ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4099530 con 0x7fbbd41573e0 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.362+0000 7fbbd95ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd406ddb0 con 0x7fbbd40ad770 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.362+0000 7fbbd95ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40a9750 con 0x7fbbd40990b0 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcbfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 0x7fbbd4098b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcbfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 0x7fbbd4098b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35224/0 (socket says 172.21.15.124:35224) 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcbfff700 1 -- 172.21.15.124:0/4120661502 learned_addr learned my addr 172.21.15.124:0/4120661502 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbd2ffd700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbd40ad770 0x7fbbd41563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbd37fe700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbd40990b0 0x7fbbd40a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcbfff700 1 -- 172.21.15.124:0/4120661502 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbd40990b0 msgr2=0x7fbbd40a8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcbfff700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbd40990b0 0x7fbbd40a8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcbfff700 1 -- 172.21.15.124:0/4120661502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbd40ad770 msgr2=0x7fbbd41563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcbfff700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbd40ad770 0x7fbbd41563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcbfff700 1 -- 172.21.15.124:0/4120661502 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4009420 con 0x7fbbd41573e0 2023-10-06T04:45:11.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbd37fe700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbd40990b0 0x7fbbd40a8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:11.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcbfff700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 0x7fbbd4098b70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00c600 tx=0x7fbbbc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:11.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcaffd700 1 -- 172.21.15.124:0/4120661502 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc011590 con 0x7fbbd41573e0 2023-10-06T04:45:11.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.363+0000 7fbbcaffd700 1 -- 172.21.15.124:0/4120661502 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc011710 con 0x7fbbd41573e0 2023-10-06T04:45:11.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.364+0000 7fbbcaffd700 1 -- 172.21.15.124:0/4120661502 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc011ad0 con 0x7fbbd41573e0 2023-10-06T04:45:11.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.364+0000 7fbbd95ff700 1 -- 172.21.15.124:0/4120661502 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd406d4a0 con 0x7fbbd41573e0 2023-10-06T04:45:11.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.364+0000 7fbbd95ff700 1 -- 172.21.15.124:0/4120661502 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd406da40 con 0x7fbbd41573e0 2023-10-06T04:45:11.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.365+0000 7fbbd95ff700 1 -- 172.21.15.124:0/4120661502 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd406df40 con 0x7fbbd41573e0 2023-10-06T04:45:11.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.366+0000 7fbbcaffd700 1 -- 172.21.15.124:0/4120661502 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbbc01c460 con 0x7fbbd41573e0 2023-10-06T04:45:11.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.366+0000 7fbbcaffd700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbbb4066f30 0x7fbbb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.366+0000 7fbbcaffd700 1 -- 172.21.15.124:0/4120661502 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbbbc084460 con 0x7fbbd41573e0 2023-10-06T04:45:11.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.367+0000 7fbbd2ffd700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbbb4066f30 0x7fbbb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.367+0000 7fbbd2ffd700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbbb4066f30 0x7fbbb40693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40030c0 tx=0x7fbbc4016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:11.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.370+0000 7fbbcaffd700 1 -- 172.21.15.124:0/4120661502 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbbc0514d0 con 0x7fbbd41573e0 2023-10-06T04:45:11.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.599+0000 7fbbd95ff700 1 -- 172.21.15.124:0/4120661502 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbd40717a0 con 0x7fbbd41573e0 2023-10-06T04:45:11.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.600+0000 7fbbcaffd700 1 -- 172.21.15.124:0/4120661502 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fbbbc054af0 con 0x7fbbd41573e0 2023-10-06T04:45:11.601 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:11.602 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/3828511424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":3828511424},{"type":"v1","addr":"172.21.15.124:6836","nonce":3828511424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/1252041103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1252041103},{"type":"v1","addr":"172.21.15.158:6834","nonce":1252041103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/978440229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":978440229},{"type":"v1","addr":"172.21.15.124:6837","nonce":978440229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:27.635332+0000","modified":"2023-10-06T04:44:31.182630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6835/1693475602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":1693475602},{"type":"v1","addr":"172.21.15.158:6835","nonce":1693475602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:45:11.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 -- 172.21.15.124:0/4120661502 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbbb4066f30 msgr2=0x7fbbb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbbb4066f30 0x7fbbb40693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40030c0 tx=0x7fbbc4016000 comp rx=0 tx=0).stop 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 -- 172.21.15.124:0/4120661502 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 msgr2=0x7fbbd4098b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 0x7fbbd4098b70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00c600 tx=0x7fbbbc007f60 comp rx=0 tx=0).stop 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 -- 172.21.15.124:0/4120661502 shutdown_connections 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbbb4066f30 0x7fbbb40693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbd40990b0 0x7fbbd40a8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbd40ad770 0x7fbbd41563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 --2- 172.21.15.124:0/4120661502 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbbd41573e0 0x7fbbd4098b70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 -- 172.21.15.124:0/4120661502 >> 172.21.15.124:0/4120661502 conn(0x7fbbd40cc050 msgr2=0x7fbbd40acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 -- 172.21.15.124:0/4120661502 shutdown_connections 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.602+0000 7fbbd95ff700 1 -- 172.21.15.124:0/4120661502 wait complete. 2023-10-06T04:45:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2023-10-06T04:45:11.621 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:11.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.808+0000 7f3356bff700 1 Processor -- start 2023-10-06T04:45:11.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.809+0000 7f3356bff700 1 -- start start 2023-10-06T04:45:11.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f3356bff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f33500ccbb0 0x7f33500cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f3356bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500cdfe0 0x7f33500ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f3356bff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500cf6b0 con 0x7f33500ccf80 2023-10-06T04:45:11.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f3356bff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33500cdb10 con 0x7f33500ccbb0 2023-10-06T04:45:11.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f3356bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500ceaa0 con 0x7f33500cdfe0 2023-10-06T04:45:11.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f335519c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f33500ccf80 0x7f33500cd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:37208/0 (socket says 172.21.15.124:37208) 2023-10-06T04:45:11.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f335519c700 1 -- 172.21.15.124:0/3045447457 learned_addr learned my addr 172.21.15.124:0/3045447457 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:11.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f334ffff700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500cdfe0 0x7f33500ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f335499b700 1 --2- 172.21.15.124:0/3045447457 >> v2:172.21.15.158:3300/0 conn(0x7f33500ccbb0 0x7f33500cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783657318 0 0) 0x7f33500cf6b0 con 0x7f33500ccf80 2023-10-06T04:45:11.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.810+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3340003570 con 0x7f33500ccf80 2023-10-06T04:45:11.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 315212039 0 0) 0x7f3340003570 con 0x7f33500ccf80 2023-10-06T04:45:11.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500cdfe0 msgr2=0x7f33500ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:11.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500cdfe0 0x7f33500ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 >> v2:172.21.15.158:3300/0 conn(0x7f33500ccbb0 msgr2=0x7f33500cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:11.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 --2- 172.21.15.124:0/3045447457 >> v2:172.21.15.158:3300/0 conn(0x7f33500ccbb0 0x7f33500cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500ced80 con 0x7f33500ccf80 2023-10-06T04:45:11.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f33480017f0 con 0x7f33500ccf80 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 >> v1:172.21.15.124:6789/0 conn(0x7f33500ccf80 legacy=0x7f33500cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500cdfe0 0x7f3340003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 0x7f3340004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3340004d50 0x7f33400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500ceaa0 con 0x7f3340003fe0 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334000ba60 con 0x7f3340004d50 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334000bbd0 con 0x7f33500cdfe0 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f334ffff700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 0x7f3340004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f335499b700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500cdfe0 0x7f3340003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.811+0000 7f335519c700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3340004d50 0x7f33400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f334ffff700 1 -- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500cdfe0 msgr2=0x7f3340003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:11.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f334ffff700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500cdfe0 0x7f3340003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f334ffff700 1 -- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3340004d50 msgr2=0x7f33400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f334ffff700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3340004d50 0x7f33400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f334ffff700 1 -- 172.21.15.124:0/3045447457 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340003570 con 0x7f3340003fe0 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f334ffff700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 0x7f3340004810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f333c009c00 tx=0x7f333c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780a13325abe2779 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c00e6b0 con 0x7f3340003fe0 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c00e810 con 0x7f3340003fe0 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f334f7fe700 1 -- 172.21.15.124:0/3045447457 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c00ebd0 con 0x7f3340003fe0 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f3356bff700 1 -- 172.21.15.124:0/3045447457 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 msgr2=0x7f3340004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f3356bff700 1 --2- 172.21.15.124:0/3045447457 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 0x7f3340004810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f333c009c00 tx=0x7f333c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.812+0000 7f335519c700 1 -- 172.21.15.124:0/3045447457 reap_dead start 2023-10-06T04:45:11.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.813+0000 7f3356bff700 1 -- 172.21.15.124:0/3045447457 shutdown_connections 2023-10-06T04:45:11.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.813+0000 7f3356bff700 1 -- 172.21.15.124:0/3045447457 >> 172.21.15.124:0/3045447457 conn(0x7f3350099710 msgr2=0x7f335006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:11.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.813+0000 7f3356bff700 1 -- 172.21.15.124:0/3045447457 shutdown_connections 2023-10-06T04:45:11.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.813+0000 7f3356bff700 1 -- 172.21.15.124:0/3045447457 wait complete. 2023-10-06T04:45:11.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.814+0000 7f3356bff700 1 Processor -- start 2023-10-06T04:45:11.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.814+0000 7f3356bff700 1 -- start start 2023-10-06T04:45:11.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.815+0000 7f3356bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 0x7f33500c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.815+0000 7f3356bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f33501551a0 0x7f335014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.815+0000 7f3356bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500c8dd0 0x7f33500ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.815+0000 7f3356bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500c8940 con 0x7f3340003fe0 2023-10-06T04:45:11.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.815+0000 7f3356bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500c7d30 con 0x7f33501551a0 2023-10-06T04:45:11.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.815+0000 7f3356bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500c8010 con 0x7f33500c8dd0 2023-10-06T04:45:11.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.815+0000 7f335499b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 0x7f33500c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.815+0000 7f335499b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 0x7f33500c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35254/0 (socket says 172.21.15.124:35254) 2023-10-06T04:45:11.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.815+0000 7f335499b700 1 -- 172.21.15.124:0/1948338332 learned_addr learned my addr 172.21.15.124:0/1948338332 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:11.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f335499b700 1 -- 172.21.15.124:0/1948338332 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500c8dd0 msgr2=0x7f33500ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f335499b700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500c8dd0 0x7f33500ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f335499b700 1 -- 172.21.15.124:0/1948338332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f33501551a0 msgr2=0x7f335014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:11.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f335499b700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f33501551a0 0x7f335014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:11.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f335499b700 1 -- 172.21.15.124:0/1948338332 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500c82f0 con 0x7f3340003fe0 2023-10-06T04:45:11.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f335499b700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 0x7f33500c74c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3344011d40 tx=0x7f33440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:11.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f334cff9700 1 -- 172.21.15.124:0/1948338332 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334400fac0 con 0x7f3340003fe0 2023-10-06T04:45:11.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f334cff9700 1 -- 172.21.15.124:0/1948338332 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334400fc20 con 0x7f3340003fe0 2023-10-06T04:45:11.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f3356bff700 1 -- 172.21.15.124:0/1948338332 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33500c85d0 con 0x7f3340003fe0 2023-10-06T04:45:11.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f334cff9700 1 -- 172.21.15.124:0/1948338332 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344014440 con 0x7f3340003fe0 2023-10-06T04:45:11.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.816+0000 7f3356bff700 1 -- 172.21.15.124:0/1948338332 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335014ff90 con 0x7f3340003fe0 2023-10-06T04:45:11.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.817+0000 7f3356bff700 1 -- 172.21.15.124:0/1948338332 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33500717a0 con 0x7f3340003fe0 2023-10-06T04:45:11.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.818+0000 7f334cff9700 1 -- 172.21.15.124:0/1948338332 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3344014a80 con 0x7f3340003fe0 2023-10-06T04:45:11.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.819+0000 7f334cff9700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3334066f30 0x7f33340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:11.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.819+0000 7f334cff9700 1 -- 172.21.15.124:0/1948338332 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3344018030 con 0x7f3340003fe0 2023-10-06T04:45:11.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.819+0000 7f334ffff700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3334066f30 0x7f33340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:11.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.820+0000 7f334ffff700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3334066f30 0x7f33340693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f33500ae520 tx=0x7f333c01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:11.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:11.823+0000 7f334cff9700 1 -- 172.21.15.124:0/1948338332 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3344052520 con 0x7f3340003fe0 2023-10-06T04:45:12.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.017+0000 7f3356bff700 1 -- 172.21.15.124:0/1948338332 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33500c8c20 con 0x7f3340003fe0 2023-10-06T04:45:12.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.017+0000 7f334cff9700 1 -- 172.21.15.124:0/1948338332 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f334405b030 con 0x7f3340003fe0 2023-10-06T04:45:12.019 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:12.020 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":22,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:44:29.149117+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:25.771714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:26.609661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:12.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 -- 172.21.15.124:0/1948338332 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3334066f30 msgr2=0x7f33340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3334066f30 0x7f33340693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f33500ae520 tx=0x7f333c01a000 comp rx=0 tx=0).stop 2023-10-06T04:45:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 -- 172.21.15.124:0/1948338332 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 msgr2=0x7f33500c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 0x7f33500c74c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3344011d40 tx=0x7f33440091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 -- 172.21.15.124:0/1948338332 shutdown_connections 2023-10-06T04:45:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3334066f30 0x7f33340693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f33500c8dd0 0x7f33500ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3340003fe0 0x7f33500c74c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 --2- 172.21.15.124:0/1948338332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f33501551a0 0x7f335014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 -- 172.21.15.124:0/1948338332 >> 172.21.15.124:0/1948338332 conn(0x7f3350099710 msgr2=0x7f33501519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 -- 172.21.15.124:0/1948338332 shutdown_connections 2023-10-06T04:45:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.020+0000 7f3356bff700 1 -- 172.21.15.124:0/1948338332 wait complete. 2023-10-06T04:45:12.039 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:45:12.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.229+0000 7f2e22fff700 1 Processor -- start 2023-10-06T04:45:12.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.230+0000 7f2e22fff700 1 -- start start 2023-10-06T04:45:12.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.231+0000 7f2e22fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2e1c0ae320 0x7f2e1c06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.231+0000 7f2e22fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c06f650 con 0x7f2e1c0ae6f0 2023-10-06T04:45:12.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.231+0000 7f2e22fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c06a090 con 0x7f2e1c0c6dd0 2023-10-06T04:45:12.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.231+0000 7f2e22fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c06f370 con 0x7f2e1c0ae320 2023-10-06T04:45:12.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.231+0000 7f2e1bfff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2e1c0ae6f0 0x7f2e1c0c66c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:37216/0 (socket says 172.21.15.124:37216) 2023-10-06T04:45:12.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.231+0000 7f2e1bfff700 1 -- 172.21.15.124:0/3430902816 learned_addr learned my addr 172.21.15.124:0/3430902816 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:12.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.231+0000 7f2e20d9b700 1 --2- 172.21.15.124:0/3430902816 >> v2:172.21.15.158:3300/0 conn(0x7f2e1c0ae320 0x7f2e1c06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200084707 0 0) 0x7f2e08001110 con 0x7f2e1c0ae6f0 2023-10-06T04:45:12.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e0c003570 con 0x7f2e1c0ae6f0 2023-10-06T04:45:12.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759762413 0 0) 0x7f2e1c06a090 con 0x7f2e1c0c6dd0 2023-10-06T04:45:12.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e08001110 con 0x7f2e1c0c6dd0 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 657903929 0 0) 0x7f2e0c003570 con 0x7f2e1c0ae6f0 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 >> v2:172.21.15.158:3300/0 conn(0x7f2e1c0ae320 msgr2=0x7f2e1c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 --2- 172.21.15.124:0/3430902816 >> v2:172.21.15.158:3300/0 conn(0x7f2e1c0ae320 0x7f2e1c06a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 >> v1:172.21.15.158:6789/0 conn(0x7f2e1c0c6dd0 legacy=0x7f2e1c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c069a40 con 0x7f2e1c0ae6f0 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f2e08001600 con 0x7f2e1c0ae6f0 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 >> v1:172.21.15.124:6789/0 conn(0x7f2e1c0ae6f0 legacy=0x7f2e1c0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e0c003bf0 0x7f2e0c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e0c004810 0x7f2e0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0c0051c0 0x7f2e0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c06f370 con 0x7f2e0c004810 2023-10-06T04:45:12.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c00c0b0 con 0x7f2e0c0051c0 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.232+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c00c270 con 0x7f2e0c003bf0 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e1bfff700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e0c004810 0x7f2e0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e20d9b700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e0c003bf0 0x7f2e0c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e2159c700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0c0051c0 0x7f2e0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e1bfff700 1 -- 172.21.15.124:0/3430902816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e0c003bf0 msgr2=0x7f2e0c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e1bfff700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e0c003bf0 0x7f2e0c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e1bfff700 1 -- 172.21.15.124:0/3430902816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0c0051c0 msgr2=0x7f2e0c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e1bfff700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0c0051c0 0x7f2e0c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e1bfff700 1 -- 172.21.15.124:0/3430902816 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c003570 con 0x7f2e0c004810 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e2159c700 1 -- 172.21.15.124:0/3430902816 reap_dead start 2023-10-06T04:45:12.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e1bfff700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e0c004810 0x7f2e0c004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c440 tx=0x7f2e08007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e29c728f8ffea38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800cd70 con 0x7f2e0c004810 2023-10-06T04:45:12.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08005920 con 0x7f2e0c004810 2023-10-06T04:45:12.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.233+0000 7f2e1b7fe700 1 -- 172.21.15.124:0/3430902816 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08005ce0 con 0x7f2e0c004810 2023-10-06T04:45:12.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.234+0000 7f2e22fff700 1 -- 172.21.15.124:0/3430902816 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e0c004810 msgr2=0x7f2e0c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.234+0000 7f2e22fff700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e0c004810 0x7f2e0c004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c440 tx=0x7f2e08007a00 comp rx=0 tx=0).stop 2023-10-06T04:45:12.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.234+0000 7f2e22fff700 1 -- 172.21.15.124:0/3430902816 shutdown_connections 2023-10-06T04:45:12.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.234+0000 7f2e22fff700 1 --2- 172.21.15.124:0/3430902816 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e0c004810 0x7f2e0c004c80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.234+0000 7f2e22fff700 1 -- 172.21.15.124:0/3430902816 >> 172.21.15.124:0/3430902816 conn(0x7f2e1c0cc080 msgr2=0x7f2e1c0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:12.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.234+0000 7f2e22fff700 1 -- 172.21.15.124:0/3430902816 shutdown_connections 2023-10-06T04:45:12.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.234+0000 7f2e22fff700 1 -- 172.21.15.124:0/3430902816 wait complete. 2023-10-06T04:45:12.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.235+0000 7f2e22fff700 1 Processor -- start 2023-10-06T04:45:12.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.236+0000 7f2e22fff700 1 -- start start 2023-10-06T04:45:12.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.236+0000 7f2e22fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0c004810 0x7f2e1c146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.236+0000 7f2e22fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e1c0c1150 0x7f2e1c0c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.236+0000 7f2e22fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c0ad190 0x7f2e1c0ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.236+0000 7f2e22fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0adb40 con 0x7f2e1c0ad190 2023-10-06T04:45:12.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.236+0000 7f2e22fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c16d610 con 0x7f2e0c004810 2023-10-06T04:45:12.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.236+0000 7f2e22fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c16cfe0 con 0x7f2e1c0c1150 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e2159c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c0ad190 0x7f2e1c0ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e2159c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c0ad190 0x7f2e1c0ad600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35262/0 (socket says 172.21.15.124:35262) 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e2159c700 1 -- 172.21.15.124:0/3037163685 learned_addr learned my addr 172.21.15.124:0/3037163685 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e20d9b700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0c004810 0x7f2e1c146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e1bfff700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e1c0c1150 0x7f2e1c0c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e2159c700 1 -- 172.21.15.124:0/3037163685 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e1c0c1150 msgr2=0x7f2e1c0c15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e2159c700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e1c0c1150 0x7f2e1c0c15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e2159c700 1 -- 172.21.15.124:0/3037163685 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0c004810 msgr2=0x7f2e1c146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e2159c700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0c004810 0x7f2e1c146bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e2159c700 1 -- 172.21.15.124:0/3037163685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0c1bd0 con 0x7f2e1c0ad190 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e20d9b700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0c004810 0x7f2e1c146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:12.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e1bfff700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e1c0c1150 0x7f2e1c0c15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.237+0000 7f2e2159c700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c0ad190 0x7f2e1c0ad600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2e14007fd0 tx=0x7f2e14009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.238+0000 7f2e18ff9700 1 -- 172.21.15.124:0/3037163685 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14006db0 con 0x7f2e1c0ad190 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.238+0000 7f2e18ff9700 1 -- 172.21.15.124:0/3037163685 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e14003070 con 0x7f2e1c0ad190 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.238+0000 7f2e22fff700 1 -- 172.21.15.124:0/3037163685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c0c1eb0 con 0x7f2e1c0ad190 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.238+0000 7f2e18ff9700 1 -- 172.21.15.124:0/3037163685 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14003430 con 0x7f2e1c0ad190 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.238+0000 7f2e22fff700 1 -- 172.21.15.124:0/3037163685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c0c5b80 con 0x7f2e1c0ad190 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.239+0000 7f2e22fff700 1 -- 172.21.15.124:0/3037163685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1c16d7c0 con 0x7f2e1c0ad190 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.240+0000 7f2e18ff9700 1 -- 172.21.15.124:0/3037163685 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e140018f0 con 0x7f2e1c0ad190 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.240+0000 7f2e18ff9700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e00066f30 0x7f2e000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.241+0000 7f2e18ff9700 1 -- 172.21.15.124:0/3037163685 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e14083f00 con 0x7f2e1c0ad190 2023-10-06T04:45:12.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.241+0000 7f2e20d9b700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e00066f30 0x7f2e000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.241+0000 7f2e20d9b700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e00066f30 0x7f2e000693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2e100093f0 tx=0x7f2e10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.245+0000 7f2e18ff9700 1 -- 172.21.15.124:0/3037163685 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e1404c5a0 con 0x7f2e1c0ad190 2023-10-06T04:45:12.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.476+0000 7f2e22fff700 1 -- 172.21.15.124:0/3037163685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2e1c0717a0 con 0x7f2e1c0ad190 2023-10-06T04:45:12.477 INFO:tasks.ceph.mon.a.smithi124.stderr:2023-10-06T04:45:12.476+0000 7fc5395f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:45:12.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.480+0000 7f2e18ff9700 1 -- 172.21.15.124:0/3037163685 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2e1c16d7c0 con 0x7f2e1c0ad190 2023-10-06T04:45:12.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 -- 172.21.15.124:0/3037163685 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e00066f30 msgr2=0x7f2e000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e00066f30 0x7f2e000693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2e100093f0 tx=0x7f2e10008040 comp rx=0 tx=0).stop 2023-10-06T04:45:12.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 -- 172.21.15.124:0/3037163685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c0ad190 msgr2=0x7f2e1c0ad600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c0ad190 0x7f2e1c0ad600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2e14007fd0 tx=0x7f2e14009040 comp rx=0 tx=0).stop 2023-10-06T04:45:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 -- 172.21.15.124:0/3037163685 shutdown_connections 2023-10-06T04:45:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c0ad190 0x7f2e1c0ad600 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0c004810 0x7f2e1c146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e00066f30 0x7f2e000693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 --2- 172.21.15.124:0/3037163685 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e1c0c1150 0x7f2e1c0c15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 -- 172.21.15.124:0/3037163685 >> 172.21.15.124:0/3037163685 conn(0x7f2e1c0cc080 msgr2=0x7f2e1c14a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 -- 172.21.15.124:0/3037163685 shutdown_connections 2023-10-06T04:45:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.483+0000 7f2e22fff700 1 -- 172.21.15.124:0/3037163685 wait complete. 2023-10-06T04:45:12.486 INFO:teuthology.orchestra.run.smithi124.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:45:12.489 INFO:tasks.ceph.mds.b.smithi158.stderr: -2116> 2023-10-06T04:44:33.013+0000 7fa9c27f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:45:12.502 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:45:12.530 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-06T04:45:12.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.691+0000 7efdd5dff700 1 Processor -- start 2023-10-06T04:45:12.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.692+0000 7efdd5dff700 1 -- start start 2023-10-06T04:45:12.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.693+0000 7efdd5dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efdd01562b0 0x7efdd015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.693+0000 7efdd5dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efdd00cca10 0x7efdd00c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.693+0000 7efdd5dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd00ad790 con 0x7efdd00c6af0 2023-10-06T04:45:12.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.693+0000 7efdd5dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd015af90 con 0x7efdd01562b0 2023-10-06T04:45:12.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.693+0000 7efdd5dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd00acb80 con 0x7efdd00cca10 2023-10-06T04:45:12.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.693+0000 7efdcf7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efdd01562b0 0x7efdd015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.693+0000 7efdcf7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efdd01562b0 0x7efdd015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35270/0 (socket says 172.21.15.124:35270) 2023-10-06T04:45:12.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.693+0000 7efdcf7fe700 1 -- 172.21.15.124:0/2422135713 learned_addr learned my addr 172.21.15.124:0/2422135713 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:12.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.693+0000 7efdcf7fe700 1 -- 172.21.15.124:0/2422135713 >> v2:172.21.15.158:3300/0 conn(0x7efdd00cca10 msgr2=0x7efdd00c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:12.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.694+0000 7efdceffd700 1 --2- 172.21.15.124:0/2422135713 >> v2:172.21.15.158:3300/0 conn(0x7efdd00cca10 0x7efdd00c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.694+0000 7efdcf7fe700 1 --2- 172.21.15.124:0/2422135713 >> v2:172.21.15.158:3300/0 conn(0x7efdd00cca10 0x7efdd00c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.694+0000 7efdcf7fe700 1 -- 172.21.15.124:0/2422135713 >> v1:172.21.15.158:6789/0 conn(0x7efdd00c6af0 legacy=0x7efdd00adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:12.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.694+0000 7efdcf7fe700 1 -- 172.21.15.124:0/2422135713 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd00ace60 con 0x7efdd01562b0 2023-10-06T04:45:12.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.694+0000 7efdceffd700 1 --2- 172.21.15.124:0/2422135713 >> v2:172.21.15.158:3300/0 conn(0x7efdd00cca10 0x7efdd00c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:12.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.694+0000 7efdcf7fe700 1 --2- 172.21.15.124:0/2422135713 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd01562b0 0x7efdd015aa50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efdd00684f0 tx=0x7efdc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc997c2b8eec3df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.694+0000 7efdce7fc700 1 -- 172.21.15.124:0/2422135713 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000b820 con 0x7efdd01562b0 2023-10-06T04:45:12.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.694+0000 7efdce7fc700 1 -- 172.21.15.124:0/2422135713 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc000b980 con 0x7efdd01562b0 2023-10-06T04:45:12.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.694+0000 7efdce7fc700 1 -- 172.21.15.124:0/2422135713 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000bd20 con 0x7efdd01562b0 2023-10-06T04:45:12.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.695+0000 7efdd5dff700 1 -- 172.21.15.124:0/2422135713 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd01562b0 msgr2=0x7efdd015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.695+0000 7efdd5dff700 1 --2- 172.21.15.124:0/2422135713 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd01562b0 0x7efdd015aa50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efdd00684f0 tx=0x7efdc0009250 comp rx=0 tx=0).stop 2023-10-06T04:45:12.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.695+0000 7efdd5dff700 1 -- 172.21.15.124:0/2422135713 shutdown_connections 2023-10-06T04:45:12.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.695+0000 7efdd5dff700 1 --2- 172.21.15.124:0/2422135713 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd01562b0 0x7efdd015aa50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.695+0000 7efdd5dff700 1 --2- 172.21.15.124:0/2422135713 >> v2:172.21.15.158:3300/0 conn(0x7efdd00cca10 0x7efdd00c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.695+0000 7efdd5dff700 1 -- 172.21.15.124:0/2422135713 >> 172.21.15.124:0/2422135713 conn(0x7efdd00680c0 msgr2=0x7efdd00cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:12.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.695+0000 7efdd5dff700 1 -- 172.21.15.124:0/2422135713 shutdown_connections 2023-10-06T04:45:12.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.695+0000 7efdd5dff700 1 -- 172.21.15.124:0/2422135713 wait complete. 2023-10-06T04:45:12.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.696+0000 7efdd5dff700 1 Processor -- start 2023-10-06T04:45:12.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.696+0000 7efdd5dff700 1 -- start start 2023-10-06T04:45:12.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.697+0000 7efdd5dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd00c6af0 0x7efdd0156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.697+0000 7efdd5dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdd00cca10 0x7efdd00c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.697+0000 7efdd5dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdd01562b0 0x7efdd01546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.697+0000 7efdd5dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00aa1d0 con 0x7efdd00c6af0 2023-10-06T04:45:12.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.697+0000 7efdd5dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00c3f70 con 0x7efdd00cca10 2023-10-06T04:45:12.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.697+0000 7efdd5dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00c4210 con 0x7efdd01562b0 2023-10-06T04:45:12.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.698+0000 7efdcf7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd00c6af0 0x7efdd0156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.698+0000 7efdcf7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd00c6af0 0x7efdd0156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:35286/0 (socket says 172.21.15.124:35286) 2023-10-06T04:45:12.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.698+0000 7efdcf7fe700 1 -- 172.21.15.124:0/2813742355 learned_addr learned my addr 172.21.15.124:0/2813742355 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.698+0000 7efdcf7fe700 1 -- 172.21.15.124:0/2813742355 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdd01562b0 msgr2=0x7efdd01546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.698+0000 7efdcf7fe700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdd01562b0 0x7efdd01546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.698+0000 7efdcf7fe700 1 -- 172.21.15.124:0/2813742355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdd00cca10 msgr2=0x7efdd00c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.698+0000 7efdcf7fe700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdd00cca10 0x7efdd00c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.698+0000 7efdcf7fe700 1 -- 172.21.15.124:0/2813742355 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc00094f0 con 0x7efdd00c6af0 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.698+0000 7efdcf7fe700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd00c6af0 0x7efdd0156680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efdc00030c0 tx=0x7efdc0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.698+0000 7efdb77fe700 1 -- 172.21.15.124:0/2813742355 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0011e60 con 0x7efdd00c6af0 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.699+0000 7efdb77fe700 1 -- 172.21.15.124:0/2813742355 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc0020070 con 0x7efdd00c6af0 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.699+0000 7efdb77fe700 1 -- 172.21.15.124:0/2813742355 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc001b6a0 con 0x7efdd00c6af0 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.699+0000 7efdd5dff700 1 -- 172.21.15.124:0/2813742355 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd00a98a0 con 0x7efdd00c6af0 2023-10-06T04:45:12.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.699+0000 7efdd5dff700 1 -- 172.21.15.124:0/2813742355 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd00a9e60 con 0x7efdd00c6af0 2023-10-06T04:45:12.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.700+0000 7efdd5dff700 1 -- 172.21.15.124:0/2813742355 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd0064850 con 0x7efdd00c6af0 2023-10-06T04:45:12.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.701+0000 7efdb77fe700 1 -- 172.21.15.124:0/2813742355 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdc0022030 con 0x7efdd00c6af0 2023-10-06T04:45:12.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.702+0000 7efdb77fe700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efdbc066f30 0x7efdbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.702+0000 7efdb77fe700 1 -- 172.21.15.124:0/2813742355 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6144+0+0 (secure 0 0 0) 0x7efdc0086640 con 0x7efdd00c6af0 2023-10-06T04:45:12.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.702+0000 7efdceffd700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efdbc066f30 0x7efdbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.703+0000 7efdceffd700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efdbc066f30 0x7efdbc0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efdd016d030 tx=0x7efdc4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.706+0000 7efdb77fe700 1 -- 172.21.15.124:0/2813742355 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdc0053700 con 0x7efdd00c6af0 2023-10-06T04:45:12.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:12.935+0000 7efdd5dff700 1 -- 172.21.15.124:0/2813742355 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efdd0064850 con 0x7efdd00c6af0 2023-10-06T04:45:13.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.482+0000 7efdb77fe700 1 -- 172.21.15.124:0/2813742355 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7efdc0056d20 con 0x7efdd00c6af0 2023-10-06T04:45:13.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 -- 172.21.15.124:0/2813742355 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efdbc066f30 msgr2=0x7efdbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efdbc066f30 0x7efdbc0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efdd016d030 tx=0x7efdc4008040 comp rx=0 tx=0).stop 2023-10-06T04:45:13.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 -- 172.21.15.124:0/2813742355 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd00c6af0 msgr2=0x7efdd0156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd00c6af0 0x7efdd0156680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efdc00030c0 tx=0x7efdc0016000 comp rx=0 tx=0).stop 2023-10-06T04:45:13.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 -- 172.21.15.124:0/2813742355 shutdown_connections 2023-10-06T04:45:13.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efdbc066f30 0x7efdbc0693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdd01562b0 0x7efdd01546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efdd00c6af0 0x7efdd0156680 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 --2- 172.21.15.124:0/2813742355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdd00cca10 0x7efdd00c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 -- 172.21.15.124:0/2813742355 >> 172.21.15.124:0/2813742355 conn(0x7efdd00680c0 msgr2=0x7efdd01551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:13.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 -- 172.21.15.124:0/2813742355 shutdown_connections 2023-10-06T04:45:13.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.485+0000 7efdd5dff700 1 -- 172.21.15.124:0/2813742355 wait complete. 2023-10-06T04:45:13.506 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:45:13.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.700+0000 7f94a85ff700 1 Processor -- start 2023-10-06T04:45:13.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.700+0000 7f94a85ff700 1 -- start start 2023-10-06T04:45:13.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.701+0000 7f94a85ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a00cd040 0x7f94a00b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.702+0000 7f94a85ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a00b11a0 con 0x7f94a00cd410 2023-10-06T04:45:13.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.702+0000 7f94a85ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a015d970 con 0x7f94a0159b90 2023-10-06T04:45:13.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.702+0000 7f94a85ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a015dc50 con 0x7f94a00cd040 2023-10-06T04:45:13.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.702+0000 7f94a5b9a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f94a00cd410 0x7f94a0159480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:59270/0 (socket says 172.21.15.124:59270) 2023-10-06T04:45:13.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.702+0000 7f94a5b9a700 1 -- 172.21.15.124:0/271525746 learned_addr learned my addr 172.21.15.124:0/271525746 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.702+0000 7f94a639b700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a00cd040 0x7f94a00b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.702+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106180122 0 0) 0x7f94a00b11a0 con 0x7f94a00cd410 2023-10-06T04:45:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.702+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f948c003570 con 0x7f94a00cd410 2023-10-06T04:45:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2628026043 0 0) 0x7f948c003570 con 0x7f94a00cd410 2023-10-06T04:45:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a00cd040 msgr2=0x7f94a00b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a00cd040 0x7f94a00b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 >> v1:172.21.15.158:6789/0 conn(0x7f94a0159b90 legacy=0x7f94a00cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a015df30 con 0x7f94a00cd410 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f9490001470 con 0x7f94a00cd410 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 >> v1:172.21.15.124:6789/0 conn(0x7f94a00cd410 legacy=0x7f94a0159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f948c003a90 0x7f948c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a00cd040 0x7f948c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f948c004d50 0x7f948c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a015dc50 con 0x7f948c003a90 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c00bb70 con 0x7f948c004d50 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c00bd30 con 0x7f94a00cd040 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a639b700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f948c003a90 0x7f948c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5b9a700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a00cd040 0x7f948c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a6b9c700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f948c004d50 0x7f948c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a639b700 1 -- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a00cd040 msgr2=0x7f948c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a639b700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a00cd040 0x7f948c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a639b700 1 -- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f948c004d50 msgr2=0x7f948c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a639b700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f948c004d50 0x7f948c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a639b700 1 -- 172.21.15.124:0/271525746 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c003570 con 0x7f948c003a90 2023-10-06T04:45:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a6b9c700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f948c004d50 0x7f948c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.703+0000 7f94a5b9a700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a00cd040 0x7f948c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.704+0000 7f94a639b700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f948c003a90 0x7f948c003ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f949c009c00 tx=0x7f949c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd258980e239917f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.704+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00e710 con 0x7f948c003a90 2023-10-06T04:45:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.704+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c00e870 con 0x7f948c003a90 2023-10-06T04:45:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.704+0000 7f94a5399700 1 -- 172.21.15.124:0/271525746 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00ec30 con 0x7f948c003a90 2023-10-06T04:45:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.704+0000 7f94a85ff700 1 -- 172.21.15.124:0/271525746 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f948c003a90 msgr2=0x7f948c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.704+0000 7f94a85ff700 1 --2- 172.21.15.124:0/271525746 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f948c003a90 0x7f948c003ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f949c009c00 tx=0x7f949c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.704+0000 7f94a6b9c700 1 -- 172.21.15.124:0/271525746 reap_dead start 2023-10-06T04:45:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.704+0000 7f94a85ff700 1 -- 172.21.15.124:0/271525746 shutdown_connections 2023-10-06T04:45:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.705+0000 7f94a85ff700 1 -- 172.21.15.124:0/271525746 >> 172.21.15.124:0/271525746 conn(0x7f94a006ed20 msgr2=0x7f94a006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:13.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.705+0000 7f94a85ff700 1 -- 172.21.15.124:0/271525746 shutdown_connections 2023-10-06T04:45:13.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.705+0000 7f94a85ff700 1 -- 172.21.15.124:0/271525746 wait complete. 2023-10-06T04:45:13.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.706+0000 7f94a85ff700 1 Processor -- start 2023-10-06T04:45:13.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.706+0000 7f94a85ff700 1 -- start start 2023-10-06T04:45:13.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.707+0000 7f94a85ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f948c003a90 0x7f94a0156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.707+0000 7f94a85ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94a00c9b00 0x7f94a00cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.707+0000 7f94a85ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a00c9f70 0x7f94a00cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.707+0000 7f94a85ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a01571e0 con 0x7f94a00c9f70 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.707+0000 7f94a85ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0169a70 con 0x7f94a00c9b00 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.707+0000 7f94a85ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00ce580 con 0x7f948c003a90 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.707+0000 7f94a6b9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a00c9f70 0x7f94a00cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.707+0000 7f94a6b9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a00c9f70 0x7f94a00cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44454/0 (socket says 172.21.15.124:44454) 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.707+0000 7f94a6b9c700 1 -- 172.21.15.124:0/829132559 learned_addr learned my addr 172.21.15.124:0/829132559 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94a639b700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f948c003a90 0x7f94a0156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94a5b9a700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94a00c9b00 0x7f94a00cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94a6b9c700 1 -- 172.21.15.124:0/829132559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f948c003a90 msgr2=0x7f94a0156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94a6b9c700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f948c003a90 0x7f94a0156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94a6b9c700 1 -- 172.21.15.124:0/829132559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94a00c9b00 msgr2=0x7f94a00cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94a6b9c700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94a00c9b00 0x7f94a00cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94a6b9c700 1 -- 172.21.15.124:0/829132559 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a00ce860 con 0x7f94a00c9f70 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94a6b9c700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a00c9f70 0x7f94a00cc130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f94a0159f60 tx=0x7f9498009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94967fc700 1 -- 172.21.15.124:0/829132559 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498012590 con 0x7f94a00c9f70 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94967fc700 1 -- 172.21.15.124:0/829132559 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94980126f0 con 0x7f94a00c9f70 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94a85ff700 1 -- 172.21.15.124:0/829132559 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a00ceb40 con 0x7f94a00c9f70 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94967fc700 1 -- 172.21.15.124:0/829132559 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498012ab0 con 0x7f94a00c9f70 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.708+0000 7f94a85ff700 1 -- 172.21.15.124:0/829132559 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a00ce130 con 0x7f94a00c9f70 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.709+0000 7f94a85ff700 1 -- 172.21.15.124:0/829132559 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a00cefe0 con 0x7f94a00c9f70 2023-10-06T04:45:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.710+0000 7f94967fc700 1 -- 172.21.15.124:0/829132559 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9498003030 con 0x7f94a00c9f70 2023-10-06T04:45:13.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.711+0000 7f94967fc700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9484066f30 0x7f94840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.711+0000 7f94967fc700 1 -- 172.21.15.124:0/829132559 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f94980844e0 con 0x7f94a00c9f70 2023-10-06T04:45:13.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.711+0000 7f94a639b700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9484066f30 0x7f94840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.712+0000 7f94a639b700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9484066f30 0x7f94840693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f949c0091e0 tx=0x7f949c01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:13.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.715+0000 7f94967fc700 1 -- 172.21.15.124:0/829132559 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9498054fb0 con 0x7f94a00c9f70 2023-10-06T04:45:13.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:13.906+0000 7f94a85ff700 1 -- 172.21.15.124:0/829132559 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f94a0070cd0 con 0x7f94a00c9f70 2023-10-06T04:45:14.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.487+0000 7f94967fc700 1 -- 172.21.15.124:0/829132559 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f94a0070cd0 con 0x7f94a00c9f70 2023-10-06T04:45:14.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 -- 172.21.15.124:0/829132559 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9484066f30 msgr2=0x7f94840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9484066f30 0x7f94840693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f949c0091e0 tx=0x7f949c01a000 comp rx=0 tx=0).stop 2023-10-06T04:45:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 -- 172.21.15.124:0/829132559 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a00c9f70 msgr2=0x7f94a00cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a00c9f70 0x7f94a00cc130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f94a0159f60 tx=0x7f9498009040 comp rx=0 tx=0).stop 2023-10-06T04:45:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 -- 172.21.15.124:0/829132559 shutdown_connections 2023-10-06T04:45:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a00c9f70 0x7f94a00cc130 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9484066f30 0x7f94840693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f948c003a90 0x7f94a0156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 --2- 172.21.15.124:0/829132559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94a00c9b00 0x7f94a00cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 -- 172.21.15.124:0/829132559 >> 172.21.15.124:0/829132559 conn(0x7f94a006ed20 msgr2=0x7f94a00cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:14.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.490+0000 7f94a85ff700 1 -- 172.21.15.124:0/829132559 shutdown_connections 2023-10-06T04:45:14.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.491+0000 7f94a85ff700 1 -- 172.21.15.124:0/829132559 wait complete. 2023-10-06T04:45:14.494 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:45:14.515 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:45:14.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.706+0000 7f7f9d9ff700 1 Processor -- start 2023-10-06T04:45:14.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.706+0000 7f7f9d9ff700 1 -- start start 2023-10-06T04:45:14.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f9d9ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7f980cd040 0x7f7f980b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:14.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f9d9ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7f980cd410 0x7f7f98159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:14.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f9d9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f981599c0 0x7f7f98068550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:14.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f9d9ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980b11a0 con 0x7f7f980cd410 2023-10-06T04:45:14.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f9d9ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9815d970 con 0x7f7f980cd040 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f9d9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9815dc50 con 0x7f7f981599c0 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f967fc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7f980cd410 0x7f7f98159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f967fc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7f980cd410 0x7f7f98159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44468/0 (socket says 172.21.15.124:44468) 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f967fc700 1 -- 172.21.15.124:0/3343395262 learned_addr learned my addr 172.21.15.124:0/3343395262 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f977fe700 1 --2- 172.21.15.124:0/3343395262 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f981599c0 0x7f7f98068550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f96ffd700 1 --2- 172.21.15.124:0/3343395262 >> v2:172.21.15.158:3300/0 conn(0x7f7f980cd040 0x7f7f980b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f967fc700 1 -- 172.21.15.124:0/3343395262 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f981599c0 msgr2=0x7f7f98068550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f967fc700 1 --2- 172.21.15.124:0/3343395262 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f981599c0 0x7f7f98068550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f967fc700 1 -- 172.21.15.124:0/3343395262 >> v2:172.21.15.158:3300/0 conn(0x7f7f980cd040 msgr2=0x7f7f980b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f967fc700 1 --2- 172.21.15.124:0/3343395262 >> v2:172.21.15.158:3300/0 conn(0x7f7f980cd040 0x7f7f980b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f967fc700 1 -- 172.21.15.124:0/3343395262 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9815df30 con 0x7f7f980cd410 2023-10-06T04:45:14.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f977fe700 1 --2- 172.21.15.124:0/3343395262 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f981599c0 0x7f7f98068550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:14.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.708+0000 7f7f96ffd700 1 --2- 172.21.15.124:0/3343395262 >> v2:172.21.15.158:3300/0 conn(0x7f7f980cd040 0x7f7f980b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:14.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f967fc700 1 --2- 172.21.15.124:0/3343395262 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f980cd410 0x7f7f98159480 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7f98067e20 tx=0x7f7f8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2d8e652b0b848f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:14.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f95ffb700 1 -- 172.21.15.124:0/3343395262 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00b860 con 0x7f7f980cd410 2023-10-06T04:45:14.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f95ffb700 1 -- 172.21.15.124:0/3343395262 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c00b9c0 con 0x7f7f980cd410 2023-10-06T04:45:14.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f95ffb700 1 -- 172.21.15.124:0/3343395262 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00bd60 con 0x7f7f980cd410 2023-10-06T04:45:14.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/3343395262 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f980cd410 msgr2=0x7f7f98159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:14.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f9d9ff700 1 --2- 172.21.15.124:0/3343395262 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f980cd410 0x7f7f98159480 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7f98067e20 tx=0x7f7f8c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:14.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/3343395262 shutdown_connections 2023-10-06T04:45:14.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f9d9ff700 1 --2- 172.21.15.124:0/3343395262 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f981599c0 0x7f7f98068550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f9d9ff700 1 --2- 172.21.15.124:0/3343395262 >> v2:172.21.15.158:3300/0 conn(0x7f7f980cd040 0x7f7f980b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f9d9ff700 1 --2- 172.21.15.124:0/3343395262 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f980cd410 0x7f7f98159480 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.709+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/3343395262 >> 172.21.15.124:0/3343395262 conn(0x7f7f9806ed20 msgr2=0x7f7f9806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:14.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.710+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/3343395262 shutdown_connections 2023-10-06T04:45:14.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.710+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/3343395262 wait complete. 2023-10-06T04:45:14.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.711+0000 7f7f9d9ff700 1 Processor -- start 2023-10-06T04:45:14.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.711+0000 7f7f9d9ff700 1 -- start start 2023-10-06T04:45:14.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.712+0000 7f7f9d9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f980cd040 0x7f7f9814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:14.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.712+0000 7f7f9d9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f980cd410 0x7f7f980c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:14.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.712+0000 7f7f9d9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f981599c0 0x7f7f980c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:14.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.712+0000 7f7f9d9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980c7610 con 0x7f7f981599c0 2023-10-06T04:45:14.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.712+0000 7f7f9d9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980c7eb0 con 0x7f7f980cd040 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.712+0000 7f7f9d9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980b6060 con 0x7f7f980cd410 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.712+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f981599c0 0x7f7f980c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.712+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f981599c0 0x7f7f980c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44474/0 (socket says 172.21.15.124:44474) 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.712+0000 7f7f977fe700 1 -- 172.21.15.124:0/432519164 learned_addr learned my addr 172.21.15.124:0/432519164 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f977fe700 1 -- 172.21.15.124:0/432519164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f980cd410 msgr2=0x7f7f980c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f96ffd700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f980cd040 0x7f7f9814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f967fc700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f980cd410 0x7f7f980c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f977fe700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f980cd410 0x7f7f980c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f977fe700 1 -- 172.21.15.124:0/432519164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f980cd040 msgr2=0x7f7f9814dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f977fe700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f980cd040 0x7f7f9814dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:14.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f977fe700 1 -- 172.21.15.124:0/432519164 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c0094f0 con 0x7f7f981599c0 2023-10-06T04:45:14.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f96ffd700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f980cd040 0x7f7f9814dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:14.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f977fe700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f981599c0 0x7f7f980c5b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7f90007f60 tx=0x7f7f90009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:14.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f7effd700 1 -- 172.21.15.124:0/432519164 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000dce0 con 0x7f7f981599c0 2023-10-06T04:45:14.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f7effd700 1 -- 172.21.15.124:0/432519164 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9000f040 con 0x7f7f981599c0 2023-10-06T04:45:14.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f7effd700 1 -- 172.21.15.124:0/432519164 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90015690 con 0x7f7f981599c0 2023-10-06T04:45:14.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/432519164 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f980c7860 con 0x7f7f981599c0 2023-10-06T04:45:14.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.713+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/432519164 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f980b52b0 con 0x7f7f981599c0 2023-10-06T04:45:14.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.714+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/432519164 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f980718b0 con 0x7f7f981599c0 2023-10-06T04:45:14.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.715+0000 7f7f7effd700 1 -- 172.21.15.124:0/432519164 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f9001e3b0 con 0x7f7f981599c0 2023-10-06T04:45:14.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.716+0000 7f7f7effd700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:14.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.716+0000 7f7f7effd700 1 -- 172.21.15.124:0/432519164 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f7f90084ab0 con 0x7f7f981599c0 2023-10-06T04:45:14.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.717+0000 7f7f96ffd700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:14.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.717+0000 7f7f96ffd700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f84066f30 0x7f7f840693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f88006f00 tx=0x7f7f88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:14.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.720+0000 7f7f7effd700 1 -- 172.21.15.124:0/432519164 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f90051c40 con 0x7f7f981599c0 2023-10-06T04:45:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:14.909+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/432519164 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f9815e210 con 0x7f7f981599c0 2023-10-06T04:45:15.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.492+0000 7f7f7effd700 1 -- 172.21.15.124:0/432519164 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7f9001a0d0 con 0x7f7f981599c0 2023-10-06T04:45:15.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/432519164 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f84066f30 msgr2=0x7f7f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:15.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f84066f30 0x7f7f840693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f88006f00 tx=0x7f7f88008040 comp rx=0 tx=0).stop 2023-10-06T04:45:15.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/432519164 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f981599c0 msgr2=0x7f7f980c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:15.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f981599c0 0x7f7f980c5b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7f90007f60 tx=0x7f7f90009930 comp rx=0 tx=0).stop 2023-10-06T04:45:15.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/432519164 shutdown_connections 2023-10-06T04:45:15.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f981599c0 0x7f7f980c5b10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f980cd040 0x7f7f9814dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 --2- 172.21.15.124:0/432519164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f980cd410 0x7f7f980c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/432519164 >> 172.21.15.124:0/432519164 conn(0x7f7f9806ed20 msgr2=0x7f7f98157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:15.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/432519164 shutdown_connections 2023-10-06T04:45:15.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.495+0000 7f7f9d9ff700 1 -- 172.21.15.124:0/432519164 wait complete. 2023-10-06T04:45:15.498 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' removed 2023-10-06T04:45:15.518 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:45:15.518 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T04:45:15.518 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:45:15.518 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:15.519 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:45:15.519 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T04:45:15.519 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:45:15.519 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:15.520 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:45:15.520 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T04:45:15.520 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:45:15.520 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:15.521 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:45:15.521 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T04:45:15.521 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:45:15.522 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:15.534 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:45:15.534 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:45:15.535 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:45:15.535 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:45:15.537 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:45:15.537 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:45:15.538 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:45:15.538 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:45:15.580 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:45:15.580 DEBUG:teuthology.parallel:result is None 2023-10-06T04:45:15.581 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:45:15.582 DEBUG:teuthology.parallel:result is None 2023-10-06T04:45:15.584 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:45:15.584 DEBUG:teuthology.parallel:result is None 2023-10-06T04:45:15.584 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:45:15.585 DEBUG:teuthology.parallel:result is None 2023-10-06T04:45:15.585 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T04:45:15.726 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-06T04:45:15.726 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-06T04:45:15.727 INFO:tasks.ceph.mds.a.smithi124.stdout:starting mds.a at 2023-10-06T04:45:15.728 INFO:tasks.ceph.mds.c.smithi124.stdout:starting mds.c at 2023-10-06T04:45:15.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.788+0000 7f24723ff700 1 Processor -- start 2023-10-06T04:45:15.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.789+0000 7f24723ff700 1 -- start start 2023-10-06T04:45:15.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f24723ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f246c15c9d0 0x7f246c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:15.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f24723ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f246c15db70 0x7f246c0cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f24723ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f246c0cb090 0x7f246c0c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f24723ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c0cb510 con 0x7f246c15c9d0 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f24723ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c0cd800 con 0x7f246c0cb090 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f24723ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c063cd0 con 0x7f246c15db70 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f246bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f246c15c9d0 0x7f246c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f246bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f246c15c9d0 0x7f246c0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44522/0 (socket says 172.21.15.124:44522) 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f246bfff700 1 -- 172.21.15.124:0/2476140420 learned_addr learned my addr 172.21.15.124:0/2476140420 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f246b7fe700 1 --2- 172.21.15.124:0/2476140420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f246c15db70 0x7f246c0cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.790+0000 7f247099c700 1 --2- 172.21.15.124:0/2476140420 >> v2:172.21.15.158:3300/0 conn(0x7f246c0cb090 0x7f246c0c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.791+0000 7f246bfff700 1 -- 172.21.15.124:0/2476140420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f246c15db70 msgr2=0x7f246c0cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.791+0000 7f246bfff700 1 --2- 172.21.15.124:0/2476140420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f246c15db70 0x7f246c0cab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.791+0000 7f246bfff700 1 -- 172.21.15.124:0/2476140420 >> v2:172.21.15.158:3300/0 conn(0x7f246c0cb090 msgr2=0x7f246c0c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:15.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.791+0000 7f246bfff700 1 --2- 172.21.15.124:0/2476140420 >> v2:172.21.15.158:3300/0 conn(0x7f246c0cb090 0x7f246c0c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.791+0000 7f246bfff700 1 -- 172.21.15.124:0/2476140420 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0cdc90 con 0x7f246c15c9d0 2023-10-06T04:45:15.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.791+0000 7f246bfff700 1 --2- 172.21.15.124:0/2476140420 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c15c9d0 0x7f246c0cc610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f246c097b60 tx=0x7f245c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d63cb24500b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:15.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.791+0000 7f246affd700 1 -- 172.21.15.124:0/2476140420 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c005c10 con 0x7f246c15c9d0 2023-10-06T04:45:15.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.791+0000 7f246affd700 1 -- 172.21.15.124:0/2476140420 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c005d70 con 0x7f246c15c9d0 2023-10-06T04:45:15.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.791+0000 7f246affd700 1 -- 172.21.15.124:0/2476140420 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c006260 con 0x7f246c15c9d0 2023-10-06T04:45:15.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.792+0000 7f24723ff700 1 -- 172.21.15.124:0/2476140420 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c15c9d0 msgr2=0x7f246c0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:15.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.792+0000 7f24723ff700 1 --2- 172.21.15.124:0/2476140420 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c15c9d0 0x7f246c0cc610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f246c097b60 tx=0x7f245c009220 comp rx=0 tx=0).stop 2023-10-06T04:45:15.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.792+0000 7f24723ff700 1 -- 172.21.15.124:0/2476140420 shutdown_connections 2023-10-06T04:45:15.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.792+0000 7f24723ff700 1 --2- 172.21.15.124:0/2476140420 >> v2:172.21.15.158:3300/0 conn(0x7f246c0cb090 0x7f246c0c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.792+0000 7f24723ff700 1 --2- 172.21.15.124:0/2476140420 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c15c9d0 0x7f246c0cc610 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.792+0000 7f24723ff700 1 --2- 172.21.15.124:0/2476140420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f246c15db70 0x7f246c0cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.792+0000 7f24723ff700 1 -- 172.21.15.124:0/2476140420 >> 172.21.15.124:0/2476140420 conn(0x7f246c097520 msgr2=0x7f246c087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:15.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.792+0000 7f24723ff700 1 -- 172.21.15.124:0/2476140420 shutdown_connections 2023-10-06T04:45:15.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.792+0000 7f24723ff700 1 -- 172.21.15.124:0/2476140420 wait complete. 2023-10-06T04:45:15.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.794+0000 7f24723ff700 1 Processor -- start 2023-10-06T04:45:15.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.794+0000 7f24723ff700 1 -- start start 2023-10-06T04:45:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.795+0000 7f24723ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c0cb090 0x7f246c152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.795+0000 7f24723ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f246c15c9d0 0x7f246c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.795+0000 7f24723ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f246c15db70 0x7f246c069c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.795+0000 7f24723ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0b2f90 con 0x7f246c0cb090 2023-10-06T04:45:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.795+0000 7f24723ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0b2380 con 0x7f246c15c9d0 2023-10-06T04:45:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.795+0000 7f24723ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0b2660 con 0x7f246c15db70 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c0cb090 0x7f246c152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c0cb090 0x7f246c152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44530/0 (socket says 172.21.15.124:44530) 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246bfff700 1 -- 172.21.15.124:0/3312678973 learned_addr learned my addr 172.21.15.124:0/3312678973 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246b7fe700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f246c15c9d0 0x7f246c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f247099c700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f246c15db70 0x7f246c069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246bfff700 1 -- 172.21.15.124:0/3312678973 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f246c15db70 msgr2=0x7f246c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246bfff700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f246c15db70 0x7f246c069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246bfff700 1 -- 172.21.15.124:0/3312678973 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f246c15c9d0 msgr2=0x7f246c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246bfff700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f246c15c9d0 0x7f246c0b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246bfff700 1 -- 172.21.15.124:0/3312678973 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c009480 con 0x7f246c0cb090 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246b7fe700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f246c15c9d0 0x7f246c0b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.796+0000 7f246bfff700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c0cb090 0x7f246c152b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f245c009f50 tx=0x7f245c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.797+0000 7f2453fff700 1 -- 172.21.15.124:0/3312678973 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c011800 con 0x7f246c0cb090 2023-10-06T04:45:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.797+0000 7f2453fff700 1 -- 172.21.15.124:0/3312678973 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c020070 con 0x7f246c0cb090 2023-10-06T04:45:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.797+0000 7f24723ff700 1 -- 172.21.15.124:0/3312678973 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c0b2940 con 0x7f246c0cb090 2023-10-06T04:45:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.797+0000 7f2453fff700 1 -- 172.21.15.124:0/3312678973 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c011b90 con 0x7f246c0cb090 2023-10-06T04:45:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.797+0000 7f24723ff700 1 -- 172.21.15.124:0/3312678973 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c0b2050 con 0x7f246c0cb090 2023-10-06T04:45:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.798+0000 7f24723ff700 1 -- 172.21.15.124:0/3312678973 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c0717a0 con 0x7f246c0cb090 2023-10-06T04:45:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.799+0000 7f2453fff700 1 -- 172.21.15.124:0/3312678973 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f245c022030 con 0x7f246c0cb090 2023-10-06T04:45:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.799+0000 7f2453fff700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2458066f30 0x7f24580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.799+0000 7f2453fff700 1 -- 172.21.15.124:0/3312678973 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f245c085ea0 con 0x7f246c0cb090 2023-10-06T04:45:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.800+0000 7f246b7fe700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2458066f30 0x7f24580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.800+0000 7f246b7fe700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2458066f30 0x7f24580693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f246c06a7e0 tx=0x7f2460008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:15.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:15.804+0000 7f2453fff700 1 -- 172.21.15.124:0/3312678973 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f245c053210 con 0x7f246c0cb090 2023-10-06T04:45:16.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.011+0000 7f24723ff700 1 -- 172.21.15.124:0/3312678973 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f246c0cbbf0 con 0x7f246c0cb090 2023-10-06T04:45:16.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.500+0000 7f2453fff700 1 -- 172.21.15.124:0/3312678973 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f245c05ae60 con 0x7f246c0cb090 2023-10-06T04:45:16.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 -- 172.21.15.124:0/3312678973 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2458066f30 msgr2=0x7f24580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:16.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2458066f30 0x7f24580693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f246c06a7e0 tx=0x7f2460008040 comp rx=0 tx=0).stop 2023-10-06T04:45:16.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 -- 172.21.15.124:0/3312678973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c0cb090 msgr2=0x7f246c152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:16.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c0cb090 0x7f246c152b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f245c009f50 tx=0x7f245c016000 comp rx=0 tx=0).stop 2023-10-06T04:45:16.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 -- 172.21.15.124:0/3312678973 shutdown_connections 2023-10-06T04:45:16.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2458066f30 0x7f24580693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:16.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f246c15db70 0x7f246c069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:16.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f246c0cb090 0x7f246c152b60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:16.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 --2- 172.21.15.124:0/3312678973 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f246c15c9d0 0x7f246c0b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:16.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 -- 172.21.15.124:0/3312678973 >> 172.21.15.124:0/3312678973 conn(0x7f246c097520 msgr2=0x7f246c068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:16.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 -- 172.21.15.124:0/3312678973 shutdown_connections 2023-10-06T04:45:16.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.503+0000 7f24723ff700 1 -- 172.21.15.124:0/3312678973 wait complete. 2023-10-06T04:45:16.506 INFO:teuthology.orchestra.run.smithi124.stderr: removed all blocklist entries 2023-10-06T04:45:16.525 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T04:45:16.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.714+0000 7fa3f17ff700 1 Processor -- start 2023-10-06T04:45:16.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.714+0000 7fa3f17ff700 1 -- start start 2023-10-06T04:45:16.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.716+0000 7fa3f17ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec0cae80 0x7fa3ec0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.716+0000 7fa3f17ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa3ec1598e0 0x7fa3ec0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.716+0000 7fa3f17ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec0c1d10 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.716+0000 7fa3f17ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec0cd430 con 0x7fa3ec1598e0 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.716+0000 7fa3f17ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0688a0 con 0x7fa3ec0cae80 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.716+0000 7fa3ea7fc700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa3ec0ccec0 0x7fa3ec1591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:59304/0 (socket says 172.21.15.124:59304) 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.716+0000 7fa3ea7fc700 1 -- 172.21.15.124:0/1463778017 learned_addr learned my addr 172.21.15.124:0/1463778017 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.717+0000 7fa3eb7fe700 1 --2- 172.21.15.124:0/1463778017 >> v2:172.21.15.158:3300/0 conn(0x7fa3ec1598e0 0x7fa3ec0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.717+0000 7fa3eaffd700 1 --2- 172.21.15.124:0/1463778017 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec0cae80 0x7fa3ec0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.717+0000 7fa3e9ffb700 1 -- 172.21.15.124:0/1463778017 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620714909 0 0) 0x7fa3ec0c1d10 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.717+0000 7fa3e9ffb700 1 -- 172.21.15.124:0/1463778017 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d4003570 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.717+0000 7fa3eaffd700 1 -- 172.21.15.124:0/1463778017 >> v2:172.21.15.158:3300/0 conn(0x7fa3ec1598e0 msgr2=0x7fa3ec0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:16.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.717+0000 7fa3eaffd700 1 --2- 172.21.15.124:0/1463778017 >> v2:172.21.15.158:3300/0 conn(0x7fa3ec1598e0 0x7fa3ec0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:16.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.717+0000 7fa3eaffd700 1 -- 172.21.15.124:0/1463778017 >> v1:172.21.15.124:6789/0 conn(0x7fa3ec0ccec0 legacy=0x7fa3ec1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:16.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.717+0000 7fa3eaffd700 1 -- 172.21.15.124:0/1463778017 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec068b80 con 0x7fa3ec0cae80 2023-10-06T04:45:16.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.717+0000 7fa3eaffd700 1 --2- 172.21.15.124:0/1463778017 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec0cae80 0x7fa3ec0cc980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0098e0 tx=0x7fa3dc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40238aeaba5d6fac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:16.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3e9ffb700 1 -- 172.21.15.124:0/1463778017 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011630 con 0x7fa3ec0cae80 2023-10-06T04:45:16.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3e9ffb700 1 -- 172.21.15.124:0/1463778017 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc011790 con 0x7fa3ec0cae80 2023-10-06T04:45:16.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3e9ffb700 1 -- 172.21.15.124:0/1463778017 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011b30 con 0x7fa3ec0cae80 2023-10-06T04:45:16.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1463778017 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec0cae80 msgr2=0x7fa3ec0cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:16.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3f17ff700 1 --2- 172.21.15.124:0/1463778017 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec0cae80 0x7fa3ec0cc980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0098e0 tx=0x7fa3dc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:16.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1463778017 shutdown_connections 2023-10-06T04:45:16.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3f17ff700 1 --2- 172.21.15.124:0/1463778017 >> v2:172.21.15.158:3300/0 conn(0x7fa3ec1598e0 0x7fa3ec0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:16.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3f17ff700 1 --2- 172.21.15.124:0/1463778017 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec0cae80 0x7fa3ec0cc980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:16.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1463778017 >> 172.21.15.124:0/1463778017 conn(0x7fa3ec0974f0 msgr2=0x7fa3ec0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:16.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1463778017 shutdown_connections 2023-10-06T04:45:16.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.718+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1463778017 wait complete. 2023-10-06T04:45:16.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.720+0000 7fa3f17ff700 1 Processor -- start 2023-10-06T04:45:16.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.720+0000 7fa3f17ff700 1 -- start start 2023-10-06T04:45:16.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3f17ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3ec0cae80 0x7fa3ec158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:16.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3f17ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3ec0ccec0 0x7fa3ec0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:16.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3f17ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec1598e0 0x7fa3ec15f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:16.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3f17ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0b4210 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3f17ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0b3d80 con 0x7fa3ec0cae80 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3f17ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0b3170 con 0x7fa3ec1598e0 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3ea7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3ec0ccec0 0x7fa3ec0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3eaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3ec0cae80 0x7fa3ec158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3ea7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3ec0ccec0 0x7fa3ec0b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44544/0 (socket says 172.21.15.124:44544) 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3ea7fc700 1 -- 172.21.15.124:0/1339299419 learned_addr learned my addr 172.21.15.124:0/1339299419 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.721+0000 7fa3eb7fe700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec1598e0 0x7fa3ec15f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3ea7fc700 1 -- 172.21.15.124:0/1339299419 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec1598e0 msgr2=0x7fa3ec15f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3ea7fc700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec1598e0 0x7fa3ec15f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3ea7fc700 1 -- 172.21.15.124:0/1339299419 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3ec0cae80 msgr2=0x7fa3ec158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3ea7fc700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3ec0cae80 0x7fa3ec158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:16.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3ea7fc700 1 -- 172.21.15.124:0/1339299419 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009420 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3eb7fe700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec1598e0 0x7fa3ec15f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:16.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3eaffd700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3ec0cae80 0x7fa3ec158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:16.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3ea7fc700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3ec0ccec0 0x7fa3ec0b2720 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c7c0 tx=0x7fa3e0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:16.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3d2ffd700 1 -- 172.21.15.124:0/1339299419 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0005cd0 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3d2ffd700 1 -- 172.21.15.124:0/1339299419 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e0005e30 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1339299419 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec0b3450 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3d2ffd700 1 -- 172.21.15.124:0/1339299419 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0007320 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.722+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1339299419 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec0b3a10 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.723+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1339299419 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec0b3ef0 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.724+0000 7fa3d2ffd700 1 -- 172.21.15.124:0/1339299419 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3e001b3b0 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.725+0000 7fa3d2ffd700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa3d8066f30 0x7fa3d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:16.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.725+0000 7fa3d2ffd700 1 -- 172.21.15.124:0/1339299419 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa3e0083a50 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.725+0000 7fa3eaffd700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa3d8066f30 0x7fa3d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:16.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.725+0000 7fa3eaffd700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa3d8066f30 0x7fa3d80693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0091e0 tx=0x7fa3dc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:16.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.729+0000 7fa3d2ffd700 1 -- 172.21.15.124:0/1339299419 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3e0050e10 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.992+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1339299419 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa3ec0717a0 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.992+0000 7fa3d2ffd700 1 -- 172.21.15.124:0/1339299419 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa3e0017070 con 0x7fa3ec0ccec0 2023-10-06T04:45:16.994 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:16.994 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:45:16.994 INFO:teuthology.orchestra.run.smithi124.stdout: "auth_dump": [ 2023-10-06T04:45:16.994 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.a", 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBzkB9lKBFMHxAAXgC27c+1ERz5OgJHsiAy4A==", 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.b", 2023-10-06T04:45:16.995 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBzkB9lvdR3NhAANuznjRvM5pPthiP1y6Pz4Q==", 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.c", 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBzkB9loGWOKhAAfZgSi/yqg2vp6u8ewu566w==", 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:16.996 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.d", 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB0kB9lXmA5BhAA2JCdPcOUZw1qb5iNn0SLNg==", 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:16.997 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.0", 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB4kB9l+SyRGBAA39xHrh7excQVD8NW32swvg==", 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:16.998 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.1", 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB7kB9lfpKxGxAA3F2cmJ5/fCVxSTYpwim3QA==", 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:16.999 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.2", 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB+kB9lv5/HHxAAqoGgt106VO/Hz5cQHozPwg==", 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.3", 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCBkB9lwh+3IxAA7Eg9nU/Oxv+3UcIniSuZiA==", 2023-10-06T04:45:17.000 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.4", 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCGkB9lxXs1BBAAwZEwn6qRy5C+8I7GhtEj1g==", 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:17.001 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.5", 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCJkB9lhGXKBxAAIlFlDabyRQva71ZvtM+l+g==", 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.002 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.6", 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCMkB9lMxz1ChAA824wwFpjXzKt7FvK3EgXFA==", 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.7", 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCPkB9lcRe+DRAA+4LUd77sN+aMHaIh78oTjA==", 2023-10-06T04:45:17.003 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.0", 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB0kB9lMOEjEBAAntffMklHDpj3DVWL1iTmTQ==", 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-06T04:45:17.004 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.1", 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB0kB9lT1B7HhAAJbSOHYRH/tQ8+HTJvLd5aA==", 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-06T04:45:17.005 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.2", 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB0kB9lg3JIFxAAPmfPWXfFG6FTOtQnvkJ/Hg==", 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.006 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.3", 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB0kB9l5oq1JRAAKYKlHwhFevVgR4qCohC3Bg==", 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.007 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.admin", 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBykB9l55BBIxAAxEWs+lJJlID4rpF3szIvaQ==", 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-mds", 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCXkB9lIo4gDBAAe6W5EUQUr31wj55LIDGg4A==", 2023-10-06T04:45:17.008 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCXkB9lQ5kgDBAArCbjE/QRB/HkFw8Po6SupA==", 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.009 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-osd", 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCXkB9lA6IgDBAATG1Pkwh2KPKdYust3JaplA==", 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCXkB9lTasgDBAA1cOP2qNl6YSAJDkjojUQpA==", 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T04:45:17.010 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCXkB9lA7QgDBAAuNXD/rvu7DcOE6RR/WqJAA==", 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCXkB9l2bwgDBAAmC8yInJp6drY6tp9tA3scw==", 2023-10-06T04:45:17.011 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mgr.x", 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBzkB9ligUHGBAAHbLmqM3wPTbD84xLUB/n2w==", 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile mgr", 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:17.012 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mgr.y", 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBzkB9lI5AdDxAA2ySdMloWexLYXANF7ODlIQ==", 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile mgr", 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout: ] 2023-10-06T04:45:17.013 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:45:17.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1339299419 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa3d8066f30 msgr2=0x7fa3d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa3d8066f30 0x7fa3d80693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0091e0 tx=0x7fa3dc017000 comp rx=0 tx=0).stop 2023-10-06T04:45:17.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1339299419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3ec0ccec0 msgr2=0x7fa3ec0b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3ec0ccec0 0x7fa3ec0b2720 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c7c0 tx=0x7fa3e0007e00 comp rx=0 tx=0).stop 2023-10-06T04:45:17.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1339299419 shutdown_connections 2023-10-06T04:45:17.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa3d8066f30 0x7fa3d80693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3ec1598e0 0x7fa3ec15f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3ec0cae80 0x7fa3ec158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 --2- 172.21.15.124:0/1339299419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3ec0ccec0 0x7fa3ec0b2720 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1339299419 >> 172.21.15.124:0/1339299419 conn(0x7fa3ec0974f0 msgr2=0x7fa3ec0c3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:17.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1339299419 shutdown_connections 2023-10-06T04:45:17.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:16.995+0000 7fa3f17ff700 1 -- 172.21.15.124:0/1339299419 wait complete. 2023-10-06T04:45:17.016 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T04:45:17.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.205+0000 7f43d3fff700 1 Processor -- start 2023-10-06T04:45:17.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.205+0000 7f43d3fff700 1 -- start start 2023-10-06T04:45:17.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.206+0000 7f43d3fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f43cc0b3d30 0x7f43cc15a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.206+0000 7f43d3fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f43cc0b1ea0 0x7f43cc0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.206+0000 7f43d3fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc15aac0 con 0x7f43cc1594b0 2023-10-06T04:45:17.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.206+0000 7f43d3fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc0b41b0 con 0x7f43cc0b1ea0 2023-10-06T04:45:17.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.206+0000 7f43d3fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc0b27e0 con 0x7f43cc0b3d30 2023-10-06T04:45:17.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.207+0000 7f43d259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f43cc0b1ea0 0x7f43cc0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.207+0000 7f43d259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f43cc0b1ea0 0x7f43cc0b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44548/0 (socket says 172.21.15.124:44548) 2023-10-06T04:45:17.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.207+0000 7f43d259c700 1 -- 172.21.15.124:0/1728878555 learned_addr learned my addr 172.21.15.124:0/1728878555 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:17.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.207+0000 7f43d159a700 1 --2- 172.21.15.124:0/1728878555 >> v2:172.21.15.158:3300/0 conn(0x7f43cc0b3d30 0x7f43cc15a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.207+0000 7f43d259c700 1 -- 172.21.15.124:0/1728878555 >> v2:172.21.15.158:3300/0 conn(0x7f43cc0b3d30 msgr2=0x7f43cc15a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:17.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.207+0000 7f43d259c700 1 --2- 172.21.15.124:0/1728878555 >> v2:172.21.15.158:3300/0 conn(0x7f43cc0b3d30 0x7f43cc15a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.207+0000 7f43d259c700 1 -- 172.21.15.124:0/1728878555 >> v1:172.21.15.124:6789/0 conn(0x7f43cc1594b0 legacy=0x7f43cc0b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.207+0000 7f43d259c700 1 -- 172.21.15.124:0/1728878555 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0b4410 con 0x7f43cc0b1ea0 2023-10-06T04:45:17.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.207+0000 7f43d0d99700 1 -- 172.21.15.124:0/1728878555 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600241876 0 0) 0x7f43cc15aac0 con 0x7f43cc1594b0 2023-10-06T04:45:17.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.207+0000 7f43d259c700 1 --2- 172.21.15.124:0/1728878555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc0b1ea0 0x7f43cc0b22a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0af780 tx=0x7f43c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e9a2d961e2206b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:17.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.208+0000 7f43d0d99700 1 -- 172.21.15.124:0/1728878555 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c400e070 con 0x7f43cc0b1ea0 2023-10-06T04:45:17.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.208+0000 7f43d0d99700 1 -- 172.21.15.124:0/1728878555 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c400ba20 con 0x7f43cc0b1ea0 2023-10-06T04:45:17.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.208+0000 7f43d0d99700 1 -- 172.21.15.124:0/1728878555 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40092e0 con 0x7f43cc0b1ea0 2023-10-06T04:45:17.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.208+0000 7f43d3fff700 1 -- 172.21.15.124:0/1728878555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc0b1ea0 msgr2=0x7f43cc0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.208+0000 7f43d3fff700 1 --2- 172.21.15.124:0/1728878555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc0b1ea0 0x7f43cc0b22a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0af780 tx=0x7f43c4009840 comp rx=0 tx=0).stop 2023-10-06T04:45:17.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.208+0000 7f43d3fff700 1 -- 172.21.15.124:0/1728878555 shutdown_connections 2023-10-06T04:45:17.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.208+0000 7f43d3fff700 1 --2- 172.21.15.124:0/1728878555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc0b1ea0 0x7f43cc0b22a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.208+0000 7f43d3fff700 1 --2- 172.21.15.124:0/1728878555 >> v2:172.21.15.158:3300/0 conn(0x7f43cc0b3d30 0x7f43cc15a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.208+0000 7f43d3fff700 1 -- 172.21.15.124:0/1728878555 >> 172.21.15.124:0/1728878555 conn(0x7f43cc06ed20 msgr2=0x7f43cc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:17.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.208+0000 7f43d3fff700 1 -- 172.21.15.124:0/1728878555 shutdown_connections 2023-10-06T04:45:17.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.209+0000 7f43d3fff700 1 -- 172.21.15.124:0/1728878555 wait complete. 2023-10-06T04:45:17.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.210+0000 7f43d3fff700 1 Processor -- start 2023-10-06T04:45:17.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.210+0000 7f43d3fff700 1 -- start start 2023-10-06T04:45:17.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.211+0000 7f43d3fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43cc0b1ea0 0x7f43cc169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.211+0000 7f43d3fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43cc0b3d30 0x7f43cc15cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.211+0000 7f43d3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc1594b0 0x7f43cc0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.211+0000 7f43d3fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc1437f0 con 0x7f43cc1594b0 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.211+0000 7f43d3fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc15c790 con 0x7f43cc0b1ea0 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.211+0000 7f43d3fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc15bb80 con 0x7f43cc0b3d30 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.211+0000 7f43d259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc1594b0 0x7f43cc0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.211+0000 7f43d259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc1594b0 0x7f43cc0ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44558/0 (socket says 172.21.15.124:44558) 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.211+0000 7f43d259c700 1 -- 172.21.15.124:0/639136709 learned_addr learned my addr 172.21.15.124:0/639136709 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43d159a700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43cc0b3d30 0x7f43cc15cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43d1d9b700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43cc0b1ea0 0x7f43cc169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43d259c700 1 -- 172.21.15.124:0/639136709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43cc0b3d30 msgr2=0x7f43cc15cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43d259c700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43cc0b3d30 0x7f43cc15cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43d259c700 1 -- 172.21.15.124:0/639136709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43cc0b1ea0 msgr2=0x7f43cc169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43d259c700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43cc0b1ea0 0x7f43cc169f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43d259c700 1 -- 172.21.15.124:0/639136709 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4009ae0 con 0x7f43cc1594b0 2023-10-06T04:45:17.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43d259c700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc1594b0 0x7f43cc0ccc20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009880 tx=0x7f43c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:17.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43c1ffb700 1 -- 172.21.15.124:0/639136709 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4008be0 con 0x7f43cc1594b0 2023-10-06T04:45:17.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43c1ffb700 1 -- 172.21.15.124:0/639136709 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4008d60 con 0x7f43cc1594b0 2023-10-06T04:45:17.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43d3fff700 1 -- 172.21.15.124:0/639136709 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc15be60 con 0x7f43cc1594b0 2023-10-06T04:45:17.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43c1ffb700 1 -- 172.21.15.124:0/639136709 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40266b0 con 0x7f43cc1594b0 2023-10-06T04:45:17.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.212+0000 7f43d3fff700 1 -- 172.21.15.124:0/639136709 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc15c420 con 0x7f43cc1594b0 2023-10-06T04:45:17.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.213+0000 7f43d3fff700 1 -- 172.21.15.124:0/639136709 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc0cd630 con 0x7f43cc1594b0 2023-10-06T04:45:17.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.214+0000 7f43c1ffb700 1 -- 172.21.15.124:0/639136709 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43c4003040 con 0x7f43cc1594b0 2023-10-06T04:45:17.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.215+0000 7f43c1ffb700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f43b0066f30 0x7f43b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.215+0000 7f43c1ffb700 1 -- 172.21.15.124:0/639136709 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f43c4085e20 con 0x7f43cc1594b0 2023-10-06T04:45:17.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.215+0000 7f43d1d9b700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f43b0066f30 0x7f43b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.216+0000 7f43d1d9b700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f43b0066f30 0x7f43b00693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f43cc157750 tx=0x7f43c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:17.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.219+0000 7f43c1ffb700 1 -- 172.21.15.124:0/639136709 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43c40531e0 con 0x7f43cc1594b0 2023-10-06T04:45:17.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.484+0000 7f43d3fff700 1 -- 172.21.15.124:0/639136709 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f43cc0717a0 con 0x7f43cc1594b0 2023-10-06T04:45:17.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.488+0000 7f43c1ffb700 1 -- 172.21.15.124:0/639136709 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f43c4009940 con 0x7f43cc1594b0 2023-10-06T04:45:17.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.490+0000 7f43d3fff700 1 -- 172.21.15.124:0/639136709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f43b0066f30 msgr2=0x7f43b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.490+0000 7f43d3fff700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f43b0066f30 0x7f43b00693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f43cc157750 tx=0x7f43c8009040 comp rx=0 tx=0).stop 2023-10-06T04:45:17.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.490+0000 7f43d3fff700 1 -- 172.21.15.124:0/639136709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc1594b0 msgr2=0x7f43cc0ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.490+0000 7f43d3fff700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc1594b0 0x7f43cc0ccc20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009880 tx=0x7f43c4018000 comp rx=0 tx=0).stop 2023-10-06T04:45:17.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.491+0000 7f43d3fff700 1 -- 172.21.15.124:0/639136709 shutdown_connections 2023-10-06T04:45:17.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.491+0000 7f43d3fff700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43cc1594b0 0x7f43cc0ccc20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.491+0000 7f43d3fff700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43cc0b1ea0 0x7f43cc169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.491+0000 7f43d3fff700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f43b0066f30 0x7f43b00693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.491+0000 7f43d3fff700 1 --2- 172.21.15.124:0/639136709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43cc0b3d30 0x7f43cc15cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.491+0000 7f43d3fff700 1 -- 172.21.15.124:0/639136709 >> 172.21.15.124:0/639136709 conn(0x7f43cc06ed20 msgr2=0x7f43cc155550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:17.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.491+0000 7f43d3fff700 1 -- 172.21.15.124:0/639136709 shutdown_connections 2023-10-06T04:45:17.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.491+0000 7f43d3fff700 1 -- 172.21.15.124:0/639136709 wait complete. 2023-10-06T04:45:17.511 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T04:45:17.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.700+0000 7f9b86dff700 1 Processor -- start 2023-10-06T04:45:17.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.700+0000 7f9b86dff700 1 -- start start 2023-10-06T04:45:17.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.702+0000 7f9b86dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9b801594b0 0x7f9b800b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.702+0000 7f9b86dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9b8015a580 0x7f9b800b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.702+0000 7f9b86dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b800b4410 con 0x7f9b800b59f0 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.702+0000 7f9b86dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800b46f0 con 0x7f9b801594b0 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.702+0000 7f9b86dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800b49d0 con 0x7f9b8015a580 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.702+0000 7f9b84b9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9b801594b0 0x7f9b800b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.702+0000 7f9b84b9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9b801594b0 0x7f9b800b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44564/0 (socket says 172.21.15.124:44564) 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.702+0000 7f9b84b9b700 1 -- 172.21.15.124:0/1774161209 learned_addr learned my addr 172.21.15.124:0/1774161209 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.702+0000 7f9b7ffff700 1 --2- 172.21.15.124:0/1774161209 >> v2:172.21.15.158:3300/0 conn(0x7f9b8015a580 0x7f9b800b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.703+0000 7f9b84b9b700 1 -- 172.21.15.124:0/1774161209 >> v2:172.21.15.158:3300/0 conn(0x7f9b8015a580 msgr2=0x7f9b800b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.703+0000 7f9b84b9b700 1 --2- 172.21.15.124:0/1774161209 >> v2:172.21.15.158:3300/0 conn(0x7f9b8015a580 0x7f9b800b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.703+0000 7f9b84b9b700 1 -- 172.21.15.124:0/1774161209 >> v1:172.21.15.158:6789/0 conn(0x7f9b800b59f0 legacy=0x7f9b800b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.703+0000 7f9b84b9b700 1 -- 172.21.15.124:0/1774161209 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800b4cb0 con 0x7f9b801594b0 2023-10-06T04:45:17.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.703+0000 7f9b84b9b700 1 --2- 172.21.15.124:0/1774161209 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b801594b0 0x7f9b800b3d30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9b800af780 tx=0x7f9b74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c244173c7f9604bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:17.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.703+0000 7f9b7f7fe700 1 -- 172.21.15.124:0/1774161209 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74009e70 con 0x7f9b801594b0 2023-10-06T04:45:17.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.703+0000 7f9b7f7fe700 1 -- 172.21.15.124:0/1774161209 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7400b860 con 0x7f9b801594b0 2023-10-06T04:45:17.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.703+0000 7f9b7f7fe700 1 -- 172.21.15.124:0/1774161209 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400bc00 con 0x7f9b801594b0 2023-10-06T04:45:17.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.704+0000 7f9b86dff700 1 -- 172.21.15.124:0/1774161209 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b801594b0 msgr2=0x7f9b800b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.704+0000 7f9b86dff700 1 --2- 172.21.15.124:0/1774161209 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b801594b0 0x7f9b800b3d30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9b800af780 tx=0x7f9b74009250 comp rx=0 tx=0).stop 2023-10-06T04:45:17.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.704+0000 7f9b86dff700 1 -- 172.21.15.124:0/1774161209 shutdown_connections 2023-10-06T04:45:17.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.704+0000 7f9b86dff700 1 --2- 172.21.15.124:0/1774161209 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b801594b0 0x7f9b800b3d30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.704+0000 7f9b86dff700 1 --2- 172.21.15.124:0/1774161209 >> v2:172.21.15.158:3300/0 conn(0x7f9b8015a580 0x7f9b800b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.704+0000 7f9b86dff700 1 -- 172.21.15.124:0/1774161209 >> 172.21.15.124:0/1774161209 conn(0x7f9b8006ed20 msgr2=0x7f9b8006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:17.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.704+0000 7f9b86dff700 1 -- 172.21.15.124:0/1774161209 shutdown_connections 2023-10-06T04:45:17.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.704+0000 7f9b86dff700 1 -- 172.21.15.124:0/1774161209 wait complete. 2023-10-06T04:45:17.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.705+0000 7f9b86dff700 1 Processor -- start 2023-10-06T04:45:17.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.706+0000 7f9b86dff700 1 -- start start 2023-10-06T04:45:17.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.706+0000 7f9b86dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800b59f0 0x7f9b801458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.706+0000 7f9b86dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b801594b0 0x7f9b800cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.706+0000 7f9b86dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b8015a580 0x7f9b800cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b86dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800c6eb0 con 0x7f9b800b59f0 2023-10-06T04:45:17.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b86dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b80145e10 con 0x7f9b801594b0 2023-10-06T04:45:17.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b86dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800c62e0 con 0x7f9b8015a580 2023-10-06T04:45:17.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b84b9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800b59f0 0x7f9b801458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b84b9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800b59f0 0x7f9b801458d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44576/0 (socket says 172.21.15.124:44576) 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b84b9b700 1 -- 172.21.15.124:0/1327778092 learned_addr learned my addr 172.21.15.124:0/1327778092 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b7ffff700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b801594b0 0x7f9b800cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b8539c700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b8015a580 0x7f9b800cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b84b9b700 1 -- 172.21.15.124:0/1327778092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b8015a580 msgr2=0x7f9b800cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b84b9b700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b8015a580 0x7f9b800cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b84b9b700 1 -- 172.21.15.124:0/1327778092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b801594b0 msgr2=0x7f9b800cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b84b9b700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b801594b0 0x7f9b800cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b84b9b700 1 -- 172.21.15.124:0/1327778092 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740094f0 con 0x7f9b800b59f0 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.707+0000 7f9b84b9b700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800b59f0 0x7f9b801458d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b74006fd0 tx=0x7f9b74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:17.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.708+0000 7f9b7cff9700 1 -- 172.21.15.124:0/1327778092 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74011420 con 0x7f9b800b59f0 2023-10-06T04:45:17.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.708+0000 7f9b7cff9700 1 -- 172.21.15.124:0/1327778092 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b740115a0 con 0x7f9b800b59f0 2023-10-06T04:45:17.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.708+0000 7f9b86dff700 1 -- 172.21.15.124:0/1327778092 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b800c7340 con 0x7f9b800b59f0 2023-10-06T04:45:17.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.708+0000 7f9b7cff9700 1 -- 172.21.15.124:0/1327778092 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74011960 con 0x7f9b800b59f0 2023-10-06T04:45:17.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.708+0000 7f9b86dff700 1 -- 172.21.15.124:0/1327778092 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b800c6860 con 0x7f9b800b59f0 2023-10-06T04:45:17.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.709+0000 7f9b86dff700 1 -- 172.21.15.124:0/1327778092 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b800717a0 con 0x7f9b800b59f0 2023-10-06T04:45:17.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.710+0000 7f9b7cff9700 1 -- 172.21.15.124:0/1327778092 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b740253f0 con 0x7f9b800b59f0 2023-10-06T04:45:17.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.710+0000 7f9b7cff9700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b64066f30 0x7f9b640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:17.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.710+0000 7f9b7cff9700 1 -- 172.21.15.124:0/1327778092 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9b74085dc0 con 0x7f9b800b59f0 2023-10-06T04:45:17.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.711+0000 7f9b7ffff700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b64066f30 0x7f9b640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:17.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.711+0000 7f9b7ffff700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b64066f30 0x7f9b640693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9b800c78c0 tx=0x7f9b6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:17.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.715+0000 7f9b7cff9700 1 -- 172.21.15.124:0/1327778092 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b74053180 con 0x7f9b800b59f0 2023-10-06T04:45:17.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.985+0000 7f9b86dff700 1 -- 172.21.15.124:0/1327778092 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9b800c7190 con 0x7f9b800b59f0 2023-10-06T04:45:17.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.989+0000 7f9b7cff9700 1 -- 172.21.15.124:0/1327778092 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9b740567a0 con 0x7f9b800b59f0 2023-10-06T04:45:17.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 -- 172.21.15.124:0/1327778092 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b64066f30 msgr2=0x7f9b640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b64066f30 0x7f9b640693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9b800c78c0 tx=0x7f9b6c008040 comp rx=0 tx=0).stop 2023-10-06T04:45:17.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 -- 172.21.15.124:0/1327778092 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800b59f0 msgr2=0x7f9b801458d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:17.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800b59f0 0x7f9b801458d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b74006fd0 tx=0x7f9b74017000 comp rx=0 tx=0).stop 2023-10-06T04:45:17.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 -- 172.21.15.124:0/1327778092 shutdown_connections 2023-10-06T04:45:17.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9b64066f30 0x7f9b640693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b8015a580 0x7f9b800cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9b800b59f0 0x7f9b801458d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 --2- 172.21.15.124:0/1327778092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b801594b0 0x7f9b800cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:17.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 -- 172.21.15.124:0/1327778092 >> 172.21.15.124:0/1327778092 conn(0x7f9b8006ed20 msgr2=0x7f9b801584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:17.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 -- 172.21.15.124:0/1327778092 shutdown_connections 2023-10-06T04:45:17.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:17.991+0000 7f9b86dff700 1 -- 172.21.15.124:0/1327778092 wait complete. 2023-10-06T04:45:18.010 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T04:45:18.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.199+0000 7fb564fff700 1 Processor -- start 2023-10-06T04:45:18.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.200+0000 7fb564fff700 1 -- start start 2023-10-06T04:45:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.201+0000 7fb564fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb5601595c0 0x7fb56015db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.201+0000 7fb564fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5600aa7c0 con 0x7fb560067840 2023-10-06T04:45:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb564fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5600a9e90 con 0x7fb560067c10 2023-10-06T04:45:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb564fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600c99a0 con 0x7fb5601595c0 2023-10-06T04:45:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55e59c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb560067840 0x7fb5600c91a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:59322/0 (socket says 172.21.15.124:59322) 2023-10-06T04:45:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55e59c700 1 -- 172.21.15.124:0/1922920772 learned_addr learned my addr 172.21.15.124:0/1922920772 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:18.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55ed9d700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb5601595c0 0x7fb56015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920717002 0 0) 0x7fb5600aa7c0 con 0x7fb560067840 2023-10-06T04:45:18.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb548003570 con 0x7fb560067840 2023-10-06T04:45:18.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697644370 0 0) 0x7fb5600a9e90 con 0x7fb560067c10 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5600aa7c0 con 0x7fb560067c10 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145202304 0 0) 0x7fb548003570 con 0x7fb560067840 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb5601595c0 msgr2=0x7fb56015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55d59a700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb5601595c0 0x7fb56015db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 >> v1:172.21.15.158:6789/0 conn(0x7fb560067c10 legacy=0x7fb560158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600aa170 con 0x7fb560067840 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.202+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fb550001470 con 0x7fb560067840 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 >> v1:172.21.15.124:6789/0 conn(0x7fb560067840 legacy=0x7fb5600c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55d59a700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb5601595c0 0x7fb548003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55d59a700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb5480041d0 0x7fb548004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55d59a700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb548004d50 0x7fb5480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600c99a0 con 0x7fb548004d50 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54800bca0 con 0x7fb5480041d0 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54800be60 con 0x7fb5601595c0 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55ed9d700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb548004d50 0x7fb5480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55e59c700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb5601595c0 0x7fb548003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55dd9b700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb5480041d0 0x7fb548004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55ed9d700 1 -- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb5601595c0 msgr2=0x7fb548003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55ed9d700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb5601595c0 0x7fb548003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55ed9d700 1 -- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb5480041d0 msgr2=0x7fb548004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55ed9d700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb5480041d0 0x7fb548004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55ed9d700 1 -- 172.21.15.124:0/1922920772 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb548003570 con 0x7fb548004d50 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55dd9b700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb5480041d0 0x7fb548004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:18.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.203+0000 7fb55ed9d700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb548004d50 0x7fb5480051c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb5580094d0 tx=0x7fb55800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c85bd968edf210 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.204+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800ea90 con 0x7fb548004d50 2023-10-06T04:45:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.204+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55800f040 con 0x7fb548004d50 2023-10-06T04:45:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.204+0000 7fb55d59a700 1 -- 172.21.15.124:0/1922920772 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800ee20 con 0x7fb548004d50 2023-10-06T04:45:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.204+0000 7fb564fff700 1 -- 172.21.15.124:0/1922920772 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb548004d50 msgr2=0x7fb5480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.204+0000 7fb564fff700 1 --2- 172.21.15.124:0/1922920772 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb548004d50 0x7fb5480051c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb5580094d0 tx=0x7fb55800b040 comp rx=0 tx=0).stop 2023-10-06T04:45:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.204+0000 7fb55ed9d700 1 -- 172.21.15.124:0/1922920772 reap_dead start 2023-10-06T04:45:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.204+0000 7fb564fff700 1 -- 172.21.15.124:0/1922920772 shutdown_connections 2023-10-06T04:45:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.204+0000 7fb564fff700 1 -- 172.21.15.124:0/1922920772 >> 172.21.15.124:0/1922920772 conn(0x7fb560069190 msgr2=0x7fb5600cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.204+0000 7fb564fff700 1 -- 172.21.15.124:0/1922920772 shutdown_connections 2023-10-06T04:45:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.204+0000 7fb564fff700 1 -- 172.21.15.124:0/1922920772 wait complete. 2023-10-06T04:45:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.206+0000 7fb564fff700 1 Processor -- start 2023-10-06T04:45:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.206+0000 7fb564fff700 1 -- start start 2023-10-06T04:45:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb564fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb548004d50 0x7fb560152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb564fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb56015bfe0 0x7fb5600cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb564fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb56015c450 0x7fb560157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb564fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600b0ba0 con 0x7fb56015bfe0 2023-10-06T04:45:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb564fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600affd0 con 0x7fb548004d50 2023-10-06T04:45:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb564fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600b0270 con 0x7fb56015c450 2023-10-06T04:45:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55dd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb56015bfe0 0x7fb5600cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55dd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb56015bfe0 0x7fb5600cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44600/0 (socket says 172.21.15.124:44600) 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55dd9b700 1 -- 172.21.15.124:0/4185338468 learned_addr learned my addr 172.21.15.124:0/4185338468 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55dd9b700 1 -- 172.21.15.124:0/4185338468 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb56015c450 msgr2=0x7fb560157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55e59c700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb548004d50 0x7fb560152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55ed9d700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb56015c450 0x7fb560157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55dd9b700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb56015c450 0x7fb560157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55dd9b700 1 -- 172.21.15.124:0/4185338468 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb548004d50 msgr2=0x7fb560152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55dd9b700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb548004d50 0x7fb560152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55dd9b700 1 -- 172.21.15.124:0/4185338468 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600b0550 con 0x7fb56015bfe0 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55e59c700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb548004d50 0x7fb560152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.207+0000 7fb55ed9d700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb56015c450 0x7fb560157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.208+0000 7fb55dd9b700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb56015bfe0 0x7fb5600cb670 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb554007fd0 tx=0x7fb554009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.208+0000 7fb54e7fc700 1 -- 172.21.15.124:0/4185338468 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554006820 con 0x7fb56015bfe0 2023-10-06T04:45:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.208+0000 7fb54e7fc700 1 -- 172.21.15.124:0/4185338468 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554010040 con 0x7fb56015bfe0 2023-10-06T04:45:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.208+0000 7fb54e7fc700 1 -- 172.21.15.124:0/4185338468 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554006bb0 con 0x7fb56015bfe0 2023-10-06T04:45:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.208+0000 7fb564fff700 1 -- 172.21.15.124:0/4185338468 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5600b0830 con 0x7fb56015bfe0 2023-10-06T04:45:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.208+0000 7fb564fff700 1 -- 172.21.15.124:0/4185338468 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5600cbbb0 con 0x7fb56015bfe0 2023-10-06T04:45:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.209+0000 7fb564fff700 1 -- 172.21.15.124:0/4185338468 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5601532d0 con 0x7fb56015bfe0 2023-10-06T04:45:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.210+0000 7fb54e7fc700 1 -- 172.21.15.124:0/4185338468 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb554007030 con 0x7fb56015bfe0 2023-10-06T04:45:18.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.211+0000 7fb54e7fc700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb540066f30 0x7fb5400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.211+0000 7fb54e7fc700 1 -- 172.21.15.124:0/4185338468 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb554083670 con 0x7fb56015bfe0 2023-10-06T04:45:18.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.211+0000 7fb55e59c700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb540066f30 0x7fb5400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.212+0000 7fb55e59c700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb540066f30 0x7fb5400693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb550001e30 tx=0x7fb550009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:18.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.215+0000 7fb54e7fc700 1 -- 172.21.15.124:0/4185338468 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb55404d5a0 con 0x7fb56015bfe0 2023-10-06T04:45:18.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.485+0000 7fb564fff700 1 -- 172.21.15.124:0/4185338468 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb5600cbe30 con 0x7fb56015bfe0 2023-10-06T04:45:18.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.489+0000 7fb54e7fc700 1 -- 172.21.15.124:0/4185338468 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb55401a0a0 con 0x7fb56015bfe0 2023-10-06T04:45:18.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 -- 172.21.15.124:0/4185338468 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb540066f30 msgr2=0x7fb5400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb540066f30 0x7fb5400693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb550001e30 tx=0x7fb550009040 comp rx=0 tx=0).stop 2023-10-06T04:45:18.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 -- 172.21.15.124:0/4185338468 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb56015bfe0 msgr2=0x7fb5600cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb56015bfe0 0x7fb5600cb670 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb554007fd0 tx=0x7fb554009040 comp rx=0 tx=0).stop 2023-10-06T04:45:18.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 -- 172.21.15.124:0/4185338468 shutdown_connections 2023-10-06T04:45:18.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb540066f30 0x7fb5400693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb56015c450 0x7fb560157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb548004d50 0x7fb560152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 --2- 172.21.15.124:0/4185338468 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb56015bfe0 0x7fb5600cb670 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 -- 172.21.15.124:0/4185338468 >> 172.21.15.124:0/4185338468 conn(0x7fb560069190 msgr2=0x7fb5600af490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:18.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 -- 172.21.15.124:0/4185338468 shutdown_connections 2023-10-06T04:45:18.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.491+0000 7fb564fff700 1 -- 172.21.15.124:0/4185338468 wait complete. 2023-10-06T04:45:18.511 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T04:45:18.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.700+0000 7f65807ff700 1 Processor -- start 2023-10-06T04:45:18.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.700+0000 7f65807ff700 1 -- start start 2023-10-06T04:45:18.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.701+0000 7f65807ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 0x7f657806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.701+0000 7f65807ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657806f650 con 0x7f65780ae320 2023-10-06T04:45:18.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.701+0000 7f65807ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657806a090 con 0x7f65780ae6f0 2023-10-06T04:45:18.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.701+0000 7f65807ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657806f370 con 0x7f657806ede0 2023-10-06T04:45:18.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.702+0000 7f657e59b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f65780ae320 0x7f65780c66c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:59328/0 (socket says 172.21.15.124:59328) 2023-10-06T04:45:18.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.702+0000 7f657e59b700 1 -- 172.21.15.124:0/1771087100 learned_addr learned my addr 172.21.15.124:0/1771087100 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:18.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.702+0000 7f657ed9c700 1 --2- 172.21.15.124:0/1771087100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 0x7f657806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.702+0000 7f657d599700 1 -- 172.21.15.124:0/1771087100 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253944416 0 0) 0x7f6574001110 con 0x7f65780ae320 2023-10-06T04:45:18.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.702+0000 7f657d599700 1 -- 172.21.15.124:0/1771087100 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6564003570 con 0x7f65780ae320 2023-10-06T04:45:18.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.702+0000 7f657d599700 1 -- 172.21.15.124:0/1771087100 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610751749 0 0) 0x7f657806a090 con 0x7f65780ae6f0 2023-10-06T04:45:18.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.702+0000 7f657d599700 1 -- 172.21.15.124:0/1771087100 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6574001110 con 0x7f65780ae6f0 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.702+0000 7f657ed9c700 1 -- 172.21.15.124:0/1771087100 >> v1:172.21.15.158:6789/0 conn(0x7f65780ae6f0 legacy=0x7f65780c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.702+0000 7f657ed9c700 1 -- 172.21.15.124:0/1771087100 >> v1:172.21.15.124:6789/0 conn(0x7f65780ae320 legacy=0x7f65780c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.702+0000 7f657ed9c700 1 -- 172.21.15.124:0/1771087100 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6578069a40 con 0x7f657806ede0 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.703+0000 7f657ed9c700 1 --2- 172.21.15.124:0/1771087100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 0x7f657806a520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6570009e90 tx=0x7f6570009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17f4b475a514e656 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.703+0000 7f657d599700 1 -- 172.21.15.124:0/1771087100 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657000e070 con 0x7f657806ede0 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.703+0000 7f657d599700 1 -- 172.21.15.124:0/1771087100 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657000bc10 con 0x7f657806ede0 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.703+0000 7f657d599700 1 -- 172.21.15.124:0/1771087100 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570012430 con 0x7f657806ede0 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.703+0000 7f65807ff700 1 -- 172.21.15.124:0/1771087100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 msgr2=0x7f657806a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.703+0000 7f65807ff700 1 --2- 172.21.15.124:0/1771087100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 0x7f657806a520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6570009e90 tx=0x7f6570009780 comp rx=0 tx=0).stop 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.704+0000 7f65807ff700 1 -- 172.21.15.124:0/1771087100 shutdown_connections 2023-10-06T04:45:18.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.704+0000 7f65807ff700 1 --2- 172.21.15.124:0/1771087100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 0x7f657806a520 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.704+0000 7f65807ff700 1 -- 172.21.15.124:0/1771087100 >> 172.21.15.124:0/1771087100 conn(0x7f65780cc080 msgr2=0x7f65780cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:18.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.704+0000 7f65807ff700 1 -- 172.21.15.124:0/1771087100 shutdown_connections 2023-10-06T04:45:18.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.704+0000 7f65807ff700 1 -- 172.21.15.124:0/1771087100 wait complete. 2023-10-06T04:45:18.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.705+0000 7f65807ff700 1 Processor -- start 2023-10-06T04:45:18.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.705+0000 7f65807ff700 1 -- start start 2023-10-06T04:45:18.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.706+0000 7f65807ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 0x7f65780b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.706+0000 7f65807ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65780ae320 0x7f6578143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.706+0000 7f65807ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65780ae6f0 0x7f6578153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.706+0000 7f65807ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780b1600 con 0x7f65780ae6f0 2023-10-06T04:45:18.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.706+0000 7f65807ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780b0900 con 0x7f65780ae320 2023-10-06T04:45:18.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.706+0000 7f65807ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657816d370 con 0x7f657806ede0 2023-10-06T04:45:18.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.706+0000 7f657ed9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65780ae6f0 0x7f6578153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.706+0000 7f657ed9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65780ae6f0 0x7f6578153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44614/0 (socket says 172.21.15.124:44614) 2023-10-06T04:45:18.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.706+0000 7f657ed9c700 1 -- 172.21.15.124:0/2261172339 learned_addr learned my addr 172.21.15.124:0/2261172339 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:18.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f657e59b700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 0x7f65780b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f657dd9a700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65780ae320 0x7f6578143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f657ed9c700 1 -- 172.21.15.124:0/2261172339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 msgr2=0x7f65780b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f657ed9c700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 0x7f65780b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f657ed9c700 1 -- 172.21.15.124:0/2261172339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65780ae320 msgr2=0x7f6578143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f657ed9c700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65780ae320 0x7f6578143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f657ed9c700 1 -- 172.21.15.124:0/2261172339 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6570009a20 con 0x7f65780ae6f0 2023-10-06T04:45:18.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f657dd9a700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65780ae320 0x7f6578143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:18.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f657e59b700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 0x7f65780b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:18.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f657ed9c700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65780ae6f0 0x7f6578153f30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f657806d000 tx=0x7f6570019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:18.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f656e7fc700 1 -- 172.21.15.124:0/2261172339 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657001b630 con 0x7f65780ae6f0 2023-10-06T04:45:18.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f656e7fc700 1 -- 172.21.15.124:0/2261172339 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657001b7b0 con 0x7f65780ae6f0 2023-10-06T04:45:18.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f65807ff700 1 -- 172.21.15.124:0/2261172339 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657816d650 con 0x7f65780ae6f0 2023-10-06T04:45:18.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f656e7fc700 1 -- 172.21.15.124:0/2261172339 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657001bb70 con 0x7f65780ae6f0 2023-10-06T04:45:18.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.707+0000 7f65807ff700 1 -- 172.21.15.124:0/2261172339 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657816dc10 con 0x7f65780ae6f0 2023-10-06T04:45:18.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.708+0000 7f65807ff700 1 -- 172.21.15.124:0/2261172339 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65781561e0 con 0x7f65780ae6f0 2023-10-06T04:45:18.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.709+0000 7f656e7fc700 1 -- 172.21.15.124:0/2261172339 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f657001c400 con 0x7f65780ae6f0 2023-10-06T04:45:18.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.711+0000 7f656e7fc700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f655c066fb0 0x7f655c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:18.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.711+0000 7f656e7fc700 1 -- 172.21.15.124:0/2261172339 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f65700862f0 con 0x7f65780ae6f0 2023-10-06T04:45:18.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.711+0000 7f657e59b700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f655c066fb0 0x7f655c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:18.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.711+0000 7f657e59b700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f655c066fb0 0x7f655c069460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6578151690 tx=0x7f6574009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:18.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.715+0000 7f656e7fc700 1 -- 172.21.15.124:0/2261172339 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65700536b0 con 0x7f65780ae6f0 2023-10-06T04:45:18.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.982+0000 7f65807ff700 1 -- 172.21.15.124:0/2261172339 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6578152150 con 0x7f65780ae6f0 2023-10-06T04:45:18.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.986+0000 7f656e7fc700 1 -- 172.21.15.124:0/2261172339 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6570056cd0 con 0x7f65780ae6f0 2023-10-06T04:45:18.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.988+0000 7f65807ff700 1 -- 172.21.15.124:0/2261172339 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f655c066fb0 msgr2=0x7f655c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.988+0000 7f65807ff700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f655c066fb0 0x7f655c069460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6578151690 tx=0x7f6574009040 comp rx=0 tx=0).stop 2023-10-06T04:45:18.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.988+0000 7f65807ff700 1 -- 172.21.15.124:0/2261172339 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65780ae6f0 msgr2=0x7f6578153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:18.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.988+0000 7f65807ff700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65780ae6f0 0x7f6578153f30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f657806d000 tx=0x7f6570019000 comp rx=0 tx=0).stop 2023-10-06T04:45:18.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.989+0000 7f65807ff700 1 -- 172.21.15.124:0/2261172339 shutdown_connections 2023-10-06T04:45:18.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.989+0000 7f65807ff700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65780ae6f0 0x7f6578153f30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.989+0000 7f65807ff700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f655c066fb0 0x7f655c069460 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.989+0000 7f65807ff700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f657806ede0 0x7f65780b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.989+0000 7f65807ff700 1 --2- 172.21.15.124:0/2261172339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65780ae320 0x7f6578143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:18.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.989+0000 7f65807ff700 1 -- 172.21.15.124:0/2261172339 >> 172.21.15.124:0/2261172339 conn(0x7f65780cc080 msgr2=0x7f65780c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:18.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.989+0000 7f65807ff700 1 -- 172.21.15.124:0/2261172339 shutdown_connections 2023-10-06T04:45:18.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:18.989+0000 7f65807ff700 1 -- 172.21.15.124:0/2261172339 wait complete. 2023-10-06T04:45:19.008 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T04:45:19.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.199+0000 7fcaf1dff700 1 Processor -- start 2023-10-06T04:45:19.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.199+0000 7fcaf1dff700 1 -- start start 2023-10-06T04:45:19.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.200+0000 7fcaf1dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec15bbe0 0x7fcaec151310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.200+0000 7fcaf1dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec06dba0 con 0x7fcaec15b500 2023-10-06T04:45:19.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.200+0000 7fcaf1dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec06d390 con 0x7fcaec15b130 2023-10-06T04:45:19.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.200+0000 7fcaf1dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0699b0 con 0x7fcaec15bbe0 2023-10-06T04:45:19.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaebfff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fcaec15b500 0x7fcaec151850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:59330/0 (socket says 172.21.15.124:59330) 2023-10-06T04:45:19.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaebfff700 1 -- 172.21.15.124:0/2367696320 learned_addr learned my addr 172.21.15.124:0/2367696320 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:19.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaeaffd700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec15bbe0 0x7fcaec151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452968540 0 0) 0x7fcae4001490 con 0x7fcaec15b500 2023-10-06T04:45:19.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad4003570 con 0x7fcaec15b500 2023-10-06T04:45:19.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657051765 0 0) 0x7fcaec06d390 con 0x7fcaec15b130 2023-10-06T04:45:19.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae4001490 con 0x7fcaec15b130 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2439246661 0 0) 0x7fcad4003570 con 0x7fcaec15b500 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec15bbe0 msgr2=0x7fcaec151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaea7fc700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec15bbe0 0x7fcaec151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 >> v1:172.21.15.158:6789/0 conn(0x7fcaec15b130 legacy=0x7fcaec06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec06d5e0 con 0x7fcaec15b500 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.201+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fcae4001980 con 0x7fcaec15b500 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 >> v1:172.21.15.124:6789/0 conn(0x7fcaec15b500 legacy=0x7fcaec151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaea7fc700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad4003c20 0x7fcad4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaea7fc700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcad4004810 0x7fcad4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaea7fc700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec15bbe0 0x7fcad4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0699b0 con 0x7fcad4004810 2023-10-06T04:45:19.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad400bc20 con 0x7fcad4003c20 2023-10-06T04:45:19.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad400bde0 con 0x7fcaec15bbe0 2023-10-06T04:45:19.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaeaffd700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcad4004810 0x7fcad4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaeb7fe700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad4003c20 0x7fcad4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaebfff700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec15bbe0 0x7fcad4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaeaffd700 1 -- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec15bbe0 msgr2=0x7fcad4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:19.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaeaffd700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec15bbe0 0x7fcad4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaeaffd700 1 -- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad4003c20 msgr2=0x7fcad4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:19.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaeaffd700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad4003c20 0x7fcad4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.202+0000 7fcaeaffd700 1 -- 172.21.15.124:0/2367696320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4003570 con 0x7fcad4004810 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaeaffd700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcad4004810 0x7fcad4004c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcaec15c010 tx=0x7fcae00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed5bacb6860e1da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000e710 con 0x7fcad4004810 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae000e870 con 0x7fcad4004810 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaea7fc700 1 -- 172.21.15.124:0/2367696320 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000ec30 con 0x7fcad4004810 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaf1dff700 1 -- 172.21.15.124:0/2367696320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcad4004810 msgr2=0x7fcad4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaf1dff700 1 --2- 172.21.15.124:0/2367696320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcad4004810 0x7fcad4004c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcaec15c010 tx=0x7fcae00091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaebfff700 1 -- 172.21.15.124:0/2367696320 reap_dead start 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaf1dff700 1 -- 172.21.15.124:0/2367696320 shutdown_connections 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaf1dff700 1 -- 172.21.15.124:0/2367696320 >> 172.21.15.124:0/2367696320 conn(0x7fcaec0cc080 msgr2=0x7fcaec0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaf1dff700 1 -- 172.21.15.124:0/2367696320 shutdown_connections 2023-10-06T04:45:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.203+0000 7fcaf1dff700 1 -- 172.21.15.124:0/2367696320 wait complete. 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.205+0000 7fcaf1dff700 1 Processor -- start 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.205+0000 7fcaf1dff700 1 -- start start 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaf1dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad4004810 0x7fcaec150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaf1dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcaec0977e0 0x7fcaec0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaf1dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec0cb0a0 0x7fcaec0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaf1dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0cb4f0 con 0x7fcaec0977e0 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaf1dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0c8440 con 0x7fcad4004810 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaf1dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec096a20 con 0x7fcaec0cb0a0 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaeaffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcaec0977e0 0x7fcaec0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaeaffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcaec0977e0 0x7fcaec0cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44632/0 (socket says 172.21.15.124:44632) 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaeaffd700 1 -- 172.21.15.124:0/3101733561 learned_addr learned my addr 172.21.15.124:0/3101733561 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaeb7fe700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad4004810 0x7fcaec150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.206+0000 7fcaebfff700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec0cb0a0 0x7fcaec0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcaeaffd700 1 -- 172.21.15.124:0/3101733561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec0cb0a0 msgr2=0x7fcaec0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcaeaffd700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec0cb0a0 0x7fcaec0c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcaeaffd700 1 -- 172.21.15.124:0/3101733561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad4004810 msgr2=0x7fcaec150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcaeaffd700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad4004810 0x7fcaec150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcaeaffd700 1 -- 172.21.15.124:0/3101733561 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec096d00 con 0x7fcaec0977e0 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcaeaffd700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcaec0977e0 0x7fcaec0cab60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e4b0 tx=0x7fcae001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcad37fe700 1 -- 172.21.15.124:0/3101733561 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0023070 con 0x7fcaec0977e0 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcad37fe700 1 -- 172.21.15.124:0/3101733561 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae000e9e0 con 0x7fcaec0977e0 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcaf1dff700 1 -- 172.21.15.124:0/3101733561 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec096fe0 con 0x7fcaec0977e0 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcad37fe700 1 -- 172.21.15.124:0/3101733561 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000e710 con 0x7fcaec0977e0 2023-10-06T04:45:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.207+0000 7fcaf1dff700 1 -- 172.21.15.124:0/3101733561 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec1513c0 con 0x7fcaec0977e0 2023-10-06T04:45:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.208+0000 7fcaf1dff700 1 -- 172.21.15.124:0/3101733561 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec097480 con 0x7fcaec0977e0 2023-10-06T04:45:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.209+0000 7fcad37fe700 1 -- 172.21.15.124:0/3101733561 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcae0013470 con 0x7fcaec0977e0 2023-10-06T04:45:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.210+0000 7fcad37fe700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcad8066f30 0x7fcad80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.210+0000 7fcad37fe700 1 -- 172.21.15.124:0/3101733561 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcae0085830 con 0x7fcaec0977e0 2023-10-06T04:45:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.210+0000 7fcaeb7fe700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcad8066f30 0x7fcad80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.211+0000 7fcaeb7fe700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcad8066f30 0x7fcad80693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcadc000c00 tx=0x7fcadc007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.214+0000 7fcad37fe700 1 -- 172.21.15.124:0/3101733561 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcae0052d70 con 0x7fcaec0977e0 2023-10-06T04:45:19.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.479+0000 7fcaf1dff700 1 -- 172.21.15.124:0/3101733561 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fcaec151da0 con 0x7fcaec0977e0 2023-10-06T04:45:19.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.483+0000 7fcad37fe700 1 -- 172.21.15.124:0/3101733561 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcae00170a0 con 0x7fcaec0977e0 2023-10-06T04:45:19.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.485+0000 7fcaf1dff700 1 -- 172.21.15.124:0/3101733561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcad8066f30 msgr2=0x7fcad80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.485+0000 7fcaf1dff700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcad8066f30 0x7fcad80693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcadc000c00 tx=0x7fcadc007d30 comp rx=0 tx=0).stop 2023-10-06T04:45:19.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.485+0000 7fcaf1dff700 1 -- 172.21.15.124:0/3101733561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcaec0977e0 msgr2=0x7fcaec0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.485+0000 7fcaf1dff700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcaec0977e0 0x7fcaec0cab60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e4b0 tx=0x7fcae001a000 comp rx=0 tx=0).stop 2023-10-06T04:45:19.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.486+0000 7fcaf1dff700 1 -- 172.21.15.124:0/3101733561 shutdown_connections 2023-10-06T04:45:19.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.486+0000 7fcaf1dff700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcad8066f30 0x7fcad80693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.486+0000 7fcaf1dff700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcaec0cb0a0 0x7fcaec0c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.486+0000 7fcaf1dff700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad4004810 0x7fcaec150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.486+0000 7fcaf1dff700 1 --2- 172.21.15.124:0/3101733561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcaec0977e0 0x7fcaec0cab60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.486+0000 7fcaf1dff700 1 -- 172.21.15.124:0/3101733561 >> 172.21.15.124:0/3101733561 conn(0x7fcaec0cc080 msgr2=0x7fcaec0aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:19.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.486+0000 7fcaf1dff700 1 -- 172.21.15.124:0/3101733561 shutdown_connections 2023-10-06T04:45:19.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.486+0000 7fcaf1dff700 1 -- 172.21.15.124:0/3101733561 wait complete. 2023-10-06T04:45:19.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T04:45:19.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.695+0000 7f019bdff700 1 Processor -- start 2023-10-06T04:45:19.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.695+0000 7f019bdff700 1 -- start start 2023-10-06T04:45:19.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.696+0000 7f019bdff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940ae320 0x7f019406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.697+0000 7f019bdff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019406f650 con 0x7f01940ae6f0 2023-10-06T04:45:19.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.697+0000 7f019bdff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019406a090 con 0x7f01940c6dd0 2023-10-06T04:45:19.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.697+0000 7f019bdff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019406f370 con 0x7f01940ae320 2023-10-06T04:45:19.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.697+0000 7f019939a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f01940ae6f0 0x7f01940c66c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:59332/0 (socket says 172.21.15.124:59332) 2023-10-06T04:45:19.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.697+0000 7f019939a700 1 -- 172.21.15.124:0/1432268684 learned_addr learned my addr 172.21.15.124:0/1432268684 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:19.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.697+0000 7f0199b9b700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940ae320 0x7f019406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.697+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461995572 0 0) 0x7f0184001110 con 0x7f01940ae6f0 2023-10-06T04:45:19.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.697+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0180003570 con 0x7f01940ae6f0 2023-10-06T04:45:19.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397472239 0 0) 0x7f0180003570 con 0x7f01940ae6f0 2023-10-06T04:45:19.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940ae320 msgr2=0x7f019406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:19.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940ae320 0x7f019406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 >> v1:172.21.15.158:6789/0 conn(0x7f01940c6dd0 legacy=0x7f019406ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194069a40 con 0x7f01940ae6f0 2023-10-06T04:45:19.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f0184001600 con 0x7f01940ae6f0 2023-10-06T04:45:19.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 >> v1:172.21.15.124:6789/0 conn(0x7f01940ae6f0 legacy=0x7f01940c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940ae320 0x7f0180003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0180004010 0x7f0180004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180004d50 0x7f01800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019406f370 con 0x7f0180004010 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018000bbf0 con 0x7f0180004d50 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018000dfc0 con 0x7f01940ae320 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f019939a700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0180004010 0x7f0180004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0199b9b700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940ae320 0x7f0180003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f019a39c700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180004d50 0x7f01800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f019939a700 1 -- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940ae320 msgr2=0x7f0180003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f019939a700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940ae320 0x7f0180003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f019939a700 1 -- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180004d50 msgr2=0x7f01800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f019939a700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180004d50 0x7f01800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f019939a700 1 -- 172.21.15.124:0/1432268684 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0180003570 con 0x7f0180004010 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.698+0000 7f0199b9b700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940ae320 0x7f0180003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f019939a700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0180004010 0x7f0180004810 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0184001ed0 tx=0x7f0184007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bdeecefa1b4cca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018400cd90 con 0x7f0180004010 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0184005920 con 0x7f0180004010 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f0198b99700 1 -- 172.21.15.124:0/1432268684 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184005ce0 con 0x7f0180004010 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f019bdff700 1 -- 172.21.15.124:0/1432268684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0180004010 msgr2=0x7f0180004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f019bdff700 1 --2- 172.21.15.124:0/1432268684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0180004010 0x7f0180004810 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0184001ed0 tx=0x7f0184007a50 comp rx=0 tx=0).stop 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f019a39c700 1 -- 172.21.15.124:0/1432268684 reap_dead start 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f019bdff700 1 -- 172.21.15.124:0/1432268684 shutdown_connections 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f019bdff700 1 -- 172.21.15.124:0/1432268684 >> 172.21.15.124:0/1432268684 conn(0x7f01940cc080 msgr2=0x7f01940cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:19.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f019bdff700 1 -- 172.21.15.124:0/1432268684 shutdown_connections 2023-10-06T04:45:19.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.699+0000 7f019bdff700 1 -- 172.21.15.124:0/1432268684 wait complete. 2023-10-06T04:45:19.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.701+0000 7f019bdff700 1 Processor -- start 2023-10-06T04:45:19.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.701+0000 7f019bdff700 1 -- start start 2023-10-06T04:45:19.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f019bdff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180004010 0x7f01941587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f019bdff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940cb270 0x7f0194152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f019bdff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f019416a5b0 0x7f01940c1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f019bdff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01941698c0 con 0x7f019416a5b0 2023-10-06T04:45:19.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f019bdff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0194159380 con 0x7f0180004010 2023-10-06T04:45:19.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f019bdff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01941590a0 con 0x7f01940cb270 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f019a39c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f019416a5b0 0x7f01940c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f019a39c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f019416a5b0 0x7f01940c1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44650/0 (socket says 172.21.15.124:44650) 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f019a39c700 1 -- 172.21.15.124:0/235356484 learned_addr learned my addr 172.21.15.124:0/235356484 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f0199b9b700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180004010 0x7f01941587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.702+0000 7f019939a700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940cb270 0x7f0194152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f019a39c700 1 -- 172.21.15.124:0/235356484 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940cb270 msgr2=0x7f0194152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f019a39c700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940cb270 0x7f0194152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f019a39c700 1 -- 172.21.15.124:0/235356484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180004010 msgr2=0x7f01941587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f019a39c700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180004010 0x7f01941587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f019a39c700 1 -- 172.21.15.124:0/235356484 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194169ad0 con 0x7f019416a5b0 2023-10-06T04:45:19.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f019a39c700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f019416a5b0 0x7f01940c1340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f019406b770 tx=0x7f018c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:19.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f0189ffb700 1 -- 172.21.15.124:0/235356484 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00ee40 con 0x7f019416a5b0 2023-10-06T04:45:19.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f0189ffb700 1 -- 172.21.15.124:0/235356484 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c013420 con 0x7f019416a5b0 2023-10-06T04:45:19.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f019bdff700 1 -- 172.21.15.124:0/235356484 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0194169db0 con 0x7f019416a5b0 2023-10-06T04:45:19.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f0189ffb700 1 -- 172.21.15.124:0/235356484 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0137e0 con 0x7f019416a5b0 2023-10-06T04:45:19.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.703+0000 7f019bdff700 1 -- 172.21.15.124:0/235356484 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0194158d00 con 0x7f019416a5b0 2023-10-06T04:45:19.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.704+0000 7f019bdff700 1 -- 172.21.15.124:0/235356484 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019416a2d0 con 0x7f019416a5b0 2023-10-06T04:45:19.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.705+0000 7f0189ffb700 1 -- 172.21.15.124:0/235356484 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f018c013b50 con 0x7f019416a5b0 2023-10-06T04:45:19.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.706+0000 7f0189ffb700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0178066f30 0x7f01780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:19.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.706+0000 7f0189ffb700 1 -- 172.21.15.124:0/235356484 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f018c0840a0 con 0x7f019416a5b0 2023-10-06T04:45:19.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.706+0000 7f0199b9b700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0178066f30 0x7f01780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:19.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.707+0000 7f0199b9b700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0178066f30 0x7f01780693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f01900077e0 tx=0x7f019000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:19.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.710+0000 7f0189ffb700 1 -- 172.21.15.124:0/235356484 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f019416a2d0 con 0x7f019416a5b0 2023-10-06T04:45:19.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.979+0000 7f019bdff700 1 -- 172.21.15.124:0/235356484 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f019416a2d0 con 0x7f019416a5b0 2023-10-06T04:45:19.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.983+0000 7f0189ffb700 1 -- 172.21.15.124:0/235356484 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f019416a2d0 con 0x7f019416a5b0 2023-10-06T04:45:19.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 -- 172.21.15.124:0/235356484 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0178066f30 msgr2=0x7f01780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0178066f30 0x7f01780693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f01900077e0 tx=0x7f019000b040 comp rx=0 tx=0).stop 2023-10-06T04:45:19.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 -- 172.21.15.124:0/235356484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f019416a5b0 msgr2=0x7f01940c1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:19.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f019416a5b0 0x7f01940c1340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f019406b770 tx=0x7f018c009040 comp rx=0 tx=0).stop 2023-10-06T04:45:19.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 -- 172.21.15.124:0/235356484 shutdown_connections 2023-10-06T04:45:19.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f019416a5b0 0x7f01940c1340 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180004010 0x7f01941587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0178066f30 0x7f01780693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 --2- 172.21.15.124:0/235356484 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01940cb270 0x7f0194152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:19.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 -- 172.21.15.124:0/235356484 >> 172.21.15.124:0/235356484 conn(0x7f01940cc080 msgr2=0x7f0194154b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:19.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 -- 172.21.15.124:0/235356484 shutdown_connections 2023-10-06T04:45:19.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:19.986+0000 7f019bdff700 1 -- 172.21.15.124:0/235356484 wait complete. 2023-10-06T04:45:20.005 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:20.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.195+0000 7f467bfff700 1 Processor -- start 2023-10-06T04:45:20.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.195+0000 7f467bfff700 1 -- start start 2023-10-06T04:45:20.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.196+0000 7f467bfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46740ccbb0 0x7f46740cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.196+0000 7f467bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f46740cdfe0 0x7f46740ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.196+0000 7f467bfff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46740cf6b0 con 0x7f46740ccf80 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.196+0000 7f467bfff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46740cdb10 con 0x7f46740cdfe0 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.196+0000 7f467bfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46740ceaa0 con 0x7f46740ccbb0 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.196+0000 7f467959a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f46740cdfe0 0x7f46740ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.196+0000 7f467959a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f46740cdfe0 0x7f46740ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44666/0 (socket says 172.21.15.124:44666) 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.196+0000 7f467959a700 1 -- 172.21.15.124:0/180585747 learned_addr learned my addr 172.21.15.124:0/180585747 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.196+0000 7f467a59c700 1 --1- 172.21.15.124:0/180585747 >> v1:172.21.15.124:6789/0 conn(0x7f46740ccf80 0x7f46740cd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:59348/0 (socket says 172.21.15.124:59348) 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.197+0000 7f4679d9b700 1 --2- 172.21.15.124:0/180585747 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46740ccbb0 0x7f46740cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.197+0000 7f467959a700 1 -- 172.21.15.124:0/180585747 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46740ccbb0 msgr2=0x7f46740cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.197+0000 7f467959a700 1 --2- 172.21.15.124:0/180585747 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46740ccbb0 0x7f46740cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.197+0000 7f467959a700 1 -- 172.21.15.124:0/180585747 >> v1:172.21.15.124:6789/0 conn(0x7f46740ccf80 legacy=0x7f46740cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.197+0000 7f467959a700 1 -- 172.21.15.124:0/180585747 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740ced80 con 0x7f46740cdfe0 2023-10-06T04:45:20.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.197+0000 7f467959a700 1 --2- 172.21.15.124:0/180585747 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 0x7f46740ce450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f46640099b0 tx=0x7f4664009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fc5c51b632b4ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:20.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.197+0000 7f4678d99700 1 -- 172.21.15.124:0/180585747 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466400b860 con 0x7f46740cdfe0 2023-10-06T04:45:20.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.197+0000 7f4678d99700 1 -- 172.21.15.124:0/180585747 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466400b9c0 con 0x7f46740cdfe0 2023-10-06T04:45:20.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.197+0000 7f4678d99700 1 -- 172.21.15.124:0/180585747 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466400bd60 con 0x7f46740cdfe0 2023-10-06T04:45:20.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.198+0000 7f467bfff700 1 -- 172.21.15.124:0/180585747 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 msgr2=0x7f46740ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.198+0000 7f467bfff700 1 --2- 172.21.15.124:0/180585747 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 0x7f46740ce450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f46640099b0 tx=0x7f4664009250 comp rx=0 tx=0).stop 2023-10-06T04:45:20.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.198+0000 7f467bfff700 1 -- 172.21.15.124:0/180585747 shutdown_connections 2023-10-06T04:45:20.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.198+0000 7f467bfff700 1 --2- 172.21.15.124:0/180585747 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46740ccbb0 0x7f46740cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.198+0000 7f467bfff700 1 --2- 172.21.15.124:0/180585747 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 0x7f46740ce450 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.198+0000 7f467bfff700 1 -- 172.21.15.124:0/180585747 >> 172.21.15.124:0/180585747 conn(0x7f4674099710 msgr2=0x7f467406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:20.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.198+0000 7f467bfff700 1 -- 172.21.15.124:0/180585747 shutdown_connections 2023-10-06T04:45:20.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.198+0000 7f467bfff700 1 -- 172.21.15.124:0/180585747 wait complete. 2023-10-06T04:45:20.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.199+0000 7f467bfff700 1 Processor -- start 2023-10-06T04:45:20.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.199+0000 7f467bfff700 1 -- start start 2023-10-06T04:45:20.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.200+0000 7f467bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46740ccbb0 0x7f46741569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.200+0000 7f467bfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46740ccf80 0x7f46740b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.200+0000 7f467bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 0x7f4674169590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.200+0000 7f467bfff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740c8230 con 0x7f46740cdfe0 2023-10-06T04:45:20.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.200+0000 7f467bfff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740c7660 con 0x7f46740ccbb0 2023-10-06T04:45:20.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.200+0000 7f467bfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4674156ef0 con 0x7f46740ccf80 2023-10-06T04:45:20.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467a59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 0x7f4674169590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:20.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467a59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 0x7f4674169590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44670/0 (socket says 172.21.15.124:44670) 2023-10-06T04:45:20.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467a59c700 1 -- 172.21.15.124:0/4224725779 learned_addr learned my addr 172.21.15.124:0/4224725779 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:20.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467959a700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46740ccf80 0x7f46740b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:20.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f4679d9b700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46740ccbb0 0x7f46741569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:20.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467a59c700 1 -- 172.21.15.124:0/4224725779 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46740ccf80 msgr2=0x7f46740b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467a59c700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46740ccf80 0x7f46740b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467a59c700 1 -- 172.21.15.124:0/4224725779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46740ccbb0 msgr2=0x7f46741569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467a59c700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46740ccbb0 0x7f46741569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467a59c700 1 -- 172.21.15.124:0/4224725779 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46640094f0 con 0x7f46740cdfe0 2023-10-06T04:45:20.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f4679d9b700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46740ccbb0 0x7f46741569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:20.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467a59c700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 0x7f4674169590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f466c00cd00 tx=0x7f466c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:20.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f4669ffb700 1 -- 172.21.15.124:0/4224725779 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c005df0 con 0x7f46740cdfe0 2023-10-06T04:45:20.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f4669ffb700 1 -- 172.21.15.124:0/4224725779 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c00a960 con 0x7f46740cdfe0 2023-10-06T04:45:20.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f4669ffb700 1 -- 172.21.15.124:0/4224725779 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c00ad00 con 0x7f46740cdfe0 2023-10-06T04:45:20.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.201+0000 7f467bfff700 1 -- 172.21.15.124:0/4224725779 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46740c7900 con 0x7f46740cdfe0 2023-10-06T04:45:20.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.202+0000 7f467bfff700 1 -- 172.21.15.124:0/4224725779 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46740c7ec0 con 0x7f46740cdfe0 2023-10-06T04:45:20.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.203+0000 7f467bfff700 1 -- 172.21.15.124:0/4224725779 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46740c83a0 con 0x7f46740cdfe0 2023-10-06T04:45:20.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.203+0000 7f4669ffb700 1 -- 172.21.15.124:0/4224725779 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f466c007300 con 0x7f46740cdfe0 2023-10-06T04:45:20.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.204+0000 7f4669ffb700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4658066f30 0x7f46580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.204+0000 7f4669ffb700 1 -- 172.21.15.124:0/4224725779 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f466c084520 con 0x7f46740cdfe0 2023-10-06T04:45:20.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.204+0000 7f4679d9b700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4658066f30 0x7f46580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:20.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.205+0000 7f4679d9b700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4658066f30 0x7f46580693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4670006fd0 tx=0x7f4670008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:20.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.208+0000 7f4669ffb700 1 -- 172.21.15.124:0/4224725779 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f466c051960 con 0x7f46740cdfe0 2023-10-06T04:45:20.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.400+0000 7f467bfff700 1 -- 172.21.15.124:0/4224725779 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46740717a0 con 0x7f46740cdfe0 2023-10-06T04:45:20.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.401+0000 7f4669ffb700 1 -- 172.21.15.124:0/4224725779 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+13794 (secure 0 0 0) 0x7f466c00ae60 con 0x7f46740cdfe0 2023-10-06T04:45:20.403 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:20.403 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":29,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:45:16.505447+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:20.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.403+0000 7f467bfff700 1 -- 172.21.15.124:0/4224725779 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4658066f30 msgr2=0x7f46580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.403+0000 7f467bfff700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4658066f30 0x7f46580693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4670006fd0 tx=0x7f4670008040 comp rx=0 tx=0).stop 2023-10-06T04:45:20.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.403+0000 7f467bfff700 1 -- 172.21.15.124:0/4224725779 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 msgr2=0x7f4674169590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.403+0000 7f467bfff700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 0x7f4674169590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f466c00cd00 tx=0x7f466c001b10 comp rx=0 tx=0).stop 2023-10-06T04:45:20.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.404+0000 7f467bfff700 1 -- 172.21.15.124:0/4224725779 shutdown_connections 2023-10-06T04:45:20.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.404+0000 7f467bfff700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46740cdfe0 0x7f4674169590 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.404+0000 7f467bfff700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46740ccbb0 0x7f46741569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.404+0000 7f467bfff700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4658066f30 0x7f46580693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.404+0000 7f467bfff700 1 --2- 172.21.15.124:0/4224725779 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46740ccf80 0x7f46740b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.404+0000 7f467bfff700 1 -- 172.21.15.124:0/4224725779 >> 172.21.15.124:0/4224725779 conn(0x7f4674099710 msgr2=0x7f4674158790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:20.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.404+0000 7f467bfff700 1 -- 172.21.15.124:0/4224725779 shutdown_connections 2023-10-06T04:45:20.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.404+0000 7f467bfff700 1 -- 172.21.15.124:0/4224725779 wait complete. 2023-10-06T04:45:20.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:45:20.423 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:45:20.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.615+0000 7f91b67ff700 1 Processor -- start 2023-10-06T04:45:20.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.615+0000 7f91b67ff700 1 -- start start 2023-10-06T04:45:20.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.616+0000 7f91b67ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f91b0159680 0x7f91b00b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.616+0000 7f91b67ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f91b00cc780 0x7f91b00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.616+0000 7f91b67ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b015d620 con 0x7f91b01592b0 2023-10-06T04:45:20.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.616+0000 7f91b67ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b015d0d0 con 0x7f91b00cc780 2023-10-06T04:45:20.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91b67ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b00b2ed0 con 0x7f91b0159680 2023-10-06T04:45:20.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91affff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f91b01592b0 0x7f91b015dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:59350/0 (socket says 172.21.15.124:59350) 2023-10-06T04:45:20.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91b4d9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f91b00cc780 0x7f91b00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:20.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91affff700 1 -- 172.21.15.124:0/2186516768 learned_addr learned my addr 172.21.15.124:0/2186516768 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:20.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91af7fe700 1 --2- 172.21.15.124:0/2186516768 >> v2:172.21.15.158:3300/0 conn(0x7f91b0159680 0x7f91b00b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:20.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91b4d9c700 1 -- 172.21.15.124:0/2186516768 >> v2:172.21.15.158:3300/0 conn(0x7f91b0159680 msgr2=0x7f91b00b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:20.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91b4d9c700 1 --2- 172.21.15.124:0/2186516768 >> v2:172.21.15.158:3300/0 conn(0x7f91b0159680 0x7f91b00b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91b4d9c700 1 -- 172.21.15.124:0/2186516768 >> v1:172.21.15.124:6789/0 conn(0x7f91b01592b0 legacy=0x7f91b015dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91b4d9c700 1 -- 172.21.15.124:0/2186516768 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b00ccbe0 con 0x7f91b00cc780 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91aeffd700 1 -- 172.21.15.124:0/2186516768 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656534670 0 0) 0x7f91b015d620 con 0x7f91b01592b0 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91af7fe700 1 --2- 172.21.15.124:0/2186516768 >> v2:172.21.15.158:3300/0 conn(0x7f91b0159680 0x7f91b00b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.617+0000 7f91b4d9c700 1 --2- 172.21.15.124:0/2186516768 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 0x7f91b00ccea0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f91b0063cf0 tx=0x7f91a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bf4c529b5b905c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91aeffd700 1 -- 172.21.15.124:0/2186516768 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a800e070 con 0x7f91b00cc780 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91aeffd700 1 -- 172.21.15.124:0/2186516768 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a800bc30 con 0x7f91b00cc780 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91aeffd700 1 -- 172.21.15.124:0/2186516768 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8012430 con 0x7f91b00cc780 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91b67ff700 1 -- 172.21.15.124:0/2186516768 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 msgr2=0x7f91b00ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91b67ff700 1 --2- 172.21.15.124:0/2186516768 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 0x7f91b00ccea0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f91b0063cf0 tx=0x7f91a8009780 comp rx=0 tx=0).stop 2023-10-06T04:45:20.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91b67ff700 1 -- 172.21.15.124:0/2186516768 shutdown_connections 2023-10-06T04:45:20.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91b67ff700 1 --2- 172.21.15.124:0/2186516768 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 0x7f91b00ccea0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91b67ff700 1 --2- 172.21.15.124:0/2186516768 >> v2:172.21.15.158:3300/0 conn(0x7f91b0159680 0x7f91b00b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91b67ff700 1 -- 172.21.15.124:0/2186516768 >> 172.21.15.124:0/2186516768 conn(0x7f91b006ed20 msgr2=0x7f91b006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:20.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91b67ff700 1 -- 172.21.15.124:0/2186516768 shutdown_connections 2023-10-06T04:45:20.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.618+0000 7f91b67ff700 1 -- 172.21.15.124:0/2186516768 wait complete. 2023-10-06T04:45:20.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.620+0000 7f91b67ff700 1 Processor -- start 2023-10-06T04:45:20.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.620+0000 7f91b67ff700 1 -- start start 2023-10-06T04:45:20.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91b67ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 0x7f91b00c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91b67ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b01592b0 0x7f91b0151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91b67ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91b0159680 0x7f91b015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91b67ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b01522c0 con 0x7f91b00cc780 2023-10-06T04:45:20.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91b67ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b015f0e0 con 0x7f91b0159680 2023-10-06T04:45:20.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91b67ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b0156030 con 0x7f91b01592b0 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91affff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 0x7f91b00c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91affff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 0x7f91b00c3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44682/0 (socket says 172.21.15.124:44682) 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91affff700 1 -- 172.21.15.124:0/1460816012 learned_addr learned my addr 172.21.15.124:0/1460816012 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91affff700 1 -- 172.21.15.124:0/1460816012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b01592b0 msgr2=0x7f91b0151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91affff700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b01592b0 0x7f91b0151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91affff700 1 -- 172.21.15.124:0/1460816012 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91b0159680 msgr2=0x7f91b015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91affff700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91b0159680 0x7f91b015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.621+0000 7f91affff700 1 -- 172.21.15.124:0/1460816012 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009a20 con 0x7f91b00cc780 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.622+0000 7f91affff700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 0x7f91b00c3f00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c7e0 tx=0x7f91a0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.622+0000 7f9197fff700 1 -- 172.21.15.124:0/1460816012 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0005b30 con 0x7f91b00cc780 2023-10-06T04:45:20.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.622+0000 7f9197fff700 1 -- 172.21.15.124:0/1460816012 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a0005c90 con 0x7f91b00cc780 2023-10-06T04:45:20.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.622+0000 7f91b67ff700 1 -- 172.21.15.124:0/1460816012 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b0156310 con 0x7f91b00cc780 2023-10-06T04:45:20.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.622+0000 7f9197fff700 1 -- 172.21.15.124:0/1460816012 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0007300 con 0x7f91b00cc780 2023-10-06T04:45:20.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.622+0000 7f91b67ff700 1 -- 172.21.15.124:0/1460816012 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b015b730 con 0x7f91b00cc780 2023-10-06T04:45:20.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.623+0000 7f91b67ff700 1 -- 172.21.15.124:0/1460816012 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b004c380 con 0x7f91b00cc780 2023-10-06T04:45:20.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.624+0000 7f9197fff700 1 -- 172.21.15.124:0/1460816012 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91a001b400 con 0x7f91b00cc780 2023-10-06T04:45:20.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.624+0000 7f9197fff700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f919c066f30 0x7f919c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:20.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.625+0000 7f9197fff700 1 -- 172.21.15.124:0/1460816012 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f91a0083f60 con 0x7f91b00cc780 2023-10-06T04:45:20.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.625+0000 7f91af7fe700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f919c066f30 0x7f919c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:20.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.625+0000 7f91af7fe700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f919c066f30 0x7f919c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f91a4006fd0 tx=0x7f91a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:20.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.629+0000 7f9197fff700 1 -- 172.21.15.124:0/1460816012 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91a00513a0 con 0x7f91b00cc780 2023-10-06T04:45:20.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.817+0000 7f91b67ff700 1 -- 172.21.15.124:0/1460816012 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f91b0156840 con 0x7f91b00cc780 2023-10-06T04:45:20.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.817+0000 7f9197fff700 1 -- 172.21.15.124:0/1460816012 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f91b0156840 con 0x7f91b00cc780 2023-10-06T04:45:20.819 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:45:20.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.819+0000 7f91b67ff700 1 -- 172.21.15.124:0/1460816012 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f919c066f30 msgr2=0x7f919c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f919c066f30 0x7f919c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f91a4006fd0 tx=0x7f91a4008040 comp rx=0 tx=0).stop 2023-10-06T04:45:20.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 -- 172.21.15.124:0/1460816012 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 msgr2=0x7f91b00c3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 0x7f91b00c3f00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c7e0 tx=0x7f91a0007df0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 -- 172.21.15.124:0/1460816012 shutdown_connections 2023-10-06T04:45:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91b0159680 0x7f91b015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91b00cc780 0x7f91b00c3f00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f919c066f30 0x7f919c0693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 --2- 172.21.15.124:0/1460816012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b01592b0 0x7f91b0151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 -- 172.21.15.124:0/1460816012 >> 172.21.15.124:0/1460816012 conn(0x7f91b006ed20 msgr2=0x7f91b00ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 -- 172.21.15.124:0/1460816012 shutdown_connections 2023-10-06T04:45:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:20.820+0000 7f91b67ff700 1 -- 172.21.15.124:0/1460816012 wait complete. 2023-10-06T04:45:20.839 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:45:21.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.029+0000 7f2aeefff700 1 Processor -- start 2023-10-06T04:45:21.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.029+0000 7f2aeefff700 1 -- start start 2023-10-06T04:45:21.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2aeefff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ae815dce0 0x7f2ae806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2aeefff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2ae806d5a0 0x7f2ae8069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2aeefff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae8068700 con 0x7f2ae8159480 2023-10-06T04:45:21.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2aeefff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae806da20 con 0x7f2ae806d5a0 2023-10-06T04:45:21.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2aeefff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae80c9030 con 0x7f2ae815dce0 2023-10-06T04:45:21.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2aecd9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2ae8159480 0x7f2ae80c8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:59358/0 (socket says 172.21.15.124:59358) 2023-10-06T04:45:21.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2aecd9b700 1 -- 172.21.15.124:0/1124288199 learned_addr learned my addr 172.21.15.124:0/1124288199 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:21.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2ae7fff700 1 --2- 172.21.15.124:0/1124288199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ae815dce0 0x7f2ae806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2aed59c700 1 --2- 172.21.15.124:0/1124288199 >> v2:172.21.15.158:3300/0 conn(0x7f2ae806d5a0 0x7f2ae8069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2ae77fe700 1 -- 172.21.15.124:0/1124288199 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750404291 0 0) 0x7f2ae8068700 con 0x7f2ae8159480 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2ae77fe700 1 -- 172.21.15.124:0/1124288199 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad8003570 con 0x7f2ae8159480 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.031+0000 7f2ae7fff700 1 -- 172.21.15.124:0/1124288199 >> v2:172.21.15.158:3300/0 conn(0x7f2ae806d5a0 msgr2=0x7f2ae8069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.032+0000 7f2ae7fff700 1 --2- 172.21.15.124:0/1124288199 >> v2:172.21.15.158:3300/0 conn(0x7f2ae806d5a0 0x7f2ae8069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.032+0000 7f2ae7fff700 1 -- 172.21.15.124:0/1124288199 >> v1:172.21.15.124:6789/0 conn(0x7f2ae8159480 legacy=0x7f2ae80c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.032+0000 7f2ae7fff700 1 -- 172.21.15.124:0/1124288199 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae8068950 con 0x7f2ae815dce0 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.032+0000 7f2aed59c700 1 --2- 172.21.15.124:0/1124288199 >> v2:172.21.15.158:3300/0 conn(0x7f2ae806d5a0 0x7f2ae8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.032+0000 7f2ae7fff700 1 --2- 172.21.15.124:0/1124288199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ae815dce0 0x7f2ae806d060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40098e0 tx=0x7f2ad40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6af30835479c708 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.032+0000 7f2ae77fe700 1 -- 172.21.15.124:0/1124288199 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4011630 con 0x7f2ae815dce0 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.032+0000 7f2ae77fe700 1 -- 172.21.15.124:0/1124288199 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad4011790 con 0x7f2ae815dce0 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.032+0000 7f2ae77fe700 1 -- 172.21.15.124:0/1124288199 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4011b30 con 0x7f2ae815dce0 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.033+0000 7f2aeefff700 1 -- 172.21.15.124:0/1124288199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ae815dce0 msgr2=0x7f2ae806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.033+0000 7f2aeefff700 1 --2- 172.21.15.124:0/1124288199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ae815dce0 0x7f2ae806d060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40098e0 tx=0x7f2ad40091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.033+0000 7f2aeefff700 1 -- 172.21.15.124:0/1124288199 shutdown_connections 2023-10-06T04:45:21.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.033+0000 7f2aeefff700 1 --2- 172.21.15.124:0/1124288199 >> v2:172.21.15.158:3300/0 conn(0x7f2ae806d5a0 0x7f2ae8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.033+0000 7f2aeefff700 1 --2- 172.21.15.124:0/1124288199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ae815dce0 0x7f2ae806d060 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.033+0000 7f2aeefff700 1 -- 172.21.15.124:0/1124288199 >> 172.21.15.124:0/1124288199 conn(0x7f2ae8063cc0 msgr2=0x7f2ae80ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:21.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.033+0000 7f2aeefff700 1 -- 172.21.15.124:0/1124288199 shutdown_connections 2023-10-06T04:45:21.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.033+0000 7f2aeefff700 1 -- 172.21.15.124:0/1124288199 wait complete. 2023-10-06T04:45:21.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.035+0000 7f2aeefff700 1 Processor -- start 2023-10-06T04:45:21.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.035+0000 7f2aeefff700 1 -- start start 2023-10-06T04:45:21.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.036+0000 7f2aeefff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ae806d5a0 0x7f2ae80c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.036+0000 7f2aeefff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ae8159480 0x7f2ae8154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.036+0000 7f2aeefff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ae815dce0 0x7f2ae80cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.036+0000 7f2aeefff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae8155c90 con 0x7f2ae815dce0 2023-10-06T04:45:21.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.036+0000 7f2aeefff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae8155f70 con 0x7f2ae806d5a0 2023-10-06T04:45:21.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.036+0000 7f2aeefff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae8156250 con 0x7f2ae8159480 2023-10-06T04:45:21.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2aed59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ae815dce0 0x7f2ae80cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2aed59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ae815dce0 0x7f2ae80cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44686/0 (socket says 172.21.15.124:44686) 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2aed59c700 1 -- 172.21.15.124:0/669664222 learned_addr learned my addr 172.21.15.124:0/669664222 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2aed59c700 1 -- 172.21.15.124:0/669664222 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ae8159480 msgr2=0x7f2ae8154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2aed59c700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ae8159480 0x7f2ae8154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2aed59c700 1 -- 172.21.15.124:0/669664222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ae806d5a0 msgr2=0x7f2ae80c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2aed59c700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ae806d5a0 0x7f2ae80c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2aed59c700 1 -- 172.21.15.124:0/669664222 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0009a20 con 0x7f2ae815dce0 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2aed59c700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ae815dce0 0x7f2ae80cbdd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009f20 tx=0x7f2ae000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2ae4ff9700 1 -- 172.21.15.124:0/669664222 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0009c80 con 0x7f2ae815dce0 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2ae4ff9700 1 -- 172.21.15.124:0/669664222 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae000f040 con 0x7f2ae815dce0 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.037+0000 7f2ae4ff9700 1 -- 172.21.15.124:0/669664222 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0014480 con 0x7f2ae815dce0 2023-10-06T04:45:21.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.038+0000 7f2aeefff700 1 -- 172.21.15.124:0/669664222 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad4009420 con 0x7f2ae815dce0 2023-10-06T04:45:21.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.038+0000 7f2aeefff700 1 -- 172.21.15.124:0/669664222 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae8156810 con 0x7f2ae815dce0 2023-10-06T04:45:21.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.039+0000 7f2aeefff700 1 -- 172.21.15.124:0/669664222 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae806c780 con 0x7f2ae815dce0 2023-10-06T04:45:21.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.039+0000 7f2ae4ff9700 1 -- 172.21.15.124:0/669664222 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ae0003020 con 0x7f2ae815dce0 2023-10-06T04:45:21.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.040+0000 7f2ae4ff9700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2acc066f30 0x7f2acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.040+0000 7f2ae4ff9700 1 -- 172.21.15.124:0/669664222 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2ae0084d80 con 0x7f2ae815dce0 2023-10-06T04:45:21.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.041+0000 7f2aecd9b700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2acc066f30 0x7f2acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.041+0000 7f2aecd9b700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2acc066f30 0x7f2acc0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0058d0 tx=0x7f2adc0079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:21.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.044+0000 7f2ae4ff9700 1 -- 172.21.15.124:0/669664222 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ae0052140 con 0x7f2ae815dce0 2023-10-06T04:45:21.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.233+0000 7f2aeefff700 1 -- 172.21.15.124:0/669664222 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ae8156a00 con 0x7f2ae815dce0 2023-10-06T04:45:21.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.233+0000 7f2ae4ff9700 1 -- 172.21.15.124:0/669664222 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ae0055760 con 0x7f2ae815dce0 2023-10-06T04:45:21.235 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:45:21.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 -- 172.21.15.124:0/669664222 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2acc066f30 msgr2=0x7f2acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2acc066f30 0x7f2acc0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0058d0 tx=0x7f2adc0079d0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 -- 172.21.15.124:0/669664222 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ae815dce0 msgr2=0x7f2ae80cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ae815dce0 0x7f2ae80cbdd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009f20 tx=0x7f2ae000b040 comp rx=0 tx=0).stop 2023-10-06T04:45:21.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 -- 172.21.15.124:0/669664222 shutdown_connections 2023-10-06T04:45:21.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ae815dce0 0x7f2ae80cbdd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ae806d5a0 0x7f2ae80c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2acc066f30 0x7f2acc0693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 --2- 172.21.15.124:0/669664222 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ae8159480 0x7f2ae8154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 -- 172.21.15.124:0/669664222 >> 172.21.15.124:0/669664222 conn(0x7f2ae8063cc0 msgr2=0x7f2ae80ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:21.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 -- 172.21.15.124:0/669664222 shutdown_connections 2023-10-06T04:45:21.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.235+0000 7f2aeefff700 1 -- 172.21.15.124:0/669664222 wait complete. 2023-10-06T04:45:21.254 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:45:21.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.442+0000 7f547cfff700 1 Processor -- start 2023-10-06T04:45:21.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.442+0000 7f547cfff700 1 -- start start 2023-10-06T04:45:21.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.443+0000 7f547cfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54780cdfe0 0x7f54780ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.443+0000 7f547cfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54780ccf80 0x7f54780cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.443+0000 7f547cfff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54780cf6b0 con 0x7f54780ccbb0 2023-10-06T04:45:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.443+0000 7f547cfff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54780d0250 con 0x7f54780ccf80 2023-10-06T04:45:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.443+0000 7f547cfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54780ceaa0 con 0x7f54780cdfe0 2023-10-06T04:45:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.444+0000 7f5476d9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54780ccf80 0x7f54780cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.444+0000 7f5476d9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54780ccf80 0x7f54780cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44698/0 (socket says 172.21.15.124:44698) 2023-10-06T04:45:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.444+0000 7f5476d9d700 1 -- 172.21.15.124:0/3352028080 learned_addr learned my addr 172.21.15.124:0/3352028080 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.444+0000 7f546dd9b700 1 --2- 172.21.15.124:0/3352028080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54780cdfe0 0x7f54780ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.444+0000 7f5476d9d700 1 -- 172.21.15.124:0/3352028080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54780cdfe0 msgr2=0x7f54780ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.444+0000 7f5476d9d700 1 --2- 172.21.15.124:0/3352028080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54780cdfe0 0x7f54780ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.444+0000 7f5476d9d700 1 -- 172.21.15.124:0/3352028080 >> v1:172.21.15.158:6789/0 conn(0x7f54780ccbb0 legacy=0x7f54780cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.444+0000 7f5476d9d700 1 -- 172.21.15.124:0/3352028080 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54780ced80 con 0x7f54780ccf80 2023-10-06T04:45:21.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.444+0000 7f5476d9d700 1 --2- 172.21.15.124:0/3352028080 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780ccf80 0x7f54780cd400 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5470009f20 tx=0x7f5470009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4f9d55cc8896ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:21.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f5475d9b700 1 -- 172.21.15.124:0/3352028080 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000e070 con 0x7f54780ccf80 2023-10-06T04:45:21.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f5475d9b700 1 -- 172.21.15.124:0/3352028080 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547000b9d0 con 0x7f54780ccf80 2023-10-06T04:45:21.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f5475d9b700 1 -- 172.21.15.124:0/3352028080 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700092e0 con 0x7f54780ccf80 2023-10-06T04:45:21.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f547cfff700 1 -- 172.21.15.124:0/3352028080 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780ccf80 msgr2=0x7f54780cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f547cfff700 1 --2- 172.21.15.124:0/3352028080 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780ccf80 0x7f54780cd400 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5470009f20 tx=0x7f5470009840 comp rx=0 tx=0).stop 2023-10-06T04:45:21.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f547cfff700 1 -- 172.21.15.124:0/3352028080 shutdown_connections 2023-10-06T04:45:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f547cfff700 1 --2- 172.21.15.124:0/3352028080 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780ccf80 0x7f54780cd400 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f547cfff700 1 --2- 172.21.15.124:0/3352028080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54780cdfe0 0x7f54780ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f547cfff700 1 -- 172.21.15.124:0/3352028080 >> 172.21.15.124:0/3352028080 conn(0x7f5478099710 msgr2=0x7f547806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f547cfff700 1 -- 172.21.15.124:0/3352028080 shutdown_connections 2023-10-06T04:45:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.445+0000 7f547cfff700 1 -- 172.21.15.124:0/3352028080 wait complete. 2023-10-06T04:45:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.447+0000 7f547cfff700 1 Processor -- start 2023-10-06T04:45:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.447+0000 7f547cfff700 1 -- start start 2023-10-06T04:45:21.451 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f547cfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54780ccbb0 0x7f54780b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.451 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f547cfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54780ccf80 0x7f5478154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.451 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f547cfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780cdfe0 0x7f547814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.451 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f547cfff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5478169e80 con 0x7f54780cdfe0 2023-10-06T04:45:21.451 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f547cfff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5478169000 con 0x7f54780ccbb0 2023-10-06T04:45:21.451 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f547cfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5478169270 con 0x7f54780ccf80 2023-10-06T04:45:21.451 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f5476d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780cdfe0 0x7f547814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f5476d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780cdfe0 0x7f547814ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44714/0 (socket says 172.21.15.124:44714) 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f5476d9d700 1 -- 172.21.15.124:0/827515576 learned_addr learned my addr 172.21.15.124:0/827515576 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f546dd9b700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54780ccf80 0x7f5478154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.448+0000 7f547659c700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54780ccbb0 0x7f54780b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f5476d9d700 1 -- 172.21.15.124:0/827515576 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54780ccf80 msgr2=0x7f5478154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f5476d9d700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54780ccf80 0x7f5478154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f5476d9d700 1 -- 172.21.15.124:0/827515576 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54780ccbb0 msgr2=0x7f54780b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f5476d9d700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54780ccbb0 0x7f54780b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f5476d9d700 1 -- 172.21.15.124:0/827515576 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470009ae0 con 0x7f54780cdfe0 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f5476d9d700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780cdfe0 0x7f547814ee00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f547000b610 tx=0x7f5470018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f546effd700 1 -- 172.21.15.124:0/827515576 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470008c40 con 0x7f54780cdfe0 2023-10-06T04:45:21.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f546effd700 1 -- 172.21.15.124:0/827515576 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470008dc0 con 0x7f54780cdfe0 2023-10-06T04:45:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f547cfff700 1 -- 172.21.15.124:0/827515576 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5478169550 con 0x7f54780cdfe0 2023-10-06T04:45:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f546effd700 1 -- 172.21.15.124:0/827515576 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700266b0 con 0x7f54780cdfe0 2023-10-06T04:45:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.449+0000 7f547cfff700 1 -- 172.21.15.124:0/827515576 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5478169b10 con 0x7f54780cdfe0 2023-10-06T04:45:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.450+0000 7f547cfff700 1 -- 172.21.15.124:0/827515576 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547816a030 con 0x7f54780cdfe0 2023-10-06T04:45:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.451+0000 7f546effd700 1 -- 172.21.15.124:0/827515576 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5470003040 con 0x7f54780cdfe0 2023-10-06T04:45:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.452+0000 7f546effd700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5458066f30 0x7f54580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.452+0000 7f546effd700 1 -- 172.21.15.124:0/827515576 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f54700863e0 con 0x7f54780cdfe0 2023-10-06T04:45:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.452+0000 7f547659c700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5458066f30 0x7f54580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.453+0000 7f547659c700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5458066f30 0x7f54580693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5478151ce0 tx=0x7f5468009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:21.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.456+0000 7f546effd700 1 -- 172.21.15.124:0/827515576 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5470053840 con 0x7f54780cdfe0 2023-10-06T04:45:21.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.650+0000 7f547cfff700 1 -- 172.21.15.124:0/827515576 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f54780717a0 con 0x7f54780cdfe0 2023-10-06T04:45:21.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.650+0000 7f546effd700 1 -- 172.21.15.124:0/827515576 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5470008f30 con 0x7f54780cdfe0 2023-10-06T04:45:21.652 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:21.652 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2023-10-06T04:45:21.652 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:21.652 INFO:teuthology.orchestra.run.smithi124.stdout: "poolnum": 1, 2023-10-06T04:45:21.652 INFO:teuthology.orchestra.run.smithi124.stdout: "poolname": "rbd" 2023-10-06T04:45:21.652 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:21.652 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:21.653 INFO:teuthology.orchestra.run.smithi124.stdout: "poolnum": 2, 2023-10-06T04:45:21.653 INFO:teuthology.orchestra.run.smithi124.stdout: "poolname": ".mgr" 2023-10-06T04:45:21.653 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:21.653 INFO:teuthology.orchestra.run.smithi124.stdout:] 2023-10-06T04:45:21.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.652+0000 7f547cfff700 1 -- 172.21.15.124:0/827515576 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5458066f30 msgr2=0x7f54580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.652+0000 7f547cfff700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5458066f30 0x7f54580693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5478151ce0 tx=0x7f5468009040 comp rx=0 tx=0).stop 2023-10-06T04:45:21.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.652+0000 7f547cfff700 1 -- 172.21.15.124:0/827515576 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780cdfe0 msgr2=0x7f547814ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.652+0000 7f547cfff700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780cdfe0 0x7f547814ee00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f547000b610 tx=0x7f5470018000 comp rx=0 tx=0).stop 2023-10-06T04:45:21.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.652+0000 7f547cfff700 1 -- 172.21.15.124:0/827515576 shutdown_connections 2023-10-06T04:45:21.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.652+0000 7f547cfff700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54780cdfe0 0x7f547814ee00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.653+0000 7f547cfff700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54780ccbb0 0x7f54780b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.653+0000 7f547cfff700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5458066f30 0x7f54580693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.653+0000 7f547cfff700 1 --2- 172.21.15.124:0/827515576 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54780ccf80 0x7f5478154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.653+0000 7f547cfff700 1 -- 172.21.15.124:0/827515576 >> 172.21.15.124:0/827515576 conn(0x7f5478099710 msgr2=0x7f54780ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:21.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.653+0000 7f547cfff700 1 -- 172.21.15.124:0/827515576 shutdown_connections 2023-10-06T04:45:21.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.653+0000 7f547cfff700 1 -- 172.21.15.124:0/827515576 wait complete. 2023-10-06T04:45:21.671 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:45:21.672 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:45:21.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.863+0000 7efc115ff700 1 Processor -- start 2023-10-06T04:45:21.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.864+0000 7efc115ff700 1 -- start start 2023-10-06T04:45:21.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.865+0000 7efc115ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c0cc5e0 0x7efc0c06b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.865+0000 7efc115ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c06c2e0 con 0x7efc0c15d260 2023-10-06T04:45:21.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.865+0000 7efc115ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c0cc270 con 0x7efc0c06beb0 2023-10-06T04:45:21.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.865+0000 7efc115ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c06dcb0 con 0x7efc0c0cc5e0 2023-10-06T04:45:21.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.865+0000 7efc0a7fc700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7efc0c15d260 0x7efc0c06ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:59368/0 (socket says 172.21.15.124:59368) 2023-10-06T04:45:21.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.865+0000 7efc0a7fc700 1 -- 172.21.15.124:0/2246551052 learned_addr learned my addr 172.21.15.124:0/2246551052 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:21.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.865+0000 7efc0affd700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c0cc5e0 0x7efc0c06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.865+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720187975 0 0) 0x7efc0c06c2e0 con 0x7efc0c15d260 2023-10-06T04:45:21.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf4003570 con 0x7efc0c15d260 2023-10-06T04:45:21.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2682633973 0 0) 0x7efbf4003570 con 0x7efc0c15d260 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c0cc5e0 msgr2=0x7efc0c06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c0cc5e0 0x7efc0c06b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 >> v1:172.21.15.158:6789/0 conn(0x7efc0c06beb0 legacy=0x7efc0c06d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c15d740 con 0x7efc0c15d260 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7efc00001470 con 0x7efc0c15d260 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 >> v1:172.21.15.124:6789/0 conn(0x7efc0c15d260 legacy=0x7efc0c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c0cc5e0 0x7efbf4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efbf4003fd0 0x7efbf4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efbf4004d50 0x7efbf40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c06dcb0 con 0x7efbf4003fd0 2023-10-06T04:45:21.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf400bba0 con 0x7efbf4004d50 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf400bd60 con 0x7efc0c0cc5e0 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc0a7fc700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efbf4003fd0 0x7efbf4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc0b7fe700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efbf4004d50 0x7efbf40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.866+0000 7efc0affd700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c0cc5e0 0x7efbf4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.867+0000 7efc0a7fc700 1 -- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c0cc5e0 msgr2=0x7efbf4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.867+0000 7efc0a7fc700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c0cc5e0 0x7efbf4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.867+0000 7efc0a7fc700 1 -- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efbf4004d50 msgr2=0x7efbf40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.867+0000 7efc0a7fc700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efbf4004d50 0x7efbf40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.867+0000 7efc0a7fc700 1 -- 172.21.15.124:0/2246551052 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf4003570 con 0x7efbf4003fd0 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.867+0000 7efc0a7fc700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efbf4003fd0 0x7efbf4004810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c2a0 tx=0x7efc00001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fbb894c83b6b9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.867+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000cb70 con 0x7efbf4003fd0 2023-10-06T04:45:21.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.867+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0000ccd0 con 0x7efbf4003fd0 2023-10-06T04:45:21.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.867+0000 7efc09ffb700 1 -- 172.21.15.124:0/2246551052 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00005b70 con 0x7efbf4003fd0 2023-10-06T04:45:21.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.868+0000 7efc115ff700 1 -- 172.21.15.124:0/2246551052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efbf4003fd0 msgr2=0x7efbf4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.868+0000 7efc115ff700 1 --2- 172.21.15.124:0/2246551052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efbf4003fd0 0x7efbf4004810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c2a0 tx=0x7efc00001da0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.868+0000 7efc0b7fe700 1 -- 172.21.15.124:0/2246551052 reap_dead start 2023-10-06T04:45:21.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.868+0000 7efc115ff700 1 -- 172.21.15.124:0/2246551052 shutdown_connections 2023-10-06T04:45:21.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.868+0000 7efc115ff700 1 -- 172.21.15.124:0/2246551052 >> 172.21.15.124:0/2246551052 conn(0x7efc0c0ce400 msgr2=0x7efc0c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:21.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.868+0000 7efc115ff700 1 -- 172.21.15.124:0/2246551052 shutdown_connections 2023-10-06T04:45:21.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.868+0000 7efc115ff700 1 -- 172.21.15.124:0/2246551052 wait complete. 2023-10-06T04:45:21.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.869+0000 7efc115ff700 1 Processor -- start 2023-10-06T04:45:21.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.869+0000 7efc115ff700 1 -- start start 2023-10-06T04:45:21.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.870+0000 7efc115ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efbf4003fd0 0x7efc0c13be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.870+0000 7efc115ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc0c0b11a0 0x7efc0c0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.870+0000 7efc115ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c157150 0x7efc0c1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.870+0000 7efc115ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c157b30 con 0x7efc0c0b11a0 2023-10-06T04:45:21.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.870+0000 7efc115ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c13c3b0 con 0x7efbf4003fd0 2023-10-06T04:45:21.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.870+0000 7efc115ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0cb150 con 0x7efc0c157150 2023-10-06T04:45:21.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.870+0000 7efc0a7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc0c0b11a0 0x7efc0c0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.870+0000 7efc0a7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc0c0b11a0 0x7efc0c0cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44736/0 (socket says 172.21.15.124:44736) 2023-10-06T04:45:21.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.870+0000 7efc0a7fc700 1 -- 172.21.15.124:0/396884168 learned_addr learned my addr 172.21.15.124:0/396884168 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:21.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc0affd700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efbf4003fd0 0x7efc0c13be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc0b7fe700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c157150 0x7efc0c1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc0a7fc700 1 -- 172.21.15.124:0/396884168 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c157150 msgr2=0x7efc0c1575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc0a7fc700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c157150 0x7efc0c1575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc0a7fc700 1 -- 172.21.15.124:0/396884168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efbf4003fd0 msgr2=0x7efc0c13be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:21.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc0a7fc700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efbf4003fd0 0x7efc0c13be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:21.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc0a7fc700 1 -- 172.21.15.124:0/396884168 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0b2290 con 0x7efc0c0b11a0 2023-10-06T04:45:21.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc0b7fe700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c157150 0x7efc0c1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:21.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc0affd700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efbf4003fd0 0x7efc0c13be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:21.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc0a7fc700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc0c0b11a0 0x7efc0c0cac10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c890 tx=0x7efc00015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:21.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efbf2ffd700 1 -- 172.21.15.124:0/396884168 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00001da0 con 0x7efc0c0b11a0 2023-10-06T04:45:21.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efbf2ffd700 1 -- 172.21.15.124:0/396884168 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0000c8c0 con 0x7efc0c0b11a0 2023-10-06T04:45:21.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efbf2ffd700 1 -- 172.21.15.124:0/396884168 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00007550 con 0x7efc0c0b11a0 2023-10-06T04:45:21.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc115ff700 1 -- 172.21.15.124:0/396884168 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c0ca000 con 0x7efc0c0b11a0 2023-10-06T04:45:21.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.871+0000 7efc115ff700 1 -- 172.21.15.124:0/396884168 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c0b1960 con 0x7efc0c0b11a0 2023-10-06T04:45:21.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.872+0000 7efc115ff700 1 -- 172.21.15.124:0/396884168 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c0b2420 con 0x7efc0c0b11a0 2023-10-06T04:45:21.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.873+0000 7efbf2ffd700 1 -- 172.21.15.124:0/396884168 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc00019030 con 0x7efc0c0b11a0 2023-10-06T04:45:21.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.874+0000 7efbf2ffd700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efbf8066f30 0x7efbf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:21.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.874+0000 7efbf2ffd700 1 -- 172.21.15.124:0/396884168 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efc00085b90 con 0x7efc0c0b11a0 2023-10-06T04:45:21.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.875+0000 7efc0affd700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efbf8066f30 0x7efbf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:21.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.875+0000 7efc0affd700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efbf8066f30 0x7efbf80693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efbfc006aa0 tx=0x7efbfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:21.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:21.878+0000 7efbf2ffd700 1 -- 172.21.15.124:0/396884168 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc00052f50 con 0x7efc0c0b11a0 2023-10-06T04:45:22.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:22.072+0000 7efc115ff700 1 -- 172.21.15.124:0/396884168 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efc0c0718b0 con 0x7efc0c0b11a0 2023-10-06T04:45:23.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.017+0000 7efbf2ffd700 1 -- 172.21.15.124:0/396884168 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7efc00056570 con 0x7efc0c0b11a0 2023-10-06T04:45:23.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 -- 172.21.15.124:0/396884168 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efbf8066f30 msgr2=0x7efbf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efbf8066f30 0x7efbf80693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efbfc006aa0 tx=0x7efbfc008040 comp rx=0 tx=0).stop 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 -- 172.21.15.124:0/396884168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc0c0b11a0 msgr2=0x7efc0c0cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc0c0b11a0 0x7efc0c0cac10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c890 tx=0x7efc00015000 comp rx=0 tx=0).stop 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 -- 172.21.15.124:0/396884168 shutdown_connections 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efbf8066f30 0x7efbf80693e0 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efbfc006aa0 tx=0x7efbfc008040 comp rx=0 tx=0).stop 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc0c157150 0x7efc0c1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efbf4003fd0 0x7efc0c13be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 --2- 172.21.15.124:0/396884168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc0c0b11a0 0x7efc0c0cac10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 -- 172.21.15.124:0/396884168 >> 172.21.15.124:0/396884168 conn(0x7efc0c0ce400 msgr2=0x7efc0c15fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 -- 172.21.15.124:0/396884168 shutdown_connections 2023-10-06T04:45:23.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.026+0000 7efc115ff700 1 -- 172.21.15.124:0/396884168 wait complete. 2023-10-06T04:45:23.029 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' created 2023-10-06T04:45:23.048 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:45:23.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.246+0000 7f931c1ff700 1 Processor -- start 2023-10-06T04:45:23.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.246+0000 7f931c1ff700 1 -- start start 2023-10-06T04:45:23.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.247+0000 7f931c1ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9314155800 0x7f93140694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:23.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.247+0000 7f931c1ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931406e240 con 0x7f93140ae6f0 2023-10-06T04:45:23.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.247+0000 7f931c1ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931406d630 con 0x7f93141596c0 2023-10-06T04:45:23.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.247+0000 7f931c1ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931406d910 con 0x7f9314155800 2023-10-06T04:45:23.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.248+0000 7f9319f9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9314155800 0x7f93140694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:23.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.248+0000 7f931a79c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f93140ae6f0 0x7f93141579a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35248/0 (socket says 172.21.15.124:35248) 2023-10-06T04:45:23.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.248+0000 7f9319f9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9314155800 0x7f93140694c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48150/0 (socket says 172.21.15.124:48150) 2023-10-06T04:45:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.248+0000 7f931a79c700 1 -- 172.21.15.124:0/1152273634 learned_addr learned my addr 172.21.15.124:0/1152273634 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:23.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.248+0000 7f9319f9b700 1 -- 172.21.15.124:0/1152273634 >> v1:172.21.15.158:6789/0 conn(0x7f93141596c0 legacy=0x7f9314157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:23.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.248+0000 7f9318f99700 1 -- 172.21.15.124:0/1152273634 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851954861 0 0) 0x7f931406e240 con 0x7f93140ae6f0 2023-10-06T04:45:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.248+0000 7f9319f9b700 1 -- 172.21.15.124:0/1152273634 >> v1:172.21.15.124:6789/0 conn(0x7f93140ae6f0 legacy=0x7f93141579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.248+0000 7f9319f9b700 1 -- 172.21.15.124:0/1152273634 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931406dbf0 con 0x7f9314155800 2023-10-06T04:45:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.249+0000 7f9319f9b700 1 --2- 172.21.15.124:0/1152273634 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 0x7f93140694c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f93100098e0 tx=0x7f93100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70d6f3c29d19a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.249+0000 7f9318f99700 1 -- 172.21.15.124:0/1152273634 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310009e80 con 0x7f9314155800 2023-10-06T04:45:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.249+0000 7f9318f99700 1 -- 172.21.15.124:0/1152273634 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931000b860 con 0x7f9314155800 2023-10-06T04:45:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.249+0000 7f9318f99700 1 -- 172.21.15.124:0/1152273634 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931000bbe0 con 0x7f9314155800 2023-10-06T04:45:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.249+0000 7f931c1ff700 1 -- 172.21.15.124:0/1152273634 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 msgr2=0x7f93140694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.249+0000 7f931c1ff700 1 --2- 172.21.15.124:0/1152273634 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 0x7f93140694c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f93100098e0 tx=0x7f93100091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.249+0000 7f931c1ff700 1 -- 172.21.15.124:0/1152273634 shutdown_connections 2023-10-06T04:45:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.249+0000 7f931c1ff700 1 --2- 172.21.15.124:0/1152273634 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 0x7f93140694c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.249+0000 7f931c1ff700 1 -- 172.21.15.124:0/1152273634 >> 172.21.15.124:0/1152273634 conn(0x7f93140680c0 msgr2=0x7f93140cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.249+0000 7f931c1ff700 1 -- 172.21.15.124:0/1152273634 shutdown_connections 2023-10-06T04:45:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.250+0000 7f931c1ff700 1 -- 172.21.15.124:0/1152273634 wait complete. 2023-10-06T04:45:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.251+0000 7f931c1ff700 1 Processor -- start 2023-10-06T04:45:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.251+0000 7f931c1ff700 1 -- start start 2023-10-06T04:45:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.252+0000 7f931c1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93140ae6f0 0x7f93140c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.252+0000 7f931c1ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 0x7f93140c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.252+0000 7f931c1ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93141596c0 0x7f9314147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.252+0000 7f931c1ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314159250 con 0x7f9314155800 2023-10-06T04:45:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.252+0000 7f931c1ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314158c90 con 0x7f93141596c0 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.252+0000 7f931c1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9314158f70 con 0x7f93140ae6f0 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.252+0000 7f931979a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 0x7f93140c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.252+0000 7f931979a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 0x7f93140c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48166/0 (socket says 172.21.15.124:48166) 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.252+0000 7f931979a700 1 -- 172.21.15.124:0/2070606211 learned_addr learned my addr 172.21.15.124:0/2070606211 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f931a79c700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93141596c0 0x7f9314147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f9319f9b700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93140ae6f0 0x7f93140c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f931979a700 1 -- 172.21.15.124:0/2070606211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93140ae6f0 msgr2=0x7f93140c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f931979a700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93140ae6f0 0x7f93140c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f931979a700 1 -- 172.21.15.124:0/2070606211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93141596c0 msgr2=0x7f9314147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f931979a700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93141596c0 0x7f9314147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f931979a700 1 -- 172.21.15.124:0/2070606211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9310009420 con 0x7f9314155800 2023-10-06T04:45:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f931a79c700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93141596c0 0x7f9314147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f931979a700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 0x7f93140c9d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f930400c4e0 tx=0x7f930400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f9309ffb700 1 -- 172.21.15.124:0/2070606211 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304011590 con 0x7f9314155800 2023-10-06T04:45:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f9309ffb700 1 -- 172.21.15.124:0/2070606211 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9304011710 con 0x7f9314155800 2023-10-06T04:45:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f931c1ff700 1 -- 172.21.15.124:0/2070606211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9314155c70 con 0x7f9314155800 2023-10-06T04:45:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f9309ffb700 1 -- 172.21.15.124:0/2070606211 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304011ad0 con 0x7f9314155800 2023-10-06T04:45:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.253+0000 7f931c1ff700 1 -- 172.21.15.124:0/2070606211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93140c5e40 con 0x7f9314155800 2023-10-06T04:45:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.254+0000 7f931c1ff700 1 -- 172.21.15.124:0/2070606211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9314064850 con 0x7f9314155800 2023-10-06T04:45:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.255+0000 7f9309ffb700 1 -- 172.21.15.124:0/2070606211 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f930401b3b0 con 0x7f9314155800 2023-10-06T04:45:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.256+0000 7f9309ffb700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f92f8066f30 0x7f92f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.256+0000 7f9309ffb700 1 -- 172.21.15.124:0/2070606211 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f9304083a90 con 0x7f9314155800 2023-10-06T04:45:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.256+0000 7f9319f9b700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f92f8066f30 0x7f92f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.257+0000 7f9319f9b700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f92f8066f30 0x7f92f80693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f93100093f0 tx=0x7f9310017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:23.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.261+0000 7f9309ffb700 1 -- 172.21.15.124:0/2070606211 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9304050ce0 con 0x7f9314155800 2023-10-06T04:45:23.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:23.451+0000 7f931c1ff700 1 -- 172.21.15.124:0/2070606211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f931404c380 con 0x7f9314155800 2023-10-06T04:45:24.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.024+0000 7f9309ffb700 1 -- 172.21.15.124:0/2070606211 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9304017070 con 0x7f9314155800 2023-10-06T04:45:24.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.029+0000 7f931c1ff700 1 -- 172.21.15.124:0/2070606211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f92f8066f30 msgr2=0x7f92f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:24.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.029+0000 7f931c1ff700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f92f8066f30 0x7f92f80693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f93100093f0 tx=0x7f9310017000 comp rx=0 tx=0).stop 2023-10-06T04:45:24.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.029+0000 7f931c1ff700 1 -- 172.21.15.124:0/2070606211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 msgr2=0x7f93140c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:24.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.029+0000 7f931c1ff700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 0x7f93140c9d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f930400c4e0 tx=0x7f930400c8a0 comp rx=0 tx=0).stop 2023-10-06T04:45:24.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.031+0000 7f931c1ff700 1 -- 172.21.15.124:0/2070606211 shutdown_connections 2023-10-06T04:45:24.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.031+0000 7f931c1ff700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93141596c0 0x7f9314147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:24.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.031+0000 7f931c1ff700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f92f8066f30 0x7f92f80693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:24.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.031+0000 7f931c1ff700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93140ae6f0 0x7f93140c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:24.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.031+0000 7f931c1ff700 1 --2- 172.21.15.124:0/2070606211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9314155800 0x7f93140c9d90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:24.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.031+0000 7f931c1ff700 1 -- 172.21.15.124:0/2070606211 >> 172.21.15.124:0/2070606211 conn(0x7f93140680c0 msgr2=0x7f93140cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:24.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.032+0000 7f931c1ff700 1 -- 172.21.15.124:0/2070606211 shutdown_connections 2023-10-06T04:45:24.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.033+0000 7f931c1ff700 1 -- 172.21.15.124:0/2070606211 wait complete. 2023-10-06T04:45:24.045 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' created 2023-10-06T04:45:24.064 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:45:24.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.257+0000 7ff0f5bff700 1 Processor -- start 2023-10-06T04:45:24.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.257+0000 7ff0f5bff700 1 -- start start 2023-10-06T04:45:24.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.258+0000 7ff0f5bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff0f0068600 0x7ff0f006a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:24.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.258+0000 7ff0f5bff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff0f00aa0c0 0x7ff0f0159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:24.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.258+0000 7ff0f5bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f015df90 con 0x7ff0f00a9cf0 2023-10-06T04:45:24.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.258+0000 7ff0f5bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f00ab310 con 0x7ff0f0068600 2023-10-06T04:45:24.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.258+0000 7ff0f5bff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f015d380 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.258+0000 7ff0eeffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff0f0068600 0x7ff0f006a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:24.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.258+0000 7ff0eeffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff0f0068600 0x7ff0f006a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48176/0 (socket says 172.21.15.124:48176) 2023-10-06T04:45:24.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.258+0000 7ff0eeffd700 1 -- 172.21.15.124:0/2209724731 learned_addr learned my addr 172.21.15.124:0/2209724731 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:24.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.259+0000 7ff0effff700 1 --2- 172.21.15.124:0/2209724731 >> v2:172.21.15.158:3300/0 conn(0x7ff0f00aa0c0 0x7ff0f0159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:24.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.259+0000 7ff0eeffd700 1 -- 172.21.15.124:0/2209724731 >> v2:172.21.15.158:3300/0 conn(0x7ff0f00aa0c0 msgr2=0x7ff0f0159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:24.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.259+0000 7ff0eeffd700 1 --2- 172.21.15.124:0/2209724731 >> v2:172.21.15.158:3300/0 conn(0x7ff0f00aa0c0 0x7ff0f0159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:24.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.259+0000 7ff0eeffd700 1 -- 172.21.15.124:0/2209724731 >> v1:172.21.15.158:6789/0 conn(0x7ff0f00a9cf0 legacy=0x7ff0f0069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:24.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.259+0000 7ff0eeffd700 1 -- 172.21.15.124:0/2209724731 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f015d660 con 0x7ff0f0068600 2023-10-06T04:45:24.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.259+0000 7ff0eeffd700 1 --2- 172.21.15.124:0/2209724731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f0068600 0x7ff0f006a690 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00aad90 tx=0x7ff0e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65eb695b6cf7f7bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:24.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.259+0000 7ff0ee7fc700 1 -- 172.21.15.124:0/2209724731 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400b860 con 0x7ff0f0068600 2023-10-06T04:45:24.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.259+0000 7ff0ee7fc700 1 -- 172.21.15.124:0/2209724731 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e400b9c0 con 0x7ff0f0068600 2023-10-06T04:45:24.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.259+0000 7ff0ee7fc700 1 -- 172.21.15.124:0/2209724731 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400bd60 con 0x7ff0f0068600 2023-10-06T04:45:24.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.260+0000 7ff0f5bff700 1 -- 172.21.15.124:0/2209724731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f0068600 msgr2=0x7ff0f006a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:24.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.260+0000 7ff0f5bff700 1 --2- 172.21.15.124:0/2209724731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f0068600 0x7ff0f006a690 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00aad90 tx=0x7ff0e4009250 comp rx=0 tx=0).stop 2023-10-06T04:45:24.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.260+0000 7ff0f5bff700 1 -- 172.21.15.124:0/2209724731 shutdown_connections 2023-10-06T04:45:24.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.260+0000 7ff0f5bff700 1 --2- 172.21.15.124:0/2209724731 >> v2:172.21.15.158:3300/0 conn(0x7ff0f00aa0c0 0x7ff0f0159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:24.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.260+0000 7ff0f5bff700 1 --2- 172.21.15.124:0/2209724731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f0068600 0x7ff0f006a690 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:24.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.260+0000 7ff0f5bff700 1 -- 172.21.15.124:0/2209724731 >> 172.21.15.124:0/2209724731 conn(0x7ff0f006bf10 msgr2=0x7ff0f00ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:24.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.260+0000 7ff0f5bff700 1 -- 172.21.15.124:0/2209724731 shutdown_connections 2023-10-06T04:45:24.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.260+0000 7ff0f5bff700 1 -- 172.21.15.124:0/2209724731 wait complete. 2023-10-06T04:45:24.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.261+0000 7ff0f5bff700 1 Processor -- start 2023-10-06T04:45:24.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.262+0000 7ff0f5bff700 1 -- start start 2023-10-06T04:45:24.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0f5bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0f0068600 0x7ff0f015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:24.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0f5bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0f00a9cf0 0x7ff0f015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:24.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0f5bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f00aa0c0 0x7ff0f014fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:24.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0f5bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f01503b0 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0f5bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f015bad0 con 0x7ff0f0068600 2023-10-06T04:45:24.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0f5bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f015bdb0 con 0x7ff0f00a9cf0 2023-10-06T04:45:24.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0effff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f00aa0c0 0x7ff0f014fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:24.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0effff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f00aa0c0 0x7ff0f014fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48180/0 (socket says 172.21.15.124:48180) 2023-10-06T04:45:24.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0effff700 1 -- 172.21.15.124:0/1709302917 learned_addr learned my addr 172.21.15.124:0/1709302917 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:24.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0ef7fe700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0f0068600 0x7ff0f015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:24.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0eeffd700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0f00a9cf0 0x7ff0f015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:24.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0effff700 1 -- 172.21.15.124:0/1709302917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0f00a9cf0 msgr2=0x7ff0f015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:24.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0effff700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0f00a9cf0 0x7ff0f015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:24.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0effff700 1 -- 172.21.15.124:0/1709302917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0f0068600 msgr2=0x7ff0f015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:24.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0effff700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0f0068600 0x7ff0f015cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:24.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0effff700 1 -- 172.21.15.124:0/1709302917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40094f0 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.263+0000 7ff0ef7fe700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0f0068600 0x7ff0f015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:24.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.264+0000 7ff0effff700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f00aa0c0 0x7ff0f014fe70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009fa0 tx=0x7ff0e8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:24.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.264+0000 7ff0d77fe700 1 -- 172.21.15.124:0/1709302917 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e800ed20 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.264+0000 7ff0d77fe700 1 -- 172.21.15.124:0/1709302917 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e800ee80 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.264+0000 7ff0f5bff700 1 -- 172.21.15.124:0/1709302917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f015c090 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.264+0000 7ff0d77fe700 1 -- 172.21.15.124:0/1709302917 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8014670 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.264+0000 7ff0f5bff700 1 -- 172.21.15.124:0/1709302917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f015c650 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.265+0000 7ff0f5bff700 1 -- 172.21.15.124:0/1709302917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f015c840 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.266+0000 7ff0d77fe700 1 -- 172.21.15.124:0/1709302917 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0e80149e0 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.267+0000 7ff0d77fe700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0dc067000 0x7ff0dc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:24.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.267+0000 7ff0d77fe700 1 -- 172.21.15.124:0/1709302917 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5958+0+0 (secure 0 0 0) 0x7ff0e8084e60 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.267+0000 7ff0ef7fe700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0dc067000 0x7ff0dc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:24.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.268+0000 7ff0ef7fe700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0dc067000 0x7ff0dc0694b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff0f01564b0 tx=0x7ff0e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:24.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.271+0000 7ff0d77fe700 1 -- 172.21.15.124:0/1709302917 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0e8051fb0 con 0x7ff0f00aa0c0 2023-10-06T04:45:24.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:24.504+0000 7ff0f5bff700 1 -- 172.21.15.124:0/1709302917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff0f004c380 con 0x7ff0f00aa0c0 2023-10-06T04:45:25.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.027+0000 7ff0d77fe700 1 -- 172.21.15.124:0/1709302917 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff0e80555d0 con 0x7ff0f00aa0c0 2023-10-06T04:45:25.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.045+0000 7ff0f5bff700 1 -- 172.21.15.124:0/1709302917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0dc067000 msgr2=0x7ff0dc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.045+0000 7ff0f5bff700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0dc067000 0x7ff0dc0694b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff0f01564b0 tx=0x7ff0e0009040 comp rx=0 tx=0).stop 2023-10-06T04:45:25.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.045+0000 7ff0f5bff700 1 -- 172.21.15.124:0/1709302917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f00aa0c0 msgr2=0x7ff0f014fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.045+0000 7ff0f5bff700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f00aa0c0 0x7ff0f014fe70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009fa0 tx=0x7ff0e8009900 comp rx=0 tx=0).stop 2023-10-06T04:45:25.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.046+0000 7ff0f5bff700 1 -- 172.21.15.124:0/1709302917 shutdown_connections 2023-10-06T04:45:25.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.046+0000 7ff0f5bff700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0f00aa0c0 0x7ff0f014fe70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.046+0000 7ff0f5bff700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0f0068600 0x7ff0f015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.046+0000 7ff0f5bff700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0dc067000 0x7ff0dc0694b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.046+0000 7ff0f5bff700 1 --2- 172.21.15.124:0/1709302917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0f00a9cf0 0x7ff0f015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.046+0000 7ff0f5bff700 1 -- 172.21.15.124:0/1709302917 >> 172.21.15.124:0/1709302917 conn(0x7ff0f006bf10 msgr2=0x7ff0f00ac3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:25.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.047+0000 7ff0f5bff700 1 -- 172.21.15.124:0/1709302917 shutdown_connections 2023-10-06T04:45:25.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.047+0000 7ff0f5bff700 1 -- 172.21.15.124:0/1709302917 wait complete. 2023-10-06T04:45:25.055 INFO:teuthology.orchestra.run.smithi124.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T04:45:25.075 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:25.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.263+0000 7fb2f4fff700 1 Processor -- start 2023-10-06T04:45:25.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.263+0000 7fb2f4fff700 1 -- start start 2023-10-06T04:45:25.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.264+0000 7fb2f4fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb2f00ac3d0 0x7fb2f00aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.264+0000 7fb2f4fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f0069cb0 con 0x7fb2f006a850 2023-10-06T04:45:25.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.264+0000 7fb2f4fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f0156110 con 0x7fb2f00af350 2023-10-06T04:45:25.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.264+0000 7fb2f4fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f006eaa0 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.264+0000 7fb2ee59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb2f00ac3d0 0x7fb2f00aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.264+0000 7fb2ee59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb2f00ac3d0 0x7fb2f00aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48182/0 (socket says 172.21.15.124:48182) 2023-10-06T04:45:25.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.265+0000 7fb2ee59c700 1 -- 172.21.15.124:0/647336234 learned_addr learned my addr 172.21.15.124:0/647336234 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:25.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.264+0000 7fb2eed9d700 1 --1- 172.21.15.124:0/647336234 >> v1:172.21.15.124:6789/0 conn(0x7fb2f006a850 0x7fb2f00add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35256/0 (socket says 172.21.15.124:35256) 2023-10-06T04:45:25.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.265+0000 7fb2ee59c700 1 -- 172.21.15.124:0/647336234 >> v1:172.21.15.158:6789/0 conn(0x7fb2f00af350 legacy=0x7fb2f006a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.265+0000 7fb2ee59c700 1 -- 172.21.15.124:0/647336234 >> v1:172.21.15.124:6789/0 conn(0x7fb2f006a850 legacy=0x7fb2f00add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.265+0000 7fb2ee59c700 1 -- 172.21.15.124:0/647336234 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f006ed80 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.265+0000 7fb2ed59a700 1 -- 172.21.15.124:0/647336234 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546083821 0 0) 0x7fb2f0069cb0 con 0x7fb2f006a850 2023-10-06T04:45:25.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.265+0000 7fb2ee59c700 1 --2- 172.21.15.124:0/647336234 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 0x7fb2f00aee10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00099b0 tx=0x7fb2e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638859d70b64ab7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:25.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.265+0000 7fb2ed59a700 1 -- 172.21.15.124:0/647336234 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000b8f0 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.265+0000 7fb2ed59a700 1 -- 172.21.15.124:0/647336234 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e000ba50 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.265+0000 7fb2ed59a700 1 -- 172.21.15.124:0/647336234 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000bdf0 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.266+0000 7fb2f4fff700 1 -- 172.21.15.124:0/647336234 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 msgr2=0x7fb2f00aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.266+0000 7fb2f4fff700 1 --2- 172.21.15.124:0/647336234 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 0x7fb2f00aee10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00099b0 tx=0x7fb2e0009250 comp rx=0 tx=0).stop 2023-10-06T04:45:25.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.266+0000 7fb2f4fff700 1 -- 172.21.15.124:0/647336234 shutdown_connections 2023-10-06T04:45:25.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.266+0000 7fb2f4fff700 1 --2- 172.21.15.124:0/647336234 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 0x7fb2f00aee10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.266+0000 7fb2f4fff700 1 -- 172.21.15.124:0/647336234 >> 172.21.15.124:0/647336234 conn(0x7fb2f00cc050 msgr2=0x7fb2f00cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:25.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.266+0000 7fb2f4fff700 1 -- 172.21.15.124:0/647336234 shutdown_connections 2023-10-06T04:45:25.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.266+0000 7fb2f4fff700 1 -- 172.21.15.124:0/647336234 wait complete. 2023-10-06T04:45:25.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.267+0000 7fb2f4fff700 1 Processor -- start 2023-10-06T04:45:25.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.268+0000 7fb2f4fff700 1 -- start start 2023-10-06T04:45:25.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.268+0000 7fb2f4fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb2f006a850 0x7fb2f00c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.268+0000 7fb2f4fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 0x7fb2f0147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.268+0000 7fb2f4fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f00af350 0x7fb2f01474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.268+0000 7fb2f4fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00c5740 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2f4fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0096e00 con 0x7fb2f00af350 2023-10-06T04:45:25.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2f4fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00970e0 con 0x7fb2f006a850 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2edd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 0x7fb2f0147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2edd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 0x7fb2f0147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48192/0 (socket says 172.21.15.124:48192) 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2edd9b700 1 -- 172.21.15.124:0/157773416 learned_addr learned my addr 172.21.15.124:0/157773416 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2ee59c700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb2f006a850 0x7fb2f00c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2eed9d700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f00af350 0x7fb2f01474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2edd9b700 1 -- 172.21.15.124:0/157773416 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb2f006a850 msgr2=0x7fb2f00c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2edd9b700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb2f006a850 0x7fb2f00c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2edd9b700 1 -- 172.21.15.124:0/157773416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f00af350 msgr2=0x7fb2f01474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2edd9b700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f00af350 0x7fb2f01474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2edd9b700 1 -- 172.21.15.124:0/157773416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e00094f0 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.269+0000 7fb2edd9b700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 0x7fb2f0147e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c590 tx=0x7fb2e4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:25.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.270+0000 7fb2de7fc700 1 -- 172.21.15.124:0/157773416 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4011590 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.270+0000 7fb2de7fc700 1 -- 172.21.15.124:0/157773416 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e4011710 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.270+0000 7fb2de7fc700 1 -- 172.21.15.124:0/157773416 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4011ad0 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.270+0000 7fb2f4fff700 1 -- 172.21.15.124:0/157773416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f00973c0 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.270+0000 7fb2f4fff700 1 -- 172.21.15.124:0/157773416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f0097980 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.271+0000 7fb2f4fff700 1 -- 172.21.15.124:0/157773416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f0097ba0 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.272+0000 7fb2de7fc700 1 -- 172.21.15.124:0/157773416 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2e401a360 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.273+0000 7fb2de7fc700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb2d0066f30 0x7fb2d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.273+0000 7fb2de7fc700 1 -- 172.21.15.124:0/157773416 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb2e4083620 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.273+0000 7fb2ee59c700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb2d0066f30 0x7fb2d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.274+0000 7fb2ee59c700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb2d0066f30 0x7fb2d00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00099b0 tx=0x7fb2e0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:25.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.277+0000 7fb2de7fc700 1 -- 172.21.15.124:0/157773416 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2e4050690 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.467+0000 7fb2f4fff700 1 -- 172.21.15.124:0/157773416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2f00717a0 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.468+0000 7fb2de7fc700 1 -- 172.21.15.124:0/157773416 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fb2e4053cb0 con 0x7fb2f00ac3d0 2023-10-06T04:45:25.470 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:25.471 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":32,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:45:24.505906+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:22.109975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:23.489027+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:25.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.470+0000 7fb2f4fff700 1 -- 172.21.15.124:0/157773416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb2d0066f30 msgr2=0x7fb2d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb2d0066f30 0x7fb2d00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00099b0 tx=0x7fb2e0017000 comp rx=0 tx=0).stop 2023-10-06T04:45:25.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 -- 172.21.15.124:0/157773416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 msgr2=0x7fb2f0147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 0x7fb2f0147e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c590 tx=0x7fb2e4007f50 comp rx=0 tx=0).stop 2023-10-06T04:45:25.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 -- 172.21.15.124:0/157773416 shutdown_connections 2023-10-06T04:45:25.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f00af350 0x7fb2f01474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb2d0066f30 0x7fb2d00693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb2f006a850 0x7fb2f00c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 --2- 172.21.15.124:0/157773416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2f00ac3d0 0x7fb2f0147e10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 -- 172.21.15.124:0/157773416 >> 172.21.15.124:0/157773416 conn(0x7fb2f00cc050 msgr2=0x7fb2f014c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:25.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 -- 172.21.15.124:0/157773416 shutdown_connections 2023-10-06T04:45:25.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.471+0000 7fb2f4fff700 1 -- 172.21.15.124:0/157773416 wait complete. 2023-10-06T04:45:25.490 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:25.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.678+0000 7fbff23ff700 1 Processor -- start 2023-10-06T04:45:25.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.679+0000 7fbff23ff700 1 -- start start 2023-10-06T04:45:25.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.680+0000 7fbff23ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbfec0ab4a0 0x7fbfec1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.680+0000 7fbff23ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec0ab940 0x7fbfec159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.680+0000 7fbff23ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfec0acfc0 con 0x7fbfec159410 2023-10-06T04:45:25.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.680+0000 7fbff23ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfec0af2a0 con 0x7fbfec0ab4a0 2023-10-06T04:45:25.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.680+0000 7fbff23ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0af580 con 0x7fbfec0ab940 2023-10-06T04:45:25.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.680+0000 7fbfebfff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fbfec159410 0x7fbfec0aad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35268/0 (socket says 172.21.15.124:35268) 2023-10-06T04:45:25.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.680+0000 7fbfebfff700 1 -- 172.21.15.124:0/3205829321 learned_addr learned my addr 172.21.15.124:0/3205829321 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:25.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.680+0000 7fbff099c700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec0ab940 0x7fbfec159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.680+0000 7fbfeb7fe700 1 --2- 172.21.15.124:0/3205829321 >> v2:172.21.15.158:3300/0 conn(0x7fbfec0ab4a0 0x7fbfec1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098047075 0 0) 0x7fbfec0acfc0 con 0x7fbfec159410 2023-10-06T04:45:25.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd4003570 con 0x7fbfec159410 2023-10-06T04:45:25.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196731054 0 0) 0x7fbfd4003570 con 0x7fbfec159410 2023-10-06T04:45:25.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec0ab940 msgr2=0x7fbfec159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:25.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec0ab940 0x7fbfec159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 >> v2:172.21.15.158:3300/0 conn(0x7fbfec0ab4a0 msgr2=0x7fbfec1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:25.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 --2- 172.21.15.124:0/3205829321 >> v2:172.21.15.158:3300/0 conn(0x7fbfec0ab4a0 0x7fbfec1597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec0af860 con 0x7fbfec159410 2023-10-06T04:45:25.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fbfdc001470 con 0x7fbfec159410 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbff099c700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec0ab940 0x7fbfec159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 >> v1:172.21.15.124:6789/0 conn(0x7fbfec159410 legacy=0x7fbfec0aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfd4003a60 0x7fbfd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfd4004810 0x7fbfd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec0ab940 0x7fbfd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0af2a0 con 0x7fbfd4003a60 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0af580 con 0x7fbfd4004810 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd400ba60 con 0x7fbfec0ab940 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfeb7fe700 1 --2- 172.21.15.124:0/3205829321 >> v2:172.21.15.158:3300/0 conn(0x7fbfec0ab4a0 0x7fbfec1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.681+0000 7fbfebfff700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfd4003a60 0x7fbfd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbff099c700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec0ab940 0x7fbfd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfeb7fe700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfd4004810 0x7fbfd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfebfff700 1 -- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec0ab940 msgr2=0x7fbfd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfebfff700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec0ab940 0x7fbfd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfebfff700 1 -- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfd4004810 msgr2=0x7fbfd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfebfff700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfd4004810 0x7fbfd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfebfff700 1 -- 172.21.15.124:0/3205829321 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe4009a20 con 0x7fbfd4003a60 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfeb7fe700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfd4004810 0x7fbfd4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfebfff700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfd4003a60 0x7fbfd4003e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c3c0 tx=0x7fbfdc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1eea4626d23cd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00cc90 con 0x7fbfd4003a60 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc00ce30 con 0x7fbfd4003a60 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.682+0000 7fbfeaffd700 1 -- 172.21.15.124:0/3205829321 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc005b70 con 0x7fbfd4003a60 2023-10-06T04:45:25.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.683+0000 7fbff23ff700 1 -- 172.21.15.124:0/3205829321 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfd4003a60 msgr2=0x7fbfd4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.683+0000 7fbff23ff700 1 --2- 172.21.15.124:0/3205829321 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfd4003a60 0x7fbfd4003e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c3c0 tx=0x7fbfdc001e90 comp rx=0 tx=0).stop 2023-10-06T04:45:25.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.683+0000 7fbff099c700 1 -- 172.21.15.124:0/3205829321 reap_dead start 2023-10-06T04:45:25.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.683+0000 7fbff23ff700 1 -- 172.21.15.124:0/3205829321 shutdown_connections 2023-10-06T04:45:25.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.683+0000 7fbff23ff700 1 -- 172.21.15.124:0/3205829321 >> 172.21.15.124:0/3205829321 conn(0x7fbfec087fb0 msgr2=0x7fbfec0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:25.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.683+0000 7fbff23ff700 1 -- 172.21.15.124:0/3205829321 shutdown_connections 2023-10-06T04:45:25.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.683+0000 7fbff23ff700 1 -- 172.21.15.124:0/3205829321 wait complete. 2023-10-06T04:45:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.684+0000 7fbff23ff700 1 Processor -- start 2023-10-06T04:45:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.685+0000 7fbff23ff700 1 -- start start 2023-10-06T04:45:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.685+0000 7fbff23ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfd4003a60 0x7fbfec0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.685+0000 7fbff23ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfec0b19e0 0x7fbfec155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.685+0000 7fbff23ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec159fb0 0x7fbfec15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.685+0000 7fbff23ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0caa20 con 0x7fbfec0b19e0 2023-10-06T04:45:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.685+0000 7fbff23ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec15a970 con 0x7fbfd4003a60 2023-10-06T04:45:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.685+0000 7fbff23ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0b1e70 con 0x7fbfec159fb0 2023-10-06T04:45:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfeb7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfec0b19e0 0x7fbfec155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfeb7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfec0b19e0 0x7fbfec155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48204/0 (socket says 172.21.15.124:48204) 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfeb7fe700 1 -- 172.21.15.124:0/2933030040 learned_addr learned my addr 172.21.15.124:0/2933030040 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfebfff700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfd4003a60 0x7fbfec0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbff099c700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec159fb0 0x7fbfec15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfeb7fe700 1 -- 172.21.15.124:0/2933030040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec159fb0 msgr2=0x7fbfec15a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfeb7fe700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec159fb0 0x7fbfec15a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfeb7fe700 1 -- 172.21.15.124:0/2933030040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfd4003a60 msgr2=0x7fbfec0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfeb7fe700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfd4003a60 0x7fbfec0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfeb7fe700 1 -- 172.21.15.124:0/2933030040 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec0c7430 con 0x7fbfec0b19e0 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbff099c700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec159fb0 0x7fbfec15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfeb7fe700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfec0b19e0 0x7fbfec155110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0011ae0 tx=0x7fbfe0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.686+0000 7fbfd3fff700 1 -- 172.21.15.124:0/2933030040 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000f9b0 con 0x7fbfec0b19e0 2023-10-06T04:45:25.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.687+0000 7fbfd3fff700 1 -- 172.21.15.124:0/2933030040 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe000fb10 con 0x7fbfec0b19e0 2023-10-06T04:45:25.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.687+0000 7fbfd3fff700 1 -- 172.21.15.124:0/2933030040 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000feb0 con 0x7fbfec0b19e0 2023-10-06T04:45:25.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.687+0000 7fbff23ff700 1 -- 172.21.15.124:0/2933030040 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfec0c7710 con 0x7fbfec0b19e0 2023-10-06T04:45:25.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.687+0000 7fbff23ff700 1 -- 172.21.15.124:0/2933030040 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfec0c7cd0 con 0x7fbfec0b19e0 2023-10-06T04:45:25.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.688+0000 7fbff23ff700 1 -- 172.21.15.124:0/2933030040 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfec04c380 con 0x7fbfec0b19e0 2023-10-06T04:45:25.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.688+0000 7fbfd3fff700 1 -- 172.21.15.124:0/2933030040 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbfe0015670 con 0x7fbfec0b19e0 2023-10-06T04:45:25.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.689+0000 7fbfd3fff700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbfd8066f30 0x7fbfd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:25.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.689+0000 7fbfd3fff700 1 -- 172.21.15.124:0/2933030040 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbfe0085060 con 0x7fbfec0b19e0 2023-10-06T04:45:25.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.690+0000 7fbfebfff700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbfd8066f30 0x7fbfd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:25.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.690+0000 7fbfebfff700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbfd8066f30 0x7fbfd80693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c3c0 tx=0x7fbfdc015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:25.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.694+0000 7fbfd3fff700 1 -- 172.21.15.124:0/2933030040 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfe00b65a0 con 0x7fbfec0b19e0 2023-10-06T04:45:25.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.885+0000 7fbff23ff700 1 -- 172.21.15.124:0/2933030040 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfec088480 con 0x7fbfec0b19e0 2023-10-06T04:45:25.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.886+0000 7fbfd3fff700 1 -- 172.21.15.124:0/2933030040 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fbfe00520d0 con 0x7fbfec0b19e0 2023-10-06T04:45:25.889 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:25.889 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":32,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:45:24.505906+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:22.109975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:23.489027+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:25.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 -- 172.21.15.124:0/2933030040 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbfd8066f30 msgr2=0x7fbfd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbfd8066f30 0x7fbfd80693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c3c0 tx=0x7fbfdc015000 comp rx=0 tx=0).stop 2023-10-06T04:45:25.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 -- 172.21.15.124:0/2933030040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfec0b19e0 msgr2=0x7fbfec155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:25.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfec0b19e0 0x7fbfec155110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0011ae0 tx=0x7fbfe0008040 comp rx=0 tx=0).stop 2023-10-06T04:45:25.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 -- 172.21.15.124:0/2933030040 shutdown_connections 2023-10-06T04:45:25.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbfd8066f30 0x7fbfd80693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfec159fb0 0x7fbfec15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfd4003a60 0x7fbfec0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 --2- 172.21.15.124:0/2933030040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbfec0b19e0 0x7fbfec155110 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:25.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 -- 172.21.15.124:0/2933030040 >> 172.21.15.124:0/2933030040 conn(0x7fbfec087fb0 msgr2=0x7fbfec0697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:25.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 -- 172.21.15.124:0/2933030040 shutdown_connections 2023-10-06T04:45:25.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:25.889+0000 7fbff23ff700 1 -- 172.21.15.124:0/2933030040 wait complete. 2023-10-06T04:45:25.908 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:45:26.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.102+0000 7f25d2bff700 1 Processor -- start 2023-10-06T04:45:26.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.102+0000 7f25d2bff700 1 -- start start 2023-10-06T04:45:26.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25d2bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f25cc0694c0 0x7f25cc069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:26.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25d2bff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc157ad0 con 0x7f25cc157700 2023-10-06T04:45:26.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25d2bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc069e40 con 0x7f25cc06a3d0 2023-10-06T04:45:26.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25d2bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc06db30 con 0x7f25cc0694c0 2023-10-06T04:45:26.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25d099b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f25cc157700 0x7f25cc06d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35284/0 (socket says 172.21.15.124:35284) 2023-10-06T04:45:26.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25d099b700 1 -- 172.21.15.124:0/841863384 learned_addr learned my addr 172.21.15.124:0/841863384 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:26.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25d119c700 1 --2- 172.21.15.124:0/841863384 >> v2:172.21.15.124:3300/0 conn(0x7f25cc0694c0 0x7f25cc069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:26.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25cb7fe700 1 -- 172.21.15.124:0/841863384 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699810862 0 0) 0x7f25cc157ad0 con 0x7f25cc157700 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25cb7fe700 1 -- 172.21.15.124:0/841863384 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25bc003570 con 0x7f25cc157700 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25d119c700 1 -- 172.21.15.124:0/841863384 >> v1:172.21.15.158:6789/0 conn(0x7f25cc06a3d0 legacy=0x7f25cc0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25d119c700 1 -- 172.21.15.124:0/841863384 >> v1:172.21.15.124:6789/0 conn(0x7f25cc157700 legacy=0x7f25cc06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.104+0000 7f25d119c700 1 -- 172.21.15.124:0/841863384 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc06de10 con 0x7f25cc0694c0 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.105+0000 7f25d119c700 1 --2- 172.21.15.124:0/841863384 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc0694c0 0x7f25cc069900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009e60 tx=0x7f25c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e523b9ed86e2f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.105+0000 7f25cb7fe700 1 -- 172.21.15.124:0/841863384 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c400e070 con 0x7f25cc0694c0 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.105+0000 7f25cb7fe700 1 -- 172.21.15.124:0/841863384 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c400bb60 con 0x7f25cc0694c0 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.105+0000 7f25cb7fe700 1 -- 172.21.15.124:0/841863384 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4012430 con 0x7f25cc0694c0 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.105+0000 7f25d2bff700 1 -- 172.21.15.124:0/841863384 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc0694c0 msgr2=0x7f25cc069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.105+0000 7f25d2bff700 1 --2- 172.21.15.124:0/841863384 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc0694c0 0x7f25cc069900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009e60 tx=0x7f25c4009780 comp rx=0 tx=0).stop 2023-10-06T04:45:26.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.105+0000 7f25d2bff700 1 -- 172.21.15.124:0/841863384 shutdown_connections 2023-10-06T04:45:26.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.105+0000 7f25d2bff700 1 --2- 172.21.15.124:0/841863384 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc0694c0 0x7f25cc069900 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:26.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.105+0000 7f25d2bff700 1 -- 172.21.15.124:0/841863384 >> 172.21.15.124:0/841863384 conn(0x7f25cc0680c0 msgr2=0x7f25cc0cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:26.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.106+0000 7f25d2bff700 1 -- 172.21.15.124:0/841863384 shutdown_connections 2023-10-06T04:45:26.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.106+0000 7f25d2bff700 1 -- 172.21.15.124:0/841863384 wait complete. 2023-10-06T04:45:26.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.107+0000 7f25d2bff700 1 Processor -- start 2023-10-06T04:45:26.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.107+0000 7f25d2bff700 1 -- start start 2023-10-06T04:45:26.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.108+0000 7f25d2bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f25cc0694c0 0x7f25cc155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:26.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.108+0000 7f25d2bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f25cc06a3d0 0x7f25cc0c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:26.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.108+0000 7f25d2bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc157700 0x7f25cc0c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:26.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.108+0000 7f25d2bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0c65b0 con 0x7f25cc157700 2023-10-06T04:45:26.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.108+0000 7f25d2bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0c6b70 con 0x7f25cc06a3d0 2023-10-06T04:45:26.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.108+0000 7f25d2bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0aad40 con 0x7f25cc0694c0 2023-10-06T04:45:26.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.108+0000 7f25d119c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc157700 0x7f25cc0c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:26.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.108+0000 7f25d119c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc157700 0x7f25cc0c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48218/0 (socket says 172.21.15.124:48218) 2023-10-06T04:45:26.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.108+0000 7f25d119c700 1 -- 172.21.15.124:0/4151185695 learned_addr learned my addr 172.21.15.124:0/4151185695 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:26.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.108+0000 7f25d099b700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f25cc0694c0 0x7f25cc155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:26.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25cbfff700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f25cc06a3d0 0x7f25cc0c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:26.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25d119c700 1 -- 172.21.15.124:0/4151185695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f25cc0694c0 msgr2=0x7f25cc155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:26.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25d119c700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f25cc0694c0 0x7f25cc155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:26.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25d119c700 1 -- 172.21.15.124:0/4151185695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f25cc06a3d0 msgr2=0x7f25cc0c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:26.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25d119c700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f25cc06a3d0 0x7f25cc0c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:26.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25d119c700 1 -- 172.21.15.124:0/4151185695 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4009a20 con 0x7f25cc157700 2023-10-06T04:45:26.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25d119c700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc157700 0x7f25cc0c52f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f25c400b6c0 tx=0x7f25c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:26.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25c8ff9700 1 -- 172.21.15.124:0/4151185695 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4027470 con 0x7f25cc157700 2023-10-06T04:45:26.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25c8ff9700 1 -- 172.21.15.124:0/4151185695 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c40275f0 con 0x7f25cc157700 2023-10-06T04:45:26.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25d2bff700 1 -- 172.21.15.124:0/4151185695 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc0ab020 con 0x7f25cc157700 2023-10-06T04:45:26.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.109+0000 7f25c8ff9700 1 -- 172.21.15.124:0/4151185695 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c40279b0 con 0x7f25cc157700 2023-10-06T04:45:26.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.110+0000 7f25d2bff700 1 -- 172.21.15.124:0/4151185695 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc155a80 con 0x7f25cc157700 2023-10-06T04:45:26.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.111+0000 7f25d2bff700 1 -- 172.21.15.124:0/4151185695 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc0abd80 con 0x7f25cc157700 2023-10-06T04:45:26.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.111+0000 7f25c8ff9700 1 -- 172.21.15.124:0/4151185695 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25c4024070 con 0x7f25cc157700 2023-10-06T04:45:26.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.112+0000 7f25c8ff9700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f25b0066f30 0x7f25b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:26.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.112+0000 7f25c8ff9700 1 -- 172.21.15.124:0/4151185695 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f25c4086fc0 con 0x7f25cc157700 2023-10-06T04:45:26.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.112+0000 7f25d099b700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f25b0066f30 0x7f25b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:26.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.113+0000 7f25d099b700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f25b0066f30 0x7f25b00693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007fd0 tx=0x7f25c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:26.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.116+0000 7f25c8ff9700 1 -- 172.21.15.124:0/4151185695 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25c40b85a0 con 0x7f25cc157700 2023-10-06T04:45:26.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:26.353+0000 7f25d2bff700 1 -- 172.21.15.124:0/4151185695 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f25cc064850 con 0x7f25cc157700 2023-10-06T04:45:27.051 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.050+0000 7f25c8ff9700 1 -- 172.21.15.124:0/4151185695 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f25c40540d0 con 0x7f25cc157700 2023-10-06T04:45:27.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 -- 172.21.15.124:0/4151185695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f25b0066f30 msgr2=0x7f25b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:27.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f25b0066f30 0x7f25b00693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007fd0 tx=0x7f25c0009040 comp rx=0 tx=0).stop 2023-10-06T04:45:27.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 -- 172.21.15.124:0/4151185695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc157700 msgr2=0x7f25cc0c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:27.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc157700 0x7f25cc0c52f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f25c400b6c0 tx=0x7f25c4019000 comp rx=0 tx=0).stop 2023-10-06T04:45:27.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 -- 172.21.15.124:0/4151185695 shutdown_connections 2023-10-06T04:45:27.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25cc157700 0x7f25cc0c52f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:27.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f25b0066f30 0x7f25b00693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:27.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f25cc0694c0 0x7f25cc155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:27.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 --2- 172.21.15.124:0/4151185695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f25cc06a3d0 0x7f25cc0c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:27.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 -- 172.21.15.124:0/4151185695 >> 172.21.15.124:0/4151185695 conn(0x7f25cc0680c0 msgr2=0x7f25cc0b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:27.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 -- 172.21.15.124:0/4151185695 shutdown_connections 2023-10-06T04:45:27.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.053+0000 7f25d2bff700 1 -- 172.21.15.124:0/4151185695 wait complete. 2023-10-06T04:45:27.075 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:45:27.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.270+0000 7f3d901ff700 1 Processor -- start 2023-10-06T04:45:27.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.270+0000 7f3d901ff700 1 -- start start 2023-10-06T04:45:27.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.271+0000 7f3d901ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d881562b0 0x7f3d8815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:27.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.271+0000 7f3d901ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3d880cca10 0x7f3d880c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:27.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.271+0000 7f3d901ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d880ad790 con 0x7f3d880c6af0 2023-10-06T04:45:27.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.271+0000 7f3d901ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8815af90 con 0x7f3d881562b0 2023-10-06T04:45:27.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.271+0000 7f3d901ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d880acb80 con 0x7f3d880cca10 2023-10-06T04:45:27.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.272+0000 7f3d8df9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d881562b0 0x7f3d8815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:27.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.272+0000 7f3d8df9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d881562b0 0x7f3d8815aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48226/0 (socket says 172.21.15.124:48226) 2023-10-06T04:45:27.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.272+0000 7f3d8df9b700 1 -- 172.21.15.124:0/3768254815 learned_addr learned my addr 172.21.15.124:0/3768254815 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:27.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.272+0000 7f3d8d79a700 1 --2- 172.21.15.124:0/3768254815 >> v2:172.21.15.158:3300/0 conn(0x7f3d880cca10 0x7f3d880c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:27.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.272+0000 7f3d8df9b700 1 -- 172.21.15.124:0/3768254815 >> v2:172.21.15.158:3300/0 conn(0x7f3d880cca10 msgr2=0x7f3d880c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:27.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.272+0000 7f3d8df9b700 1 --2- 172.21.15.124:0/3768254815 >> v2:172.21.15.158:3300/0 conn(0x7f3d880cca10 0x7f3d880c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:27.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.272+0000 7f3d8df9b700 1 -- 172.21.15.124:0/3768254815 >> v1:172.21.15.124:6789/0 conn(0x7f3d880c6af0 legacy=0x7f3d880adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:27.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.272+0000 7f3d8df9b700 1 -- 172.21.15.124:0/3768254815 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880ace60 con 0x7f3d881562b0 2023-10-06T04:45:27.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.272+0000 7f3d8df9b700 1 --2- 172.21.15.124:0/3768254815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d881562b0 0x7f3d8815aa50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3d880684f0 tx=0x7f3d84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3eb94900f226df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d8cf99700 1 -- 172.21.15.124:0/3768254815 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84009e70 con 0x7f3d881562b0 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d8cf99700 1 -- 172.21.15.124:0/3768254815 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400b860 con 0x7f3d881562b0 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d8cf99700 1 -- 172.21.15.124:0/3768254815 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400bc00 con 0x7f3d881562b0 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d901ff700 1 -- 172.21.15.124:0/3768254815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d881562b0 msgr2=0x7f3d8815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d901ff700 1 --2- 172.21.15.124:0/3768254815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d881562b0 0x7f3d8815aa50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3d880684f0 tx=0x7f3d84009250 comp rx=0 tx=0).stop 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d901ff700 1 -- 172.21.15.124:0/3768254815 shutdown_connections 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d901ff700 1 --2- 172.21.15.124:0/3768254815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d881562b0 0x7f3d8815aa50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d901ff700 1 --2- 172.21.15.124:0/3768254815 >> v2:172.21.15.158:3300/0 conn(0x7f3d880cca10 0x7f3d880c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d901ff700 1 -- 172.21.15.124:0/3768254815 >> 172.21.15.124:0/3768254815 conn(0x7f3d880680c0 msgr2=0x7f3d880cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d901ff700 1 -- 172.21.15.124:0/3768254815 shutdown_connections 2023-10-06T04:45:27.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.273+0000 7f3d901ff700 1 -- 172.21.15.124:0/3768254815 wait complete. 2023-10-06T04:45:27.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.275+0000 7f3d901ff700 1 Processor -- start 2023-10-06T04:45:27.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.275+0000 7f3d901ff700 1 -- start start 2023-10-06T04:45:27.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d901ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d880c6af0 0x7f3d8816dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:27.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d901ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d880cca10 0x7f3d881546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:27.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d901ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d881562b0 0x7f3d880adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:27.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d901ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880c3020 con 0x7f3d880c6af0 2023-10-06T04:45:27.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d901ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880c2580 con 0x7f3d880cca10 2023-10-06T04:45:27.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d901ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880c50c0 con 0x7f3d881562b0 2023-10-06T04:45:27.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8df9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d880c6af0 0x7f3d8816dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:27.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8df9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d880c6af0 0x7f3d8816dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48234/0 (socket says 172.21.15.124:48234) 2023-10-06T04:45:27.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8df9b700 1 -- 172.21.15.124:0/1701269187 learned_addr learned my addr 172.21.15.124:0/1701269187 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:27.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8d79a700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d880cca10 0x7f3d881546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:27.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8df9b700 1 -- 172.21.15.124:0/1701269187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d881562b0 msgr2=0x7f3d880adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:27.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8e79c700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d881562b0 0x7f3d880adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:27.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8df9b700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d881562b0 0x7f3d880adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:27.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8df9b700 1 -- 172.21.15.124:0/1701269187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d880cca10 msgr2=0x7f3d881546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:27.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8df9b700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d880cca10 0x7f3d881546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:27.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8df9b700 1 -- 172.21.15.124:0/1701269187 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d840094f0 con 0x7f3d880c6af0 2023-10-06T04:45:27.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8d79a700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d880cca10 0x7f3d881546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:27.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.276+0000 7f3d8e79c700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d881562b0 0x7f3d880adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:27.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.277+0000 7f3d8df9b700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d880c6af0 0x7f3d8816dda0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d8806cf10 tx=0x7f3d84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:27.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.277+0000 7f3d7dffb700 1 -- 172.21.15.124:0/1701269187 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84011420 con 0x7f3d880c6af0 2023-10-06T04:45:27.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.277+0000 7f3d7dffb700 1 -- 172.21.15.124:0/1701269187 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d84011580 con 0x7f3d880c6af0 2023-10-06T04:45:27.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.277+0000 7f3d901ff700 1 -- 172.21.15.124:0/1701269187 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d880c53a0 con 0x7f3d880c6af0 2023-10-06T04:45:27.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.277+0000 7f3d7dffb700 1 -- 172.21.15.124:0/1701269187 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84011940 con 0x7f3d880c6af0 2023-10-06T04:45:27.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.277+0000 7f3d901ff700 1 -- 172.21.15.124:0/1701269187 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8816e2e0 con 0x7f3d880c6af0 2023-10-06T04:45:27.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.278+0000 7f3d901ff700 1 -- 172.21.15.124:0/1701269187 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d88064850 con 0x7f3d880c6af0 2023-10-06T04:45:27.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.279+0000 7f3d7dffb700 1 -- 172.21.15.124:0/1701269187 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d8402c3b0 con 0x7f3d880c6af0 2023-10-06T04:45:27.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.280+0000 7f3d7dffb700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d6c066f30 0x7f3d6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:27.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.280+0000 7f3d7dffb700 1 -- 172.21.15.124:0/1701269187 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3d84085d00 con 0x7f3d880c6af0 2023-10-06T04:45:27.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.281+0000 7f3d8d79a700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d6c066f30 0x7f3d6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:27.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.281+0000 7f3d8d79a700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d6c066f30 0x7f3d6c0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d78006f00 tx=0x7f3d78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:27.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.285+0000 7f3d7dffb700 1 -- 172.21.15.124:0/1701269187 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d84052d70 con 0x7f3d880c6af0 2023-10-06T04:45:27.508 INFO:tasks.ceph.mds.a.smithi124.stderr:2023-10-06T04:45:27.506+0000 7f0deb7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:45:27.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:27.519+0000 7f3d901ff700 1 -- 172.21.15.124:0/1701269187 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3d8804c380 con 0x7f3d880c6af0 2023-10-06T04:45:28.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.059+0000 7f3d7dffb700 1 -- 172.21.15.124:0/1701269187 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d840150c0 con 0x7f3d880c6af0 2023-10-06T04:45:28.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 -- 172.21.15.124:0/1701269187 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d6c066f30 msgr2=0x7f3d6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d6c066f30 0x7f3d6c0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d78006f00 tx=0x7f3d78008040 comp rx=0 tx=0).stop 2023-10-06T04:45:28.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 -- 172.21.15.124:0/1701269187 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d880c6af0 msgr2=0x7f3d8816dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d880c6af0 0x7f3d8816dda0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d8806cf10 tx=0x7f3d84017000 comp rx=0 tx=0).stop 2023-10-06T04:45:28.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 -- 172.21.15.124:0/1701269187 shutdown_connections 2023-10-06T04:45:28.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3d6c066f30 0x7f3d6c0693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d881562b0 0x7f3d880adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d880c6af0 0x7f3d8816dda0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 --2- 172.21.15.124:0/1701269187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d880cca10 0x7f3d881546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 -- 172.21.15.124:0/1701269187 >> 172.21.15.124:0/1701269187 conn(0x7f3d880680c0 msgr2=0x7f3d88155260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:28.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 -- 172.21.15.124:0/1701269187 shutdown_connections 2023-10-06T04:45:28.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.061+0000 7f3d901ff700 1 -- 172.21.15.124:0/1701269187 wait complete. 2023-10-06T04:45:28.080 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:28.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.268+0000 7f8ef3dff700 1 Processor -- start 2023-10-06T04:45:28.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.269+0000 7f8ef3dff700 1 -- start start 2023-10-06T04:45:28.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.270+0000 7f8ef3dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8eec0b1a70 0x7f8eec06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:28.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.270+0000 7f8ef3dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eec06e870 con 0x7f8eec06a140 2023-10-06T04:45:28.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.270+0000 7f8ef3dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eec069cb0 con 0x7f8eec0ac3d0 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.270+0000 7f8ef3dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eec156110 con 0x7f8eec0b1a70 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.270+0000 7f8ef139a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8eec0b1a70 0x7f8eec06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.270+0000 7f8ef239c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f8eec06a140 0x7f8eec06a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35300/0 (socket says 172.21.15.124:35300) 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.270+0000 7f8ef139a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8eec0b1a70 0x7f8eec06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48248/0 (socket says 172.21.15.124:48248) 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.270+0000 7f8ef239c700 1 -- 172.21.15.124:0/1716688578 learned_addr learned my addr 172.21.15.124:0/1716688578 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.271+0000 7f8ef139a700 1 -- 172.21.15.124:0/1716688578 >> v1:172.21.15.158:6789/0 conn(0x7f8eec0ac3d0 legacy=0x7f8eec0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.271+0000 7f8ef139a700 1 -- 172.21.15.124:0/1716688578 >> v1:172.21.15.124:6789/0 conn(0x7f8eec06a140 legacy=0x7f8eec06a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.271+0000 7f8ef139a700 1 -- 172.21.15.124:0/1716688578 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec06eaa0 con 0x7f8eec0b1a70 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.271+0000 7f8ef0b99700 1 -- 172.21.15.124:0/1716688578 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907665843 0 0) 0x7f8eec06e870 con 0x7f8eec06a140 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.271+0000 7f8ef139a700 1 --2- 172.21.15.124:0/1716688578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 0x7f8eec06e330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00bb90 tx=0x7f8edc00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6844601fa0f59acd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:28.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.271+0000 7f8ef0b99700 1 -- 172.21.15.124:0/1716688578 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc00db20 con 0x7f8eec0b1a70 2023-10-06T04:45:28.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.271+0000 7f8ef0b99700 1 -- 172.21.15.124:0/1716688578 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc00dc80 con 0x7f8eec0b1a70 2023-10-06T04:45:28.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.271+0000 7f8ef0b99700 1 -- 172.21.15.124:0/1716688578 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc017410 con 0x7f8eec0b1a70 2023-10-06T04:45:28.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.272+0000 7f8ef3dff700 1 -- 172.21.15.124:0/1716688578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 msgr2=0x7f8eec06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.272+0000 7f8ef3dff700 1 --2- 172.21.15.124:0/1716688578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 0x7f8eec06e330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00bb90 tx=0x7f8edc00b430 comp rx=0 tx=0).stop 2023-10-06T04:45:28.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.272+0000 7f8ef3dff700 1 -- 172.21.15.124:0/1716688578 shutdown_connections 2023-10-06T04:45:28.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.272+0000 7f8ef3dff700 1 --2- 172.21.15.124:0/1716688578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 0x7f8eec06e330 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.272+0000 7f8ef3dff700 1 -- 172.21.15.124:0/1716688578 >> 172.21.15.124:0/1716688578 conn(0x7f8eec0cc050 msgr2=0x7f8eec0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:28.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.272+0000 7f8ef3dff700 1 -- 172.21.15.124:0/1716688578 shutdown_connections 2023-10-06T04:45:28.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.272+0000 7f8ef3dff700 1 -- 172.21.15.124:0/1716688578 wait complete. 2023-10-06T04:45:28.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.273+0000 7f8ef3dff700 1 Processor -- start 2023-10-06T04:45:28.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.273+0000 7f8ef3dff700 1 -- start start 2023-10-06T04:45:28.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.274+0000 7f8ef3dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8eec06a140 0x7f8eec0aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:28.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.274+0000 7f8ef3dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8eec0ac3d0 0x7f8eec0c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:28.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.274+0000 7f8ef3dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 0x7f8eec0991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:28.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.274+0000 7f8ef3dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec0ab280 con 0x7f8eec0b1a70 2023-10-06T04:45:28.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.274+0000 7f8ef3dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec097f00 con 0x7f8eec06a140 2023-10-06T04:45:28.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.274+0000 7f8ef3dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec098d60 con 0x7f8eec0ac3d0 2023-10-06T04:45:28.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef239c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 0x7f8eec0991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:28.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef239c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 0x7f8eec0991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48252/0 (socket says 172.21.15.124:48252) 2023-10-06T04:45:28.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef239c700 1 -- 172.21.15.124:0/3911442744 learned_addr learned my addr 172.21.15.124:0/3911442744 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:28.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef139a700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8eec0ac3d0 0x7f8eec0c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:28.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef1b9b700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8eec06a140 0x7f8eec0aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:28.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef239c700 1 -- 172.21.15.124:0/3911442744 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8eec0ac3d0 msgr2=0x7f8eec0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef239c700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8eec0ac3d0 0x7f8eec0c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef239c700 1 -- 172.21.15.124:0/3911442744 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8eec06a140 msgr2=0x7f8eec0aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef239c700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8eec06a140 0x7f8eec0aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef239c700 1 -- 172.21.15.124:0/3911442744 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc00b6d0 con 0x7f8eec0b1a70 2023-10-06T04:45:28.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef139a700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8eec0ac3d0 0x7f8eec0c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:28.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ef239c700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 0x7f8eec0991f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400cc10 tx=0x7f8ee4001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:28.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.275+0000 7f8ee1ffb700 1 -- 172.21.15.124:0/3911442744 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400a930 con 0x7f8eec0b1a70 2023-10-06T04:45:28.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.276+0000 7f8ee1ffb700 1 -- 172.21.15.124:0/3911442744 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee400aab0 con 0x7f8eec0b1a70 2023-10-06T04:45:28.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.276+0000 7f8ef3dff700 1 -- 172.21.15.124:0/3911442744 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eec0c59c0 con 0x7f8eec0b1a70 2023-10-06T04:45:28.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.276+0000 7f8ee1ffb700 1 -- 172.21.15.124:0/3911442744 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400ae70 con 0x7f8eec0b1a70 2023-10-06T04:45:28.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.276+0000 7f8ef3dff700 1 -- 172.21.15.124:0/3911442744 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eec098430 con 0x7f8eec0b1a70 2023-10-06T04:45:28.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.277+0000 7f8ef3dff700 1 -- 172.21.15.124:0/3911442744 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eec098ef0 con 0x7f8eec0b1a70 2023-10-06T04:45:28.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.278+0000 7f8ee1ffb700 1 -- 172.21.15.124:0/3911442744 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ee4007300 con 0x7f8eec0b1a70 2023-10-06T04:45:28.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.278+0000 7f8ee1ffb700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8ed0066f30 0x7f8ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:28.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.278+0000 7f8ee1ffb700 1 -- 172.21.15.124:0/3911442744 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ee4084b60 con 0x7f8eec0b1a70 2023-10-06T04:45:28.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.279+0000 7f8ef1b9b700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8ed0066f30 0x7f8ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:28.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.279+0000 7f8ef1b9b700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8ed0066f30 0x7f8ed00693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8003860 tx=0x7f8ee8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:28.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.283+0000 7f8ee1ffb700 1 -- 172.21.15.124:0/3911442744 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ee4051bc0 con 0x7f8eec0b1a70 2023-10-06T04:45:28.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.513+0000 7f8ef3dff700 1 -- 172.21.15.124:0/3911442744 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8eec0717a0 con 0x7f8eec0b1a70 2023-10-06T04:45:28.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.513+0000 7f8ee1ffb700 1 -- 172.21.15.124:0/3911442744 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f8ee40551e0 con 0x7f8eec0b1a70 2023-10-06T04:45:28.515 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:28.515 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/518958812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":518958812},{"type":"v1","addr":"172.21.15.158:6834","nonce":518958812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/120181660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":120181660},{"type":"v1","addr":"172.21.15.158:6835","nonce":120181660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1421870244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1421870244},{"type":"v1","addr":"172.21.15.124:6836","nonce":1421870244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:24.506230+0000","modified":"2023-10-06T04:45:28.049891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.124:6837/1031472040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1031472040},{"type":"v1","addr":"172.21.15.124:6837","nonce":1031472040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:45:28.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 -- 172.21.15.124:0/3911442744 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8ed0066f30 msgr2=0x7f8ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8ed0066f30 0x7f8ed00693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8003860 tx=0x7f8ee8009040 comp rx=0 tx=0).stop 2023-10-06T04:45:28.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 -- 172.21.15.124:0/3911442744 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 msgr2=0x7f8eec0991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 0x7f8eec0991f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400cc10 tx=0x7f8ee4001970 comp rx=0 tx=0).stop 2023-10-06T04:45:28.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 -- 172.21.15.124:0/3911442744 shutdown_connections 2023-10-06T04:45:28.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8eec0b1a70 0x7f8eec0991f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8eec06a140 0x7f8eec0aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8ed0066f30 0x7f8ed00693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 --2- 172.21.15.124:0/3911442744 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8eec0ac3d0 0x7f8eec0c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 -- 172.21.15.124:0/3911442744 >> 172.21.15.124:0/3911442744 conn(0x7f8eec0cc050 msgr2=0x7f8eec06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:28.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 -- 172.21.15.124:0/3911442744 shutdown_connections 2023-10-06T04:45:28.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.516+0000 7f8ef3dff700 1 -- 172.21.15.124:0/3911442744 wait complete. 2023-10-06T04:45:28.519 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2023-10-06T04:45:28.535 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:28.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.722+0000 7fc55f1ff700 1 Processor -- start 2023-10-06T04:45:28.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.722+0000 7fc55f1ff700 1 -- start start 2023-10-06T04:45:28.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.723+0000 7fc55f1ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc5580ce450 0x7fc5580cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:28.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.723+0000 7fc55f1ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5580cf6b0 con 0x7fc5580cdfe0 2023-10-06T04:45:28.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.723+0000 7fc55f1ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5580ceaa0 con 0x7fc5580ccbb0 2023-10-06T04:45:28.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.723+0000 7fc55f1ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5580d0250 con 0x7fc5580ce450 2023-10-06T04:45:28.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.724+0000 7fc557fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc5580cdfe0 0x7fc5580ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35310/0 (socket says 172.21.15.124:35310) 2023-10-06T04:45:28.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.724+0000 7fc557fff700 1 -- 172.21.15.124:0/3804498798 learned_addr learned my addr 172.21.15.124:0/3804498798 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:28.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.724+0000 7fc55d79c700 1 --2- 172.21.15.124:0/3804498798 >> v2:172.21.15.158:3300/0 conn(0x7fc5580ce450 0x7fc5580cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:28.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.724+0000 7fc5577fe700 1 -- 172.21.15.124:0/3804498798 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146392537 0 0) 0x7fc5580cf6b0 con 0x7fc5580cdfe0 2023-10-06T04:45:28.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.724+0000 7fc5577fe700 1 -- 172.21.15.124:0/3804498798 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc548003570 con 0x7fc5580cdfe0 2023-10-06T04:45:28.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.724+0000 7fc55d79c700 1 -- 172.21.15.124:0/3804498798 >> v1:172.21.15.158:6789/0 conn(0x7fc5580ccbb0 legacy=0x7fc5580cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.724+0000 7fc55d79c700 1 -- 172.21.15.124:0/3804498798 >> v1:172.21.15.124:6789/0 conn(0x7fc5580cdfe0 legacy=0x7fc5580ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.724+0000 7fc55d79c700 1 -- 172.21.15.124:0/3804498798 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5580ced80 con 0x7fc5580ce450 2023-10-06T04:45:28.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.724+0000 7fc55d79c700 1 --2- 172.21.15.124:0/3804498798 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5580ce450 0x7fc5580cd690 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc550009e60 tx=0x7fc550009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b2cd9a08e54c9e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:28.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.725+0000 7fc5577fe700 1 -- 172.21.15.124:0/3804498798 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55000e070 con 0x7fc5580ce450 2023-10-06T04:45:28.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.725+0000 7fc5577fe700 1 -- 172.21.15.124:0/3804498798 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55000bb60 con 0x7fc5580ce450 2023-10-06T04:45:28.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.725+0000 7fc5577fe700 1 -- 172.21.15.124:0/3804498798 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550012430 con 0x7fc5580ce450 2023-10-06T04:45:28.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.725+0000 7fc55f1ff700 1 -- 172.21.15.124:0/3804498798 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5580ce450 msgr2=0x7fc5580cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.725+0000 7fc55f1ff700 1 --2- 172.21.15.124:0/3804498798 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5580ce450 0x7fc5580cd690 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc550009e60 tx=0x7fc550009780 comp rx=0 tx=0).stop 2023-10-06T04:45:28.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.725+0000 7fc55f1ff700 1 -- 172.21.15.124:0/3804498798 shutdown_connections 2023-10-06T04:45:28.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.725+0000 7fc55f1ff700 1 --2- 172.21.15.124:0/3804498798 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5580ce450 0x7fc5580cd690 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.725+0000 7fc55f1ff700 1 -- 172.21.15.124:0/3804498798 >> 172.21.15.124:0/3804498798 conn(0x7fc558099710 msgr2=0x7fc55806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:28.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.725+0000 7fc55f1ff700 1 -- 172.21.15.124:0/3804498798 shutdown_connections 2023-10-06T04:45:28.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.725+0000 7fc55f1ff700 1 -- 172.21.15.124:0/3804498798 wait complete. 2023-10-06T04:45:28.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.727+0000 7fc55f1ff700 1 Processor -- start 2023-10-06T04:45:28.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.727+0000 7fc55f1ff700 1 -- start start 2023-10-06T04:45:28.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55f1ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5580ccbb0 0x7fc5580c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:28.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55f1ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5580cdfe0 0x7fc558157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55f1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5580ce450 0x7fc55809b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55f1ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580c5890 con 0x7fc5580ccbb0 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55f1ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580c48b0 con 0x7fc5580cdfe0 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55f1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55809dde0 con 0x7fc5580ce450 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55cf9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5580ccbb0 0x7fc5580c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55cf9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5580ccbb0 0x7fc5580c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48268/0 (socket says 172.21.15.124:48268) 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55cf9b700 1 -- 172.21.15.124:0/1164357027 learned_addr learned my addr 172.21.15.124:0/1164357027 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55cf9b700 1 -- 172.21.15.124:0/1164357027 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5580ce450 msgr2=0x7fc55809b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55cf9b700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5580ce450 0x7fc55809b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55cf9b700 1 -- 172.21.15.124:0/1164357027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5580cdfe0 msgr2=0x7fc558157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.728+0000 7fc55cf9b700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5580cdfe0 0x7fc558157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.729+0000 7fc55cf9b700 1 -- 172.21.15.124:0/1164357027 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc550009a20 con 0x7fc5580ccbb0 2023-10-06T04:45:28.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.729+0000 7fc55cf9b700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5580ccbb0 0x7fc5580c5350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00c590 tx=0x7fc54c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:28.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.729+0000 7fc554ff9700 1 -- 172.21.15.124:0/1164357027 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c011590 con 0x7fc5580ccbb0 2023-10-06T04:45:28.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.729+0000 7fc554ff9700 1 -- 172.21.15.124:0/1164357027 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c0116f0 con 0x7fc5580ccbb0 2023-10-06T04:45:28.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.729+0000 7fc554ff9700 1 -- 172.21.15.124:0/1164357027 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c011ab0 con 0x7fc5580ccbb0 2023-10-06T04:45:28.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.729+0000 7fc55f1ff700 1 -- 172.21.15.124:0/1164357027 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5580c4b50 con 0x7fc5580ccbb0 2023-10-06T04:45:28.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.729+0000 7fc55f1ff700 1 -- 172.21.15.124:0/1164357027 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55809e0c0 con 0x7fc5580ccbb0 2023-10-06T04:45:28.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.730+0000 7fc55f1ff700 1 -- 172.21.15.124:0/1164357027 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5580c5070 con 0x7fc5580ccbb0 2023-10-06T04:45:28.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.731+0000 7fc554ff9700 1 -- 172.21.15.124:0/1164357027 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc54c01b3b0 con 0x7fc5580ccbb0 2023-10-06T04:45:28.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.732+0000 7fc554ff9700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc53c066f30 0x7fc53c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:28.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.732+0000 7fc554ff9700 1 -- 172.21.15.124:0/1164357027 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc54c083ce0 con 0x7fc5580ccbb0 2023-10-06T04:45:28.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.732+0000 7fc557fff700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc53c066f30 0x7fc53c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:28.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.733+0000 7fc557fff700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc53c066f30 0x7fc53c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc5440058d0 tx=0x7fc5440079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:28.737 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.736+0000 7fc554ff9700 1 -- 172.21.15.124:0/1164357027 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc54c050d50 con 0x7fc5580ccbb0 2023-10-06T04:45:28.827 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:45:28.832 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:45:28.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.933+0000 7fc55f1ff700 1 -- 172.21.15.124:0/1164357027 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5580717a0 con 0x7fc5580ccbb0 2023-10-06T04:45:28.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.934+0000 7fc554ff9700 1 -- 172.21.15.124:0/1164357027 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fc54c017020 con 0x7fc5580ccbb0 2023-10-06T04:45:28.936 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:28.936 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":33,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:45:26.035018+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:22.109975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:23.489027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:28.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 -- 172.21.15.124:0/1164357027 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc53c066f30 msgr2=0x7fc53c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc53c066f30 0x7fc53c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc5440058d0 tx=0x7fc5440079d0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 -- 172.21.15.124:0/1164357027 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5580ccbb0 msgr2=0x7fc5580c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:28.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5580ccbb0 0x7fc5580c5350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00c590 tx=0x7fc54c00c950 comp rx=0 tx=0).stop 2023-10-06T04:45:28.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 -- 172.21.15.124:0/1164357027 shutdown_connections 2023-10-06T04:45:28.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc53c066f30 0x7fc53c0693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5580ce450 0x7fc55809b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5580ccbb0 0x7fc5580c5350 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 --2- 172.21.15.124:0/1164357027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5580cdfe0 0x7fc558157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:28.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 -- 172.21.15.124:0/1164357027 >> 172.21.15.124:0/1164357027 conn(0x7fc558099710 msgr2=0x7fc5581584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:28.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 -- 172.21.15.124:0/1164357027 shutdown_connections 2023-10-06T04:45:28.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:28.937+0000 7fc55f1ff700 1 -- 172.21.15.124:0/1164357027 wait complete. 2023-10-06T04:45:28.956 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:45:28.956 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:45:29.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.185+0000 7f82f1dff700 1 Processor -- start 2023-10-06T04:45:29.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.185+0000 7f82f1dff700 1 -- start start 2023-10-06T04:45:29.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.186+0000 7f82f1dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f82ec0cdfe0 0x7f82ec0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.186+0000 7f82f1dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f82ec0ccf80 0x7f82ec0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.186+0000 7f82f1dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ec0cf6b0 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.186+0000 7f82f1dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ec0d0250 con 0x7f82ec0ccf80 2023-10-06T04:45:29.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.186+0000 7f82f1dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ec0ceaa0 con 0x7f82ec0cdfe0 2023-10-06T04:45:29.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.187+0000 7f82ebfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f82ec0ccf80 0x7f82ec0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.187+0000 7f82ebfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f82ec0ccf80 0x7f82ec0cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48276/0 (socket says 172.21.15.124:48276) 2023-10-06T04:45:29.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.187+0000 7f82ebfff700 1 -- 172.21.15.124:0/1567531727 learned_addr learned my addr 172.21.15.124:0/1567531727 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:29.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.187+0000 7f82eaffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f82ec0cdfe0 0x7f82ec0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.187+0000 7f82ebfff700 1 -- 172.21.15.124:0/1567531727 >> v2:172.21.15.158:3300/0 conn(0x7f82ec0cdfe0 msgr2=0x7f82ec0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:29.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.187+0000 7f82ebfff700 1 --2- 172.21.15.124:0/1567531727 >> v2:172.21.15.158:3300/0 conn(0x7f82ec0cdfe0 0x7f82ec0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.187+0000 7f82ebfff700 1 -- 172.21.15.124:0/1567531727 >> v1:172.21.15.158:6789/0 conn(0x7f82ec0ccbb0 legacy=0x7f82ec0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.187+0000 7f82ebfff700 1 -- 172.21.15.124:0/1567531727 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec0ced80 con 0x7f82ec0ccf80 2023-10-06T04:45:29.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.187+0000 7f82ebfff700 1 --2- 172.21.15.124:0/1567531727 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccf80 0x7f82ec0cd3e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0cdf90 tx=0x7f82e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7612adcdb08963d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:29.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.187+0000 7f82ea7fc700 1 -- 172.21.15.124:0/1567531727 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e400e070 con 0x7f82ec0ccf80 2023-10-06T04:45:29.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.188+0000 7f82ea7fc700 1 -- 172.21.15.124:0/1567531727 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e400ba20 con 0x7f82ec0ccf80 2023-10-06T04:45:29.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.188+0000 7f82ea7fc700 1 -- 172.21.15.124:0/1567531727 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e40092e0 con 0x7f82ec0ccf80 2023-10-06T04:45:29.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.188+0000 7f82f1dff700 1 -- 172.21.15.124:0/1567531727 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccf80 msgr2=0x7f82ec0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.188+0000 7f82f1dff700 1 --2- 172.21.15.124:0/1567531727 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccf80 0x7f82ec0cd3e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0cdf90 tx=0x7f82e4009840 comp rx=0 tx=0).stop 2023-10-06T04:45:29.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.188+0000 7f82f1dff700 1 -- 172.21.15.124:0/1567531727 shutdown_connections 2023-10-06T04:45:29.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.188+0000 7f82f1dff700 1 --2- 172.21.15.124:0/1567531727 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccf80 0x7f82ec0cd3e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.188+0000 7f82f1dff700 1 --2- 172.21.15.124:0/1567531727 >> v2:172.21.15.158:3300/0 conn(0x7f82ec0cdfe0 0x7f82ec0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.188+0000 7f82f1dff700 1 -- 172.21.15.124:0/1567531727 >> 172.21.15.124:0/1567531727 conn(0x7f82ec099710 msgr2=0x7f82ec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:29.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.188+0000 7f82f1dff700 1 -- 172.21.15.124:0/1567531727 shutdown_connections 2023-10-06T04:45:29.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.188+0000 7f82f1dff700 1 -- 172.21.15.124:0/1567531727 wait complete. 2023-10-06T04:45:29.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.190+0000 7f82f1dff700 1 Processor -- start 2023-10-06T04:45:29.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.190+0000 7f82f1dff700 1 -- start start 2023-10-06T04:45:29.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82f1dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccbb0 0x7f82ec150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82f1dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82ec0ccf80 0x7f82ec0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82f1dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82ec0cdfe0 0x7f82ec0b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82f1dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec169a10 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82f1dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec1510c0 con 0x7f82ec0cdfe0 2023-10-06T04:45:29.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82f1dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec0b0be0 con 0x7f82ec0ccf80 2023-10-06T04:45:29.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82eb7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccbb0 0x7f82ec150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82eb7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccbb0 0x7f82ec150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48290/0 (socket says 172.21.15.124:48290) 2023-10-06T04:45:29.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82eb7fe700 1 -- 172.21.15.124:0/160457075 learned_addr learned my addr 172.21.15.124:0/160457075 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:29.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82ebfff700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82ec0cdfe0 0x7f82ec0b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82eb7fe700 1 -- 172.21.15.124:0/160457075 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82ec0ccf80 msgr2=0x7f82ec0b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82eaffd700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82ec0ccf80 0x7f82ec0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82eb7fe700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82ec0ccf80 0x7f82ec0b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82eb7fe700 1 -- 172.21.15.124:0/160457075 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82ec0cdfe0 msgr2=0x7f82ec0b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82eb7fe700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82ec0cdfe0 0x7f82ec0b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82eb7fe700 1 -- 172.21.15.124:0/160457075 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4009ae0 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.191+0000 7f82eaffd700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82ec0ccf80 0x7f82ec0b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:29.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.192+0000 7f82eb7fe700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccbb0 0x7f82ec150b80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00c590 tx=0x7f82dc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:29.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.192+0000 7f82d37fe700 1 -- 172.21.15.124:0/160457075 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc011590 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.192+0000 7f82d37fe700 1 -- 172.21.15.124:0/160457075 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc0116f0 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.192+0000 7f82f1dff700 1 -- 172.21.15.124:0/160457075 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ec0b0ec0 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.192+0000 7f82d37fe700 1 -- 172.21.15.124:0/160457075 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc011ab0 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.192+0000 7f82f1dff700 1 -- 172.21.15.124:0/160457075 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ec0b1480 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.193+0000 7f82f1dff700 1 -- 172.21.15.124:0/160457075 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ec0717a0 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.194+0000 7f82d37fe700 1 -- 172.21.15.124:0/160457075 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82dc01b3b0 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.195+0000 7f82d37fe700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f82d8066f30 0x7f82d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.195+0000 7f82d37fe700 1 -- 172.21.15.124:0/160457075 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f82dc083c70 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.195+0000 7f82eaffd700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f82d8066f30 0x7f82d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.195+0000 7f82eaffd700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f82d8066f30 0x7f82d80693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f82e0006f00 tx=0x7f82e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:29.200 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.199+0000 7f82d37fe700 1 -- 172.21.15.124:0/160457075 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82dc050ce0 con 0x7f82ec0ccbb0 2023-10-06T04:45:29.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.385+0000 7f82f1dff700 1 -- 172.21.15.124:0/160457075 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82ec0cf060 con 0x7f82d8066f30 2023-10-06T04:45:29.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.395+0000 7f82d37fe700 1 -- 172.21.15.124:0/160457075 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300516 (secure 0 0 0) 0x7f82ec0cf060 con 0x7f82d8066f30 2023-10-06T04:45:29.400 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:29.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 -- 172.21.15.124:0/160457075 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f82d8066f30 msgr2=0x7f82d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f82d8066f30 0x7f82d80693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f82e0006f00 tx=0x7f82e0008040 comp rx=0 tx=0).stop 2023-10-06T04:45:29.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 -- 172.21.15.124:0/160457075 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccbb0 msgr2=0x7f82ec150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccbb0 0x7f82ec150b80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00c590 tx=0x7f82dc00c950 comp rx=0 tx=0).stop 2023-10-06T04:45:29.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 -- 172.21.15.124:0/160457075 shutdown_connections 2023-10-06T04:45:29.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82ec0cdfe0 0x7f82ec0b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82ec0ccbb0 0x7f82ec150b80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f82d8066f30 0x7f82d80693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 --2- 172.21.15.124:0/160457075 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82ec0ccf80 0x7f82ec0b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 -- 172.21.15.124:0/160457075 >> 172.21.15.124:0/160457075 conn(0x7f82ec099710 msgr2=0x7f82ec1584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:29.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 -- 172.21.15.124:0/160457075 shutdown_connections 2023-10-06T04:45:29.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.399+0000 7f82f1dff700 1 -- 172.21.15.124:0/160457075 wait complete. 2023-10-06T04:45:29.404 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:45:29.418 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-06T04:45:27.918036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382044,"kb_used_data":3740,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592676,"statfs":{"total":773094113280,"available":770654900224,"internally_reserved":0,"allocated":3829760,"data_stored":2201410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.901617"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022609+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:36.144588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022355+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:26.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022913+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:34.018015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.018969+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:52.566342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019046+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:37:59.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022518+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:56.166420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.023814+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:53.503530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019684+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:57.337163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.023798+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:32.652101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019533+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:09.892507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019135+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:29.900864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022886+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:33.467360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.023719+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:54.083119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.024295+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:03.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.023066+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:32.567729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022493+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:04.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019816+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:33.467360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019053+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:51.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019251+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:57.516769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022887+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:06.318676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019072+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:46.953946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019114+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:46.243724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.023042+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:29.900864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.018944+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:37.896218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019330+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:11.139647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:16.509841+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:45:16.509841+0000","last_peered":"2023-10-06T04:45:16.509841+0000","last_clean":"2023-10-06T04:45:16.509841+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:45:16.509841+0000","last_undegraded":"2023-10-06T04:45:16.509841+0000","last_fullsized":"2023-10-06T04:45:16.509841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022800+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:09.892507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:16.597115+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:45:16.597115+0000","last_peered":"2023-10-06T04:45:16.597115+0000","last_clean":"2023-10-06T04:45:16.597115+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:45:16.597115+0000","last_undegraded":"2023-10-06T04:45:16.597115+0000","last_fullsized":"2023-10-06T04:45:16.597115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019121+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:56.166420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.790318+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:45:17.790318+0000","last_peered":"2023-10-06T04:45:17.790318+0000","last_clean":"2023-10-06T04:45:17.790318+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:45:17.790318+0000","last_undegraded":"2023-10-06T04:45:17.790318+0000","last_fullsized":"2023-10-06T04:45:17.790318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":169,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.789900+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:45:17.789900+0000","last_peered":"2023-10-06T04:45:17.789900+0000","last_clean":"2023-10-06T04:45:17.789900+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:45:17.789900+0000","last_undegraded":"2023-10-06T04:45:17.789900+0000","last_fullsized":"2023-10-06T04:45:17.789900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019078+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:40.933596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.789882+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:45:17.789882+0000","last_peered":"2023-10-06T04:45:17.789882+0000","last_clean":"2023-10-06T04:45:17.789882+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:45:17.789882+0000","last_undegraded":"2023-10-06T04:45:17.789882+0000","last_fullsized":"2023-10-06T04:45:17.789882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022492+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:37:59.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.789900+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:45:17.789900+0000","last_peered":"2023-10-06T04:45:17.789900+0000","last_clean":"2023-10-06T04:45:17.789900+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:45:17.789900+0000","last_undegraded":"2023-10-06T04:45:17.789900+0000","last_fullsized":"2023-10-06T04:45:17.789900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022359+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.914389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:16.509332+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:45:16.509332+0000","last_peered":"2023-10-06T04:45:16.509332+0000","last_clean":"2023-10-06T04:45:16.509332+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:45:16.509332+0000","last_undegraded":"2023-10-06T04:45:16.509332+0000","last_fullsized":"2023-10-06T04:45:16.509332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022715+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:46.991315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.790189+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:45:17.790189+0000","last_peered":"2023-10-06T04:45:17.790189+0000","last_clean":"2023-10-06T04:45:17.790189+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:45:17.790189+0000","last_undegraded":"2023-10-06T04:45:17.790189+0000","last_fullsized":"2023-10-06T04:45:17.790189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022794+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:09.333679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.790174+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:45:17.790174+0000","last_peered":"2023-10-06T04:45:17.790174+0000","last_clean":"2023-10-06T04:45:17.790174+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:45:17.790174+0000","last_undegraded":"2023-10-06T04:45:17.790174+0000","last_fullsized":"2023-10-06T04:45:17.790174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298192,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073648,"statfs":{"total":96636764160,"available":96331415552,"internally_reserved":0,"allocated":925696,"data_stored":718722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.622}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.3070000000000004,"5min":9.3070000000000004,"15min":9.3070000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.2129999999999992,"5min":9.2129999999999992,"15min":9.2129999999999992},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":9.0850000000000009,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":9.0969999999999995},"last":0.746}]},{"osd":4,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.76500000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":122196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.44},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67200000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.80400000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298192,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073648,"statfs":{"total":96636764160,"available":96331415552,"internally_reserved":0,"allocated":925696,"data_stored":718722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.44},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.2509999999999994,"5min":9.2509999999999994,"15min":9.2509999999999994},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.498}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":6.4000000000000004,"5min":6.4000000000000004,"15min":6.4000000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.4450000000000003,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.61499999999999999},{"interface":"front","average":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":19.992999999999999,"5min":19.992999999999999,"15min":19.992999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":6.476,"5min":6.476,"15min":6.476},"last":0.628},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.9050000000000002,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.753},{"interface":"front","average":{"1min":2.056,"5min":2.056,"15min":2.056},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":19.960999999999999,"5min":19.960999999999999,"15min":19.960999999999999},"last":0.63300000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":331776,"data_stored":128354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.379},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.623}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.58999999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":331776,"data_stored":128354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":11.241,"5min":11.241,"15min":11.241},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.273,"5min":11.273,"15min":11.273},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.499}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":11.125999999999999,"5min":11.125999999999999,"15min":11.125999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":11.208,"5min":11.208,"15min":11.208},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.879},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":5.327,"5min":5.327,"15min":5.327},"last":0.89800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.74199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":331776,"data_stored":128354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.5}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.84499999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":331776,"data_stored":128354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.379},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.437},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.64200000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":331776,"data_stored":128354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:45:29.427 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:45:29.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.647+0000 7fa7569ff700 1 Processor -- start 2023-10-06T04:45:29.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.647+0000 7fa7569ff700 1 -- start start 2023-10-06T04:45:29.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.648+0000 7fa7569ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa7500a7d00 0x7fa7500675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.648+0000 7fa7569ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7500c9930 con 0x7fa7500a7930 2023-10-06T04:45:29.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.648+0000 7fa7569ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa750159f30 con 0x7fa75006bef0 2023-10-06T04:45:29.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.648+0000 7fa7569ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75015a210 con 0x7fa7500a7d00 2023-10-06T04:45:29.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.649+0000 7fa74ffff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa7500a7930 0x7fa7500c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35314/0 (socket says 172.21.15.124:35314) 2023-10-06T04:45:29.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.649+0000 7fa74ffff700 1 -- 172.21.15.124:0/2337199522 learned_addr learned my addr 172.21.15.124:0/2337199522 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:29.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.649+0000 7fa74f7fe700 1 --2- 172.21.15.124:0/2337199522 >> v2:172.21.15.158:3300/0 conn(0x7fa7500a7d00 0x7fa7500675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.649+0000 7fa74effd700 1 -- 172.21.15.124:0/2337199522 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088780886 0 0) 0x7fa740001110 con 0x7fa7500a7930 2023-10-06T04:45:29.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.649+0000 7fa74effd700 1 -- 172.21.15.124:0/2337199522 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa738003570 con 0x7fa7500a7930 2023-10-06T04:45:29.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.649+0000 7fa74effd700 1 -- 172.21.15.124:0/2337199522 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615292079 0 0) 0x7fa750159f30 con 0x7fa75006bef0 2023-10-06T04:45:29.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.649+0000 7fa74effd700 1 -- 172.21.15.124:0/2337199522 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa740001110 con 0x7fa75006bef0 2023-10-06T04:45:29.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.649+0000 7fa74f7fe700 1 -- 172.21.15.124:0/2337199522 >> v1:172.21.15.158:6789/0 conn(0x7fa75006bef0 legacy=0x7fa75015d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.649+0000 7fa74f7fe700 1 -- 172.21.15.124:0/2337199522 >> v1:172.21.15.124:6789/0 conn(0x7fa7500a7930 legacy=0x7fa7500c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.649+0000 7fa74f7fe700 1 -- 172.21.15.124:0/2337199522 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75015a4f0 con 0x7fa7500a7d00 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.650+0000 7fa74f7fe700 1 --2- 172.21.15.124:0/2337199522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7500a7d00 0x7fa7500675f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa7440098e0 tx=0x7fa7440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ae737629830160e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.650+0000 7fa74effd700 1 -- 172.21.15.124:0/2337199522 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744011630 con 0x7fa7500a7d00 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.650+0000 7fa74effd700 1 -- 172.21.15.124:0/2337199522 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744011790 con 0x7fa7500a7d00 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.650+0000 7fa74effd700 1 -- 172.21.15.124:0/2337199522 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744011b30 con 0x7fa7500a7d00 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.650+0000 7fa7569ff700 1 -- 172.21.15.124:0/2337199522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7500a7d00 msgr2=0x7fa7500675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.650+0000 7fa7569ff700 1 --2- 172.21.15.124:0/2337199522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7500a7d00 0x7fa7500675f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa7440098e0 tx=0x7fa7440091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.650+0000 7fa7569ff700 1 -- 172.21.15.124:0/2337199522 shutdown_connections 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.650+0000 7fa7569ff700 1 --2- 172.21.15.124:0/2337199522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7500a7d00 0x7fa7500675f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.650+0000 7fa7569ff700 1 -- 172.21.15.124:0/2337199522 >> 172.21.15.124:0/2337199522 conn(0x7fa7500691d0 msgr2=0x7fa7500cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:29.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.650+0000 7fa7569ff700 1 -- 172.21.15.124:0/2337199522 shutdown_connections 2023-10-06T04:45:29.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.651+0000 7fa7569ff700 1 -- 172.21.15.124:0/2337199522 wait complete. 2023-10-06T04:45:29.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.653+0000 7fa7569ff700 1 Processor -- start 2023-10-06T04:45:29.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.653+0000 7fa7569ff700 1 -- start start 2023-10-06T04:45:29.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa7569ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa75006bef0 0x7fa75014b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa7569ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7500a7930 0x7fa750099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa7569ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7500a7d00 0x7fa75006b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa7569ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa750155d20 con 0x7fa75006bef0 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa7569ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75009a300 con 0x7fa7500a7930 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa7569ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75009a5e0 con 0x7fa7500a7d00 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa74ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa75006bef0 0x7fa75014b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa74ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa75006bef0 0x7fa75014b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48306/0 (socket says 172.21.15.124:48306) 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa74ffff700 1 -- 172.21.15.124:0/2789225695 learned_addr learned my addr 172.21.15.124:0/2789225695 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa754f9c700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7500a7d00 0x7fa75006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.654+0000 7fa74f7fe700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7500a7930 0x7fa750099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa74ffff700 1 -- 172.21.15.124:0/2789225695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7500a7d00 msgr2=0x7fa75006b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa74ffff700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7500a7d00 0x7fa75006b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa74ffff700 1 -- 172.21.15.124:0/2789225695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7500a7930 msgr2=0x7fa750099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa74ffff700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7500a7930 0x7fa750099890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa74ffff700 1 -- 172.21.15.124:0/2789225695 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744009420 con 0x7fa75006bef0 2023-10-06T04:45:29.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa74ffff700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa75006bef0 0x7fa75014b0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c830 tx=0x7fa740007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:29.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa737fff700 1 -- 172.21.15.124:0/2789225695 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740005b30 con 0x7fa75006bef0 2023-10-06T04:45:29.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa737fff700 1 -- 172.21.15.124:0/2789225695 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa740005c90 con 0x7fa75006bef0 2023-10-06T04:45:29.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa7569ff700 1 -- 172.21.15.124:0/2789225695 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75009a8c0 con 0x7fa75006bef0 2023-10-06T04:45:29.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa737fff700 1 -- 172.21.15.124:0/2789225695 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740007320 con 0x7fa75006bef0 2023-10-06T04:45:29.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.655+0000 7fa7569ff700 1 -- 172.21.15.124:0/2789225695 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75014b630 con 0x7fa75006bef0 2023-10-06T04:45:29.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.656+0000 7fa7569ff700 1 -- 172.21.15.124:0/2789225695 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7500717a0 con 0x7fa75006bef0 2023-10-06T04:45:29.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.657+0000 7fa737fff700 1 -- 172.21.15.124:0/2789225695 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa74001b400 con 0x7fa75006bef0 2023-10-06T04:45:29.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.658+0000 7fa737fff700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa73c066f30 0x7fa73c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:29.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.658+0000 7fa737fff700 1 -- 172.21.15.124:0/2789225695 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa7400841b0 con 0x7fa75006bef0 2023-10-06T04:45:29.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.658+0000 7fa74f7fe700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa73c066f30 0x7fa73c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:29.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.659+0000 7fa74f7fe700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa73c066f30 0x7fa73c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa7500a8100 tx=0x7fa744017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:29.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.662+0000 7fa737fff700 1 -- 172.21.15.124:0/2789225695 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa740051340 con 0x7fa75006bef0 2023-10-06T04:45:29.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.846+0000 7fa7569ff700 1 -- 172.21.15.124:0/2789225695 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa750155e60 con 0x7fa73c066f30 2023-10-06T04:45:29.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.855+0000 7fa737fff700 1 -- 172.21.15.124:0/2789225695 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300516 (secure 0 0 0) 0x7fa744000c50 con 0x7fa73c066f30 2023-10-06T04:45:29.860 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:29.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.858+0000 7fa7569ff700 1 -- 172.21.15.124:0/2789225695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa73c066f30 msgr2=0x7fa73c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.858+0000 7fa7569ff700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa73c066f30 0x7fa73c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa7500a8100 tx=0x7fa744017000 comp rx=0 tx=0).stop 2023-10-06T04:45:29.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.858+0000 7fa7569ff700 1 -- 172.21.15.124:0/2789225695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa75006bef0 msgr2=0x7fa75014b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:29.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.858+0000 7fa7569ff700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa75006bef0 0x7fa75014b0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c830 tx=0x7fa740007ea0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.859+0000 7fa7569ff700 1 -- 172.21.15.124:0/2789225695 shutdown_connections 2023-10-06T04:45:29.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.859+0000 7fa7569ff700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa73c066f30 0x7fa73c0693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.859+0000 7fa7569ff700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7500a7d00 0x7fa75006b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.859+0000 7fa7569ff700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa75006bef0 0x7fa75014b0f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.859+0000 7fa7569ff700 1 --2- 172.21.15.124:0/2789225695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7500a7930 0x7fa750099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:29.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.859+0000 7fa7569ff700 1 -- 172.21.15.124:0/2789225695 >> 172.21.15.124:0/2789225695 conn(0x7fa7500691d0 msgr2=0x7fa7500af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:29.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.859+0000 7fa7569ff700 1 -- 172.21.15.124:0/2789225695 shutdown_connections 2023-10-06T04:45:29.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:29.859+0000 7fa7569ff700 1 -- 172.21.15.124:0/2789225695 wait complete. 2023-10-06T04:45:29.863 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:45:29.878 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-06T04:45:27.918036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382044,"kb_used_data":3740,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592676,"statfs":{"total":773094113280,"available":770654900224,"internally_reserved":0,"allocated":3829760,"data_stored":2201410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.901617"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022609+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:36.144588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022355+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:26.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022913+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:34.018015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.018969+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:52.566342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019046+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:37:59.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022518+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:56.166420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.023814+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:53.503530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019684+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:57.337163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.023798+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:32.652101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019533+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:09.892507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019135+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:29.900864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022886+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:33.467360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.023719+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:54.083119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.024295+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:03.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.023066+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:32.567729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022493+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:04.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019816+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:33.467360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019053+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:51.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019251+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:57.516769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022887+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:06.318676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019072+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:46.953946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019114+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:46.243724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.023042+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:29.900864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.018944+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:37.896218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019330+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:11.139647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:16.509841+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:45:16.509841+0000","last_peered":"2023-10-06T04:45:16.509841+0000","last_clean":"2023-10-06T04:45:16.509841+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:45:16.509841+0000","last_undegraded":"2023-10-06T04:45:16.509841+0000","last_fullsized":"2023-10-06T04:45:16.509841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022800+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:09.892507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:16.597115+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:45:16.597115+0000","last_peered":"2023-10-06T04:45:16.597115+0000","last_clean":"2023-10-06T04:45:16.597115+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:45:16.597115+0000","last_undegraded":"2023-10-06T04:45:16.597115+0000","last_fullsized":"2023-10-06T04:45:16.597115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019121+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:56.166420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.790318+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:45:17.790318+0000","last_peered":"2023-10-06T04:45:17.790318+0000","last_clean":"2023-10-06T04:45:17.790318+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:45:17.790318+0000","last_undegraded":"2023-10-06T04:45:17.790318+0000","last_fullsized":"2023-10-06T04:45:17.790318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":169,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.789900+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:45:17.789900+0000","last_peered":"2023-10-06T04:45:17.789900+0000","last_clean":"2023-10-06T04:45:17.789900+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:45:17.789900+0000","last_undegraded":"2023-10-06T04:45:17.789900+0000","last_fullsized":"2023-10-06T04:45:17.789900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.019078+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:40.933596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.789882+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:45:17.789882+0000","last_peered":"2023-10-06T04:45:17.789882+0000","last_clean":"2023-10-06T04:45:17.789882+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:45:17.789882+0000","last_undegraded":"2023-10-06T04:45:17.789882+0000","last_fullsized":"2023-10-06T04:45:17.789882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022492+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:37:59.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.789900+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:45:17.789900+0000","last_peered":"2023-10-06T04:45:17.789900+0000","last_clean":"2023-10-06T04:45:17.789900+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:45:17.789900+0000","last_undegraded":"2023-10-06T04:45:17.789900+0000","last_fullsized":"2023-10-06T04:45:17.789900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022359+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.914389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:16.509332+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:45:16.509332+0000","last_peered":"2023-10-06T04:45:16.509332+0000","last_clean":"2023-10-06T04:45:16.509332+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:45:16.509332+0000","last_undegraded":"2023-10-06T04:45:16.509332+0000","last_fullsized":"2023-10-06T04:45:16.509332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022715+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:46.991315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.790189+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:45:17.790189+0000","last_peered":"2023-10-06T04:45:17.790189+0000","last_clean":"2023-10-06T04:45:17.790189+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:45:17.790189+0000","last_undegraded":"2023-10-06T04:45:17.790189+0000","last_fullsized":"2023-10-06T04:45:17.790189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:45:24.015637+0000","last_change":"2023-10-06T04:45:24.015637+0000","last_active":"2023-10-06T04:45:24.015637+0000","last_peered":"2023-10-06T04:45:24.015637+0000","last_clean":"2023-10-06T04:45:24.015637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:24.015637+0000","last_undegraded":"2023-10-06T04:45:24.015637+0000","last_fullsized":"2023-10-06T04:45:24.015637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:23.012155+0000","last_change":"2023-10-06T04:45:23.022794+0000","last_active":"2023-10-06T04:45:23.012155+0000","last_peered":"2023-10-06T04:45:23.012155+0000","last_clean":"2023-10-06T04:45:23.012155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:23.012155+0000","last_undegraded":"2023-10-06T04:45:23.012155+0000","last_fullsized":"2023-10-06T04:45:23.012155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:09.333679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:45:17.790174+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:45:17.790174+0000","last_peered":"2023-10-06T04:45:17.790174+0000","last_clean":"2023-10-06T04:45:17.790174+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:45:17.790174+0000","last_undegraded":"2023-10-06T04:45:17.790174+0000","last_fullsized":"2023-10-06T04:45:17.790174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298192,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073648,"statfs":{"total":96636764160,"available":96331415552,"internally_reserved":0,"allocated":925696,"data_stored":718722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.622}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.3070000000000004,"5min":9.3070000000000004,"15min":9.3070000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.2129999999999992,"5min":9.2129999999999992,"15min":9.2129999999999992},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":9.0850000000000009,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":9.0969999999999995},"last":0.746}]},{"osd":4,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.76500000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":122196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.44},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67200000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.80400000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298192,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073648,"statfs":{"total":96636764160,"available":96331415552,"internally_reserved":0,"allocated":925696,"data_stored":718722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.44},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.2509999999999994,"5min":9.2509999999999994,"15min":9.2509999999999994},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.498}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":6.4000000000000004,"5min":6.4000000000000004,"15min":6.4000000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.4450000000000003,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.61499999999999999},{"interface":"front","average":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":19.992999999999999,"5min":19.992999999999999,"15min":19.992999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":6.476,"5min":6.476,"15min":6.476},"last":0.628},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.9050000000000002,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.753},{"interface":"front","average":{"1min":2.056,"5min":2.056,"15min":2.056},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":19.960999999999999,"5min":19.960999999999999,"15min":19.960999999999999},"last":0.63300000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":331776,"data_stored":128354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.379},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.623}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.58999999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":331776,"data_stored":128354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":11.241,"5min":11.241,"15min":11.241},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.273,"5min":11.273,"15min":11.273},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.499}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":11.125999999999999,"5min":11.125999999999999,"15min":11.125999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":11.208,"5min":11.208,"15min":11.208},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.879},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":5.327,"5min":5.327,"15min":5.327},"last":0.89800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.74199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":331776,"data_stored":128354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.5}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.84499999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":331776,"data_stored":128354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.379},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.437},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.64200000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":331776,"data_stored":128354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:45:29.885 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:45:30.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.109+0000 7f6d203ff700 1 Processor -- start 2023-10-06T04:45:30.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.109+0000 7f6d203ff700 1 -- start start 2023-10-06T04:45:30.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.110+0000 7f6d203ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6d18159750 0x7f6d180b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.110+0000 7f6d203ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d180cc040 con 0x7f6d18068bb0 2023-10-06T04:45:30.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.110+0000 7f6d203ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1806e990 con 0x7f6d1806ddc0 2023-10-06T04:45:30.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.110+0000 7f6d203ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d180cb9f0 con 0x7f6d18159750 2023-10-06T04:45:30.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.111+0000 7f6d1d99a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6d18068bb0 0x7f6d18159040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35316/0 (socket says 172.21.15.124:35316) 2023-10-06T04:45:30.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.111+0000 7f6d1d99a700 1 -- 172.21.15.124:0/3294989503 learned_addr learned my addr 172.21.15.124:0/3294989503 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:30.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.111+0000 7f6d1e99c700 1 --2- 172.21.15.124:0/3294989503 >> v2:172.21.15.158:3300/0 conn(0x7f6d18159750 0x7f6d180b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.111+0000 7f6d1d199700 1 -- 172.21.15.124:0/3294989503 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741184814 0 0) 0x7f6d180cc040 con 0x7f6d18068bb0 2023-10-06T04:45:30.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.111+0000 7f6d1d199700 1 -- 172.21.15.124:0/3294989503 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d04003570 con 0x7f6d18068bb0 2023-10-06T04:45:30.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.111+0000 7f6d1d199700 1 -- 172.21.15.124:0/3294989503 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545553585 0 0) 0x7f6d1806e990 con 0x7f6d1806ddc0 2023-10-06T04:45:30.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.111+0000 7f6d1d199700 1 -- 172.21.15.124:0/3294989503 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d180cc040 con 0x7f6d1806ddc0 2023-10-06T04:45:30.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.111+0000 7f6d1e99c700 1 -- 172.21.15.124:0/3294989503 >> v1:172.21.15.158:6789/0 conn(0x7f6d1806ddc0 legacy=0x7f6d1806e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.111+0000 7f6d1e99c700 1 -- 172.21.15.124:0/3294989503 >> v1:172.21.15.124:6789/0 conn(0x7f6d18068bb0 legacy=0x7f6d18159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.111+0000 7f6d1e99c700 1 -- 172.21.15.124:0/3294989503 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180cbcd0 con 0x7f6d18159750 2023-10-06T04:45:30.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.112+0000 7f6d1e99c700 1 --2- 172.21.15.124:0/3294989503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d18159750 0x7f6d180b1f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009e60 tx=0x7f6d10009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7699a402e78b389 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:30.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.112+0000 7f6d1d199700 1 -- 172.21.15.124:0/3294989503 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1000e070 con 0x7f6d18159750 2023-10-06T04:45:30.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.112+0000 7f6d1d199700 1 -- 172.21.15.124:0/3294989503 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1000bab0 con 0x7f6d18159750 2023-10-06T04:45:30.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.112+0000 7f6d1d199700 1 -- 172.21.15.124:0/3294989503 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1000be70 con 0x7f6d18159750 2023-10-06T04:45:30.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.112+0000 7f6d203ff700 1 -- 172.21.15.124:0/3294989503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d18159750 msgr2=0x7f6d180b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.112+0000 7f6d203ff700 1 --2- 172.21.15.124:0/3294989503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d18159750 0x7f6d180b1f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009e60 tx=0x7f6d10009780 comp rx=0 tx=0).stop 2023-10-06T04:45:30.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.113+0000 7f6d203ff700 1 -- 172.21.15.124:0/3294989503 shutdown_connections 2023-10-06T04:45:30.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.113+0000 7f6d203ff700 1 --2- 172.21.15.124:0/3294989503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d18159750 0x7f6d180b1f50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.113+0000 7f6d203ff700 1 -- 172.21.15.124:0/3294989503 >> 172.21.15.124:0/3294989503 conn(0x7f6d180cd390 msgr2=0x7f6d180b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:30.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.113+0000 7f6d203ff700 1 -- 172.21.15.124:0/3294989503 shutdown_connections 2023-10-06T04:45:30.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.113+0000 7f6d203ff700 1 -- 172.21.15.124:0/3294989503 wait complete. 2023-10-06T04:45:30.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.114+0000 7f6d203ff700 1 Processor -- start 2023-10-06T04:45:30.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.114+0000 7f6d203ff700 1 -- start start 2023-10-06T04:45:30.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d203ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d18068bb0 0x7f6d1813e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d203ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d1806ddc0 0x7f6d1814ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d203ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d18159750 0x7f6d1814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d203ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d18169cc0 con 0x7f6d18159750 2023-10-06T04:45:30.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d203ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d18169f10 con 0x7f6d18068bb0 2023-10-06T04:45:30.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d203ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1816a1f0 con 0x7f6d1806ddc0 2023-10-06T04:45:30.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d1e99c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d18159750 0x7f6d1814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d1e99c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d18159750 0x7f6d1814e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48314/0 (socket says 172.21.15.124:48314) 2023-10-06T04:45:30.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d1e99c700 1 -- 172.21.15.124:0/2096595889 learned_addr learned my addr 172.21.15.124:0/2096595889 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:30.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d1d99a700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d1806ddc0 0x7f6d1814ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.115+0000 7f6d1e19b700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d18068bb0 0x7f6d1813e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d1e99c700 1 -- 172.21.15.124:0/2096595889 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d1806ddc0 msgr2=0x7f6d1814ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d1e99c700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d1806ddc0 0x7f6d1814ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d1e99c700 1 -- 172.21.15.124:0/2096595889 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d18068bb0 msgr2=0x7f6d1813e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d1e99c700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d18068bb0 0x7f6d1813e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d1e99c700 1 -- 172.21.15.124:0/2096595889 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d10009a20 con 0x7f6d18159750 2023-10-06T04:45:30.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d1d99a700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d1806ddc0 0x7f6d1814ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:30.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d1e99c700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d18159750 0x7f6d1814e330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6d180694e0 tx=0x7f6d10019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:30.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d0e7fc700 1 -- 172.21.15.124:0/2096595889 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10012e60 con 0x7f6d18159750 2023-10-06T04:45:30.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d0e7fc700 1 -- 172.21.15.124:0/2096595889 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d10026480 con 0x7f6d18159750 2023-10-06T04:45:30.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d0e7fc700 1 -- 172.21.15.124:0/2096595889 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10026820 con 0x7f6d18159750 2023-10-06T04:45:30.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d203ff700 1 -- 172.21.15.124:0/2096595889 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1816a4d0 con 0x7f6d18159750 2023-10-06T04:45:30.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.116+0000 7f6d203ff700 1 -- 172.21.15.124:0/2096595889 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1816aa90 con 0x7f6d18159750 2023-10-06T04:45:30.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.118+0000 7f6d203ff700 1 -- 172.21.15.124:0/2096595889 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d180631f0 con 0x7f6d18159750 2023-10-06T04:45:30.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.118+0000 7f6d0e7fc700 1 -- 172.21.15.124:0/2096595889 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d1001c400 con 0x7f6d18159750 2023-10-06T04:45:30.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.119+0000 7f6d0e7fc700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6cfc066f30 0x7f6cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.119+0000 7f6d0e7fc700 1 -- 172.21.15.124:0/2096595889 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6d10086610 con 0x7f6d18159750 2023-10-06T04:45:30.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.119+0000 7f6d1e19b700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6cfc066f30 0x7f6cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.120+0000 7f6d1e19b700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6cfc066f30 0x7f6cfc0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d14007fd0 tx=0x7f6d14007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:30.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.123+0000 7f6d0e7fc700 1 -- 172.21.15.124:0/2096595889 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d10053720 con 0x7f6d18159750 2023-10-06T04:45:30.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.311+0000 7f6d203ff700 1 -- 172.21.15.124:0/2096595889 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d180717a0 con 0x7f6cfc066f30 2023-10-06T04:45:30.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.320+0000 7f6d0e7fc700 1 -- 172.21.15.124:0/2096595889 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311254 (secure 0 0 0) 0x7f6d180717a0 con 0x7f6cfc066f30 2023-10-06T04:45:30.325 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:30.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 -- 172.21.15.124:0/2096595889 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6cfc066f30 msgr2=0x7f6cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6cfc066f30 0x7f6cfc0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d14007fd0 tx=0x7f6d14007d50 comp rx=0 tx=0).stop 2023-10-06T04:45:30.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 -- 172.21.15.124:0/2096595889 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d18159750 msgr2=0x7f6d1814e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d18159750 0x7f6d1814e330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6d180694e0 tx=0x7f6d10019000 comp rx=0 tx=0).stop 2023-10-06T04:45:30.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 -- 172.21.15.124:0/2096595889 shutdown_connections 2023-10-06T04:45:30.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d18159750 0x7f6d1814e330 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d18068bb0 0x7f6d1813e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6cfc066f30 0x7f6cfc0693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 --2- 172.21.15.124:0/2096595889 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d1806ddc0 0x7f6d1814ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 -- 172.21.15.124:0/2096595889 >> 172.21.15.124:0/2096595889 conn(0x7f6d180cd390 msgr2=0x7f6d18157f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:30.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 -- 172.21.15.124:0/2096595889 shutdown_connections 2023-10-06T04:45:30.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.324+0000 7f6d203ff700 1 -- 172.21.15.124:0/2096595889 wait complete. 2023-10-06T04:45:30.329 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:45:30.343 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-06T04:45:29.918571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382408,"kb_used_data":4104,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592312,"statfs":{"total":773094113280,"available":770654527488,"internally_reserved":0,"allocated":4202496,"data_stored":2375164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001158"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057213+0000","last_change":"2023-10-06T04:45:25.055410+0000","last_active":"2023-10-06T04:45:25.057213+0000","last_peered":"2023-10-06T04:45:25.057213+0000","last_clean":"2023-10-06T04:45:25.057213+0000","last_became_active":"2023-10-06T04:45:25.055134+0000","last_became_peered":"2023-10-06T04:45:25.055134+0000","last_unstale":"2023-10-06T04:45:25.057213+0000","last_undegraded":"2023-10-06T04:45:25.057213+0000","last_fullsized":"2023-10-06T04:45:25.057213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:17.060167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057785+0000","last_change":"2023-10-06T04:45:25.051552+0000","last_active":"2023-10-06T04:45:25.057785+0000","last_peered":"2023-10-06T04:45:25.057785+0000","last_clean":"2023-10-06T04:45:25.057785+0000","last_became_active":"2023-10-06T04:45:25.051059+0000","last_became_peered":"2023-10-06T04:45:25.051059+0000","last_unstale":"2023-10-06T04:45:25.057785+0000","last_undegraded":"2023-10-06T04:45:25.057785+0000","last_fullsized":"2023-10-06T04:45:25.057785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:39.256429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.045082+0000","last_change":"2023-10-06T04:45:25.034869+0000","last_active":"2023-10-06T04:45:25.045082+0000","last_peered":"2023-10-06T04:45:25.045082+0000","last_clean":"2023-10-06T04:45:25.045082+0000","last_became_active":"2023-10-06T04:45:25.034530+0000","last_became_peered":"2023-10-06T04:45:25.034530+0000","last_unstale":"2023-10-06T04:45:25.045082+0000","last_undegraded":"2023-10-06T04:45:25.045082+0000","last_fullsized":"2023-10-06T04:45:25.045082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:35.153566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.048655+0000","last_change":"2023-10-06T04:45:25.044979+0000","last_active":"2023-10-06T04:45:25.048655+0000","last_peered":"2023-10-06T04:45:25.048655+0000","last_clean":"2023-10-06T04:45:25.048655+0000","last_became_active":"2023-10-06T04:45:25.044464+0000","last_became_peered":"2023-10-06T04:45:25.044464+0000","last_unstale":"2023-10-06T04:45:25.048655+0000","last_undegraded":"2023-10-06T04:45:25.048655+0000","last_fullsized":"2023-10-06T04:45:25.048655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:48.818850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046270+0000","last_change":"2023-10-06T04:45:25.041271+0000","last_active":"2023-10-06T04:45:25.046270+0000","last_peered":"2023-10-06T04:45:25.046270+0000","last_clean":"2023-10-06T04:45:25.046270+0000","last_became_active":"2023-10-06T04:45:25.040966+0000","last_became_peered":"2023-10-06T04:45:25.040966+0000","last_unstale":"2023-10-06T04:45:25.046270+0000","last_undegraded":"2023-10-06T04:45:25.046270+0000","last_fullsized":"2023-10-06T04:45:25.046270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:03.033468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055245+0000","last_change":"2023-10-06T04:45:25.052180+0000","last_active":"2023-10-06T04:45:25.055245+0000","last_peered":"2023-10-06T04:45:25.055245+0000","last_clean":"2023-10-06T04:45:25.055245+0000","last_became_active":"2023-10-06T04:45:25.051920+0000","last_became_peered":"2023-10-06T04:45:25.051920+0000","last_unstale":"2023-10-06T04:45:25.055245+0000","last_undegraded":"2023-10-06T04:45:25.055245+0000","last_fullsized":"2023-10-06T04:45:25.055245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:22.064473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.053830+0000","last_change":"2023-10-06T04:45:25.051988+0000","last_active":"2023-10-06T04:45:25.053830+0000","last_peered":"2023-10-06T04:45:25.053830+0000","last_clean":"2023-10-06T04:45:25.053830+0000","last_became_active":"2023-10-06T04:45:25.051658+0000","last_became_peered":"2023-10-06T04:45:25.051658+0000","last_unstale":"2023-10-06T04:45:25.053830+0000","last_undegraded":"2023-10-06T04:45:25.053830+0000","last_fullsized":"2023-10-06T04:45:25.053830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:32.285391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.054990+0000","last_change":"2023-10-06T04:45:25.047833+0000","last_active":"2023-10-06T04:45:25.054990+0000","last_peered":"2023-10-06T04:45:25.054990+0000","last_clean":"2023-10-06T04:45:25.054990+0000","last_became_active":"2023-10-06T04:45:25.047553+0000","last_became_peered":"2023-10-06T04:45:25.047553+0000","last_unstale":"2023-10-06T04:45:25.054990+0000","last_undegraded":"2023-10-06T04:45:25.054990+0000","last_fullsized":"2023-10-06T04:45:25.054990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:16.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.043229+0000","last_change":"2023-10-06T04:45:25.034793+0000","last_active":"2023-10-06T04:45:25.043229+0000","last_peered":"2023-10-06T04:45:25.043229+0000","last_clean":"2023-10-06T04:45:25.043229+0000","last_became_active":"2023-10-06T04:45:25.034518+0000","last_became_peered":"2023-10-06T04:45:25.034518+0000","last_unstale":"2023-10-06T04:45:25.043229+0000","last_undegraded":"2023-10-06T04:45:25.043229+0000","last_fullsized":"2023-10-06T04:45:25.043229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:21.839127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049441+0000","last_change":"2023-10-06T04:45:25.042634+0000","last_active":"2023-10-06T04:45:25.049441+0000","last_peered":"2023-10-06T04:45:25.049441+0000","last_clean":"2023-10-06T04:45:25.049441+0000","last_became_active":"2023-10-06T04:45:25.042312+0000","last_became_peered":"2023-10-06T04:45:25.042312+0000","last_unstale":"2023-10-06T04:45:25.049441+0000","last_undegraded":"2023-10-06T04:45:25.049441+0000","last_fullsized":"2023-10-06T04:45:25.049441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.529270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049406+0000","last_change":"2023-10-06T04:45:25.041696+0000","last_active":"2023-10-06T04:45:25.049406+0000","last_peered":"2023-10-06T04:45:25.049406+0000","last_clean":"2023-10-06T04:45:25.049406+0000","last_became_active":"2023-10-06T04:45:25.041426+0000","last_became_peered":"2023-10-06T04:45:25.041426+0000","last_unstale":"2023-10-06T04:45:25.049406+0000","last_undegraded":"2023-10-06T04:45:25.049406+0000","last_fullsized":"2023-10-06T04:45:25.049406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:16.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050812+0000","last_change":"2023-10-06T04:45:25.045801+0000","last_active":"2023-10-06T04:45:25.050812+0000","last_peered":"2023-10-06T04:45:25.050812+0000","last_clean":"2023-10-06T04:45:25.050812+0000","last_became_active":"2023-10-06T04:45:25.045532+0000","last_became_peered":"2023-10-06T04:45:25.045532+0000","last_unstale":"2023-10-06T04:45:25.050812+0000","last_undegraded":"2023-10-06T04:45:25.050812+0000","last_fullsized":"2023-10-06T04:45:25.050812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:59.095337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046568+0000","last_change":"2023-10-06T04:45:25.034602+0000","last_active":"2023-10-06T04:45:25.046568+0000","last_peered":"2023-10-06T04:45:25.046568+0000","last_clean":"2023-10-06T04:45:25.046568+0000","last_became_active":"2023-10-06T04:45:25.034295+0000","last_became_peered":"2023-10-06T04:45:25.034295+0000","last_unstale":"2023-10-06T04:45:25.046568+0000","last_undegraded":"2023-10-06T04:45:25.046568+0000","last_fullsized":"2023-10-06T04:45:25.046568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:05.161120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059002+0000","last_change":"2023-10-06T04:45:25.051193+0000","last_active":"2023-10-06T04:45:25.059002+0000","last_peered":"2023-10-06T04:45:25.059002+0000","last_clean":"2023-10-06T04:45:25.059002+0000","last_became_active":"2023-10-06T04:45:25.050910+0000","last_became_peered":"2023-10-06T04:45:25.050910+0000","last_unstale":"2023-10-06T04:45:25.059002+0000","last_undegraded":"2023-10-06T04:45:25.059002+0000","last_fullsized":"2023-10-06T04:45:25.059002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.809711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049266+0000","last_change":"2023-10-06T04:45:25.041301+0000","last_active":"2023-10-06T04:45:25.049266+0000","last_peered":"2023-10-06T04:45:25.049266+0000","last_clean":"2023-10-06T04:45:25.049266+0000","last_became_active":"2023-10-06T04:45:25.041036+0000","last_became_peered":"2023-10-06T04:45:25.041036+0000","last_unstale":"2023-10-06T04:45:25.049266+0000","last_undegraded":"2023-10-06T04:45:25.049266+0000","last_fullsized":"2023-10-06T04:45:25.049266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:17.060167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060827+0000","last_change":"2023-10-06T04:45:25.048025+0000","last_active":"2023-10-06T04:45:25.060827+0000","last_peered":"2023-10-06T04:45:25.060827+0000","last_clean":"2023-10-06T04:45:25.060827+0000","last_became_active":"2023-10-06T04:45:25.047720+0000","last_became_peered":"2023-10-06T04:45:25.047720+0000","last_unstale":"2023-10-06T04:45:25.060827+0000","last_undegraded":"2023-10-06T04:45:25.060827+0000","last_fullsized":"2023-10-06T04:45:25.060827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:15.277269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061467+0000","last_change":"2023-10-06T04:45:25.057434+0000","last_active":"2023-10-06T04:45:25.061467+0000","last_peered":"2023-10-06T04:45:25.061467+0000","last_clean":"2023-10-06T04:45:25.061467+0000","last_became_active":"2023-10-06T04:45:25.057176+0000","last_became_peered":"2023-10-06T04:45:25.057176+0000","last_unstale":"2023-10-06T04:45:25.061467+0000","last_undegraded":"2023-10-06T04:45:25.061467+0000","last_fullsized":"2023-10-06T04:45:25.061467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:03.163638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046874+0000","last_change":"2023-10-06T04:45:25.043714+0000","last_active":"2023-10-06T04:45:25.046874+0000","last_peered":"2023-10-06T04:45:25.046874+0000","last_clean":"2023-10-06T04:45:25.046874+0000","last_became_active":"2023-10-06T04:45:25.043397+0000","last_became_peered":"2023-10-06T04:45:25.043397+0000","last_unstale":"2023-10-06T04:45:25.046874+0000","last_undegraded":"2023-10-06T04:45:25.046874+0000","last_fullsized":"2023-10-06T04:45:25.046874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:54.194269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.047115+0000","last_change":"2023-10-06T04:45:25.043961+0000","last_active":"2023-10-06T04:45:25.047115+0000","last_peered":"2023-10-06T04:45:25.047115+0000","last_clean":"2023-10-06T04:45:25.047115+0000","last_became_active":"2023-10-06T04:45:25.043694+0000","last_became_peered":"2023-10-06T04:45:25.043694+0000","last_unstale":"2023-10-06T04:45:25.047115+0000","last_undegraded":"2023-10-06T04:45:25.047115+0000","last_fullsized":"2023-10-06T04:45:25.047115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:39.267589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055206+0000","last_change":"2023-10-06T04:45:25.046510+0000","last_active":"2023-10-06T04:45:25.055206+0000","last_peered":"2023-10-06T04:45:25.055206+0000","last_clean":"2023-10-06T04:45:25.055206+0000","last_became_active":"2023-10-06T04:45:25.045787+0000","last_became_peered":"2023-10-06T04:45:25.045787+0000","last_unstale":"2023-10-06T04:45:25.055206+0000","last_undegraded":"2023-10-06T04:45:25.055206+0000","last_fullsized":"2023-10-06T04:45:25.055206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:46.712666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.048645+0000","last_change":"2023-10-06T04:45:25.038523+0000","last_active":"2023-10-06T04:45:25.048645+0000","last_peered":"2023-10-06T04:45:25.048645+0000","last_clean":"2023-10-06T04:45:25.048645+0000","last_became_active":"2023-10-06T04:45:25.036737+0000","last_became_peered":"2023-10-06T04:45:25.036737+0000","last_unstale":"2023-10-06T04:45:25.048645+0000","last_undegraded":"2023-10-06T04:45:25.048645+0000","last_fullsized":"2023-10-06T04:45:25.048645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:28.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059019+0000","last_change":"2023-10-06T04:45:25.051826+0000","last_active":"2023-10-06T04:45:25.059019+0000","last_peered":"2023-10-06T04:45:25.059019+0000","last_clean":"2023-10-06T04:45:25.059019+0000","last_became_active":"2023-10-06T04:45:25.051505+0000","last_became_peered":"2023-10-06T04:45:25.051505+0000","last_unstale":"2023-10-06T04:45:25.059019+0000","last_undegraded":"2023-10-06T04:45:25.059019+0000","last_fullsized":"2023-10-06T04:45:25.059019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:12.049850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061514+0000","last_change":"2023-10-06T04:45:25.057347+0000","last_active":"2023-10-06T04:45:25.061514+0000","last_peered":"2023-10-06T04:45:25.061514+0000","last_clean":"2023-10-06T04:45:25.061514+0000","last_became_active":"2023-10-06T04:45:25.056999+0000","last_became_peered":"2023-10-06T04:45:25.056999+0000","last_unstale":"2023-10-06T04:45:25.061514+0000","last_undegraded":"2023-10-06T04:45:25.061514+0000","last_fullsized":"2023-10-06T04:45:25.061514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:16.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060690+0000","last_change":"2023-10-06T04:45:25.059550+0000","last_active":"2023-10-06T04:45:25.060690+0000","last_peered":"2023-10-06T04:45:25.060690+0000","last_clean":"2023-10-06T04:45:25.060690+0000","last_became_active":"2023-10-06T04:45:25.059284+0000","last_became_peered":"2023-10-06T04:45:25.059284+0000","last_unstale":"2023-10-06T04:45:25.060690+0000","last_undegraded":"2023-10-06T04:45:25.060690+0000","last_fullsized":"2023-10-06T04:45:25.060690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:10.915398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.051570+0000","last_change":"2023-10-06T04:45:25.045967+0000","last_active":"2023-10-06T04:45:25.051570+0000","last_peered":"2023-10-06T04:45:25.051570+0000","last_clean":"2023-10-06T04:45:25.051570+0000","last_became_active":"2023-10-06T04:45:25.045686+0000","last_became_peered":"2023-10-06T04:45:25.045686+0000","last_unstale":"2023-10-06T04:45:25.051570+0000","last_undegraded":"2023-10-06T04:45:25.051570+0000","last_fullsized":"2023-10-06T04:45:25.051570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:34.470842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050076+0000","last_change":"2023-10-06T04:45:25.041504+0000","last_active":"2023-10-06T04:45:25.050076+0000","last_peered":"2023-10-06T04:45:25.050076+0000","last_clean":"2023-10-06T04:45:25.050076+0000","last_became_active":"2023-10-06T04:45:25.041209+0000","last_became_peered":"2023-10-06T04:45:25.041209+0000","last_unstale":"2023-10-06T04:45:25.050076+0000","last_undegraded":"2023-10-06T04:45:25.050076+0000","last_fullsized":"2023-10-06T04:45:25.050076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:48.388756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050924+0000","last_change":"2023-10-06T04:45:25.045462+0000","last_active":"2023-10-06T04:45:25.050924+0000","last_peered":"2023-10-06T04:45:25.050924+0000","last_clean":"2023-10-06T04:45:25.050924+0000","last_became_active":"2023-10-06T04:45:25.045120+0000","last_became_peered":"2023-10-06T04:45:25.045120+0000","last_unstale":"2023-10-06T04:45:25.050924+0000","last_undegraded":"2023-10-06T04:45:25.050924+0000","last_fullsized":"2023-10-06T04:45:25.050924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.086601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055997+0000","last_change":"2023-10-06T04:45:25.053681+0000","last_active":"2023-10-06T04:45:25.055997+0000","last_peered":"2023-10-06T04:45:25.055997+0000","last_clean":"2023-10-06T04:45:25.055997+0000","last_became_active":"2023-10-06T04:45:25.053386+0000","last_became_peered":"2023-10-06T04:45:25.053386+0000","last_unstale":"2023-10-06T04:45:25.055997+0000","last_undegraded":"2023-10-06T04:45:25.055997+0000","last_fullsized":"2023-10-06T04:45:25.055997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:39.256429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046624+0000","last_change":"2023-10-06T04:45:25.040933+0000","last_active":"2023-10-06T04:45:25.046624+0000","last_peered":"2023-10-06T04:45:25.046624+0000","last_clean":"2023-10-06T04:45:25.046624+0000","last_became_active":"2023-10-06T04:45:25.040635+0000","last_became_peered":"2023-10-06T04:45:25.040635+0000","last_unstale":"2023-10-06T04:45:25.046624+0000","last_undegraded":"2023-10-06T04:45:25.046624+0000","last_fullsized":"2023-10-06T04:45:25.046624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:17.174984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057608+0000","last_change":"2023-10-06T04:45:25.052785+0000","last_active":"2023-10-06T04:45:25.057608+0000","last_peered":"2023-10-06T04:45:25.057608+0000","last_clean":"2023-10-06T04:45:25.057608+0000","last_became_active":"2023-10-06T04:45:25.052516+0000","last_became_peered":"2023-10-06T04:45:25.052516+0000","last_unstale":"2023-10-06T04:45:25.057608+0000","last_undegraded":"2023-10-06T04:45:25.057608+0000","last_fullsized":"2023-10-06T04:45:25.057608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:33.655583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061490+0000","last_change":"2023-10-06T04:45:25.056826+0000","last_active":"2023-10-06T04:45:25.061490+0000","last_peered":"2023-10-06T04:45:25.061490+0000","last_clean":"2023-10-06T04:45:25.061490+0000","last_became_active":"2023-10-06T04:45:25.056526+0000","last_became_peered":"2023-10-06T04:45:25.056526+0000","last_unstale":"2023-10-06T04:45:25.061490+0000","last_undegraded":"2023-10-06T04:45:25.061490+0000","last_fullsized":"2023-10-06T04:45:25.061490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:39.256429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050072+0000","last_change":"2023-10-06T04:45:25.039915+0000","last_active":"2023-10-06T04:45:25.050072+0000","last_peered":"2023-10-06T04:45:25.050072+0000","last_clean":"2023-10-06T04:45:25.050072+0000","last_became_active":"2023-10-06T04:45:25.039654+0000","last_became_peered":"2023-10-06T04:45:25.039654+0000","last_unstale":"2023-10-06T04:45:25.050072+0000","last_undegraded":"2023-10-06T04:45:25.050072+0000","last_fullsized":"2023-10-06T04:45:25.050072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:50.918893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060770+0000","last_change":"2023-10-06T04:45:25.041306+0000","last_active":"2023-10-06T04:45:25.060770+0000","last_peered":"2023-10-06T04:45:25.060770+0000","last_clean":"2023-10-06T04:45:25.060770+0000","last_became_active":"2023-10-06T04:45:25.040960+0000","last_became_peered":"2023-10-06T04:45:25.040960+0000","last_unstale":"2023-10-06T04:45:25.060770+0000","last_undegraded":"2023-10-06T04:45:25.060770+0000","last_fullsized":"2023-10-06T04:45:25.060770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:41.320747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061598+0000","last_change":"2023-10-06T04:45:24.043680+0000","last_active":"2023-10-06T04:45:25.061598+0000","last_peered":"2023-10-06T04:45:25.061598+0000","last_clean":"2023-10-06T04:45:25.061598+0000","last_became_active":"2023-10-06T04:45:24.043382+0000","last_became_peered":"2023-10-06T04:45:24.043382+0000","last_unstale":"2023-10-06T04:45:25.061598+0000","last_undegraded":"2023-10-06T04:45:25.061598+0000","last_fullsized":"2023-10-06T04:45:25.061598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:32.245374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.052918+0000","last_change":"2023-10-06T04:45:25.048950+0000","last_active":"2023-10-06T04:45:25.052918+0000","last_peered":"2023-10-06T04:45:25.052918+0000","last_clean":"2023-10-06T04:45:25.052918+0000","last_became_active":"2023-10-06T04:45:25.048721+0000","last_became_peered":"2023-10-06T04:45:25.048721+0000","last_unstale":"2023-10-06T04:45:25.052918+0000","last_undegraded":"2023-10-06T04:45:25.052918+0000","last_fullsized":"2023-10-06T04:45:25.052918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:58.607577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060959+0000","last_change":"2023-10-06T04:45:24.046282+0000","last_active":"2023-10-06T04:45:25.060959+0000","last_peered":"2023-10-06T04:45:25.060959+0000","last_clean":"2023-10-06T04:45:25.060959+0000","last_became_active":"2023-10-06T04:45:24.045974+0000","last_became_peered":"2023-10-06T04:45:24.045974+0000","last_unstale":"2023-10-06T04:45:25.060959+0000","last_undegraded":"2023-10-06T04:45:25.060959+0000","last_fullsized":"2023-10-06T04:45:25.060959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:33.673260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058196+0000","last_change":"2023-10-06T04:45:25.048339+0000","last_active":"2023-10-06T04:45:25.058196+0000","last_peered":"2023-10-06T04:45:25.058196+0000","last_clean":"2023-10-06T04:45:25.058196+0000","last_became_active":"2023-10-06T04:45:25.048068+0000","last_became_peered":"2023-10-06T04:45:25.048068+0000","last_unstale":"2023-10-06T04:45:25.058196+0000","last_undegraded":"2023-10-06T04:45:25.058196+0000","last_fullsized":"2023-10-06T04:45:25.058196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:53.754887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057356+0000","last_change":"2023-10-06T04:45:24.044697+0000","last_active":"2023-10-06T04:45:25.057356+0000","last_peered":"2023-10-06T04:45:25.057356+0000","last_clean":"2023-10-06T04:45:25.057356+0000","last_became_active":"2023-10-06T04:45:24.044416+0000","last_became_peered":"2023-10-06T04:45:24.044416+0000","last_unstale":"2023-10-06T04:45:25.057356+0000","last_undegraded":"2023-10-06T04:45:25.057356+0000","last_fullsized":"2023-10-06T04:45:25.057356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:26.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058160+0000","last_change":"2023-10-06T04:45:25.056068+0000","last_active":"2023-10-06T04:45:25.058160+0000","last_peered":"2023-10-06T04:45:25.058160+0000","last_clean":"2023-10-06T04:45:25.058160+0000","last_became_active":"2023-10-06T04:45:25.055748+0000","last_became_peered":"2023-10-06T04:45:25.055748+0000","last_unstale":"2023-10-06T04:45:25.058160+0000","last_undegraded":"2023-10-06T04:45:25.058160+0000","last_fullsized":"2023-10-06T04:45:25.058160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:53.754887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058107+0000","last_change":"2023-10-06T04:45:24.038087+0000","last_active":"2023-10-06T04:45:25.058107+0000","last_peered":"2023-10-06T04:45:25.058107+0000","last_clean":"2023-10-06T04:45:25.058107+0000","last_became_active":"2023-10-06T04:45:24.037832+0000","last_became_peered":"2023-10-06T04:45:24.037832+0000","last_unstale":"2023-10-06T04:45:25.058107+0000","last_undegraded":"2023-10-06T04:45:25.058107+0000","last_fullsized":"2023-10-06T04:45:25.058107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:02.160156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.042774+0000","last_change":"2023-10-06T04:45:25.033165+0000","last_active":"2023-10-06T04:45:25.042774+0000","last_peered":"2023-10-06T04:45:25.042774+0000","last_clean":"2023-10-06T04:45:25.042774+0000","last_became_active":"2023-10-06T04:45:25.032906+0000","last_became_peered":"2023-10-06T04:45:25.032906+0000","last_unstale":"2023-10-06T04:45:25.042774+0000","last_undegraded":"2023-10-06T04:45:25.042774+0000","last_fullsized":"2023-10-06T04:45:25.042774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:25:12.065102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.051271+0000","last_change":"2023-10-06T04:45:24.040390+0000","last_active":"2023-10-06T04:45:25.051271+0000","last_peered":"2023-10-06T04:45:25.051271+0000","last_clean":"2023-10-06T04:45:25.051271+0000","last_became_active":"2023-10-06T04:45:24.040138+0000","last_became_peered":"2023-10-06T04:45:24.040138+0000","last_unstale":"2023-10-06T04:45:25.051271+0000","last_undegraded":"2023-10-06T04:45:25.051271+0000","last_fullsized":"2023-10-06T04:45:25.051271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:32.652101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046696+0000","last_change":"2023-10-06T04:45:25.036858+0000","last_active":"2023-10-06T04:45:25.046696+0000","last_peered":"2023-10-06T04:45:25.046696+0000","last_clean":"2023-10-06T04:45:25.046696+0000","last_became_active":"2023-10-06T04:45:25.036536+0000","last_became_peered":"2023-10-06T04:45:25.036536+0000","last_unstale":"2023-10-06T04:45:25.046696+0000","last_undegraded":"2023-10-06T04:45:25.046696+0000","last_fullsized":"2023-10-06T04:45:25.046696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:53.754887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060953+0000","last_change":"2023-10-06T04:45:24.046735+0000","last_active":"2023-10-06T04:45:25.060953+0000","last_peered":"2023-10-06T04:45:25.060953+0000","last_clean":"2023-10-06T04:45:25.060953+0000","last_became_active":"2023-10-06T04:45:24.046460+0000","last_became_peered":"2023-10-06T04:45:24.046460+0000","last_unstale":"2023-10-06T04:45:25.060953+0000","last_undegraded":"2023-10-06T04:45:25.060953+0000","last_fullsized":"2023-10-06T04:45:25.060953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:54.083119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058991+0000","last_change":"2023-10-06T04:45:25.050257+0000","last_active":"2023-10-06T04:45:25.058991+0000","last_peered":"2023-10-06T04:45:25.058991+0000","last_clean":"2023-10-06T04:45:25.058991+0000","last_became_active":"2023-10-06T04:45:25.049989+0000","last_became_peered":"2023-10-06T04:45:25.049989+0000","last_unstale":"2023-10-06T04:45:25.058991+0000","last_undegraded":"2023-10-06T04:45:25.058991+0000","last_fullsized":"2023-10-06T04:45:25.058991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:17.060167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032030+0000","last_change":"2023-10-06T04:45:24.037184+0000","last_active":"2023-10-06T04:45:25.032030+0000","last_peered":"2023-10-06T04:45:25.032030+0000","last_clean":"2023-10-06T04:45:25.032030+0000","last_became_active":"2023-10-06T04:45:24.036910+0000","last_became_peered":"2023-10-06T04:45:24.036910+0000","last_unstale":"2023-10-06T04:45:25.032030+0000","last_undegraded":"2023-10-06T04:45:25.032030+0000","last_fullsized":"2023-10-06T04:45:25.032030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.914389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.062829+0000","last_change":"2023-10-06T04:45:25.058465+0000","last_active":"2023-10-06T04:45:25.062829+0000","last_peered":"2023-10-06T04:45:25.062829+0000","last_clean":"2023-10-06T04:45:25.062829+0000","last_became_active":"2023-10-06T04:45:25.058170+0000","last_became_peered":"2023-10-06T04:45:25.058170+0000","last_unstale":"2023-10-06T04:45:25.062829+0000","last_undegraded":"2023-10-06T04:45:25.062829+0000","last_fullsized":"2023-10-06T04:45:25.062829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.529270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.033942+0000","last_change":"2023-10-06T04:45:24.048019+0000","last_active":"2023-10-06T04:45:25.033942+0000","last_peered":"2023-10-06T04:45:25.033942+0000","last_clean":"2023-10-06T04:45:25.033942+0000","last_became_active":"2023-10-06T04:45:24.046776+0000","last_became_peered":"2023-10-06T04:45:24.046776+0000","last_unstale":"2023-10-06T04:45:25.033942+0000","last_undegraded":"2023-10-06T04:45:25.033942+0000","last_fullsized":"2023-10-06T04:45:25.033942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:35.677022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.047506+0000","last_change":"2023-10-06T04:45:25.044751+0000","last_active":"2023-10-06T04:45:25.047506+0000","last_peered":"2023-10-06T04:45:25.047506+0000","last_clean":"2023-10-06T04:45:25.047506+0000","last_became_active":"2023-10-06T04:45:25.044135+0000","last_became_peered":"2023-10-06T04:45:25.044135+0000","last_unstale":"2023-10-06T04:45:25.047506+0000","last_undegraded":"2023-10-06T04:45:25.047506+0000","last_fullsized":"2023-10-06T04:45:25.047506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:34.676742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.044085+0000","last_change":"2023-10-06T04:45:24.039106+0000","last_active":"2023-10-06T04:45:25.044085+0000","last_peered":"2023-10-06T04:45:25.044085+0000","last_clean":"2023-10-06T04:45:25.044085+0000","last_became_active":"2023-10-06T04:45:24.038821+0000","last_became_peered":"2023-10-06T04:45:24.038821+0000","last_unstale":"2023-10-06T04:45:25.044085+0000","last_undegraded":"2023-10-06T04:45:25.044085+0000","last_fullsized":"2023-10-06T04:45:25.044085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:48.520607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061521+0000","last_change":"2023-10-06T04:45:25.058027+0000","last_active":"2023-10-06T04:45:25.061521+0000","last_peered":"2023-10-06T04:45:25.061521+0000","last_clean":"2023-10-06T04:45:25.061521+0000","last_became_active":"2023-10-06T04:45:25.057759+0000","last_became_peered":"2023-10-06T04:45:25.057759+0000","last_unstale":"2023-10-06T04:45:25.061521+0000","last_undegraded":"2023-10-06T04:45:25.061521+0000","last_fullsized":"2023-10-06T04:45:25.061521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:32.285391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.028175+0000","last_change":"2023-10-06T04:45:24.040075+0000","last_active":"2023-10-06T04:45:25.028175+0000","last_peered":"2023-10-06T04:45:25.028175+0000","last_clean":"2023-10-06T04:45:25.028175+0000","last_became_active":"2023-10-06T04:45:24.039813+0000","last_became_peered":"2023-10-06T04:45:24.039813+0000","last_unstale":"2023-10-06T04:45:25.028175+0000","last_undegraded":"2023-10-06T04:45:25.028175+0000","last_fullsized":"2023-10-06T04:45:25.028175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.171502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.062994+0000","last_change":"2023-10-06T04:45:25.058596+0000","last_active":"2023-10-06T04:45:25.062994+0000","last_peered":"2023-10-06T04:45:25.062994+0000","last_clean":"2023-10-06T04:45:25.062994+0000","last_became_active":"2023-10-06T04:45:25.057874+0000","last_became_peered":"2023-10-06T04:45:25.057874+0000","last_unstale":"2023-10-06T04:45:25.062994+0000","last_undegraded":"2023-10-06T04:45:25.062994+0000","last_fullsized":"2023-10-06T04:45:25.062994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:37.777434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055677+0000","last_change":"2023-10-06T04:45:24.042012+0000","last_active":"2023-10-06T04:45:25.055677+0000","last_peered":"2023-10-06T04:45:25.055677+0000","last_clean":"2023-10-06T04:45:25.055677+0000","last_became_active":"2023-10-06T04:45:24.041752+0000","last_became_peered":"2023-10-06T04:45:24.041752+0000","last_unstale":"2023-10-06T04:45:25.055677+0000","last_undegraded":"2023-10-06T04:45:25.055677+0000","last_fullsized":"2023-10-06T04:45:25.055677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:45.709185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059564+0000","last_change":"2023-10-06T04:45:25.046424+0000","last_active":"2023-10-06T04:45:25.059564+0000","last_peered":"2023-10-06T04:45:25.059564+0000","last_clean":"2023-10-06T04:45:25.059564+0000","last_became_active":"2023-10-06T04:45:25.046155+0000","last_became_peered":"2023-10-06T04:45:25.046155+0000","last_unstale":"2023-10-06T04:45:25.059564+0000","last_undegraded":"2023-10-06T04:45:25.059564+0000","last_fullsized":"2023-10-06T04:45:25.059564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:28.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.063313+0000","last_change":"2023-10-06T04:45:24.042616+0000","last_active":"2023-10-06T04:45:25.063313+0000","last_peered":"2023-10-06T04:45:25.063313+0000","last_clean":"2023-10-06T04:45:25.063313+0000","last_became_active":"2023-10-06T04:45:24.042368+0000","last_became_peered":"2023-10-06T04:45:24.042368+0000","last_unstale":"2023-10-06T04:45:25.063313+0000","last_undegraded":"2023-10-06T04:45:25.063313+0000","last_fullsized":"2023-10-06T04:45:25.063313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:53.190787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.045269+0000","last_change":"2023-10-06T04:45:25.042108+0000","last_active":"2023-10-06T04:45:25.045269+0000","last_peered":"2023-10-06T04:45:25.045269+0000","last_clean":"2023-10-06T04:45:25.045269+0000","last_became_active":"2023-10-06T04:45:25.041770+0000","last_became_peered":"2023-10-06T04:45:25.041770+0000","last_unstale":"2023-10-06T04:45:25.045269+0000","last_undegraded":"2023-10-06T04:45:25.045269+0000","last_fullsized":"2023-10-06T04:45:25.045269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:03.272820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.054996+0000","last_change":"2023-10-06T04:45:24.044839+0000","last_active":"2023-10-06T04:45:25.054996+0000","last_peered":"2023-10-06T04:45:25.054996+0000","last_clean":"2023-10-06T04:45:25.054996+0000","last_became_active":"2023-10-06T04:45:24.044609+0000","last_became_peered":"2023-10-06T04:45:24.044609+0000","last_unstale":"2023-10-06T04:45:25.054996+0000","last_undegraded":"2023-10-06T04:45:25.054996+0000","last_fullsized":"2023-10-06T04:45:25.054996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.171502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055118+0000","last_change":"2023-10-06T04:45:25.047180+0000","last_active":"2023-10-06T04:45:25.055118+0000","last_peered":"2023-10-06T04:45:25.055118+0000","last_clean":"2023-10-06T04:45:25.055118+0000","last_became_active":"2023-10-06T04:45:25.046892+0000","last_became_peered":"2023-10-06T04:45:25.046892+0000","last_unstale":"2023-10-06T04:45:25.055118+0000","last_undegraded":"2023-10-06T04:45:25.055118+0000","last_fullsized":"2023-10-06T04:45:25.055118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:23.793022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031742+0000","last_change":"2023-10-06T04:45:24.042592+0000","last_active":"2023-10-06T04:45:25.031742+0000","last_peered":"2023-10-06T04:45:25.031742+0000","last_clean":"2023-10-06T04:45:25.031742+0000","last_became_active":"2023-10-06T04:45:24.042174+0000","last_became_peered":"2023-10-06T04:45:24.042174+0000","last_unstale":"2023-10-06T04:45:25.031742+0000","last_undegraded":"2023-10-06T04:45:25.031742+0000","last_fullsized":"2023-10-06T04:45:25.031742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:09.333679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061413+0000","last_change":"2023-10-06T04:45:25.056826+0000","last_active":"2023-10-06T04:45:25.061413+0000","last_peered":"2023-10-06T04:45:25.061413+0000","last_clean":"2023-10-06T04:45:25.061413+0000","last_became_active":"2023-10-06T04:45:25.056564+0000","last_became_peered":"2023-10-06T04:45:25.056564+0000","last_unstale":"2023-10-06T04:45:25.061413+0000","last_undegraded":"2023-10-06T04:45:25.061413+0000","last_fullsized":"2023-10-06T04:45:25.061413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:23.793022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031601+0000","last_change":"2023-10-06T04:45:24.046164+0000","last_active":"2023-10-06T04:45:25.031601+0000","last_peered":"2023-10-06T04:45:25.031601+0000","last_clean":"2023-10-06T04:45:25.031601+0000","last_became_active":"2023-10-06T04:45:24.045838+0000","last_became_peered":"2023-10-06T04:45:24.045838+0000","last_unstale":"2023-10-06T04:45:25.031601+0000","last_undegraded":"2023-10-06T04:45:25.031601+0000","last_fullsized":"2023-10-06T04:45:25.031601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:16.041117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.056300+0000","last_change":"2023-10-06T04:45:25.051756+0000","last_active":"2023-10-06T04:45:25.056300+0000","last_peered":"2023-10-06T04:45:25.056300+0000","last_clean":"2023-10-06T04:45:25.056300+0000","last_became_active":"2023-10-06T04:45:25.051464+0000","last_became_peered":"2023-10-06T04:45:25.051464+0000","last_unstale":"2023-10-06T04:45:25.056300+0000","last_undegraded":"2023-10-06T04:45:25.056300+0000","last_fullsized":"2023-10-06T04:45:25.056300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:28.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061490+0000","last_change":"2023-10-06T04:45:24.045655+0000","last_active":"2023-10-06T04:45:25.061490+0000","last_peered":"2023-10-06T04:45:25.061490+0000","last_clean":"2023-10-06T04:45:25.061490+0000","last_became_active":"2023-10-06T04:45:24.045386+0000","last_became_peered":"2023-10-06T04:45:24.045386+0000","last_unstale":"2023-10-06T04:45:25.061490+0000","last_undegraded":"2023-10-06T04:45:25.061490+0000","last_fullsized":"2023-10-06T04:45:25.061490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:33.467360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.056374+0000","last_change":"2023-10-06T04:45:25.051472+0000","last_active":"2023-10-06T04:45:25.056374+0000","last_peered":"2023-10-06T04:45:25.056374+0000","last_clean":"2023-10-06T04:45:25.056374+0000","last_became_active":"2023-10-06T04:45:25.051215+0000","last_became_peered":"2023-10-06T04:45:25.051215+0000","last_unstale":"2023-10-06T04:45:25.056374+0000","last_undegraded":"2023-10-06T04:45:25.056374+0000","last_fullsized":"2023-10-06T04:45:25.056374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:05.161120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060210+0000","last_change":"2023-10-06T04:45:24.045022+0000","last_active":"2023-10-06T04:45:25.060210+0000","last_peered":"2023-10-06T04:45:25.060210+0000","last_clean":"2023-10-06T04:45:25.060210+0000","last_became_active":"2023-10-06T04:45:24.044717+0000","last_became_peered":"2023-10-06T04:45:24.044717+0000","last_unstale":"2023-10-06T04:45:25.060210+0000","last_undegraded":"2023-10-06T04:45:25.060210+0000","last_fullsized":"2023-10-06T04:45:25.060210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:54.083119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.047231+0000","last_change":"2023-10-06T04:45:25.038112+0000","last_active":"2023-10-06T04:45:25.047231+0000","last_peered":"2023-10-06T04:45:25.047231+0000","last_clean":"2023-10-06T04:45:25.047231+0000","last_became_active":"2023-10-06T04:45:25.037838+0000","last_became_peered":"2023-10-06T04:45:25.037838+0000","last_unstale":"2023-10-06T04:45:25.047231+0000","last_undegraded":"2023-10-06T04:45:25.047231+0000","last_fullsized":"2023-10-06T04:45:25.047231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.809711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061571+0000","last_change":"2023-10-06T04:45:24.035422+0000","last_active":"2023-10-06T04:45:25.061571+0000","last_peered":"2023-10-06T04:45:25.061571+0000","last_clean":"2023-10-06T04:45:25.061571+0000","last_became_active":"2023-10-06T04:45:24.035082+0000","last_became_peered":"2023-10-06T04:45:24.035082+0000","last_unstale":"2023-10-06T04:45:25.061571+0000","last_undegraded":"2023-10-06T04:45:25.061571+0000","last_fullsized":"2023-10-06T04:45:25.061571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:40.317265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058177+0000","last_change":"2023-10-06T04:45:25.047754+0000","last_active":"2023-10-06T04:45:25.058177+0000","last_peered":"2023-10-06T04:45:25.058177+0000","last_clean":"2023-10-06T04:45:25.058177+0000","last_became_active":"2023-10-06T04:45:25.047417+0000","last_became_peered":"2023-10-06T04:45:25.047417+0000","last_unstale":"2023-10-06T04:45:25.058177+0000","last_undegraded":"2023-10-06T04:45:25.058177+0000","last_fullsized":"2023-10-06T04:45:25.058177+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:40.635239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061744+0000","last_change":"2023-10-06T04:45:24.042918+0000","last_active":"2023-10-06T04:45:25.061744+0000","last_peered":"2023-10-06T04:45:25.061744+0000","last_clean":"2023-10-06T04:45:25.061744+0000","last_became_active":"2023-10-06T04:45:24.042646+0000","last_became_peered":"2023-10-06T04:45:24.042646+0000","last_unstale":"2023-10-06T04:45:25.061744+0000","last_undegraded":"2023-10-06T04:45:25.061744+0000","last_fullsized":"2023-10-06T04:45:25.061744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:28.240091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057704+0000","last_change":"2023-10-06T04:45:25.056690+0000","last_active":"2023-10-06T04:45:25.057704+0000","last_peered":"2023-10-06T04:45:25.057704+0000","last_clean":"2023-10-06T04:45:25.057704+0000","last_became_active":"2023-10-06T04:45:25.056393+0000","last_became_peered":"2023-10-06T04:45:25.056393+0000","last_unstale":"2023-10-06T04:45:25.057704+0000","last_undegraded":"2023-10-06T04:45:25.057704+0000","last_fullsized":"2023-10-06T04:45:25.057704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:10.337161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031248+0000","last_change":"2023-10-06T04:45:24.041465+0000","last_active":"2023-10-06T04:45:25.031248+0000","last_peered":"2023-10-06T04:45:25.031248+0000","last_clean":"2023-10-06T04:45:25.031248+0000","last_became_active":"2023-10-06T04:45:24.041130+0000","last_became_peered":"2023-10-06T04:45:24.041130+0000","last_unstale":"2023-10-06T04:45:25.031248+0000","last_undegraded":"2023-10-06T04:45:25.031248+0000","last_fullsized":"2023-10-06T04:45:25.031248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:00.390284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060849+0000","last_change":"2023-10-06T04:45:25.048046+0000","last_active":"2023-10-06T04:45:25.060849+0000","last_peered":"2023-10-06T04:45:25.060849+0000","last_clean":"2023-10-06T04:45:25.060849+0000","last_became_active":"2023-10-06T04:45:25.047278+0000","last_became_peered":"2023-10-06T04:45:25.047278+0000","last_unstale":"2023-10-06T04:45:25.060849+0000","last_undegraded":"2023-10-06T04:45:25.060849+0000","last_fullsized":"2023-10-06T04:45:25.060849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:44.480794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055548+0000","last_change":"2023-10-06T04:45:24.041722+0000","last_active":"2023-10-06T04:45:25.055548+0000","last_peered":"2023-10-06T04:45:25.055548+0000","last_clean":"2023-10-06T04:45:25.055548+0000","last_became_active":"2023-10-06T04:45:24.041403+0000","last_became_peered":"2023-10-06T04:45:24.041403+0000","last_unstale":"2023-10-06T04:45:25.055548+0000","last_undegraded":"2023-10-06T04:45:25.055548+0000","last_fullsized":"2023-10-06T04:45:25.055548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:32.383557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060537+0000","last_change":"2023-10-06T04:45:25.056705+0000","last_active":"2023-10-06T04:45:25.060537+0000","last_peered":"2023-10-06T04:45:25.060537+0000","last_clean":"2023-10-06T04:45:25.060537+0000","last_became_active":"2023-10-06T04:45:25.056418+0000","last_became_peered":"2023-10-06T04:45:25.056418+0000","last_unstale":"2023-10-06T04:45:25.060537+0000","last_undegraded":"2023-10-06T04:45:25.060537+0000","last_fullsized":"2023-10-06T04:45:25.060537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:12.144695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031079+0000","last_change":"2023-10-06T04:45:24.035822+0000","last_active":"2023-10-06T04:45:25.031079+0000","last_peered":"2023-10-06T04:45:25.031079+0000","last_clean":"2023-10-06T04:45:25.031079+0000","last_became_active":"2023-10-06T04:45:24.035472+0000","last_became_peered":"2023-10-06T04:45:24.035472+0000","last_unstale":"2023-10-06T04:45:25.031079+0000","last_undegraded":"2023-10-06T04:45:25.031079+0000","last_fullsized":"2023-10-06T04:45:25.031079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:13.317724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.052919+0000","last_change":"2023-10-06T04:45:25.050200+0000","last_active":"2023-10-06T04:45:25.052919+0000","last_peered":"2023-10-06T04:45:25.052919+0000","last_clean":"2023-10-06T04:45:25.052919+0000","last_became_active":"2023-10-06T04:45:25.049918+0000","last_became_peered":"2023-10-06T04:45:25.049918+0000","last_unstale":"2023-10-06T04:45:25.052919+0000","last_undegraded":"2023-10-06T04:45:25.052919+0000","last_fullsized":"2023-10-06T04:45:25.052919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:23.793022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034862+0000","last_change":"2023-10-06T04:45:24.049005+0000","last_active":"2023-10-06T04:45:25.034862+0000","last_peered":"2023-10-06T04:45:25.034862+0000","last_clean":"2023-10-06T04:45:25.034862+0000","last_became_active":"2023-10-06T04:45:24.048710+0000","last_became_peered":"2023-10-06T04:45:24.048710+0000","last_unstale":"2023-10-06T04:45:25.034862+0000","last_undegraded":"2023-10-06T04:45:25.034862+0000","last_fullsized":"2023-10-06T04:45:25.034862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:09.892507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.062810+0000","last_change":"2023-10-06T04:45:25.058473+0000","last_active":"2023-10-06T04:45:25.062810+0000","last_peered":"2023-10-06T04:45:25.062810+0000","last_clean":"2023-10-06T04:45:25.062810+0000","last_became_active":"2023-10-06T04:45:25.058174+0000","last_became_peered":"2023-10-06T04:45:25.058174+0000","last_unstale":"2023-10-06T04:45:25.062810+0000","last_undegraded":"2023-10-06T04:45:25.062810+0000","last_fullsized":"2023-10-06T04:45:25.062810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:32.285391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031484+0000","last_change":"2023-10-06T04:45:24.040874+0000","last_active":"2023-10-06T04:45:25.031484+0000","last_peered":"2023-10-06T04:45:25.031484+0000","last_clean":"2023-10-06T04:45:25.031484+0000","last_became_active":"2023-10-06T04:45:24.040622+0000","last_became_peered":"2023-10-06T04:45:24.040622+0000","last_unstale":"2023-10-06T04:45:25.031484+0000","last_undegraded":"2023-10-06T04:45:25.031484+0000","last_fullsized":"2023-10-06T04:45:25.031484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:06.175768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059036+0000","last_change":"2023-10-06T04:45:25.052636+0000","last_active":"2023-10-06T04:45:25.059036+0000","last_peered":"2023-10-06T04:45:25.059036+0000","last_clean":"2023-10-06T04:45:25.059036+0000","last_became_active":"2023-10-06T04:45:25.052320+0000","last_became_peered":"2023-10-06T04:45:25.052320+0000","last_unstale":"2023-10-06T04:45:25.059036+0000","last_undegraded":"2023-10-06T04:45:25.059036+0000","last_fullsized":"2023-10-06T04:45:25.059036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:05.161120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.030908+0000","last_change":"2023-10-06T04:45:24.042782+0000","last_active":"2023-10-06T04:45:25.030908+0000","last_peered":"2023-10-06T04:45:25.030908+0000","last_clean":"2023-10-06T04:45:25.030908+0000","last_became_active":"2023-10-06T04:45:24.040786+0000","last_became_peered":"2023-10-06T04:45:24.040786+0000","last_unstale":"2023-10-06T04:45:25.030908+0000","last_undegraded":"2023-10-06T04:45:25.030908+0000","last_fullsized":"2023-10-06T04:45:25.030908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:08.373503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031576+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:45:25.031576+0000","last_peered":"2023-10-06T04:45:25.031576+0000","last_clean":"2023-10-06T04:45:25.031576+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:45:25.031576+0000","last_undegraded":"2023-10-06T04:45:25.031576+0000","last_fullsized":"2023-10-06T04:45:25.031576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060883+0000","last_change":"2023-10-06T04:45:25.048977+0000","last_active":"2023-10-06T04:45:25.060883+0000","last_peered":"2023-10-06T04:45:25.060883+0000","last_clean":"2023-10-06T04:45:25.060883+0000","last_became_active":"2023-10-06T04:45:25.048698+0000","last_became_peered":"2023-10-06T04:45:25.048698+0000","last_unstale":"2023-10-06T04:45:25.060883+0000","last_undegraded":"2023-10-06T04:45:25.060883+0000","last_fullsized":"2023-10-06T04:45:25.060883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.529270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034572+0000","last_change":"2023-10-06T04:45:24.042117+0000","last_active":"2023-10-06T04:45:25.034572+0000","last_peered":"2023-10-06T04:45:25.034572+0000","last_clean":"2023-10-06T04:45:25.034572+0000","last_became_active":"2023-10-06T04:45:24.041876+0000","last_became_peered":"2023-10-06T04:45:24.041876+0000","last_unstale":"2023-10-06T04:45:25.034572+0000","last_undegraded":"2023-10-06T04:45:25.034572+0000","last_fullsized":"2023-10-06T04:45:25.034572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:45.709185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.036823+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:45:25.036823+0000","last_peered":"2023-10-06T04:45:25.036823+0000","last_clean":"2023-10-06T04:45:25.036823+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:45:25.036823+0000","last_undegraded":"2023-10-06T04:45:25.036823+0000","last_fullsized":"2023-10-06T04:45:25.036823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.053635+0000","last_change":"2023-10-06T04:45:25.048854+0000","last_active":"2023-10-06T04:45:25.053635+0000","last_peered":"2023-10-06T04:45:25.053635+0000","last_clean":"2023-10-06T04:45:25.053635+0000","last_became_active":"2023-10-06T04:45:25.048608+0000","last_became_peered":"2023-10-06T04:45:25.048608+0000","last_unstale":"2023-10-06T04:45:25.053635+0000","last_undegraded":"2023-10-06T04:45:25.053635+0000","last_fullsized":"2023-10-06T04:45:25.053635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:17.232105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.053985+0000","last_change":"2023-10-06T04:45:24.040958+0000","last_active":"2023-10-06T04:45:25.053985+0000","last_peered":"2023-10-06T04:45:25.053985+0000","last_clean":"2023-10-06T04:45:25.053985+0000","last_became_active":"2023-10-06T04:45:24.040708+0000","last_became_peered":"2023-10-06T04:45:24.040708+0000","last_unstale":"2023-10-06T04:45:25.053985+0000","last_undegraded":"2023-10-06T04:45:25.053985+0000","last_fullsized":"2023-10-06T04:45:25.053985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:53.190787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031224+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:45:25.031224+0000","last_peered":"2023-10-06T04:45:25.031224+0000","last_clean":"2023-10-06T04:45:25.031224+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:45:25.031224+0000","last_undegraded":"2023-10-06T04:45:25.031224+0000","last_fullsized":"2023-10-06T04:45:25.031224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032722+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:45:25.032722+0000","last_peered":"2023-10-06T04:45:25.032722+0000","last_clean":"2023-10-06T04:45:25.032722+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:45:25.032722+0000","last_undegraded":"2023-10-06T04:45:25.032722+0000","last_fullsized":"2023-10-06T04:45:25.032722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061540+0000","last_change":"2023-10-06T04:45:25.058535+0000","last_active":"2023-10-06T04:45:25.061540+0000","last_peered":"2023-10-06T04:45:25.061540+0000","last_clean":"2023-10-06T04:45:25.061540+0000","last_became_active":"2023-10-06T04:45:25.058002+0000","last_became_peered":"2023-10-06T04:45:25.058002+0000","last_unstale":"2023-10-06T04:45:25.061540+0000","last_undegraded":"2023-10-06T04:45:25.061540+0000","last_fullsized":"2023-10-06T04:45:25.061540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:54.036388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.030053+0000","last_change":"2023-10-06T04:45:24.043108+0000","last_active":"2023-10-06T04:45:25.030053+0000","last_peered":"2023-10-06T04:45:25.030053+0000","last_clean":"2023-10-06T04:45:25.030053+0000","last_became_active":"2023-10-06T04:45:24.042819+0000","last_became_peered":"2023-10-06T04:45:24.042819+0000","last_unstale":"2023-10-06T04:45:25.030053+0000","last_undegraded":"2023-10-06T04:45:25.030053+0000","last_fullsized":"2023-10-06T04:45:25.030053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:35.981900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034413+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:45:25.034413+0000","last_peered":"2023-10-06T04:45:25.034413+0000","last_clean":"2023-10-06T04:45:25.034413+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:45:25.034413+0000","last_undegraded":"2023-10-06T04:45:25.034413+0000","last_fullsized":"2023-10-06T04:45:25.034413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060490+0000","last_change":"2023-10-06T04:45:25.056909+0000","last_active":"2023-10-06T04:45:25.060490+0000","last_peered":"2023-10-06T04:45:25.060490+0000","last_clean":"2023-10-06T04:45:25.060490+0000","last_became_active":"2023-10-06T04:45:25.056637+0000","last_became_peered":"2023-10-06T04:45:25.056637+0000","last_unstale":"2023-10-06T04:45:25.060490+0000","last_undegraded":"2023-10-06T04:45:25.060490+0000","last_fullsized":"2023-10-06T04:45:25.060490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:54.036388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034554+0000","last_change":"2023-10-06T04:45:24.049099+0000","last_active":"2023-10-06T04:45:25.034554+0000","last_peered":"2023-10-06T04:45:25.034554+0000","last_clean":"2023-10-06T04:45:25.034554+0000","last_became_active":"2023-10-06T04:45:24.048803+0000","last_became_peered":"2023-10-06T04:45:24.048803+0000","last_unstale":"2023-10-06T04:45:25.034554+0000","last_undegraded":"2023-10-06T04:45:25.034554+0000","last_fullsized":"2023-10-06T04:45:25.034554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:32.652101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032637+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:45:25.032637+0000","last_peered":"2023-10-06T04:45:25.032637+0000","last_clean":"2023-10-06T04:45:25.032637+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:45:25.032637+0000","last_undegraded":"2023-10-06T04:45:25.032637+0000","last_fullsized":"2023-10-06T04:45:25.032637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057765+0000","last_change":"2023-10-06T04:45:25.051257+0000","last_active":"2023-10-06T04:45:25.057765+0000","last_peered":"2023-10-06T04:45:25.057765+0000","last_clean":"2023-10-06T04:45:25.057765+0000","last_became_active":"2023-10-06T04:45:25.050992+0000","last_became_peered":"2023-10-06T04:45:25.050992+0000","last_unstale":"2023-10-06T04:45:25.057765+0000","last_undegraded":"2023-10-06T04:45:25.057765+0000","last_fullsized":"2023-10-06T04:45:25.057765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:54.036388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.027145+0000","last_change":"2023-10-06T04:45:24.040171+0000","last_active":"2023-10-06T04:45:25.027145+0000","last_peered":"2023-10-06T04:45:25.027145+0000","last_clean":"2023-10-06T04:45:25.027145+0000","last_became_active":"2023-10-06T04:45:24.039922+0000","last_became_peered":"2023-10-06T04:45:24.039922+0000","last_unstale":"2023-10-06T04:45:25.027145+0000","last_undegraded":"2023-10-06T04:45:25.027145+0000","last_fullsized":"2023-10-06T04:45:25.027145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:02.029986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.028062+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:45:25.028062+0000","last_peered":"2023-10-06T04:45:25.028062+0000","last_clean":"2023-10-06T04:45:25.028062+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:45:25.028062+0000","last_undegraded":"2023-10-06T04:45:25.028062+0000","last_fullsized":"2023-10-06T04:45:25.028062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049642+0000","last_change":"2023-10-06T04:45:25.041365+0000","last_active":"2023-10-06T04:45:25.049642+0000","last_peered":"2023-10-06T04:45:25.049642+0000","last_clean":"2023-10-06T04:45:25.049642+0000","last_became_active":"2023-10-06T04:45:25.041060+0000","last_became_peered":"2023-10-06T04:45:25.041060+0000","last_unstale":"2023-10-06T04:45:25.049642+0000","last_undegraded":"2023-10-06T04:45:25.049642+0000","last_fullsized":"2023-10-06T04:45:25.049642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:35.153566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.033141+0000","last_change":"2023-10-06T04:45:24.042570+0000","last_active":"2023-10-06T04:45:25.033141+0000","last_peered":"2023-10-06T04:45:25.033141+0000","last_clean":"2023-10-06T04:45:25.033141+0000","last_became_active":"2023-10-06T04:45:24.042247+0000","last_became_peered":"2023-10-06T04:45:24.042247+0000","last_unstale":"2023-10-06T04:45:25.033141+0000","last_undegraded":"2023-10-06T04:45:25.033141+0000","last_fullsized":"2023-10-06T04:45:25.033141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:52.768810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031742+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:45:25.031742+0000","last_peered":"2023-10-06T04:45:25.031742+0000","last_clean":"2023-10-06T04:45:25.031742+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:45:25.031742+0000","last_undegraded":"2023-10-06T04:45:25.031742+0000","last_fullsized":"2023-10-06T04:45:25.031742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055348+0000","last_change":"2023-10-06T04:45:25.052680+0000","last_active":"2023-10-06T04:45:25.055348+0000","last_peered":"2023-10-06T04:45:25.055348+0000","last_clean":"2023-10-06T04:45:25.055348+0000","last_became_active":"2023-10-06T04:45:25.052385+0000","last_became_peered":"2023-10-06T04:45:25.052385+0000","last_unstale":"2023-10-06T04:45:25.055348+0000","last_undegraded":"2023-10-06T04:45:25.055348+0000","last_fullsized":"2023-10-06T04:45:25.055348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:20.941027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.026600+0000","last_change":"2023-10-06T04:45:24.046407+0000","last_active":"2023-10-06T04:45:25.026600+0000","last_peered":"2023-10-06T04:45:25.026600+0000","last_clean":"2023-10-06T04:45:25.026600+0000","last_became_active":"2023-10-06T04:45:24.045925+0000","last_became_peered":"2023-10-06T04:45:24.045925+0000","last_unstale":"2023-10-06T04:45:25.026600+0000","last_undegraded":"2023-10-06T04:45:25.026600+0000","last_fullsized":"2023-10-06T04:45:25.026600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:47.815368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032651+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:45:25.032651+0000","last_peered":"2023-10-06T04:45:25.032651+0000","last_clean":"2023-10-06T04:45:25.032651+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:45:25.032651+0000","last_undegraded":"2023-10-06T04:45:25.032651+0000","last_fullsized":"2023-10-06T04:45:25.032651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298244,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073596,"statfs":{"total":96636764160,"available":96331362304,"internally_reserved":0,"allocated":978944,"data_stored":740701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.3070000000000004,"5min":9.3070000000000004,"15min":9.3070000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.2129999999999992,"5min":9.2129999999999992,"15min":9.2129999999999992},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":9.0850000000000009,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":9.0969999999999995},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.90700000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.878},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.92300000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.83499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":149281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.37},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.498}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.72099999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":739185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.2509999999999994,"5min":9.2509999999999994,"15min":9.2509999999999994},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":6.4000000000000004,"5min":6.4000000000000004,"15min":6.4000000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.4450000000000003,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.73799999999999999},{"interface":"front","average":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":19.992999999999999,"5min":19.992999999999999,"15min":19.992999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":6.476,"5min":6.476,"15min":6.476},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.9050000000000002,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":2.056,"5min":2.056,"15min":2.056},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":19.960999999999999,"5min":19.960999999999999,"15min":19.960999999999999},"last":0.92700000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":148761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.63}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.75700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":148797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.35799999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":11.241,"5min":11.241,"15min":11.241},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.273,"5min":11.273,"15min":11.273},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.436}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":11.125999999999999,"5min":11.125999999999999,"15min":11.125999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":11.208,"5min":11.208,"15min":11.208},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.622},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":5.327,"5min":5.327,"15min":5.327},"last":0.749}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.66100000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297664,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074176,"statfs":{"total":96636764160,"available":96331956224,"internally_reserved":0,"allocated":385024,"data_stored":150297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.745}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":149303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.74399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.71999999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":148839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.73399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:45:30.351 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T04:45:30.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.570+0000 7f6a18dff700 1 Processor -- start 2023-10-06T04:45:30.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.571+0000 7f6a18dff700 1 -- start start 2023-10-06T04:45:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a18dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6a140cae80 0x7f6a140cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a18dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140ccec0 0x7f6a141591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a18dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6a140cb250 0x7f6a14159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a18dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a140cd430 con 0x7f6a140cae80 2023-10-06T04:45:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a18dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a14159c50 con 0x7f6a140cb250 2023-10-06T04:45:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a18dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140c1d10 con 0x7f6a140ccec0 2023-10-06T04:45:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a1259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6a140cae80 0x7f6a140cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a1259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6a140cae80 0x7f6a140cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48318/0 (socket says 172.21.15.124:48318) 2023-10-06T04:45:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a1259c700 1 -- 172.21.15.124:0/1112231400 learned_addr learned my addr 172.21.15.124:0/1112231400 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a12d9d700 1 --2- 172.21.15.124:0/1112231400 >> v2:172.21.15.158:3300/0 conn(0x7f6a140cb250 0x7f6a14159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a11d9b700 1 --2- 172.21.15.124:0/1112231400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140ccec0 0x7f6a141591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a1259c700 1 -- 172.21.15.124:0/1112231400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140ccec0 msgr2=0x7f6a141591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a1259c700 1 --2- 172.21.15.124:0/1112231400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140ccec0 0x7f6a141591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a1259c700 1 -- 172.21.15.124:0/1112231400 >> v2:172.21.15.158:3300/0 conn(0x7f6a140cb250 msgr2=0x7f6a14159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a1259c700 1 --2- 172.21.15.124:0/1112231400 >> v2:172.21.15.158:3300/0 conn(0x7f6a140cb250 0x7f6a14159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.572+0000 7f6a1259c700 1 -- 172.21.15.124:0/1112231400 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140688a0 con 0x7f6a140cae80 2023-10-06T04:45:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.573+0000 7f6a1259c700 1 --2- 172.21.15.124:0/1112231400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cae80 0x7f6a140cc980 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6a1406fa70 tx=0x7f6a04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885d9f6f53a83a81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.573+0000 7f6a1159a700 1 -- 172.21.15.124:0/1112231400 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400b8b0 con 0x7f6a140cae80 2023-10-06T04:45:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.573+0000 7f6a1159a700 1 -- 172.21.15.124:0/1112231400 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400ba10 con 0x7f6a140cae80 2023-10-06T04:45:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.573+0000 7f6a1159a700 1 -- 172.21.15.124:0/1112231400 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400bdb0 con 0x7f6a140cae80 2023-10-06T04:45:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.573+0000 7f6a18dff700 1 -- 172.21.15.124:0/1112231400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cae80 msgr2=0x7f6a140cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.573+0000 7f6a18dff700 1 --2- 172.21.15.124:0/1112231400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cae80 0x7f6a140cc980 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6a1406fa70 tx=0x7f6a04009250 comp rx=0 tx=0).stop 2023-10-06T04:45:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.574+0000 7f6a18dff700 1 -- 172.21.15.124:0/1112231400 shutdown_connections 2023-10-06T04:45:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.574+0000 7f6a18dff700 1 --2- 172.21.15.124:0/1112231400 >> v2:172.21.15.158:3300/0 conn(0x7f6a140cb250 0x7f6a14159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.574+0000 7f6a18dff700 1 --2- 172.21.15.124:0/1112231400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cae80 0x7f6a140cc980 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.574+0000 7f6a18dff700 1 --2- 172.21.15.124:0/1112231400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140ccec0 0x7f6a141591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.574+0000 7f6a18dff700 1 -- 172.21.15.124:0/1112231400 >> 172.21.15.124:0/1112231400 conn(0x7f6a140974f0 msgr2=0x7f6a140639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.574+0000 7f6a18dff700 1 -- 172.21.15.124:0/1112231400 shutdown_connections 2023-10-06T04:45:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.574+0000 7f6a18dff700 1 -- 172.21.15.124:0/1112231400 wait complete. 2023-10-06T04:45:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.575+0000 7f6a18dff700 1 Processor -- start 2023-10-06T04:45:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.575+0000 7f6a18dff700 1 -- start start 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.576+0000 7f6a18dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cae80 0x7f6a14158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.576+0000 7f6a18dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cb250 0x7f6a1406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.576+0000 7f6a18dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140ccec0 0x7f6a1406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.576+0000 7f6a18dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140b3670 con 0x7f6a140cb250 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.576+0000 7f6a18dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140b2af0 con 0x7f6a140cae80 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.576+0000 7f6a18dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140b2dd0 con 0x7f6a140ccec0 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.576+0000 7f6a11d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cb250 0x7f6a1406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.576+0000 7f6a11d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cb250 0x7f6a1406c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48332/0 (socket says 172.21.15.124:48332) 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.576+0000 7f6a11d9b700 1 -- 172.21.15.124:0/1806510999 learned_addr learned my addr 172.21.15.124:0/1806510999 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.576+0000 7f6a1259c700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cae80 0x7f6a14158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a12d9d700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140ccec0 0x7f6a1406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a11d9b700 1 -- 172.21.15.124:0/1806510999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140ccec0 msgr2=0x7f6a1406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a11d9b700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140ccec0 0x7f6a1406cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a11d9b700 1 -- 172.21.15.124:0/1806510999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cae80 msgr2=0x7f6a14158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a11d9b700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cae80 0x7f6a14158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a11d9b700 1 -- 172.21.15.124:0/1806510999 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a040094f0 con 0x7f6a140cb250 2023-10-06T04:45:30.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a1259c700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cae80 0x7f6a14158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:30.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a11d9b700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cb250 0x7f6a1406c9c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800d860 tx=0x7f6a08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a027fc700 1 -- 172.21.15.124:0/1806510999 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080125f0 con 0x7f6a140cb250 2023-10-06T04:45:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a027fc700 1 -- 172.21.15.124:0/1806510999 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a08012750 con 0x7f6a140cb250 2023-10-06T04:45:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a027fc700 1 -- 172.21.15.124:0/1806510999 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08012b10 con 0x7f6a140cb250 2023-10-06T04:45:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a18dff700 1 -- 172.21.15.124:0/1806510999 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a140b30b0 con 0x7f6a140cb250 2023-10-06T04:45:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.577+0000 7f6a18dff700 1 -- 172.21.15.124:0/1806510999 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a14158ca0 con 0x7f6a140cb250 2023-10-06T04:45:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.578+0000 7f6a18dff700 1 -- 172.21.15.124:0/1806510999 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a140717a0 con 0x7f6a140cb250 2023-10-06T04:45:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.579+0000 7f6a027fc700 1 -- 172.21.15.124:0/1806510999 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a0801e460 con 0x7f6a140cb250 2023-10-06T04:45:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.580+0000 7f6a027fc700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f69f4066f30 0x7f69f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:30.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.580+0000 7f6a027fc700 1 -- 172.21.15.124:0/1806510999 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a08084d50 con 0x7f6a140cb250 2023-10-06T04:45:30.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.580+0000 7f6a1259c700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f69f4066f30 0x7f69f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:30.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.581+0000 7f6a1259c700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f69f4066f30 0x7f69f40693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6a1406fa70 tx=0x7f6a04017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:30.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.584+0000 7f6a027fc700 1 -- 172.21.15.124:0/1806510999 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a08051dc0 con 0x7f6a140cb250 2023-10-06T04:45:30.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.851+0000 7f6a18dff700 1 -- 172.21.15.124:0/1806510999 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6a14068b80 con 0x7f6a140cb250 2023-10-06T04:45:30.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.852+0000 7f6a027fc700 1 -- 172.21.15.124:0/1806510999 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1564 (secure 0 0 0) 0x7f6a080553e0 con 0x7f6a140cb250 2023-10-06T04:45:30.854 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:30.854 INFO:teuthology.orchestra.run.smithi124.stdout:{"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1696567458,"num_in_osds":8,"osd_in_since":1696567450,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592674,"bytes_used":2439585792,"bytes_avail":770654527488,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4968}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-10-06T04:45:19.916902+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T04:45:30.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.854+0000 7f6a18dff700 1 -- 172.21.15.124:0/1806510999 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f69f4066f30 msgr2=0x7f69f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.854+0000 7f6a18dff700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f69f4066f30 0x7f69f40693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6a1406fa70 tx=0x7f6a04017000 comp rx=0 tx=0).stop 2023-10-06T04:45:30.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.854+0000 7f6a18dff700 1 -- 172.21.15.124:0/1806510999 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cb250 msgr2=0x7f6a1406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:30.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.854+0000 7f6a18dff700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cb250 0x7f6a1406c9c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800d860 tx=0x7f6a08008040 comp rx=0 tx=0).stop 2023-10-06T04:45:30.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.854+0000 7f6a18dff700 1 -- 172.21.15.124:0/1806510999 shutdown_connections 2023-10-06T04:45:30.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.854+0000 7f6a18dff700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f69f4066f30 0x7f69f40693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.854+0000 7f6a18dff700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140ccec0 0x7f6a1406cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.855+0000 7f6a18dff700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cae80 0x7f6a14158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.855+0000 7f6a18dff700 1 --2- 172.21.15.124:0/1806510999 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a140cb250 0x7f6a1406c9c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:30.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.855+0000 7f6a18dff700 1 -- 172.21.15.124:0/1806510999 >> 172.21.15.124:0/1806510999 conn(0x7f6a140974f0 msgr2=0x7f6a1406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:30.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.855+0000 7f6a18dff700 1 -- 172.21.15.124:0/1806510999 shutdown_connections 2023-10-06T04:45:30.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:30.855+0000 7f6a18dff700 1 -- 172.21.15.124:0/1806510999 wait complete. 2023-10-06T04:45:30.874 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T04:45:30.874 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:45:31.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.063+0000 7f00581ff700 1 Processor -- start 2023-10-06T04:45:31.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.063+0000 7f00581ff700 1 -- start start 2023-10-06T04:45:31.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.064+0000 7f00581ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f00500cdfe0 0x7f00500ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:31.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.064+0000 7f00581ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00500cf6b0 con 0x7f00500ccbb0 2023-10-06T04:45:31.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.064+0000 7f00581ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00500ceaa0 con 0x7f00500ccf80 2023-10-06T04:45:31.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.064+0000 7f00581ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00500d0250 con 0x7f00500cdfe0 2023-10-06T04:45:31.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.064+0000 7f005579a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f00500cdfe0 0x7f00500ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:31.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.064+0000 7f005579a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f00500cdfe0 0x7f00500ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48340/0 (socket says 172.21.15.124:48340) 2023-10-06T04:45:31.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.064+0000 7f005579a700 1 -- 172.21.15.124:0/3405681283 learned_addr learned my addr 172.21.15.124:0/3405681283 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:31.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.064+0000 7f0055f9b700 1 --1- 172.21.15.124:0/3405681283 >> v1:172.21.15.124:6789/0 conn(0x7f00500ccbb0 0x7f00500cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35330/0 (socket says 172.21.15.124:35330) 2023-10-06T04:45:31.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.065+0000 7f005579a700 1 -- 172.21.15.124:0/3405681283 >> v1:172.21.15.158:6789/0 conn(0x7f00500ccf80 legacy=0x7f00500cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:31.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.065+0000 7f005579a700 1 -- 172.21.15.124:0/3405681283 >> v1:172.21.15.124:6789/0 conn(0x7f00500ccbb0 legacy=0x7f00500cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:31.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.065+0000 7f005579a700 1 -- 172.21.15.124:0/3405681283 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500ced80 con 0x7f00500cdfe0 2023-10-06T04:45:31.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.065+0000 7f0054f99700 1 -- 172.21.15.124:0/3405681283 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547218368 0 0) 0x7f00500cf6b0 con 0x7f00500ccbb0 2023-10-06T04:45:31.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.065+0000 7f005579a700 1 --2- 172.21.15.124:0/3405681283 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500cdfe0 0x7f00500ce450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f00400099b0 tx=0x7f0040009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6394911bcf34b2d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:31.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.065+0000 7f0054f99700 1 -- 172.21.15.124:0/3405681283 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000b860 con 0x7f00500cdfe0 2023-10-06T04:45:31.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.065+0000 7f0054f99700 1 -- 172.21.15.124:0/3405681283 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004000b9c0 con 0x7f00500cdfe0 2023-10-06T04:45:31.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.065+0000 7f0054f99700 1 -- 172.21.15.124:0/3405681283 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000bd60 con 0x7f00500cdfe0 2023-10-06T04:45:31.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.066+0000 7f00581ff700 1 -- 172.21.15.124:0/3405681283 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500cdfe0 msgr2=0x7f00500ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:31.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.066+0000 7f00581ff700 1 --2- 172.21.15.124:0/3405681283 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500cdfe0 0x7f00500ce450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f00400099b0 tx=0x7f0040009250 comp rx=0 tx=0).stop 2023-10-06T04:45:31.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.066+0000 7f00581ff700 1 -- 172.21.15.124:0/3405681283 shutdown_connections 2023-10-06T04:45:31.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.066+0000 7f00581ff700 1 --2- 172.21.15.124:0/3405681283 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500cdfe0 0x7f00500ce450 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:31.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.066+0000 7f00581ff700 1 -- 172.21.15.124:0/3405681283 >> 172.21.15.124:0/3405681283 conn(0x7f0050099710 msgr2=0x7f005006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:31.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.066+0000 7f00581ff700 1 -- 172.21.15.124:0/3405681283 shutdown_connections 2023-10-06T04:45:31.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.066+0000 7f00581ff700 1 -- 172.21.15.124:0/3405681283 wait complete. 2023-10-06T04:45:31.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.067+0000 7f00581ff700 1 Processor -- start 2023-10-06T04:45:31.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.067+0000 7f00581ff700 1 -- start start 2023-10-06T04:45:31.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.068+0000 7f00581ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00500ccbb0 0x7f0050156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:31.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.068+0000 7f00581ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500ccf80 0x7f00500b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:31.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.068+0000 7f00581ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00500cdfe0 0x7f00500b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:31.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.068+0000 7f00581ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005016a860 con 0x7f00500ccf80 2023-10-06T04:45:31.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.068+0000 7f00581ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00500c4730 con 0x7f00500cdfe0 2023-10-06T04:45:31.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.068+0000 7f00581ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00500c6be0 con 0x7f00500ccbb0 2023-10-06T04:45:31.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.068+0000 7f005579a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500ccf80 0x7f00500b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:31.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f005579a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500ccf80 0x7f00500b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:48344/0 (socket says 172.21.15.124:48344) 2023-10-06T04:45:31.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f005579a700 1 -- 172.21.15.124:0/3963335444 learned_addr learned my addr 172.21.15.124:0/3963335444 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:31.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f0055f9b700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00500ccbb0 0x7f0050156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:31.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f005679c700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00500cdfe0 0x7f00500b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:31.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f005579a700 1 -- 172.21.15.124:0/3963335444 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00500ccbb0 msgr2=0x7f0050156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:31.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f005579a700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00500ccbb0 0x7f0050156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:31.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f005579a700 1 -- 172.21.15.124:0/3963335444 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00500cdfe0 msgr2=0x7f00500b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:31.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f005579a700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00500cdfe0 0x7f00500b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:31.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f005579a700 1 -- 172.21.15.124:0/3963335444 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400094f0 con 0x7f00500ccf80 2023-10-06T04:45:31.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f0055f9b700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00500ccbb0 0x7f0050156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:31.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f005679c700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00500cdfe0 0x7f00500b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:31.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f005579a700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500ccf80 0x7f00500b53b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0040006f50 tx=0x7f0040017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:31.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f0045ffb700 1 -- 172.21.15.124:0/3963335444 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004001f070 con 0x7f00500ccf80 2023-10-06T04:45:31.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f0045ffb700 1 -- 172.21.15.124:0/3963335444 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0040011d10 con 0x7f00500ccf80 2023-10-06T04:45:31.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.069+0000 7f00581ff700 1 -- 172.21.15.124:0/3963335444 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00500c3e00 con 0x7f00500ccf80 2023-10-06T04:45:31.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.070+0000 7f0045ffb700 1 -- 172.21.15.124:0/3963335444 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040025670 con 0x7f00500ccf80 2023-10-06T04:45:31.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.070+0000 7f00581ff700 1 -- 172.21.15.124:0/3963335444 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00500c43c0 con 0x7f00500ccf80 2023-10-06T04:45:31.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.071+0000 7f00581ff700 1 -- 172.21.15.124:0/3963335444 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00500717a0 con 0x7f00500ccf80 2023-10-06T04:45:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.072+0000 7f0045ffb700 1 -- 172.21.15.124:0/3963335444 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0040023070 con 0x7f00500ccf80 2023-10-06T04:45:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.072+0000 7f0045ffb700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0034066f30 0x7f00340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.072+0000 7f0045ffb700 1 -- 172.21.15.124:0/3963335444 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0040085880 con 0x7f00500ccf80 2023-10-06T04:45:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.073+0000 7f0055f9b700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0034066f30 0x7f00340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:31.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.073+0000 7f0055f9b700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0034066f30 0x7f00340693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f00500cb950 tx=0x7f004c007c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:31.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.077+0000 7f0045ffb700 1 -- 172.21.15.124:0/3963335444 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0040052a40 con 0x7f00500ccf80 2023-10-06T04:45:31.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.262+0000 7f00581ff700 1 -- 172.21.15.124:0/3963335444 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f005015ac90 con 0x7f0034066f30 2023-10-06T04:45:31.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.271+0000 7f0045ffb700 1 -- 172.21.15.124:0/3963335444 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311254 (secure 0 0 0) 0x7f005015ac90 con 0x7f0034066f30 2023-10-06T04:45:31.277 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:31.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.275+0000 7f00581ff700 1 -- 172.21.15.124:0/3963335444 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0034066f30 msgr2=0x7f00340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:31.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.275+0000 7f00581ff700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0034066f30 0x7f00340693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f00500cb950 tx=0x7f004c007c90 comp rx=0 tx=0).stop 2023-10-06T04:45:31.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.275+0000 7f00581ff700 1 -- 172.21.15.124:0/3963335444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500ccf80 msgr2=0x7f00500b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:31.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.275+0000 7f00581ff700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500ccf80 0x7f00500b53b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0040006f50 tx=0x7f0040017000 comp rx=0 tx=0).stop 2023-10-06T04:45:31.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.275+0000 7f00581ff700 1 -- 172.21.15.124:0/3963335444 shutdown_connections 2023-10-06T04:45:31.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.275+0000 7f00581ff700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00500cdfe0 0x7f00500b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:31.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.275+0000 7f00581ff700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f0034066f30 0x7f00340693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:31.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.275+0000 7f00581ff700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00500ccbb0 0x7f0050156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:31.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.275+0000 7f00581ff700 1 --2- 172.21.15.124:0/3963335444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00500ccf80 0x7f00500b53b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:31.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.275+0000 7f00581ff700 1 -- 172.21.15.124:0/3963335444 >> 172.21.15.124:0/3963335444 conn(0x7f0050099710 msgr2=0x7f00500ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:31.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.276+0000 7f00581ff700 1 -- 172.21.15.124:0/3963335444 shutdown_connections 2023-10-06T04:45:31.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:31.276+0000 7f00581ff700 1 -- 172.21.15.124:0/3963335444 wait complete. 2023-10-06T04:45:31.280 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:45:31.294 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-06T04:45:29.918571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382408,"kb_used_data":4104,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592312,"statfs":{"total":773094113280,"available":770654527488,"internally_reserved":0,"allocated":4202496,"data_stored":2375164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001158"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057213+0000","last_change":"2023-10-06T04:45:25.055410+0000","last_active":"2023-10-06T04:45:25.057213+0000","last_peered":"2023-10-06T04:45:25.057213+0000","last_clean":"2023-10-06T04:45:25.057213+0000","last_became_active":"2023-10-06T04:45:25.055134+0000","last_became_peered":"2023-10-06T04:45:25.055134+0000","last_unstale":"2023-10-06T04:45:25.057213+0000","last_undegraded":"2023-10-06T04:45:25.057213+0000","last_fullsized":"2023-10-06T04:45:25.057213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:17.060167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057785+0000","last_change":"2023-10-06T04:45:25.051552+0000","last_active":"2023-10-06T04:45:25.057785+0000","last_peered":"2023-10-06T04:45:25.057785+0000","last_clean":"2023-10-06T04:45:25.057785+0000","last_became_active":"2023-10-06T04:45:25.051059+0000","last_became_peered":"2023-10-06T04:45:25.051059+0000","last_unstale":"2023-10-06T04:45:25.057785+0000","last_undegraded":"2023-10-06T04:45:25.057785+0000","last_fullsized":"2023-10-06T04:45:25.057785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:39.256429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.045082+0000","last_change":"2023-10-06T04:45:25.034869+0000","last_active":"2023-10-06T04:45:25.045082+0000","last_peered":"2023-10-06T04:45:25.045082+0000","last_clean":"2023-10-06T04:45:25.045082+0000","last_became_active":"2023-10-06T04:45:25.034530+0000","last_became_peered":"2023-10-06T04:45:25.034530+0000","last_unstale":"2023-10-06T04:45:25.045082+0000","last_undegraded":"2023-10-06T04:45:25.045082+0000","last_fullsized":"2023-10-06T04:45:25.045082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:35.153566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.048655+0000","last_change":"2023-10-06T04:45:25.044979+0000","last_active":"2023-10-06T04:45:25.048655+0000","last_peered":"2023-10-06T04:45:25.048655+0000","last_clean":"2023-10-06T04:45:25.048655+0000","last_became_active":"2023-10-06T04:45:25.044464+0000","last_became_peered":"2023-10-06T04:45:25.044464+0000","last_unstale":"2023-10-06T04:45:25.048655+0000","last_undegraded":"2023-10-06T04:45:25.048655+0000","last_fullsized":"2023-10-06T04:45:25.048655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:48.818850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046270+0000","last_change":"2023-10-06T04:45:25.041271+0000","last_active":"2023-10-06T04:45:25.046270+0000","last_peered":"2023-10-06T04:45:25.046270+0000","last_clean":"2023-10-06T04:45:25.046270+0000","last_became_active":"2023-10-06T04:45:25.040966+0000","last_became_peered":"2023-10-06T04:45:25.040966+0000","last_unstale":"2023-10-06T04:45:25.046270+0000","last_undegraded":"2023-10-06T04:45:25.046270+0000","last_fullsized":"2023-10-06T04:45:25.046270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:03.033468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055245+0000","last_change":"2023-10-06T04:45:25.052180+0000","last_active":"2023-10-06T04:45:25.055245+0000","last_peered":"2023-10-06T04:45:25.055245+0000","last_clean":"2023-10-06T04:45:25.055245+0000","last_became_active":"2023-10-06T04:45:25.051920+0000","last_became_peered":"2023-10-06T04:45:25.051920+0000","last_unstale":"2023-10-06T04:45:25.055245+0000","last_undegraded":"2023-10-06T04:45:25.055245+0000","last_fullsized":"2023-10-06T04:45:25.055245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:22.064473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.053830+0000","last_change":"2023-10-06T04:45:25.051988+0000","last_active":"2023-10-06T04:45:25.053830+0000","last_peered":"2023-10-06T04:45:25.053830+0000","last_clean":"2023-10-06T04:45:25.053830+0000","last_became_active":"2023-10-06T04:45:25.051658+0000","last_became_peered":"2023-10-06T04:45:25.051658+0000","last_unstale":"2023-10-06T04:45:25.053830+0000","last_undegraded":"2023-10-06T04:45:25.053830+0000","last_fullsized":"2023-10-06T04:45:25.053830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:32.285391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.054990+0000","last_change":"2023-10-06T04:45:25.047833+0000","last_active":"2023-10-06T04:45:25.054990+0000","last_peered":"2023-10-06T04:45:25.054990+0000","last_clean":"2023-10-06T04:45:25.054990+0000","last_became_active":"2023-10-06T04:45:25.047553+0000","last_became_peered":"2023-10-06T04:45:25.047553+0000","last_unstale":"2023-10-06T04:45:25.054990+0000","last_undegraded":"2023-10-06T04:45:25.054990+0000","last_fullsized":"2023-10-06T04:45:25.054990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:16.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.043229+0000","last_change":"2023-10-06T04:45:25.034793+0000","last_active":"2023-10-06T04:45:25.043229+0000","last_peered":"2023-10-06T04:45:25.043229+0000","last_clean":"2023-10-06T04:45:25.043229+0000","last_became_active":"2023-10-06T04:45:25.034518+0000","last_became_peered":"2023-10-06T04:45:25.034518+0000","last_unstale":"2023-10-06T04:45:25.043229+0000","last_undegraded":"2023-10-06T04:45:25.043229+0000","last_fullsized":"2023-10-06T04:45:25.043229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:21.839127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049441+0000","last_change":"2023-10-06T04:45:25.042634+0000","last_active":"2023-10-06T04:45:25.049441+0000","last_peered":"2023-10-06T04:45:25.049441+0000","last_clean":"2023-10-06T04:45:25.049441+0000","last_became_active":"2023-10-06T04:45:25.042312+0000","last_became_peered":"2023-10-06T04:45:25.042312+0000","last_unstale":"2023-10-06T04:45:25.049441+0000","last_undegraded":"2023-10-06T04:45:25.049441+0000","last_fullsized":"2023-10-06T04:45:25.049441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.529270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049406+0000","last_change":"2023-10-06T04:45:25.041696+0000","last_active":"2023-10-06T04:45:25.049406+0000","last_peered":"2023-10-06T04:45:25.049406+0000","last_clean":"2023-10-06T04:45:25.049406+0000","last_became_active":"2023-10-06T04:45:25.041426+0000","last_became_peered":"2023-10-06T04:45:25.041426+0000","last_unstale":"2023-10-06T04:45:25.049406+0000","last_undegraded":"2023-10-06T04:45:25.049406+0000","last_fullsized":"2023-10-06T04:45:25.049406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:16.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050812+0000","last_change":"2023-10-06T04:45:25.045801+0000","last_active":"2023-10-06T04:45:25.050812+0000","last_peered":"2023-10-06T04:45:25.050812+0000","last_clean":"2023-10-06T04:45:25.050812+0000","last_became_active":"2023-10-06T04:45:25.045532+0000","last_became_peered":"2023-10-06T04:45:25.045532+0000","last_unstale":"2023-10-06T04:45:25.050812+0000","last_undegraded":"2023-10-06T04:45:25.050812+0000","last_fullsized":"2023-10-06T04:45:25.050812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:59.095337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046568+0000","last_change":"2023-10-06T04:45:25.034602+0000","last_active":"2023-10-06T04:45:25.046568+0000","last_peered":"2023-10-06T04:45:25.046568+0000","last_clean":"2023-10-06T04:45:25.046568+0000","last_became_active":"2023-10-06T04:45:25.034295+0000","last_became_peered":"2023-10-06T04:45:25.034295+0000","last_unstale":"2023-10-06T04:45:25.046568+0000","last_undegraded":"2023-10-06T04:45:25.046568+0000","last_fullsized":"2023-10-06T04:45:25.046568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:05.161120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059002+0000","last_change":"2023-10-06T04:45:25.051193+0000","last_active":"2023-10-06T04:45:25.059002+0000","last_peered":"2023-10-06T04:45:25.059002+0000","last_clean":"2023-10-06T04:45:25.059002+0000","last_became_active":"2023-10-06T04:45:25.050910+0000","last_became_peered":"2023-10-06T04:45:25.050910+0000","last_unstale":"2023-10-06T04:45:25.059002+0000","last_undegraded":"2023-10-06T04:45:25.059002+0000","last_fullsized":"2023-10-06T04:45:25.059002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.809711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049266+0000","last_change":"2023-10-06T04:45:25.041301+0000","last_active":"2023-10-06T04:45:25.049266+0000","last_peered":"2023-10-06T04:45:25.049266+0000","last_clean":"2023-10-06T04:45:25.049266+0000","last_became_active":"2023-10-06T04:45:25.041036+0000","last_became_peered":"2023-10-06T04:45:25.041036+0000","last_unstale":"2023-10-06T04:45:25.049266+0000","last_undegraded":"2023-10-06T04:45:25.049266+0000","last_fullsized":"2023-10-06T04:45:25.049266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:17.060167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060827+0000","last_change":"2023-10-06T04:45:25.048025+0000","last_active":"2023-10-06T04:45:25.060827+0000","last_peered":"2023-10-06T04:45:25.060827+0000","last_clean":"2023-10-06T04:45:25.060827+0000","last_became_active":"2023-10-06T04:45:25.047720+0000","last_became_peered":"2023-10-06T04:45:25.047720+0000","last_unstale":"2023-10-06T04:45:25.060827+0000","last_undegraded":"2023-10-06T04:45:25.060827+0000","last_fullsized":"2023-10-06T04:45:25.060827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:15.277269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061467+0000","last_change":"2023-10-06T04:45:25.057434+0000","last_active":"2023-10-06T04:45:25.061467+0000","last_peered":"2023-10-06T04:45:25.061467+0000","last_clean":"2023-10-06T04:45:25.061467+0000","last_became_active":"2023-10-06T04:45:25.057176+0000","last_became_peered":"2023-10-06T04:45:25.057176+0000","last_unstale":"2023-10-06T04:45:25.061467+0000","last_undegraded":"2023-10-06T04:45:25.061467+0000","last_fullsized":"2023-10-06T04:45:25.061467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:03.163638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046874+0000","last_change":"2023-10-06T04:45:25.043714+0000","last_active":"2023-10-06T04:45:25.046874+0000","last_peered":"2023-10-06T04:45:25.046874+0000","last_clean":"2023-10-06T04:45:25.046874+0000","last_became_active":"2023-10-06T04:45:25.043397+0000","last_became_peered":"2023-10-06T04:45:25.043397+0000","last_unstale":"2023-10-06T04:45:25.046874+0000","last_undegraded":"2023-10-06T04:45:25.046874+0000","last_fullsized":"2023-10-06T04:45:25.046874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:54.194269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.047115+0000","last_change":"2023-10-06T04:45:25.043961+0000","last_active":"2023-10-06T04:45:25.047115+0000","last_peered":"2023-10-06T04:45:25.047115+0000","last_clean":"2023-10-06T04:45:25.047115+0000","last_became_active":"2023-10-06T04:45:25.043694+0000","last_became_peered":"2023-10-06T04:45:25.043694+0000","last_unstale":"2023-10-06T04:45:25.047115+0000","last_undegraded":"2023-10-06T04:45:25.047115+0000","last_fullsized":"2023-10-06T04:45:25.047115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:39.267589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055206+0000","last_change":"2023-10-06T04:45:25.046510+0000","last_active":"2023-10-06T04:45:25.055206+0000","last_peered":"2023-10-06T04:45:25.055206+0000","last_clean":"2023-10-06T04:45:25.055206+0000","last_became_active":"2023-10-06T04:45:25.045787+0000","last_became_peered":"2023-10-06T04:45:25.045787+0000","last_unstale":"2023-10-06T04:45:25.055206+0000","last_undegraded":"2023-10-06T04:45:25.055206+0000","last_fullsized":"2023-10-06T04:45:25.055206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:46.712666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.048645+0000","last_change":"2023-10-06T04:45:25.038523+0000","last_active":"2023-10-06T04:45:25.048645+0000","last_peered":"2023-10-06T04:45:25.048645+0000","last_clean":"2023-10-06T04:45:25.048645+0000","last_became_active":"2023-10-06T04:45:25.036737+0000","last_became_peered":"2023-10-06T04:45:25.036737+0000","last_unstale":"2023-10-06T04:45:25.048645+0000","last_undegraded":"2023-10-06T04:45:25.048645+0000","last_fullsized":"2023-10-06T04:45:25.048645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:28.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059019+0000","last_change":"2023-10-06T04:45:25.051826+0000","last_active":"2023-10-06T04:45:25.059019+0000","last_peered":"2023-10-06T04:45:25.059019+0000","last_clean":"2023-10-06T04:45:25.059019+0000","last_became_active":"2023-10-06T04:45:25.051505+0000","last_became_peered":"2023-10-06T04:45:25.051505+0000","last_unstale":"2023-10-06T04:45:25.059019+0000","last_undegraded":"2023-10-06T04:45:25.059019+0000","last_fullsized":"2023-10-06T04:45:25.059019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:12.049850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061514+0000","last_change":"2023-10-06T04:45:25.057347+0000","last_active":"2023-10-06T04:45:25.061514+0000","last_peered":"2023-10-06T04:45:25.061514+0000","last_clean":"2023-10-06T04:45:25.061514+0000","last_became_active":"2023-10-06T04:45:25.056999+0000","last_became_peered":"2023-10-06T04:45:25.056999+0000","last_unstale":"2023-10-06T04:45:25.061514+0000","last_undegraded":"2023-10-06T04:45:25.061514+0000","last_fullsized":"2023-10-06T04:45:25.061514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:16.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060690+0000","last_change":"2023-10-06T04:45:25.059550+0000","last_active":"2023-10-06T04:45:25.060690+0000","last_peered":"2023-10-06T04:45:25.060690+0000","last_clean":"2023-10-06T04:45:25.060690+0000","last_became_active":"2023-10-06T04:45:25.059284+0000","last_became_peered":"2023-10-06T04:45:25.059284+0000","last_unstale":"2023-10-06T04:45:25.060690+0000","last_undegraded":"2023-10-06T04:45:25.060690+0000","last_fullsized":"2023-10-06T04:45:25.060690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:10.915398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.051570+0000","last_change":"2023-10-06T04:45:25.045967+0000","last_active":"2023-10-06T04:45:25.051570+0000","last_peered":"2023-10-06T04:45:25.051570+0000","last_clean":"2023-10-06T04:45:25.051570+0000","last_became_active":"2023-10-06T04:45:25.045686+0000","last_became_peered":"2023-10-06T04:45:25.045686+0000","last_unstale":"2023-10-06T04:45:25.051570+0000","last_undegraded":"2023-10-06T04:45:25.051570+0000","last_fullsized":"2023-10-06T04:45:25.051570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:34.470842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050076+0000","last_change":"2023-10-06T04:45:25.041504+0000","last_active":"2023-10-06T04:45:25.050076+0000","last_peered":"2023-10-06T04:45:25.050076+0000","last_clean":"2023-10-06T04:45:25.050076+0000","last_became_active":"2023-10-06T04:45:25.041209+0000","last_became_peered":"2023-10-06T04:45:25.041209+0000","last_unstale":"2023-10-06T04:45:25.050076+0000","last_undegraded":"2023-10-06T04:45:25.050076+0000","last_fullsized":"2023-10-06T04:45:25.050076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:48.388756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050924+0000","last_change":"2023-10-06T04:45:25.045462+0000","last_active":"2023-10-06T04:45:25.050924+0000","last_peered":"2023-10-06T04:45:25.050924+0000","last_clean":"2023-10-06T04:45:25.050924+0000","last_became_active":"2023-10-06T04:45:25.045120+0000","last_became_peered":"2023-10-06T04:45:25.045120+0000","last_unstale":"2023-10-06T04:45:25.050924+0000","last_undegraded":"2023-10-06T04:45:25.050924+0000","last_fullsized":"2023-10-06T04:45:25.050924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.086601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055997+0000","last_change":"2023-10-06T04:45:25.053681+0000","last_active":"2023-10-06T04:45:25.055997+0000","last_peered":"2023-10-06T04:45:25.055997+0000","last_clean":"2023-10-06T04:45:25.055997+0000","last_became_active":"2023-10-06T04:45:25.053386+0000","last_became_peered":"2023-10-06T04:45:25.053386+0000","last_unstale":"2023-10-06T04:45:25.055997+0000","last_undegraded":"2023-10-06T04:45:25.055997+0000","last_fullsized":"2023-10-06T04:45:25.055997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:39.256429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046624+0000","last_change":"2023-10-06T04:45:25.040933+0000","last_active":"2023-10-06T04:45:25.046624+0000","last_peered":"2023-10-06T04:45:25.046624+0000","last_clean":"2023-10-06T04:45:25.046624+0000","last_became_active":"2023-10-06T04:45:25.040635+0000","last_became_peered":"2023-10-06T04:45:25.040635+0000","last_unstale":"2023-10-06T04:45:25.046624+0000","last_undegraded":"2023-10-06T04:45:25.046624+0000","last_fullsized":"2023-10-06T04:45:25.046624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:17.174984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057608+0000","last_change":"2023-10-06T04:45:25.052785+0000","last_active":"2023-10-06T04:45:25.057608+0000","last_peered":"2023-10-06T04:45:25.057608+0000","last_clean":"2023-10-06T04:45:25.057608+0000","last_became_active":"2023-10-06T04:45:25.052516+0000","last_became_peered":"2023-10-06T04:45:25.052516+0000","last_unstale":"2023-10-06T04:45:25.057608+0000","last_undegraded":"2023-10-06T04:45:25.057608+0000","last_fullsized":"2023-10-06T04:45:25.057608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:33.655583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061490+0000","last_change":"2023-10-06T04:45:25.056826+0000","last_active":"2023-10-06T04:45:25.061490+0000","last_peered":"2023-10-06T04:45:25.061490+0000","last_clean":"2023-10-06T04:45:25.061490+0000","last_became_active":"2023-10-06T04:45:25.056526+0000","last_became_peered":"2023-10-06T04:45:25.056526+0000","last_unstale":"2023-10-06T04:45:25.061490+0000","last_undegraded":"2023-10-06T04:45:25.061490+0000","last_fullsized":"2023-10-06T04:45:25.061490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:39.256429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050072+0000","last_change":"2023-10-06T04:45:25.039915+0000","last_active":"2023-10-06T04:45:25.050072+0000","last_peered":"2023-10-06T04:45:25.050072+0000","last_clean":"2023-10-06T04:45:25.050072+0000","last_became_active":"2023-10-06T04:45:25.039654+0000","last_became_peered":"2023-10-06T04:45:25.039654+0000","last_unstale":"2023-10-06T04:45:25.050072+0000","last_undegraded":"2023-10-06T04:45:25.050072+0000","last_fullsized":"2023-10-06T04:45:25.050072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:50.918893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060770+0000","last_change":"2023-10-06T04:45:25.041306+0000","last_active":"2023-10-06T04:45:25.060770+0000","last_peered":"2023-10-06T04:45:25.060770+0000","last_clean":"2023-10-06T04:45:25.060770+0000","last_became_active":"2023-10-06T04:45:25.040960+0000","last_became_peered":"2023-10-06T04:45:25.040960+0000","last_unstale":"2023-10-06T04:45:25.060770+0000","last_undegraded":"2023-10-06T04:45:25.060770+0000","last_fullsized":"2023-10-06T04:45:25.060770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:41.320747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061598+0000","last_change":"2023-10-06T04:45:24.043680+0000","last_active":"2023-10-06T04:45:25.061598+0000","last_peered":"2023-10-06T04:45:25.061598+0000","last_clean":"2023-10-06T04:45:25.061598+0000","last_became_active":"2023-10-06T04:45:24.043382+0000","last_became_peered":"2023-10-06T04:45:24.043382+0000","last_unstale":"2023-10-06T04:45:25.061598+0000","last_undegraded":"2023-10-06T04:45:25.061598+0000","last_fullsized":"2023-10-06T04:45:25.061598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:32.245374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.052918+0000","last_change":"2023-10-06T04:45:25.048950+0000","last_active":"2023-10-06T04:45:25.052918+0000","last_peered":"2023-10-06T04:45:25.052918+0000","last_clean":"2023-10-06T04:45:25.052918+0000","last_became_active":"2023-10-06T04:45:25.048721+0000","last_became_peered":"2023-10-06T04:45:25.048721+0000","last_unstale":"2023-10-06T04:45:25.052918+0000","last_undegraded":"2023-10-06T04:45:25.052918+0000","last_fullsized":"2023-10-06T04:45:25.052918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:58.607577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060959+0000","last_change":"2023-10-06T04:45:24.046282+0000","last_active":"2023-10-06T04:45:25.060959+0000","last_peered":"2023-10-06T04:45:25.060959+0000","last_clean":"2023-10-06T04:45:25.060959+0000","last_became_active":"2023-10-06T04:45:24.045974+0000","last_became_peered":"2023-10-06T04:45:24.045974+0000","last_unstale":"2023-10-06T04:45:25.060959+0000","last_undegraded":"2023-10-06T04:45:25.060959+0000","last_fullsized":"2023-10-06T04:45:25.060959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:33.673260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058196+0000","last_change":"2023-10-06T04:45:25.048339+0000","last_active":"2023-10-06T04:45:25.058196+0000","last_peered":"2023-10-06T04:45:25.058196+0000","last_clean":"2023-10-06T04:45:25.058196+0000","last_became_active":"2023-10-06T04:45:25.048068+0000","last_became_peered":"2023-10-06T04:45:25.048068+0000","last_unstale":"2023-10-06T04:45:25.058196+0000","last_undegraded":"2023-10-06T04:45:25.058196+0000","last_fullsized":"2023-10-06T04:45:25.058196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:53.754887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057356+0000","last_change":"2023-10-06T04:45:24.044697+0000","last_active":"2023-10-06T04:45:25.057356+0000","last_peered":"2023-10-06T04:45:25.057356+0000","last_clean":"2023-10-06T04:45:25.057356+0000","last_became_active":"2023-10-06T04:45:24.044416+0000","last_became_peered":"2023-10-06T04:45:24.044416+0000","last_unstale":"2023-10-06T04:45:25.057356+0000","last_undegraded":"2023-10-06T04:45:25.057356+0000","last_fullsized":"2023-10-06T04:45:25.057356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:26.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058160+0000","last_change":"2023-10-06T04:45:25.056068+0000","last_active":"2023-10-06T04:45:25.058160+0000","last_peered":"2023-10-06T04:45:25.058160+0000","last_clean":"2023-10-06T04:45:25.058160+0000","last_became_active":"2023-10-06T04:45:25.055748+0000","last_became_peered":"2023-10-06T04:45:25.055748+0000","last_unstale":"2023-10-06T04:45:25.058160+0000","last_undegraded":"2023-10-06T04:45:25.058160+0000","last_fullsized":"2023-10-06T04:45:25.058160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:53.754887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058107+0000","last_change":"2023-10-06T04:45:24.038087+0000","last_active":"2023-10-06T04:45:25.058107+0000","last_peered":"2023-10-06T04:45:25.058107+0000","last_clean":"2023-10-06T04:45:25.058107+0000","last_became_active":"2023-10-06T04:45:24.037832+0000","last_became_peered":"2023-10-06T04:45:24.037832+0000","last_unstale":"2023-10-06T04:45:25.058107+0000","last_undegraded":"2023-10-06T04:45:25.058107+0000","last_fullsized":"2023-10-06T04:45:25.058107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:02.160156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.042774+0000","last_change":"2023-10-06T04:45:25.033165+0000","last_active":"2023-10-06T04:45:25.042774+0000","last_peered":"2023-10-06T04:45:25.042774+0000","last_clean":"2023-10-06T04:45:25.042774+0000","last_became_active":"2023-10-06T04:45:25.032906+0000","last_became_peered":"2023-10-06T04:45:25.032906+0000","last_unstale":"2023-10-06T04:45:25.042774+0000","last_undegraded":"2023-10-06T04:45:25.042774+0000","last_fullsized":"2023-10-06T04:45:25.042774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:25:12.065102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.051271+0000","last_change":"2023-10-06T04:45:24.040390+0000","last_active":"2023-10-06T04:45:25.051271+0000","last_peered":"2023-10-06T04:45:25.051271+0000","last_clean":"2023-10-06T04:45:25.051271+0000","last_became_active":"2023-10-06T04:45:24.040138+0000","last_became_peered":"2023-10-06T04:45:24.040138+0000","last_unstale":"2023-10-06T04:45:25.051271+0000","last_undegraded":"2023-10-06T04:45:25.051271+0000","last_fullsized":"2023-10-06T04:45:25.051271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:32.652101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046696+0000","last_change":"2023-10-06T04:45:25.036858+0000","last_active":"2023-10-06T04:45:25.046696+0000","last_peered":"2023-10-06T04:45:25.046696+0000","last_clean":"2023-10-06T04:45:25.046696+0000","last_became_active":"2023-10-06T04:45:25.036536+0000","last_became_peered":"2023-10-06T04:45:25.036536+0000","last_unstale":"2023-10-06T04:45:25.046696+0000","last_undegraded":"2023-10-06T04:45:25.046696+0000","last_fullsized":"2023-10-06T04:45:25.046696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:53.754887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060953+0000","last_change":"2023-10-06T04:45:24.046735+0000","last_active":"2023-10-06T04:45:25.060953+0000","last_peered":"2023-10-06T04:45:25.060953+0000","last_clean":"2023-10-06T04:45:25.060953+0000","last_became_active":"2023-10-06T04:45:24.046460+0000","last_became_peered":"2023-10-06T04:45:24.046460+0000","last_unstale":"2023-10-06T04:45:25.060953+0000","last_undegraded":"2023-10-06T04:45:25.060953+0000","last_fullsized":"2023-10-06T04:45:25.060953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:54.083119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058991+0000","last_change":"2023-10-06T04:45:25.050257+0000","last_active":"2023-10-06T04:45:25.058991+0000","last_peered":"2023-10-06T04:45:25.058991+0000","last_clean":"2023-10-06T04:45:25.058991+0000","last_became_active":"2023-10-06T04:45:25.049989+0000","last_became_peered":"2023-10-06T04:45:25.049989+0000","last_unstale":"2023-10-06T04:45:25.058991+0000","last_undegraded":"2023-10-06T04:45:25.058991+0000","last_fullsized":"2023-10-06T04:45:25.058991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:17.060167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032030+0000","last_change":"2023-10-06T04:45:24.037184+0000","last_active":"2023-10-06T04:45:25.032030+0000","last_peered":"2023-10-06T04:45:25.032030+0000","last_clean":"2023-10-06T04:45:25.032030+0000","last_became_active":"2023-10-06T04:45:24.036910+0000","last_became_peered":"2023-10-06T04:45:24.036910+0000","last_unstale":"2023-10-06T04:45:25.032030+0000","last_undegraded":"2023-10-06T04:45:25.032030+0000","last_fullsized":"2023-10-06T04:45:25.032030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.914389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.062829+0000","last_change":"2023-10-06T04:45:25.058465+0000","last_active":"2023-10-06T04:45:25.062829+0000","last_peered":"2023-10-06T04:45:25.062829+0000","last_clean":"2023-10-06T04:45:25.062829+0000","last_became_active":"2023-10-06T04:45:25.058170+0000","last_became_peered":"2023-10-06T04:45:25.058170+0000","last_unstale":"2023-10-06T04:45:25.062829+0000","last_undegraded":"2023-10-06T04:45:25.062829+0000","last_fullsized":"2023-10-06T04:45:25.062829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.529270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.033942+0000","last_change":"2023-10-06T04:45:24.048019+0000","last_active":"2023-10-06T04:45:25.033942+0000","last_peered":"2023-10-06T04:45:25.033942+0000","last_clean":"2023-10-06T04:45:25.033942+0000","last_became_active":"2023-10-06T04:45:24.046776+0000","last_became_peered":"2023-10-06T04:45:24.046776+0000","last_unstale":"2023-10-06T04:45:25.033942+0000","last_undegraded":"2023-10-06T04:45:25.033942+0000","last_fullsized":"2023-10-06T04:45:25.033942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:35.677022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.047506+0000","last_change":"2023-10-06T04:45:25.044751+0000","last_active":"2023-10-06T04:45:25.047506+0000","last_peered":"2023-10-06T04:45:25.047506+0000","last_clean":"2023-10-06T04:45:25.047506+0000","last_became_active":"2023-10-06T04:45:25.044135+0000","last_became_peered":"2023-10-06T04:45:25.044135+0000","last_unstale":"2023-10-06T04:45:25.047506+0000","last_undegraded":"2023-10-06T04:45:25.047506+0000","last_fullsized":"2023-10-06T04:45:25.047506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:34.676742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.044085+0000","last_change":"2023-10-06T04:45:24.039106+0000","last_active":"2023-10-06T04:45:25.044085+0000","last_peered":"2023-10-06T04:45:25.044085+0000","last_clean":"2023-10-06T04:45:25.044085+0000","last_became_active":"2023-10-06T04:45:24.038821+0000","last_became_peered":"2023-10-06T04:45:24.038821+0000","last_unstale":"2023-10-06T04:45:25.044085+0000","last_undegraded":"2023-10-06T04:45:25.044085+0000","last_fullsized":"2023-10-06T04:45:25.044085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:48.520607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061521+0000","last_change":"2023-10-06T04:45:25.058027+0000","last_active":"2023-10-06T04:45:25.061521+0000","last_peered":"2023-10-06T04:45:25.061521+0000","last_clean":"2023-10-06T04:45:25.061521+0000","last_became_active":"2023-10-06T04:45:25.057759+0000","last_became_peered":"2023-10-06T04:45:25.057759+0000","last_unstale":"2023-10-06T04:45:25.061521+0000","last_undegraded":"2023-10-06T04:45:25.061521+0000","last_fullsized":"2023-10-06T04:45:25.061521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:32.285391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.028175+0000","last_change":"2023-10-06T04:45:24.040075+0000","last_active":"2023-10-06T04:45:25.028175+0000","last_peered":"2023-10-06T04:45:25.028175+0000","last_clean":"2023-10-06T04:45:25.028175+0000","last_became_active":"2023-10-06T04:45:24.039813+0000","last_became_peered":"2023-10-06T04:45:24.039813+0000","last_unstale":"2023-10-06T04:45:25.028175+0000","last_undegraded":"2023-10-06T04:45:25.028175+0000","last_fullsized":"2023-10-06T04:45:25.028175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.171502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.062994+0000","last_change":"2023-10-06T04:45:25.058596+0000","last_active":"2023-10-06T04:45:25.062994+0000","last_peered":"2023-10-06T04:45:25.062994+0000","last_clean":"2023-10-06T04:45:25.062994+0000","last_became_active":"2023-10-06T04:45:25.057874+0000","last_became_peered":"2023-10-06T04:45:25.057874+0000","last_unstale":"2023-10-06T04:45:25.062994+0000","last_undegraded":"2023-10-06T04:45:25.062994+0000","last_fullsized":"2023-10-06T04:45:25.062994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:37.777434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055677+0000","last_change":"2023-10-06T04:45:24.042012+0000","last_active":"2023-10-06T04:45:25.055677+0000","last_peered":"2023-10-06T04:45:25.055677+0000","last_clean":"2023-10-06T04:45:25.055677+0000","last_became_active":"2023-10-06T04:45:24.041752+0000","last_became_peered":"2023-10-06T04:45:24.041752+0000","last_unstale":"2023-10-06T04:45:25.055677+0000","last_undegraded":"2023-10-06T04:45:25.055677+0000","last_fullsized":"2023-10-06T04:45:25.055677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:45.709185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059564+0000","last_change":"2023-10-06T04:45:25.046424+0000","last_active":"2023-10-06T04:45:25.059564+0000","last_peered":"2023-10-06T04:45:25.059564+0000","last_clean":"2023-10-06T04:45:25.059564+0000","last_became_active":"2023-10-06T04:45:25.046155+0000","last_became_peered":"2023-10-06T04:45:25.046155+0000","last_unstale":"2023-10-06T04:45:25.059564+0000","last_undegraded":"2023-10-06T04:45:25.059564+0000","last_fullsized":"2023-10-06T04:45:25.059564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:28.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.063313+0000","last_change":"2023-10-06T04:45:24.042616+0000","last_active":"2023-10-06T04:45:25.063313+0000","last_peered":"2023-10-06T04:45:25.063313+0000","last_clean":"2023-10-06T04:45:25.063313+0000","last_became_active":"2023-10-06T04:45:24.042368+0000","last_became_peered":"2023-10-06T04:45:24.042368+0000","last_unstale":"2023-10-06T04:45:25.063313+0000","last_undegraded":"2023-10-06T04:45:25.063313+0000","last_fullsized":"2023-10-06T04:45:25.063313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:53.190787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.045269+0000","last_change":"2023-10-06T04:45:25.042108+0000","last_active":"2023-10-06T04:45:25.045269+0000","last_peered":"2023-10-06T04:45:25.045269+0000","last_clean":"2023-10-06T04:45:25.045269+0000","last_became_active":"2023-10-06T04:45:25.041770+0000","last_became_peered":"2023-10-06T04:45:25.041770+0000","last_unstale":"2023-10-06T04:45:25.045269+0000","last_undegraded":"2023-10-06T04:45:25.045269+0000","last_fullsized":"2023-10-06T04:45:25.045269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:03.272820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.054996+0000","last_change":"2023-10-06T04:45:24.044839+0000","last_active":"2023-10-06T04:45:25.054996+0000","last_peered":"2023-10-06T04:45:25.054996+0000","last_clean":"2023-10-06T04:45:25.054996+0000","last_became_active":"2023-10-06T04:45:24.044609+0000","last_became_peered":"2023-10-06T04:45:24.044609+0000","last_unstale":"2023-10-06T04:45:25.054996+0000","last_undegraded":"2023-10-06T04:45:25.054996+0000","last_fullsized":"2023-10-06T04:45:25.054996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.171502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055118+0000","last_change":"2023-10-06T04:45:25.047180+0000","last_active":"2023-10-06T04:45:25.055118+0000","last_peered":"2023-10-06T04:45:25.055118+0000","last_clean":"2023-10-06T04:45:25.055118+0000","last_became_active":"2023-10-06T04:45:25.046892+0000","last_became_peered":"2023-10-06T04:45:25.046892+0000","last_unstale":"2023-10-06T04:45:25.055118+0000","last_undegraded":"2023-10-06T04:45:25.055118+0000","last_fullsized":"2023-10-06T04:45:25.055118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:23.793022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031742+0000","last_change":"2023-10-06T04:45:24.042592+0000","last_active":"2023-10-06T04:45:25.031742+0000","last_peered":"2023-10-06T04:45:25.031742+0000","last_clean":"2023-10-06T04:45:25.031742+0000","last_became_active":"2023-10-06T04:45:24.042174+0000","last_became_peered":"2023-10-06T04:45:24.042174+0000","last_unstale":"2023-10-06T04:45:25.031742+0000","last_undegraded":"2023-10-06T04:45:25.031742+0000","last_fullsized":"2023-10-06T04:45:25.031742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:09.333679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061413+0000","last_change":"2023-10-06T04:45:25.056826+0000","last_active":"2023-10-06T04:45:25.061413+0000","last_peered":"2023-10-06T04:45:25.061413+0000","last_clean":"2023-10-06T04:45:25.061413+0000","last_became_active":"2023-10-06T04:45:25.056564+0000","last_became_peered":"2023-10-06T04:45:25.056564+0000","last_unstale":"2023-10-06T04:45:25.061413+0000","last_undegraded":"2023-10-06T04:45:25.061413+0000","last_fullsized":"2023-10-06T04:45:25.061413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:23.793022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031601+0000","last_change":"2023-10-06T04:45:24.046164+0000","last_active":"2023-10-06T04:45:25.031601+0000","last_peered":"2023-10-06T04:45:25.031601+0000","last_clean":"2023-10-06T04:45:25.031601+0000","last_became_active":"2023-10-06T04:45:24.045838+0000","last_became_peered":"2023-10-06T04:45:24.045838+0000","last_unstale":"2023-10-06T04:45:25.031601+0000","last_undegraded":"2023-10-06T04:45:25.031601+0000","last_fullsized":"2023-10-06T04:45:25.031601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:16.041117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.056300+0000","last_change":"2023-10-06T04:45:25.051756+0000","last_active":"2023-10-06T04:45:25.056300+0000","last_peered":"2023-10-06T04:45:25.056300+0000","last_clean":"2023-10-06T04:45:25.056300+0000","last_became_active":"2023-10-06T04:45:25.051464+0000","last_became_peered":"2023-10-06T04:45:25.051464+0000","last_unstale":"2023-10-06T04:45:25.056300+0000","last_undegraded":"2023-10-06T04:45:25.056300+0000","last_fullsized":"2023-10-06T04:45:25.056300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:28.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061490+0000","last_change":"2023-10-06T04:45:24.045655+0000","last_active":"2023-10-06T04:45:25.061490+0000","last_peered":"2023-10-06T04:45:25.061490+0000","last_clean":"2023-10-06T04:45:25.061490+0000","last_became_active":"2023-10-06T04:45:24.045386+0000","last_became_peered":"2023-10-06T04:45:24.045386+0000","last_unstale":"2023-10-06T04:45:25.061490+0000","last_undegraded":"2023-10-06T04:45:25.061490+0000","last_fullsized":"2023-10-06T04:45:25.061490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:33.467360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.056374+0000","last_change":"2023-10-06T04:45:25.051472+0000","last_active":"2023-10-06T04:45:25.056374+0000","last_peered":"2023-10-06T04:45:25.056374+0000","last_clean":"2023-10-06T04:45:25.056374+0000","last_became_active":"2023-10-06T04:45:25.051215+0000","last_became_peered":"2023-10-06T04:45:25.051215+0000","last_unstale":"2023-10-06T04:45:25.056374+0000","last_undegraded":"2023-10-06T04:45:25.056374+0000","last_fullsized":"2023-10-06T04:45:25.056374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:05.161120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060210+0000","last_change":"2023-10-06T04:45:24.045022+0000","last_active":"2023-10-06T04:45:25.060210+0000","last_peered":"2023-10-06T04:45:25.060210+0000","last_clean":"2023-10-06T04:45:25.060210+0000","last_became_active":"2023-10-06T04:45:24.044717+0000","last_became_peered":"2023-10-06T04:45:24.044717+0000","last_unstale":"2023-10-06T04:45:25.060210+0000","last_undegraded":"2023-10-06T04:45:25.060210+0000","last_fullsized":"2023-10-06T04:45:25.060210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:54.083119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.047231+0000","last_change":"2023-10-06T04:45:25.038112+0000","last_active":"2023-10-06T04:45:25.047231+0000","last_peered":"2023-10-06T04:45:25.047231+0000","last_clean":"2023-10-06T04:45:25.047231+0000","last_became_active":"2023-10-06T04:45:25.037838+0000","last_became_peered":"2023-10-06T04:45:25.037838+0000","last_unstale":"2023-10-06T04:45:25.047231+0000","last_undegraded":"2023-10-06T04:45:25.047231+0000","last_fullsized":"2023-10-06T04:45:25.047231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.809711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061571+0000","last_change":"2023-10-06T04:45:24.035422+0000","last_active":"2023-10-06T04:45:25.061571+0000","last_peered":"2023-10-06T04:45:25.061571+0000","last_clean":"2023-10-06T04:45:25.061571+0000","last_became_active":"2023-10-06T04:45:24.035082+0000","last_became_peered":"2023-10-06T04:45:24.035082+0000","last_unstale":"2023-10-06T04:45:25.061571+0000","last_undegraded":"2023-10-06T04:45:25.061571+0000","last_fullsized":"2023-10-06T04:45:25.061571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:40.317265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058177+0000","last_change":"2023-10-06T04:45:25.047754+0000","last_active":"2023-10-06T04:45:25.058177+0000","last_peered":"2023-10-06T04:45:25.058177+0000","last_clean":"2023-10-06T04:45:25.058177+0000","last_became_active":"2023-10-06T04:45:25.047417+0000","last_became_peered":"2023-10-06T04:45:25.047417+0000","last_unstale":"2023-10-06T04:45:25.058177+0000","last_undegraded":"2023-10-06T04:45:25.058177+0000","last_fullsized":"2023-10-06T04:45:25.058177+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:40.635239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061744+0000","last_change":"2023-10-06T04:45:24.042918+0000","last_active":"2023-10-06T04:45:25.061744+0000","last_peered":"2023-10-06T04:45:25.061744+0000","last_clean":"2023-10-06T04:45:25.061744+0000","last_became_active":"2023-10-06T04:45:24.042646+0000","last_became_peered":"2023-10-06T04:45:24.042646+0000","last_unstale":"2023-10-06T04:45:25.061744+0000","last_undegraded":"2023-10-06T04:45:25.061744+0000","last_fullsized":"2023-10-06T04:45:25.061744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:28.240091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057704+0000","last_change":"2023-10-06T04:45:25.056690+0000","last_active":"2023-10-06T04:45:25.057704+0000","last_peered":"2023-10-06T04:45:25.057704+0000","last_clean":"2023-10-06T04:45:25.057704+0000","last_became_active":"2023-10-06T04:45:25.056393+0000","last_became_peered":"2023-10-06T04:45:25.056393+0000","last_unstale":"2023-10-06T04:45:25.057704+0000","last_undegraded":"2023-10-06T04:45:25.057704+0000","last_fullsized":"2023-10-06T04:45:25.057704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:10.337161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031248+0000","last_change":"2023-10-06T04:45:24.041465+0000","last_active":"2023-10-06T04:45:25.031248+0000","last_peered":"2023-10-06T04:45:25.031248+0000","last_clean":"2023-10-06T04:45:25.031248+0000","last_became_active":"2023-10-06T04:45:24.041130+0000","last_became_peered":"2023-10-06T04:45:24.041130+0000","last_unstale":"2023-10-06T04:45:25.031248+0000","last_undegraded":"2023-10-06T04:45:25.031248+0000","last_fullsized":"2023-10-06T04:45:25.031248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:00.390284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060849+0000","last_change":"2023-10-06T04:45:25.048046+0000","last_active":"2023-10-06T04:45:25.060849+0000","last_peered":"2023-10-06T04:45:25.060849+0000","last_clean":"2023-10-06T04:45:25.060849+0000","last_became_active":"2023-10-06T04:45:25.047278+0000","last_became_peered":"2023-10-06T04:45:25.047278+0000","last_unstale":"2023-10-06T04:45:25.060849+0000","last_undegraded":"2023-10-06T04:45:25.060849+0000","last_fullsized":"2023-10-06T04:45:25.060849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:44.480794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055548+0000","last_change":"2023-10-06T04:45:24.041722+0000","last_active":"2023-10-06T04:45:25.055548+0000","last_peered":"2023-10-06T04:45:25.055548+0000","last_clean":"2023-10-06T04:45:25.055548+0000","last_became_active":"2023-10-06T04:45:24.041403+0000","last_became_peered":"2023-10-06T04:45:24.041403+0000","last_unstale":"2023-10-06T04:45:25.055548+0000","last_undegraded":"2023-10-06T04:45:25.055548+0000","last_fullsized":"2023-10-06T04:45:25.055548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:32.383557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060537+0000","last_change":"2023-10-06T04:45:25.056705+0000","last_active":"2023-10-06T04:45:25.060537+0000","last_peered":"2023-10-06T04:45:25.060537+0000","last_clean":"2023-10-06T04:45:25.060537+0000","last_became_active":"2023-10-06T04:45:25.056418+0000","last_became_peered":"2023-10-06T04:45:25.056418+0000","last_unstale":"2023-10-06T04:45:25.060537+0000","last_undegraded":"2023-10-06T04:45:25.060537+0000","last_fullsized":"2023-10-06T04:45:25.060537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:12.144695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031079+0000","last_change":"2023-10-06T04:45:24.035822+0000","last_active":"2023-10-06T04:45:25.031079+0000","last_peered":"2023-10-06T04:45:25.031079+0000","last_clean":"2023-10-06T04:45:25.031079+0000","last_became_active":"2023-10-06T04:45:24.035472+0000","last_became_peered":"2023-10-06T04:45:24.035472+0000","last_unstale":"2023-10-06T04:45:25.031079+0000","last_undegraded":"2023-10-06T04:45:25.031079+0000","last_fullsized":"2023-10-06T04:45:25.031079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:13.317724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.052919+0000","last_change":"2023-10-06T04:45:25.050200+0000","last_active":"2023-10-06T04:45:25.052919+0000","last_peered":"2023-10-06T04:45:25.052919+0000","last_clean":"2023-10-06T04:45:25.052919+0000","last_became_active":"2023-10-06T04:45:25.049918+0000","last_became_peered":"2023-10-06T04:45:25.049918+0000","last_unstale":"2023-10-06T04:45:25.052919+0000","last_undegraded":"2023-10-06T04:45:25.052919+0000","last_fullsized":"2023-10-06T04:45:25.052919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:23.793022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034862+0000","last_change":"2023-10-06T04:45:24.049005+0000","last_active":"2023-10-06T04:45:25.034862+0000","last_peered":"2023-10-06T04:45:25.034862+0000","last_clean":"2023-10-06T04:45:25.034862+0000","last_became_active":"2023-10-06T04:45:24.048710+0000","last_became_peered":"2023-10-06T04:45:24.048710+0000","last_unstale":"2023-10-06T04:45:25.034862+0000","last_undegraded":"2023-10-06T04:45:25.034862+0000","last_fullsized":"2023-10-06T04:45:25.034862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:09.892507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.062810+0000","last_change":"2023-10-06T04:45:25.058473+0000","last_active":"2023-10-06T04:45:25.062810+0000","last_peered":"2023-10-06T04:45:25.062810+0000","last_clean":"2023-10-06T04:45:25.062810+0000","last_became_active":"2023-10-06T04:45:25.058174+0000","last_became_peered":"2023-10-06T04:45:25.058174+0000","last_unstale":"2023-10-06T04:45:25.062810+0000","last_undegraded":"2023-10-06T04:45:25.062810+0000","last_fullsized":"2023-10-06T04:45:25.062810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:32.285391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031484+0000","last_change":"2023-10-06T04:45:24.040874+0000","last_active":"2023-10-06T04:45:25.031484+0000","last_peered":"2023-10-06T04:45:25.031484+0000","last_clean":"2023-10-06T04:45:25.031484+0000","last_became_active":"2023-10-06T04:45:24.040622+0000","last_became_peered":"2023-10-06T04:45:24.040622+0000","last_unstale":"2023-10-06T04:45:25.031484+0000","last_undegraded":"2023-10-06T04:45:25.031484+0000","last_fullsized":"2023-10-06T04:45:25.031484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:06.175768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059036+0000","last_change":"2023-10-06T04:45:25.052636+0000","last_active":"2023-10-06T04:45:25.059036+0000","last_peered":"2023-10-06T04:45:25.059036+0000","last_clean":"2023-10-06T04:45:25.059036+0000","last_became_active":"2023-10-06T04:45:25.052320+0000","last_became_peered":"2023-10-06T04:45:25.052320+0000","last_unstale":"2023-10-06T04:45:25.059036+0000","last_undegraded":"2023-10-06T04:45:25.059036+0000","last_fullsized":"2023-10-06T04:45:25.059036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:05.161120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.030908+0000","last_change":"2023-10-06T04:45:24.042782+0000","last_active":"2023-10-06T04:45:25.030908+0000","last_peered":"2023-10-06T04:45:25.030908+0000","last_clean":"2023-10-06T04:45:25.030908+0000","last_became_active":"2023-10-06T04:45:24.040786+0000","last_became_peered":"2023-10-06T04:45:24.040786+0000","last_unstale":"2023-10-06T04:45:25.030908+0000","last_undegraded":"2023-10-06T04:45:25.030908+0000","last_fullsized":"2023-10-06T04:45:25.030908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:08.373503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031576+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:45:25.031576+0000","last_peered":"2023-10-06T04:45:25.031576+0000","last_clean":"2023-10-06T04:45:25.031576+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:45:25.031576+0000","last_undegraded":"2023-10-06T04:45:25.031576+0000","last_fullsized":"2023-10-06T04:45:25.031576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060883+0000","last_change":"2023-10-06T04:45:25.048977+0000","last_active":"2023-10-06T04:45:25.060883+0000","last_peered":"2023-10-06T04:45:25.060883+0000","last_clean":"2023-10-06T04:45:25.060883+0000","last_became_active":"2023-10-06T04:45:25.048698+0000","last_became_peered":"2023-10-06T04:45:25.048698+0000","last_unstale":"2023-10-06T04:45:25.060883+0000","last_undegraded":"2023-10-06T04:45:25.060883+0000","last_fullsized":"2023-10-06T04:45:25.060883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.529270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034572+0000","last_change":"2023-10-06T04:45:24.042117+0000","last_active":"2023-10-06T04:45:25.034572+0000","last_peered":"2023-10-06T04:45:25.034572+0000","last_clean":"2023-10-06T04:45:25.034572+0000","last_became_active":"2023-10-06T04:45:24.041876+0000","last_became_peered":"2023-10-06T04:45:24.041876+0000","last_unstale":"2023-10-06T04:45:25.034572+0000","last_undegraded":"2023-10-06T04:45:25.034572+0000","last_fullsized":"2023-10-06T04:45:25.034572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:45.709185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.036823+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:45:25.036823+0000","last_peered":"2023-10-06T04:45:25.036823+0000","last_clean":"2023-10-06T04:45:25.036823+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:45:25.036823+0000","last_undegraded":"2023-10-06T04:45:25.036823+0000","last_fullsized":"2023-10-06T04:45:25.036823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.053635+0000","last_change":"2023-10-06T04:45:25.048854+0000","last_active":"2023-10-06T04:45:25.053635+0000","last_peered":"2023-10-06T04:45:25.053635+0000","last_clean":"2023-10-06T04:45:25.053635+0000","last_became_active":"2023-10-06T04:45:25.048608+0000","last_became_peered":"2023-10-06T04:45:25.048608+0000","last_unstale":"2023-10-06T04:45:25.053635+0000","last_undegraded":"2023-10-06T04:45:25.053635+0000","last_fullsized":"2023-10-06T04:45:25.053635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:17.232105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.053985+0000","last_change":"2023-10-06T04:45:24.040958+0000","last_active":"2023-10-06T04:45:25.053985+0000","last_peered":"2023-10-06T04:45:25.053985+0000","last_clean":"2023-10-06T04:45:25.053985+0000","last_became_active":"2023-10-06T04:45:24.040708+0000","last_became_peered":"2023-10-06T04:45:24.040708+0000","last_unstale":"2023-10-06T04:45:25.053985+0000","last_undegraded":"2023-10-06T04:45:25.053985+0000","last_fullsized":"2023-10-06T04:45:25.053985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:53.190787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031224+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:45:25.031224+0000","last_peered":"2023-10-06T04:45:25.031224+0000","last_clean":"2023-10-06T04:45:25.031224+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:45:25.031224+0000","last_undegraded":"2023-10-06T04:45:25.031224+0000","last_fullsized":"2023-10-06T04:45:25.031224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032722+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:45:25.032722+0000","last_peered":"2023-10-06T04:45:25.032722+0000","last_clean":"2023-10-06T04:45:25.032722+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:45:25.032722+0000","last_undegraded":"2023-10-06T04:45:25.032722+0000","last_fullsized":"2023-10-06T04:45:25.032722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061540+0000","last_change":"2023-10-06T04:45:25.058535+0000","last_active":"2023-10-06T04:45:25.061540+0000","last_peered":"2023-10-06T04:45:25.061540+0000","last_clean":"2023-10-06T04:45:25.061540+0000","last_became_active":"2023-10-06T04:45:25.058002+0000","last_became_peered":"2023-10-06T04:45:25.058002+0000","last_unstale":"2023-10-06T04:45:25.061540+0000","last_undegraded":"2023-10-06T04:45:25.061540+0000","last_fullsized":"2023-10-06T04:45:25.061540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:54.036388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.030053+0000","last_change":"2023-10-06T04:45:24.043108+0000","last_active":"2023-10-06T04:45:25.030053+0000","last_peered":"2023-10-06T04:45:25.030053+0000","last_clean":"2023-10-06T04:45:25.030053+0000","last_became_active":"2023-10-06T04:45:24.042819+0000","last_became_peered":"2023-10-06T04:45:24.042819+0000","last_unstale":"2023-10-06T04:45:25.030053+0000","last_undegraded":"2023-10-06T04:45:25.030053+0000","last_fullsized":"2023-10-06T04:45:25.030053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:35.981900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034413+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:45:25.034413+0000","last_peered":"2023-10-06T04:45:25.034413+0000","last_clean":"2023-10-06T04:45:25.034413+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:45:25.034413+0000","last_undegraded":"2023-10-06T04:45:25.034413+0000","last_fullsized":"2023-10-06T04:45:25.034413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060490+0000","last_change":"2023-10-06T04:45:25.056909+0000","last_active":"2023-10-06T04:45:25.060490+0000","last_peered":"2023-10-06T04:45:25.060490+0000","last_clean":"2023-10-06T04:45:25.060490+0000","last_became_active":"2023-10-06T04:45:25.056637+0000","last_became_peered":"2023-10-06T04:45:25.056637+0000","last_unstale":"2023-10-06T04:45:25.060490+0000","last_undegraded":"2023-10-06T04:45:25.060490+0000","last_fullsized":"2023-10-06T04:45:25.060490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:54.036388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034554+0000","last_change":"2023-10-06T04:45:24.049099+0000","last_active":"2023-10-06T04:45:25.034554+0000","last_peered":"2023-10-06T04:45:25.034554+0000","last_clean":"2023-10-06T04:45:25.034554+0000","last_became_active":"2023-10-06T04:45:24.048803+0000","last_became_peered":"2023-10-06T04:45:24.048803+0000","last_unstale":"2023-10-06T04:45:25.034554+0000","last_undegraded":"2023-10-06T04:45:25.034554+0000","last_fullsized":"2023-10-06T04:45:25.034554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:32.652101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032637+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:45:25.032637+0000","last_peered":"2023-10-06T04:45:25.032637+0000","last_clean":"2023-10-06T04:45:25.032637+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:45:25.032637+0000","last_undegraded":"2023-10-06T04:45:25.032637+0000","last_fullsized":"2023-10-06T04:45:25.032637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057765+0000","last_change":"2023-10-06T04:45:25.051257+0000","last_active":"2023-10-06T04:45:25.057765+0000","last_peered":"2023-10-06T04:45:25.057765+0000","last_clean":"2023-10-06T04:45:25.057765+0000","last_became_active":"2023-10-06T04:45:25.050992+0000","last_became_peered":"2023-10-06T04:45:25.050992+0000","last_unstale":"2023-10-06T04:45:25.057765+0000","last_undegraded":"2023-10-06T04:45:25.057765+0000","last_fullsized":"2023-10-06T04:45:25.057765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:54.036388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.027145+0000","last_change":"2023-10-06T04:45:24.040171+0000","last_active":"2023-10-06T04:45:25.027145+0000","last_peered":"2023-10-06T04:45:25.027145+0000","last_clean":"2023-10-06T04:45:25.027145+0000","last_became_active":"2023-10-06T04:45:24.039922+0000","last_became_peered":"2023-10-06T04:45:24.039922+0000","last_unstale":"2023-10-06T04:45:25.027145+0000","last_undegraded":"2023-10-06T04:45:25.027145+0000","last_fullsized":"2023-10-06T04:45:25.027145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:02.029986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.028062+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:45:25.028062+0000","last_peered":"2023-10-06T04:45:25.028062+0000","last_clean":"2023-10-06T04:45:25.028062+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:45:25.028062+0000","last_undegraded":"2023-10-06T04:45:25.028062+0000","last_fullsized":"2023-10-06T04:45:25.028062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049642+0000","last_change":"2023-10-06T04:45:25.041365+0000","last_active":"2023-10-06T04:45:25.049642+0000","last_peered":"2023-10-06T04:45:25.049642+0000","last_clean":"2023-10-06T04:45:25.049642+0000","last_became_active":"2023-10-06T04:45:25.041060+0000","last_became_peered":"2023-10-06T04:45:25.041060+0000","last_unstale":"2023-10-06T04:45:25.049642+0000","last_undegraded":"2023-10-06T04:45:25.049642+0000","last_fullsized":"2023-10-06T04:45:25.049642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:35.153566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.033141+0000","last_change":"2023-10-06T04:45:24.042570+0000","last_active":"2023-10-06T04:45:25.033141+0000","last_peered":"2023-10-06T04:45:25.033141+0000","last_clean":"2023-10-06T04:45:25.033141+0000","last_became_active":"2023-10-06T04:45:24.042247+0000","last_became_peered":"2023-10-06T04:45:24.042247+0000","last_unstale":"2023-10-06T04:45:25.033141+0000","last_undegraded":"2023-10-06T04:45:25.033141+0000","last_fullsized":"2023-10-06T04:45:25.033141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:52.768810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031742+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:45:25.031742+0000","last_peered":"2023-10-06T04:45:25.031742+0000","last_clean":"2023-10-06T04:45:25.031742+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:45:25.031742+0000","last_undegraded":"2023-10-06T04:45:25.031742+0000","last_fullsized":"2023-10-06T04:45:25.031742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055348+0000","last_change":"2023-10-06T04:45:25.052680+0000","last_active":"2023-10-06T04:45:25.055348+0000","last_peered":"2023-10-06T04:45:25.055348+0000","last_clean":"2023-10-06T04:45:25.055348+0000","last_became_active":"2023-10-06T04:45:25.052385+0000","last_became_peered":"2023-10-06T04:45:25.052385+0000","last_unstale":"2023-10-06T04:45:25.055348+0000","last_undegraded":"2023-10-06T04:45:25.055348+0000","last_fullsized":"2023-10-06T04:45:25.055348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:20.941027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.026600+0000","last_change":"2023-10-06T04:45:24.046407+0000","last_active":"2023-10-06T04:45:25.026600+0000","last_peered":"2023-10-06T04:45:25.026600+0000","last_clean":"2023-10-06T04:45:25.026600+0000","last_became_active":"2023-10-06T04:45:24.045925+0000","last_became_peered":"2023-10-06T04:45:24.045925+0000","last_unstale":"2023-10-06T04:45:25.026600+0000","last_undegraded":"2023-10-06T04:45:25.026600+0000","last_fullsized":"2023-10-06T04:45:25.026600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:47.815368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032651+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:45:25.032651+0000","last_peered":"2023-10-06T04:45:25.032651+0000","last_clean":"2023-10-06T04:45:25.032651+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:45:25.032651+0000","last_undegraded":"2023-10-06T04:45:25.032651+0000","last_fullsized":"2023-10-06T04:45:25.032651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298244,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073596,"statfs":{"total":96636764160,"available":96331362304,"internally_reserved":0,"allocated":978944,"data_stored":740701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.3070000000000004,"5min":9.3070000000000004,"15min":9.3070000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.2129999999999992,"5min":9.2129999999999992,"15min":9.2129999999999992},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":9.0850000000000009,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":9.0969999999999995},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.90700000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.878},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.92300000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.83499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":149281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.37},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.498}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.72099999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":739185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.2509999999999994,"5min":9.2509999999999994,"15min":9.2509999999999994},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":6.4000000000000004,"5min":6.4000000000000004,"15min":6.4000000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.4450000000000003,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.73799999999999999},{"interface":"front","average":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":19.992999999999999,"5min":19.992999999999999,"15min":19.992999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":6.476,"5min":6.476,"15min":6.476},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.9050000000000002,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":2.056,"5min":2.056,"15min":2.056},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":19.960999999999999,"5min":19.960999999999999,"15min":19.960999999999999},"last":0.92700000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":148761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.63}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.75700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":148797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.35799999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":11.241,"5min":11.241,"15min":11.241},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.273,"5min":11.273,"15min":11.273},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.436}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":11.125999999999999,"5min":11.125999999999999,"15min":11.125999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":11.208,"5min":11.208,"15min":11.208},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.622},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":5.327,"5min":5.327,"15min":5.327},"last":0.749}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.66100000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297664,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074176,"statfs":{"total":96636764160,"available":96331956224,"internally_reserved":0,"allocated":385024,"data_stored":150297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.745}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":149303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.74399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.71999999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":148839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.73399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:45:34.306 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:45:34.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.501+0000 7fa6341ff700 1 Processor -- start 2023-10-06T04:45:34.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.501+0000 7fa6341ff700 1 -- start start 2023-10-06T04:45:34.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.502+0000 7fa6341ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa62c0ccd30 0x7fa62c099610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:34.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.502+0000 7fa6341ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0acc40 con 0x7fa62c0abb60 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.502+0000 7fa6341ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0ad0d0 con 0x7fa62c0690b0 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.502+0000 7fa6341ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c06ae30 con 0x7fa62c0ccd30 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.503+0000 7fa63179a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa62c0ccd30 0x7fa62c099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.503+0000 7fa631f9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa62c0abb60 0x7fa62c098f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53040/0 (socket says 172.21.15.124:53040) 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.503+0000 7fa63179a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa62c0ccd30 0x7fa62c099610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54994/0 (socket says 172.21.15.124:54994) 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.503+0000 7fa631f9b700 1 -- 172.21.15.124:0/382454345 learned_addr learned my addr 172.21.15.124:0/382454345 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.503+0000 7fa63179a700 1 -- 172.21.15.124:0/382454345 >> v1:172.21.15.158:6789/0 conn(0x7fa62c0690b0 legacy=0x7fa62c096a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.503+0000 7fa63179a700 1 -- 172.21.15.124:0/382454345 >> v1:172.21.15.124:6789/0 conn(0x7fa62c0abb60 legacy=0x7fa62c098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.503+0000 7fa63179a700 1 -- 172.21.15.124:0/382454345 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c0ac5f0 con 0x7fa62c0ccd30 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.503+0000 7fa630f99700 1 -- 172.21.15.124:0/382454345 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684219908 0 0) 0x7fa62c0acc40 con 0x7fa62c0abb60 2023-10-06T04:45:34.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.503+0000 7fa63179a700 1 --2- 172.21.15.124:0/382454345 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0ccd30 0x7fa62c099610 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0098e0 tx=0x7fa61c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a14df4c3875928 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:34.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.504+0000 7fa630f99700 1 -- 172.21.15.124:0/382454345 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c009e80 con 0x7fa62c0ccd30 2023-10-06T04:45:34.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.504+0000 7fa630f99700 1 -- 172.21.15.124:0/382454345 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c00b860 con 0x7fa62c0ccd30 2023-10-06T04:45:34.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.504+0000 7fa630f99700 1 -- 172.21.15.124:0/382454345 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00bbe0 con 0x7fa62c0ccd30 2023-10-06T04:45:34.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.504+0000 7fa6341ff700 1 -- 172.21.15.124:0/382454345 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0ccd30 msgr2=0x7fa62c099610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.504+0000 7fa6341ff700 1 --2- 172.21.15.124:0/382454345 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0ccd30 0x7fa62c099610 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0098e0 tx=0x7fa61c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.504+0000 7fa6341ff700 1 -- 172.21.15.124:0/382454345 shutdown_connections 2023-10-06T04:45:34.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.504+0000 7fa6341ff700 1 --2- 172.21.15.124:0/382454345 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0ccd30 0x7fa62c099610 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.504+0000 7fa6341ff700 1 -- 172.21.15.124:0/382454345 >> 172.21.15.124:0/382454345 conn(0x7fa62c0cc050 msgr2=0x7fa62c0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:34.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.504+0000 7fa6341ff700 1 -- 172.21.15.124:0/382454345 shutdown_connections 2023-10-06T04:45:34.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.504+0000 7fa6341ff700 1 -- 172.21.15.124:0/382454345 wait complete. 2023-10-06T04:45:34.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.506+0000 7fa6341ff700 1 Processor -- start 2023-10-06T04:45:34.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.506+0000 7fa6341ff700 1 -- start start 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa6341ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa62c0690b0 0x7fa62c149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa6341ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0abb60 0x7fa62c16ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa6341ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa62c0ccd30 0x7fa62c16b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa6341ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c15c420 con 0x7fa62c0abb60 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa6341ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c15c700 con 0x7fa62c0ccd30 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa6341ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c15c9e0 con 0x7fa62c0690b0 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa63179a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0abb60 0x7fa62c16ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa63179a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0abb60 0x7fa62c16ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55004/0 (socket says 172.21.15.124:55004) 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa63179a700 1 -- 172.21.15.124:0/2147786197 learned_addr learned my addr 172.21.15.124:0/2147786197 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa631f9b700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa62c0690b0 0x7fa62c149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:34.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa63179a700 1 -- 172.21.15.124:0/2147786197 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa62c0690b0 msgr2=0x7fa62c149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa63279c700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa62c0ccd30 0x7fa62c16b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa63179a700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa62c0690b0 0x7fa62c149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa63179a700 1 -- 172.21.15.124:0/2147786197 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa62c0ccd30 msgr2=0x7fa62c16b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa63179a700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa62c0ccd30 0x7fa62c16b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa63179a700 1 -- 172.21.15.124:0/2147786197 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c009420 con 0x7fa62c0abb60 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa631f9b700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa62c0690b0 0x7fa62c149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.507+0000 7fa63279c700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa62c0ccd30 0x7fa62c16b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.508+0000 7fa63179a700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0abb60 0x7fa62c16ab30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa62c06c840 tx=0x7fa61c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.508+0000 7fa621ffb700 1 -- 172.21.15.124:0/2147786197 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c011420 con 0x7fa62c0abb60 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.508+0000 7fa621ffb700 1 -- 172.21.15.124:0/2147786197 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c011580 con 0x7fa62c0abb60 2023-10-06T04:45:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.508+0000 7fa621ffb700 1 -- 172.21.15.124:0/2147786197 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c011920 con 0x7fa62c0abb60 2023-10-06T04:45:34.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.508+0000 7fa6341ff700 1 -- 172.21.15.124:0/2147786197 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c15ccc0 con 0x7fa62c0abb60 2023-10-06T04:45:34.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.508+0000 7fa6341ff700 1 -- 172.21.15.124:0/2147786197 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c1497b0 con 0x7fa62c0abb60 2023-10-06T04:45:34.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.509+0000 7fa6341ff700 1 -- 172.21.15.124:0/2147786197 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c15d1e0 con 0x7fa62c0abb60 2023-10-06T04:45:34.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.510+0000 7fa621ffb700 1 -- 172.21.15.124:0/2147786197 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa61c011c90 con 0x7fa62c0abb60 2023-10-06T04:45:34.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.511+0000 7fa621ffb700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa610066f30 0x7fa6100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:34.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.511+0000 7fa621ffb700 1 -- 172.21.15.124:0/2147786197 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa61c085ea0 con 0x7fa62c0abb60 2023-10-06T04:45:34.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.511+0000 7fa631f9b700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa610066f30 0x7fa6100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:34.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.512+0000 7fa631f9b700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa610066f30 0x7fa6100693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa628000c00 tx=0x7fa628009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:34.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.515+0000 7fa621ffb700 1 -- 172.21.15.124:0/2147786197 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa62c15d1e0 con 0x7fa62c0abb60 2023-10-06T04:45:34.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.704+0000 7fa6341ff700 1 -- 172.21.15.124:0/2147786197 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa62c15d1e0 con 0x7fa610066f30 2023-10-06T04:45:34.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.713+0000 7fa621ffb700 1 -- 172.21.15.124:0/2147786197 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311254 (secure 0 0 0) 0x7fa62c15d1e0 con 0x7fa610066f30 2023-10-06T04:45:34.719 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 -- 172.21.15.124:0/2147786197 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa610066f30 msgr2=0x7fa6100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa610066f30 0x7fa6100693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa628000c00 tx=0x7fa628009040 comp rx=0 tx=0).stop 2023-10-06T04:45:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 -- 172.21.15.124:0/2147786197 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0abb60 msgr2=0x7fa62c16ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0abb60 0x7fa62c16ab30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa62c06c840 tx=0x7fa61c017000 comp rx=0 tx=0).stop 2023-10-06T04:45:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 -- 172.21.15.124:0/2147786197 shutdown_connections 2023-10-06T04:45:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa62c0ccd30 0x7fa62c16b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa610066f30 0x7fa6100693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa62c0690b0 0x7fa62c149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 --2- 172.21.15.124:0/2147786197 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa62c0abb60 0x7fa62c16ab30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 -- 172.21.15.124:0/2147786197 >> 172.21.15.124:0/2147786197 conn(0x7fa62c0cc050 msgr2=0x7fa62c096a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:34.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 -- 172.21.15.124:0/2147786197 shutdown_connections 2023-10-06T04:45:34.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.717+0000 7fa6341ff700 1 -- 172.21.15.124:0/2147786197 wait complete. 2023-10-06T04:45:34.723 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:45:34.737 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-06T04:45:33.919331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382408,"kb_used_data":4104,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592312,"statfs":{"total":773094113280,"available":770654527488,"internally_reserved":0,"allocated":4202496,"data_stored":2375164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.894683"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057213+0000","last_change":"2023-10-06T04:45:25.055410+0000","last_active":"2023-10-06T04:45:25.057213+0000","last_peered":"2023-10-06T04:45:25.057213+0000","last_clean":"2023-10-06T04:45:25.057213+0000","last_became_active":"2023-10-06T04:45:25.055134+0000","last_became_peered":"2023-10-06T04:45:25.055134+0000","last_unstale":"2023-10-06T04:45:25.057213+0000","last_undegraded":"2023-10-06T04:45:25.057213+0000","last_fullsized":"2023-10-06T04:45:25.057213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:17.060167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057785+0000","last_change":"2023-10-06T04:45:25.051552+0000","last_active":"2023-10-06T04:45:25.057785+0000","last_peered":"2023-10-06T04:45:25.057785+0000","last_clean":"2023-10-06T04:45:25.057785+0000","last_became_active":"2023-10-06T04:45:25.051059+0000","last_became_peered":"2023-10-06T04:45:25.051059+0000","last_unstale":"2023-10-06T04:45:25.057785+0000","last_undegraded":"2023-10-06T04:45:25.057785+0000","last_fullsized":"2023-10-06T04:45:25.057785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:39.256429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.045082+0000","last_change":"2023-10-06T04:45:25.034869+0000","last_active":"2023-10-06T04:45:25.045082+0000","last_peered":"2023-10-06T04:45:25.045082+0000","last_clean":"2023-10-06T04:45:25.045082+0000","last_became_active":"2023-10-06T04:45:25.034530+0000","last_became_peered":"2023-10-06T04:45:25.034530+0000","last_unstale":"2023-10-06T04:45:25.045082+0000","last_undegraded":"2023-10-06T04:45:25.045082+0000","last_fullsized":"2023-10-06T04:45:25.045082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:35.153566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.048655+0000","last_change":"2023-10-06T04:45:25.044979+0000","last_active":"2023-10-06T04:45:25.048655+0000","last_peered":"2023-10-06T04:45:25.048655+0000","last_clean":"2023-10-06T04:45:25.048655+0000","last_became_active":"2023-10-06T04:45:25.044464+0000","last_became_peered":"2023-10-06T04:45:25.044464+0000","last_unstale":"2023-10-06T04:45:25.048655+0000","last_undegraded":"2023-10-06T04:45:25.048655+0000","last_fullsized":"2023-10-06T04:45:25.048655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:48.818850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046270+0000","last_change":"2023-10-06T04:45:25.041271+0000","last_active":"2023-10-06T04:45:25.046270+0000","last_peered":"2023-10-06T04:45:25.046270+0000","last_clean":"2023-10-06T04:45:25.046270+0000","last_became_active":"2023-10-06T04:45:25.040966+0000","last_became_peered":"2023-10-06T04:45:25.040966+0000","last_unstale":"2023-10-06T04:45:25.046270+0000","last_undegraded":"2023-10-06T04:45:25.046270+0000","last_fullsized":"2023-10-06T04:45:25.046270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:03.033468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055245+0000","last_change":"2023-10-06T04:45:25.052180+0000","last_active":"2023-10-06T04:45:25.055245+0000","last_peered":"2023-10-06T04:45:25.055245+0000","last_clean":"2023-10-06T04:45:25.055245+0000","last_became_active":"2023-10-06T04:45:25.051920+0000","last_became_peered":"2023-10-06T04:45:25.051920+0000","last_unstale":"2023-10-06T04:45:25.055245+0000","last_undegraded":"2023-10-06T04:45:25.055245+0000","last_fullsized":"2023-10-06T04:45:25.055245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:22.064473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.053830+0000","last_change":"2023-10-06T04:45:25.051988+0000","last_active":"2023-10-06T04:45:25.053830+0000","last_peered":"2023-10-06T04:45:25.053830+0000","last_clean":"2023-10-06T04:45:25.053830+0000","last_became_active":"2023-10-06T04:45:25.051658+0000","last_became_peered":"2023-10-06T04:45:25.051658+0000","last_unstale":"2023-10-06T04:45:25.053830+0000","last_undegraded":"2023-10-06T04:45:25.053830+0000","last_fullsized":"2023-10-06T04:45:25.053830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:32.285391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.054990+0000","last_change":"2023-10-06T04:45:25.047833+0000","last_active":"2023-10-06T04:45:25.054990+0000","last_peered":"2023-10-06T04:45:25.054990+0000","last_clean":"2023-10-06T04:45:25.054990+0000","last_became_active":"2023-10-06T04:45:25.047553+0000","last_became_peered":"2023-10-06T04:45:25.047553+0000","last_unstale":"2023-10-06T04:45:25.054990+0000","last_undegraded":"2023-10-06T04:45:25.054990+0000","last_fullsized":"2023-10-06T04:45:25.054990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:16.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.043229+0000","last_change":"2023-10-06T04:45:25.034793+0000","last_active":"2023-10-06T04:45:25.043229+0000","last_peered":"2023-10-06T04:45:25.043229+0000","last_clean":"2023-10-06T04:45:25.043229+0000","last_became_active":"2023-10-06T04:45:25.034518+0000","last_became_peered":"2023-10-06T04:45:25.034518+0000","last_unstale":"2023-10-06T04:45:25.043229+0000","last_undegraded":"2023-10-06T04:45:25.043229+0000","last_fullsized":"2023-10-06T04:45:25.043229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:21.839127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049441+0000","last_change":"2023-10-06T04:45:25.042634+0000","last_active":"2023-10-06T04:45:25.049441+0000","last_peered":"2023-10-06T04:45:25.049441+0000","last_clean":"2023-10-06T04:45:25.049441+0000","last_became_active":"2023-10-06T04:45:25.042312+0000","last_became_peered":"2023-10-06T04:45:25.042312+0000","last_unstale":"2023-10-06T04:45:25.049441+0000","last_undegraded":"2023-10-06T04:45:25.049441+0000","last_fullsized":"2023-10-06T04:45:25.049441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.529270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049406+0000","last_change":"2023-10-06T04:45:25.041696+0000","last_active":"2023-10-06T04:45:25.049406+0000","last_peered":"2023-10-06T04:45:25.049406+0000","last_clean":"2023-10-06T04:45:25.049406+0000","last_became_active":"2023-10-06T04:45:25.041426+0000","last_became_peered":"2023-10-06T04:45:25.041426+0000","last_unstale":"2023-10-06T04:45:25.049406+0000","last_undegraded":"2023-10-06T04:45:25.049406+0000","last_fullsized":"2023-10-06T04:45:25.049406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:16.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050812+0000","last_change":"2023-10-06T04:45:25.045801+0000","last_active":"2023-10-06T04:45:25.050812+0000","last_peered":"2023-10-06T04:45:25.050812+0000","last_clean":"2023-10-06T04:45:25.050812+0000","last_became_active":"2023-10-06T04:45:25.045532+0000","last_became_peered":"2023-10-06T04:45:25.045532+0000","last_unstale":"2023-10-06T04:45:25.050812+0000","last_undegraded":"2023-10-06T04:45:25.050812+0000","last_fullsized":"2023-10-06T04:45:25.050812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:59.095337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046568+0000","last_change":"2023-10-06T04:45:25.034602+0000","last_active":"2023-10-06T04:45:25.046568+0000","last_peered":"2023-10-06T04:45:25.046568+0000","last_clean":"2023-10-06T04:45:25.046568+0000","last_became_active":"2023-10-06T04:45:25.034295+0000","last_became_peered":"2023-10-06T04:45:25.034295+0000","last_unstale":"2023-10-06T04:45:25.046568+0000","last_undegraded":"2023-10-06T04:45:25.046568+0000","last_fullsized":"2023-10-06T04:45:25.046568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:05.161120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059002+0000","last_change":"2023-10-06T04:45:25.051193+0000","last_active":"2023-10-06T04:45:25.059002+0000","last_peered":"2023-10-06T04:45:25.059002+0000","last_clean":"2023-10-06T04:45:25.059002+0000","last_became_active":"2023-10-06T04:45:25.050910+0000","last_became_peered":"2023-10-06T04:45:25.050910+0000","last_unstale":"2023-10-06T04:45:25.059002+0000","last_undegraded":"2023-10-06T04:45:25.059002+0000","last_fullsized":"2023-10-06T04:45:25.059002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.809711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049266+0000","last_change":"2023-10-06T04:45:25.041301+0000","last_active":"2023-10-06T04:45:25.049266+0000","last_peered":"2023-10-06T04:45:25.049266+0000","last_clean":"2023-10-06T04:45:25.049266+0000","last_became_active":"2023-10-06T04:45:25.041036+0000","last_became_peered":"2023-10-06T04:45:25.041036+0000","last_unstale":"2023-10-06T04:45:25.049266+0000","last_undegraded":"2023-10-06T04:45:25.049266+0000","last_fullsized":"2023-10-06T04:45:25.049266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:17.060167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060827+0000","last_change":"2023-10-06T04:45:25.048025+0000","last_active":"2023-10-06T04:45:25.060827+0000","last_peered":"2023-10-06T04:45:25.060827+0000","last_clean":"2023-10-06T04:45:25.060827+0000","last_became_active":"2023-10-06T04:45:25.047720+0000","last_became_peered":"2023-10-06T04:45:25.047720+0000","last_unstale":"2023-10-06T04:45:25.060827+0000","last_undegraded":"2023-10-06T04:45:25.060827+0000","last_fullsized":"2023-10-06T04:45:25.060827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:15.277269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061467+0000","last_change":"2023-10-06T04:45:25.057434+0000","last_active":"2023-10-06T04:45:25.061467+0000","last_peered":"2023-10-06T04:45:25.061467+0000","last_clean":"2023-10-06T04:45:25.061467+0000","last_became_active":"2023-10-06T04:45:25.057176+0000","last_became_peered":"2023-10-06T04:45:25.057176+0000","last_unstale":"2023-10-06T04:45:25.061467+0000","last_undegraded":"2023-10-06T04:45:25.061467+0000","last_fullsized":"2023-10-06T04:45:25.061467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:03.163638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046874+0000","last_change":"2023-10-06T04:45:25.043714+0000","last_active":"2023-10-06T04:45:25.046874+0000","last_peered":"2023-10-06T04:45:25.046874+0000","last_clean":"2023-10-06T04:45:25.046874+0000","last_became_active":"2023-10-06T04:45:25.043397+0000","last_became_peered":"2023-10-06T04:45:25.043397+0000","last_unstale":"2023-10-06T04:45:25.046874+0000","last_undegraded":"2023-10-06T04:45:25.046874+0000","last_fullsized":"2023-10-06T04:45:25.046874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:54.194269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.047115+0000","last_change":"2023-10-06T04:45:25.043961+0000","last_active":"2023-10-06T04:45:25.047115+0000","last_peered":"2023-10-06T04:45:25.047115+0000","last_clean":"2023-10-06T04:45:25.047115+0000","last_became_active":"2023-10-06T04:45:25.043694+0000","last_became_peered":"2023-10-06T04:45:25.043694+0000","last_unstale":"2023-10-06T04:45:25.047115+0000","last_undegraded":"2023-10-06T04:45:25.047115+0000","last_fullsized":"2023-10-06T04:45:25.047115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:39.267589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055206+0000","last_change":"2023-10-06T04:45:25.046510+0000","last_active":"2023-10-06T04:45:25.055206+0000","last_peered":"2023-10-06T04:45:25.055206+0000","last_clean":"2023-10-06T04:45:25.055206+0000","last_became_active":"2023-10-06T04:45:25.045787+0000","last_became_peered":"2023-10-06T04:45:25.045787+0000","last_unstale":"2023-10-06T04:45:25.055206+0000","last_undegraded":"2023-10-06T04:45:25.055206+0000","last_fullsized":"2023-10-06T04:45:25.055206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:46.712666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.048645+0000","last_change":"2023-10-06T04:45:25.038523+0000","last_active":"2023-10-06T04:45:25.048645+0000","last_peered":"2023-10-06T04:45:25.048645+0000","last_clean":"2023-10-06T04:45:25.048645+0000","last_became_active":"2023-10-06T04:45:25.036737+0000","last_became_peered":"2023-10-06T04:45:25.036737+0000","last_unstale":"2023-10-06T04:45:25.048645+0000","last_undegraded":"2023-10-06T04:45:25.048645+0000","last_fullsized":"2023-10-06T04:45:25.048645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:28.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059019+0000","last_change":"2023-10-06T04:45:25.051826+0000","last_active":"2023-10-06T04:45:25.059019+0000","last_peered":"2023-10-06T04:45:25.059019+0000","last_clean":"2023-10-06T04:45:25.059019+0000","last_became_active":"2023-10-06T04:45:25.051505+0000","last_became_peered":"2023-10-06T04:45:25.051505+0000","last_unstale":"2023-10-06T04:45:25.059019+0000","last_undegraded":"2023-10-06T04:45:25.059019+0000","last_fullsized":"2023-10-06T04:45:25.059019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:12.049850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061514+0000","last_change":"2023-10-06T04:45:25.057347+0000","last_active":"2023-10-06T04:45:25.061514+0000","last_peered":"2023-10-06T04:45:25.061514+0000","last_clean":"2023-10-06T04:45:25.061514+0000","last_became_active":"2023-10-06T04:45:25.056999+0000","last_became_peered":"2023-10-06T04:45:25.056999+0000","last_unstale":"2023-10-06T04:45:25.061514+0000","last_undegraded":"2023-10-06T04:45:25.061514+0000","last_fullsized":"2023-10-06T04:45:25.061514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:16.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060690+0000","last_change":"2023-10-06T04:45:25.059550+0000","last_active":"2023-10-06T04:45:25.060690+0000","last_peered":"2023-10-06T04:45:25.060690+0000","last_clean":"2023-10-06T04:45:25.060690+0000","last_became_active":"2023-10-06T04:45:25.059284+0000","last_became_peered":"2023-10-06T04:45:25.059284+0000","last_unstale":"2023-10-06T04:45:25.060690+0000","last_undegraded":"2023-10-06T04:45:25.060690+0000","last_fullsized":"2023-10-06T04:45:25.060690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:10.915398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.051570+0000","last_change":"2023-10-06T04:45:25.045967+0000","last_active":"2023-10-06T04:45:25.051570+0000","last_peered":"2023-10-06T04:45:25.051570+0000","last_clean":"2023-10-06T04:45:25.051570+0000","last_became_active":"2023-10-06T04:45:25.045686+0000","last_became_peered":"2023-10-06T04:45:25.045686+0000","last_unstale":"2023-10-06T04:45:25.051570+0000","last_undegraded":"2023-10-06T04:45:25.051570+0000","last_fullsized":"2023-10-06T04:45:25.051570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:34.470842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050076+0000","last_change":"2023-10-06T04:45:25.041504+0000","last_active":"2023-10-06T04:45:25.050076+0000","last_peered":"2023-10-06T04:45:25.050076+0000","last_clean":"2023-10-06T04:45:25.050076+0000","last_became_active":"2023-10-06T04:45:25.041209+0000","last_became_peered":"2023-10-06T04:45:25.041209+0000","last_unstale":"2023-10-06T04:45:25.050076+0000","last_undegraded":"2023-10-06T04:45:25.050076+0000","last_fullsized":"2023-10-06T04:45:25.050076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:48.388756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050924+0000","last_change":"2023-10-06T04:45:25.045462+0000","last_active":"2023-10-06T04:45:25.050924+0000","last_peered":"2023-10-06T04:45:25.050924+0000","last_clean":"2023-10-06T04:45:25.050924+0000","last_became_active":"2023-10-06T04:45:25.045120+0000","last_became_peered":"2023-10-06T04:45:25.045120+0000","last_unstale":"2023-10-06T04:45:25.050924+0000","last_undegraded":"2023-10-06T04:45:25.050924+0000","last_fullsized":"2023-10-06T04:45:25.050924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.086601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055997+0000","last_change":"2023-10-06T04:45:25.053681+0000","last_active":"2023-10-06T04:45:25.055997+0000","last_peered":"2023-10-06T04:45:25.055997+0000","last_clean":"2023-10-06T04:45:25.055997+0000","last_became_active":"2023-10-06T04:45:25.053386+0000","last_became_peered":"2023-10-06T04:45:25.053386+0000","last_unstale":"2023-10-06T04:45:25.055997+0000","last_undegraded":"2023-10-06T04:45:25.055997+0000","last_fullsized":"2023-10-06T04:45:25.055997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:39.256429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046624+0000","last_change":"2023-10-06T04:45:25.040933+0000","last_active":"2023-10-06T04:45:25.046624+0000","last_peered":"2023-10-06T04:45:25.046624+0000","last_clean":"2023-10-06T04:45:25.046624+0000","last_became_active":"2023-10-06T04:45:25.040635+0000","last_became_peered":"2023-10-06T04:45:25.040635+0000","last_unstale":"2023-10-06T04:45:25.046624+0000","last_undegraded":"2023-10-06T04:45:25.046624+0000","last_fullsized":"2023-10-06T04:45:25.046624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:17.174984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057608+0000","last_change":"2023-10-06T04:45:25.052785+0000","last_active":"2023-10-06T04:45:25.057608+0000","last_peered":"2023-10-06T04:45:25.057608+0000","last_clean":"2023-10-06T04:45:25.057608+0000","last_became_active":"2023-10-06T04:45:25.052516+0000","last_became_peered":"2023-10-06T04:45:25.052516+0000","last_unstale":"2023-10-06T04:45:25.057608+0000","last_undegraded":"2023-10-06T04:45:25.057608+0000","last_fullsized":"2023-10-06T04:45:25.057608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:33.655583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061490+0000","last_change":"2023-10-06T04:45:25.056826+0000","last_active":"2023-10-06T04:45:25.061490+0000","last_peered":"2023-10-06T04:45:25.061490+0000","last_clean":"2023-10-06T04:45:25.061490+0000","last_became_active":"2023-10-06T04:45:25.056526+0000","last_became_peered":"2023-10-06T04:45:25.056526+0000","last_unstale":"2023-10-06T04:45:25.061490+0000","last_undegraded":"2023-10-06T04:45:25.061490+0000","last_fullsized":"2023-10-06T04:45:25.061490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:39.256429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.050072+0000","last_change":"2023-10-06T04:45:25.039915+0000","last_active":"2023-10-06T04:45:25.050072+0000","last_peered":"2023-10-06T04:45:25.050072+0000","last_clean":"2023-10-06T04:45:25.050072+0000","last_became_active":"2023-10-06T04:45:25.039654+0000","last_became_peered":"2023-10-06T04:45:25.039654+0000","last_unstale":"2023-10-06T04:45:25.050072+0000","last_undegraded":"2023-10-06T04:45:25.050072+0000","last_fullsized":"2023-10-06T04:45:25.050072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:50.918893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060770+0000","last_change":"2023-10-06T04:45:25.041306+0000","last_active":"2023-10-06T04:45:25.060770+0000","last_peered":"2023-10-06T04:45:25.060770+0000","last_clean":"2023-10-06T04:45:25.060770+0000","last_became_active":"2023-10-06T04:45:25.040960+0000","last_became_peered":"2023-10-06T04:45:25.040960+0000","last_unstale":"2023-10-06T04:45:25.060770+0000","last_undegraded":"2023-10-06T04:45:25.060770+0000","last_fullsized":"2023-10-06T04:45:25.060770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:41.320747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061598+0000","last_change":"2023-10-06T04:45:24.043680+0000","last_active":"2023-10-06T04:45:25.061598+0000","last_peered":"2023-10-06T04:45:25.061598+0000","last_clean":"2023-10-06T04:45:25.061598+0000","last_became_active":"2023-10-06T04:45:24.043382+0000","last_became_peered":"2023-10-06T04:45:24.043382+0000","last_unstale":"2023-10-06T04:45:25.061598+0000","last_undegraded":"2023-10-06T04:45:25.061598+0000","last_fullsized":"2023-10-06T04:45:25.061598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:32.245374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.052918+0000","last_change":"2023-10-06T04:45:25.048950+0000","last_active":"2023-10-06T04:45:25.052918+0000","last_peered":"2023-10-06T04:45:25.052918+0000","last_clean":"2023-10-06T04:45:25.052918+0000","last_became_active":"2023-10-06T04:45:25.048721+0000","last_became_peered":"2023-10-06T04:45:25.048721+0000","last_unstale":"2023-10-06T04:45:25.052918+0000","last_undegraded":"2023-10-06T04:45:25.052918+0000","last_fullsized":"2023-10-06T04:45:25.052918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:58.607577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060959+0000","last_change":"2023-10-06T04:45:24.046282+0000","last_active":"2023-10-06T04:45:25.060959+0000","last_peered":"2023-10-06T04:45:25.060959+0000","last_clean":"2023-10-06T04:45:25.060959+0000","last_became_active":"2023-10-06T04:45:24.045974+0000","last_became_peered":"2023-10-06T04:45:24.045974+0000","last_unstale":"2023-10-06T04:45:25.060959+0000","last_undegraded":"2023-10-06T04:45:25.060959+0000","last_fullsized":"2023-10-06T04:45:25.060959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:33.673260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058196+0000","last_change":"2023-10-06T04:45:25.048339+0000","last_active":"2023-10-06T04:45:25.058196+0000","last_peered":"2023-10-06T04:45:25.058196+0000","last_clean":"2023-10-06T04:45:25.058196+0000","last_became_active":"2023-10-06T04:45:25.048068+0000","last_became_peered":"2023-10-06T04:45:25.048068+0000","last_unstale":"2023-10-06T04:45:25.058196+0000","last_undegraded":"2023-10-06T04:45:25.058196+0000","last_fullsized":"2023-10-06T04:45:25.058196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:53.754887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057356+0000","last_change":"2023-10-06T04:45:24.044697+0000","last_active":"2023-10-06T04:45:25.057356+0000","last_peered":"2023-10-06T04:45:25.057356+0000","last_clean":"2023-10-06T04:45:25.057356+0000","last_became_active":"2023-10-06T04:45:24.044416+0000","last_became_peered":"2023-10-06T04:45:24.044416+0000","last_unstale":"2023-10-06T04:45:25.057356+0000","last_undegraded":"2023-10-06T04:45:25.057356+0000","last_fullsized":"2023-10-06T04:45:25.057356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:26.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058160+0000","last_change":"2023-10-06T04:45:25.056068+0000","last_active":"2023-10-06T04:45:25.058160+0000","last_peered":"2023-10-06T04:45:25.058160+0000","last_clean":"2023-10-06T04:45:25.058160+0000","last_became_active":"2023-10-06T04:45:25.055748+0000","last_became_peered":"2023-10-06T04:45:25.055748+0000","last_unstale":"2023-10-06T04:45:25.058160+0000","last_undegraded":"2023-10-06T04:45:25.058160+0000","last_fullsized":"2023-10-06T04:45:25.058160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:53.754887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058107+0000","last_change":"2023-10-06T04:45:24.038087+0000","last_active":"2023-10-06T04:45:25.058107+0000","last_peered":"2023-10-06T04:45:25.058107+0000","last_clean":"2023-10-06T04:45:25.058107+0000","last_became_active":"2023-10-06T04:45:24.037832+0000","last_became_peered":"2023-10-06T04:45:24.037832+0000","last_unstale":"2023-10-06T04:45:25.058107+0000","last_undegraded":"2023-10-06T04:45:25.058107+0000","last_fullsized":"2023-10-06T04:45:25.058107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:02.160156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.042774+0000","last_change":"2023-10-06T04:45:25.033165+0000","last_active":"2023-10-06T04:45:25.042774+0000","last_peered":"2023-10-06T04:45:25.042774+0000","last_clean":"2023-10-06T04:45:25.042774+0000","last_became_active":"2023-10-06T04:45:25.032906+0000","last_became_peered":"2023-10-06T04:45:25.032906+0000","last_unstale":"2023-10-06T04:45:25.042774+0000","last_undegraded":"2023-10-06T04:45:25.042774+0000","last_fullsized":"2023-10-06T04:45:25.042774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:25:12.065102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.051271+0000","last_change":"2023-10-06T04:45:24.040390+0000","last_active":"2023-10-06T04:45:25.051271+0000","last_peered":"2023-10-06T04:45:25.051271+0000","last_clean":"2023-10-06T04:45:25.051271+0000","last_became_active":"2023-10-06T04:45:24.040138+0000","last_became_peered":"2023-10-06T04:45:24.040138+0000","last_unstale":"2023-10-06T04:45:25.051271+0000","last_undegraded":"2023-10-06T04:45:25.051271+0000","last_fullsized":"2023-10-06T04:45:25.051271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:32.652101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.046696+0000","last_change":"2023-10-06T04:45:25.036858+0000","last_active":"2023-10-06T04:45:25.046696+0000","last_peered":"2023-10-06T04:45:25.046696+0000","last_clean":"2023-10-06T04:45:25.046696+0000","last_became_active":"2023-10-06T04:45:25.036536+0000","last_became_peered":"2023-10-06T04:45:25.036536+0000","last_unstale":"2023-10-06T04:45:25.046696+0000","last_undegraded":"2023-10-06T04:45:25.046696+0000","last_fullsized":"2023-10-06T04:45:25.046696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:53.754887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060953+0000","last_change":"2023-10-06T04:45:24.046735+0000","last_active":"2023-10-06T04:45:25.060953+0000","last_peered":"2023-10-06T04:45:25.060953+0000","last_clean":"2023-10-06T04:45:25.060953+0000","last_became_active":"2023-10-06T04:45:24.046460+0000","last_became_peered":"2023-10-06T04:45:24.046460+0000","last_unstale":"2023-10-06T04:45:25.060953+0000","last_undegraded":"2023-10-06T04:45:25.060953+0000","last_fullsized":"2023-10-06T04:45:25.060953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:54.083119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058991+0000","last_change":"2023-10-06T04:45:25.050257+0000","last_active":"2023-10-06T04:45:25.058991+0000","last_peered":"2023-10-06T04:45:25.058991+0000","last_clean":"2023-10-06T04:45:25.058991+0000","last_became_active":"2023-10-06T04:45:25.049989+0000","last_became_peered":"2023-10-06T04:45:25.049989+0000","last_unstale":"2023-10-06T04:45:25.058991+0000","last_undegraded":"2023-10-06T04:45:25.058991+0000","last_fullsized":"2023-10-06T04:45:25.058991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:17.060167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032030+0000","last_change":"2023-10-06T04:45:24.037184+0000","last_active":"2023-10-06T04:45:25.032030+0000","last_peered":"2023-10-06T04:45:25.032030+0000","last_clean":"2023-10-06T04:45:25.032030+0000","last_became_active":"2023-10-06T04:45:24.036910+0000","last_became_peered":"2023-10-06T04:45:24.036910+0000","last_unstale":"2023-10-06T04:45:25.032030+0000","last_undegraded":"2023-10-06T04:45:25.032030+0000","last_fullsized":"2023-10-06T04:45:25.032030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.914389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.062829+0000","last_change":"2023-10-06T04:45:25.058465+0000","last_active":"2023-10-06T04:45:25.062829+0000","last_peered":"2023-10-06T04:45:25.062829+0000","last_clean":"2023-10-06T04:45:25.062829+0000","last_became_active":"2023-10-06T04:45:25.058170+0000","last_became_peered":"2023-10-06T04:45:25.058170+0000","last_unstale":"2023-10-06T04:45:25.062829+0000","last_undegraded":"2023-10-06T04:45:25.062829+0000","last_fullsized":"2023-10-06T04:45:25.062829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.529270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.033942+0000","last_change":"2023-10-06T04:45:24.048019+0000","last_active":"2023-10-06T04:45:25.033942+0000","last_peered":"2023-10-06T04:45:25.033942+0000","last_clean":"2023-10-06T04:45:25.033942+0000","last_became_active":"2023-10-06T04:45:24.046776+0000","last_became_peered":"2023-10-06T04:45:24.046776+0000","last_unstale":"2023-10-06T04:45:25.033942+0000","last_undegraded":"2023-10-06T04:45:25.033942+0000","last_fullsized":"2023-10-06T04:45:25.033942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:35.677022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.047506+0000","last_change":"2023-10-06T04:45:25.044751+0000","last_active":"2023-10-06T04:45:25.047506+0000","last_peered":"2023-10-06T04:45:25.047506+0000","last_clean":"2023-10-06T04:45:25.047506+0000","last_became_active":"2023-10-06T04:45:25.044135+0000","last_became_peered":"2023-10-06T04:45:25.044135+0000","last_unstale":"2023-10-06T04:45:25.047506+0000","last_undegraded":"2023-10-06T04:45:25.047506+0000","last_fullsized":"2023-10-06T04:45:25.047506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:34.676742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.044085+0000","last_change":"2023-10-06T04:45:24.039106+0000","last_active":"2023-10-06T04:45:25.044085+0000","last_peered":"2023-10-06T04:45:25.044085+0000","last_clean":"2023-10-06T04:45:25.044085+0000","last_became_active":"2023-10-06T04:45:24.038821+0000","last_became_peered":"2023-10-06T04:45:24.038821+0000","last_unstale":"2023-10-06T04:45:25.044085+0000","last_undegraded":"2023-10-06T04:45:25.044085+0000","last_fullsized":"2023-10-06T04:45:25.044085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:48.520607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061521+0000","last_change":"2023-10-06T04:45:25.058027+0000","last_active":"2023-10-06T04:45:25.061521+0000","last_peered":"2023-10-06T04:45:25.061521+0000","last_clean":"2023-10-06T04:45:25.061521+0000","last_became_active":"2023-10-06T04:45:25.057759+0000","last_became_peered":"2023-10-06T04:45:25.057759+0000","last_unstale":"2023-10-06T04:45:25.061521+0000","last_undegraded":"2023-10-06T04:45:25.061521+0000","last_fullsized":"2023-10-06T04:45:25.061521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:32.285391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.028175+0000","last_change":"2023-10-06T04:45:24.040075+0000","last_active":"2023-10-06T04:45:25.028175+0000","last_peered":"2023-10-06T04:45:25.028175+0000","last_clean":"2023-10-06T04:45:25.028175+0000","last_became_active":"2023-10-06T04:45:24.039813+0000","last_became_peered":"2023-10-06T04:45:24.039813+0000","last_unstale":"2023-10-06T04:45:25.028175+0000","last_undegraded":"2023-10-06T04:45:25.028175+0000","last_fullsized":"2023-10-06T04:45:25.028175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.171502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.062994+0000","last_change":"2023-10-06T04:45:25.058596+0000","last_active":"2023-10-06T04:45:25.062994+0000","last_peered":"2023-10-06T04:45:25.062994+0000","last_clean":"2023-10-06T04:45:25.062994+0000","last_became_active":"2023-10-06T04:45:25.057874+0000","last_became_peered":"2023-10-06T04:45:25.057874+0000","last_unstale":"2023-10-06T04:45:25.062994+0000","last_undegraded":"2023-10-06T04:45:25.062994+0000","last_fullsized":"2023-10-06T04:45:25.062994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:37.777434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055677+0000","last_change":"2023-10-06T04:45:24.042012+0000","last_active":"2023-10-06T04:45:25.055677+0000","last_peered":"2023-10-06T04:45:25.055677+0000","last_clean":"2023-10-06T04:45:25.055677+0000","last_became_active":"2023-10-06T04:45:24.041752+0000","last_became_peered":"2023-10-06T04:45:24.041752+0000","last_unstale":"2023-10-06T04:45:25.055677+0000","last_undegraded":"2023-10-06T04:45:25.055677+0000","last_fullsized":"2023-10-06T04:45:25.055677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:45.709185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059564+0000","last_change":"2023-10-06T04:45:25.046424+0000","last_active":"2023-10-06T04:45:25.059564+0000","last_peered":"2023-10-06T04:45:25.059564+0000","last_clean":"2023-10-06T04:45:25.059564+0000","last_became_active":"2023-10-06T04:45:25.046155+0000","last_became_peered":"2023-10-06T04:45:25.046155+0000","last_unstale":"2023-10-06T04:45:25.059564+0000","last_undegraded":"2023-10-06T04:45:25.059564+0000","last_fullsized":"2023-10-06T04:45:25.059564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:28.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.063313+0000","last_change":"2023-10-06T04:45:24.042616+0000","last_active":"2023-10-06T04:45:25.063313+0000","last_peered":"2023-10-06T04:45:25.063313+0000","last_clean":"2023-10-06T04:45:25.063313+0000","last_became_active":"2023-10-06T04:45:24.042368+0000","last_became_peered":"2023-10-06T04:45:24.042368+0000","last_unstale":"2023-10-06T04:45:25.063313+0000","last_undegraded":"2023-10-06T04:45:25.063313+0000","last_fullsized":"2023-10-06T04:45:25.063313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:53.190787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.045269+0000","last_change":"2023-10-06T04:45:25.042108+0000","last_active":"2023-10-06T04:45:25.045269+0000","last_peered":"2023-10-06T04:45:25.045269+0000","last_clean":"2023-10-06T04:45:25.045269+0000","last_became_active":"2023-10-06T04:45:25.041770+0000","last_became_peered":"2023-10-06T04:45:25.041770+0000","last_unstale":"2023-10-06T04:45:25.045269+0000","last_undegraded":"2023-10-06T04:45:25.045269+0000","last_fullsized":"2023-10-06T04:45:25.045269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:03.272820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.054996+0000","last_change":"2023-10-06T04:45:24.044839+0000","last_active":"2023-10-06T04:45:25.054996+0000","last_peered":"2023-10-06T04:45:25.054996+0000","last_clean":"2023-10-06T04:45:25.054996+0000","last_became_active":"2023-10-06T04:45:24.044609+0000","last_became_peered":"2023-10-06T04:45:24.044609+0000","last_unstale":"2023-10-06T04:45:25.054996+0000","last_undegraded":"2023-10-06T04:45:25.054996+0000","last_fullsized":"2023-10-06T04:45:25.054996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.171502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055118+0000","last_change":"2023-10-06T04:45:25.047180+0000","last_active":"2023-10-06T04:45:25.055118+0000","last_peered":"2023-10-06T04:45:25.055118+0000","last_clean":"2023-10-06T04:45:25.055118+0000","last_became_active":"2023-10-06T04:45:25.046892+0000","last_became_peered":"2023-10-06T04:45:25.046892+0000","last_unstale":"2023-10-06T04:45:25.055118+0000","last_undegraded":"2023-10-06T04:45:25.055118+0000","last_fullsized":"2023-10-06T04:45:25.055118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:23.793022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031742+0000","last_change":"2023-10-06T04:45:24.042592+0000","last_active":"2023-10-06T04:45:25.031742+0000","last_peered":"2023-10-06T04:45:25.031742+0000","last_clean":"2023-10-06T04:45:25.031742+0000","last_became_active":"2023-10-06T04:45:24.042174+0000","last_became_peered":"2023-10-06T04:45:24.042174+0000","last_unstale":"2023-10-06T04:45:25.031742+0000","last_undegraded":"2023-10-06T04:45:25.031742+0000","last_fullsized":"2023-10-06T04:45:25.031742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:09.333679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061413+0000","last_change":"2023-10-06T04:45:25.056826+0000","last_active":"2023-10-06T04:45:25.061413+0000","last_peered":"2023-10-06T04:45:25.061413+0000","last_clean":"2023-10-06T04:45:25.061413+0000","last_became_active":"2023-10-06T04:45:25.056564+0000","last_became_peered":"2023-10-06T04:45:25.056564+0000","last_unstale":"2023-10-06T04:45:25.061413+0000","last_undegraded":"2023-10-06T04:45:25.061413+0000","last_fullsized":"2023-10-06T04:45:25.061413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:23.793022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031601+0000","last_change":"2023-10-06T04:45:24.046164+0000","last_active":"2023-10-06T04:45:25.031601+0000","last_peered":"2023-10-06T04:45:25.031601+0000","last_clean":"2023-10-06T04:45:25.031601+0000","last_became_active":"2023-10-06T04:45:24.045838+0000","last_became_peered":"2023-10-06T04:45:24.045838+0000","last_unstale":"2023-10-06T04:45:25.031601+0000","last_undegraded":"2023-10-06T04:45:25.031601+0000","last_fullsized":"2023-10-06T04:45:25.031601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:16.041117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.056300+0000","last_change":"2023-10-06T04:45:25.051756+0000","last_active":"2023-10-06T04:45:25.056300+0000","last_peered":"2023-10-06T04:45:25.056300+0000","last_clean":"2023-10-06T04:45:25.056300+0000","last_became_active":"2023-10-06T04:45:25.051464+0000","last_became_peered":"2023-10-06T04:45:25.051464+0000","last_unstale":"2023-10-06T04:45:25.056300+0000","last_undegraded":"2023-10-06T04:45:25.056300+0000","last_fullsized":"2023-10-06T04:45:25.056300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:28.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061490+0000","last_change":"2023-10-06T04:45:24.045655+0000","last_active":"2023-10-06T04:45:25.061490+0000","last_peered":"2023-10-06T04:45:25.061490+0000","last_clean":"2023-10-06T04:45:25.061490+0000","last_became_active":"2023-10-06T04:45:24.045386+0000","last_became_peered":"2023-10-06T04:45:24.045386+0000","last_unstale":"2023-10-06T04:45:25.061490+0000","last_undegraded":"2023-10-06T04:45:25.061490+0000","last_fullsized":"2023-10-06T04:45:25.061490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:33.467360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.056374+0000","last_change":"2023-10-06T04:45:25.051472+0000","last_active":"2023-10-06T04:45:25.056374+0000","last_peered":"2023-10-06T04:45:25.056374+0000","last_clean":"2023-10-06T04:45:25.056374+0000","last_became_active":"2023-10-06T04:45:25.051215+0000","last_became_peered":"2023-10-06T04:45:25.051215+0000","last_unstale":"2023-10-06T04:45:25.056374+0000","last_undegraded":"2023-10-06T04:45:25.056374+0000","last_fullsized":"2023-10-06T04:45:25.056374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:05.161120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060210+0000","last_change":"2023-10-06T04:45:24.045022+0000","last_active":"2023-10-06T04:45:25.060210+0000","last_peered":"2023-10-06T04:45:25.060210+0000","last_clean":"2023-10-06T04:45:25.060210+0000","last_became_active":"2023-10-06T04:45:24.044717+0000","last_became_peered":"2023-10-06T04:45:24.044717+0000","last_unstale":"2023-10-06T04:45:25.060210+0000","last_undegraded":"2023-10-06T04:45:25.060210+0000","last_fullsized":"2023-10-06T04:45:25.060210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:54.083119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.047231+0000","last_change":"2023-10-06T04:45:25.038112+0000","last_active":"2023-10-06T04:45:25.047231+0000","last_peered":"2023-10-06T04:45:25.047231+0000","last_clean":"2023-10-06T04:45:25.047231+0000","last_became_active":"2023-10-06T04:45:25.037838+0000","last_became_peered":"2023-10-06T04:45:25.037838+0000","last_unstale":"2023-10-06T04:45:25.047231+0000","last_undegraded":"2023-10-06T04:45:25.047231+0000","last_fullsized":"2023-10-06T04:45:25.047231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.809711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061571+0000","last_change":"2023-10-06T04:45:24.035422+0000","last_active":"2023-10-06T04:45:25.061571+0000","last_peered":"2023-10-06T04:45:25.061571+0000","last_clean":"2023-10-06T04:45:25.061571+0000","last_became_active":"2023-10-06T04:45:24.035082+0000","last_became_peered":"2023-10-06T04:45:24.035082+0000","last_unstale":"2023-10-06T04:45:25.061571+0000","last_undegraded":"2023-10-06T04:45:25.061571+0000","last_fullsized":"2023-10-06T04:45:25.061571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:40.317265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.058177+0000","last_change":"2023-10-06T04:45:25.047754+0000","last_active":"2023-10-06T04:45:25.058177+0000","last_peered":"2023-10-06T04:45:25.058177+0000","last_clean":"2023-10-06T04:45:25.058177+0000","last_became_active":"2023-10-06T04:45:25.047417+0000","last_became_peered":"2023-10-06T04:45:25.047417+0000","last_unstale":"2023-10-06T04:45:25.058177+0000","last_undegraded":"2023-10-06T04:45:25.058177+0000","last_fullsized":"2023-10-06T04:45:25.058177+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:40.635239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061744+0000","last_change":"2023-10-06T04:45:24.042918+0000","last_active":"2023-10-06T04:45:25.061744+0000","last_peered":"2023-10-06T04:45:25.061744+0000","last_clean":"2023-10-06T04:45:25.061744+0000","last_became_active":"2023-10-06T04:45:24.042646+0000","last_became_peered":"2023-10-06T04:45:24.042646+0000","last_unstale":"2023-10-06T04:45:25.061744+0000","last_undegraded":"2023-10-06T04:45:25.061744+0000","last_fullsized":"2023-10-06T04:45:25.061744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:28.240091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057704+0000","last_change":"2023-10-06T04:45:25.056690+0000","last_active":"2023-10-06T04:45:25.057704+0000","last_peered":"2023-10-06T04:45:25.057704+0000","last_clean":"2023-10-06T04:45:25.057704+0000","last_became_active":"2023-10-06T04:45:25.056393+0000","last_became_peered":"2023-10-06T04:45:25.056393+0000","last_unstale":"2023-10-06T04:45:25.057704+0000","last_undegraded":"2023-10-06T04:45:25.057704+0000","last_fullsized":"2023-10-06T04:45:25.057704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:10.337161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031248+0000","last_change":"2023-10-06T04:45:24.041465+0000","last_active":"2023-10-06T04:45:25.031248+0000","last_peered":"2023-10-06T04:45:25.031248+0000","last_clean":"2023-10-06T04:45:25.031248+0000","last_became_active":"2023-10-06T04:45:24.041130+0000","last_became_peered":"2023-10-06T04:45:24.041130+0000","last_unstale":"2023-10-06T04:45:25.031248+0000","last_undegraded":"2023-10-06T04:45:25.031248+0000","last_fullsized":"2023-10-06T04:45:25.031248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:00.390284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060849+0000","last_change":"2023-10-06T04:45:25.048046+0000","last_active":"2023-10-06T04:45:25.060849+0000","last_peered":"2023-10-06T04:45:25.060849+0000","last_clean":"2023-10-06T04:45:25.060849+0000","last_became_active":"2023-10-06T04:45:25.047278+0000","last_became_peered":"2023-10-06T04:45:25.047278+0000","last_unstale":"2023-10-06T04:45:25.060849+0000","last_undegraded":"2023-10-06T04:45:25.060849+0000","last_fullsized":"2023-10-06T04:45:25.060849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:44.480794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055548+0000","last_change":"2023-10-06T04:45:24.041722+0000","last_active":"2023-10-06T04:45:25.055548+0000","last_peered":"2023-10-06T04:45:25.055548+0000","last_clean":"2023-10-06T04:45:25.055548+0000","last_became_active":"2023-10-06T04:45:24.041403+0000","last_became_peered":"2023-10-06T04:45:24.041403+0000","last_unstale":"2023-10-06T04:45:25.055548+0000","last_undegraded":"2023-10-06T04:45:25.055548+0000","last_fullsized":"2023-10-06T04:45:25.055548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:32.383557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060537+0000","last_change":"2023-10-06T04:45:25.056705+0000","last_active":"2023-10-06T04:45:25.060537+0000","last_peered":"2023-10-06T04:45:25.060537+0000","last_clean":"2023-10-06T04:45:25.060537+0000","last_became_active":"2023-10-06T04:45:25.056418+0000","last_became_peered":"2023-10-06T04:45:25.056418+0000","last_unstale":"2023-10-06T04:45:25.060537+0000","last_undegraded":"2023-10-06T04:45:25.060537+0000","last_fullsized":"2023-10-06T04:45:25.060537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:12.144695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031079+0000","last_change":"2023-10-06T04:45:24.035822+0000","last_active":"2023-10-06T04:45:25.031079+0000","last_peered":"2023-10-06T04:45:25.031079+0000","last_clean":"2023-10-06T04:45:25.031079+0000","last_became_active":"2023-10-06T04:45:24.035472+0000","last_became_peered":"2023-10-06T04:45:24.035472+0000","last_unstale":"2023-10-06T04:45:25.031079+0000","last_undegraded":"2023-10-06T04:45:25.031079+0000","last_fullsized":"2023-10-06T04:45:25.031079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:13.317724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.052919+0000","last_change":"2023-10-06T04:45:25.050200+0000","last_active":"2023-10-06T04:45:25.052919+0000","last_peered":"2023-10-06T04:45:25.052919+0000","last_clean":"2023-10-06T04:45:25.052919+0000","last_became_active":"2023-10-06T04:45:25.049918+0000","last_became_peered":"2023-10-06T04:45:25.049918+0000","last_unstale":"2023-10-06T04:45:25.052919+0000","last_undegraded":"2023-10-06T04:45:25.052919+0000","last_fullsized":"2023-10-06T04:45:25.052919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:23.793022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034862+0000","last_change":"2023-10-06T04:45:24.049005+0000","last_active":"2023-10-06T04:45:25.034862+0000","last_peered":"2023-10-06T04:45:25.034862+0000","last_clean":"2023-10-06T04:45:25.034862+0000","last_became_active":"2023-10-06T04:45:24.048710+0000","last_became_peered":"2023-10-06T04:45:24.048710+0000","last_unstale":"2023-10-06T04:45:25.034862+0000","last_undegraded":"2023-10-06T04:45:25.034862+0000","last_fullsized":"2023-10-06T04:45:25.034862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:09.892507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.062810+0000","last_change":"2023-10-06T04:45:25.058473+0000","last_active":"2023-10-06T04:45:25.062810+0000","last_peered":"2023-10-06T04:45:25.062810+0000","last_clean":"2023-10-06T04:45:25.062810+0000","last_became_active":"2023-10-06T04:45:25.058174+0000","last_became_peered":"2023-10-06T04:45:25.058174+0000","last_unstale":"2023-10-06T04:45:25.062810+0000","last_undegraded":"2023-10-06T04:45:25.062810+0000","last_fullsized":"2023-10-06T04:45:25.062810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:32.285391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031484+0000","last_change":"2023-10-06T04:45:24.040874+0000","last_active":"2023-10-06T04:45:25.031484+0000","last_peered":"2023-10-06T04:45:25.031484+0000","last_clean":"2023-10-06T04:45:25.031484+0000","last_became_active":"2023-10-06T04:45:24.040622+0000","last_became_peered":"2023-10-06T04:45:24.040622+0000","last_unstale":"2023-10-06T04:45:25.031484+0000","last_undegraded":"2023-10-06T04:45:25.031484+0000","last_fullsized":"2023-10-06T04:45:25.031484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:06.175768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.059036+0000","last_change":"2023-10-06T04:45:25.052636+0000","last_active":"2023-10-06T04:45:25.059036+0000","last_peered":"2023-10-06T04:45:25.059036+0000","last_clean":"2023-10-06T04:45:25.059036+0000","last_became_active":"2023-10-06T04:45:25.052320+0000","last_became_peered":"2023-10-06T04:45:25.052320+0000","last_unstale":"2023-10-06T04:45:25.059036+0000","last_undegraded":"2023-10-06T04:45:25.059036+0000","last_fullsized":"2023-10-06T04:45:25.059036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:05.161120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.030908+0000","last_change":"2023-10-06T04:45:24.042782+0000","last_active":"2023-10-06T04:45:25.030908+0000","last_peered":"2023-10-06T04:45:25.030908+0000","last_clean":"2023-10-06T04:45:25.030908+0000","last_became_active":"2023-10-06T04:45:24.040786+0000","last_became_peered":"2023-10-06T04:45:24.040786+0000","last_unstale":"2023-10-06T04:45:25.030908+0000","last_undegraded":"2023-10-06T04:45:25.030908+0000","last_fullsized":"2023-10-06T04:45:25.030908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:08.373503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031576+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:45:25.031576+0000","last_peered":"2023-10-06T04:45:25.031576+0000","last_clean":"2023-10-06T04:45:25.031576+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:45:25.031576+0000","last_undegraded":"2023-10-06T04:45:25.031576+0000","last_fullsized":"2023-10-06T04:45:25.031576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060883+0000","last_change":"2023-10-06T04:45:25.048977+0000","last_active":"2023-10-06T04:45:25.060883+0000","last_peered":"2023-10-06T04:45:25.060883+0000","last_clean":"2023-10-06T04:45:25.060883+0000","last_became_active":"2023-10-06T04:45:25.048698+0000","last_became_peered":"2023-10-06T04:45:25.048698+0000","last_unstale":"2023-10-06T04:45:25.060883+0000","last_undegraded":"2023-10-06T04:45:25.060883+0000","last_fullsized":"2023-10-06T04:45:25.060883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.529270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034572+0000","last_change":"2023-10-06T04:45:24.042117+0000","last_active":"2023-10-06T04:45:25.034572+0000","last_peered":"2023-10-06T04:45:25.034572+0000","last_clean":"2023-10-06T04:45:25.034572+0000","last_became_active":"2023-10-06T04:45:24.041876+0000","last_became_peered":"2023-10-06T04:45:24.041876+0000","last_unstale":"2023-10-06T04:45:25.034572+0000","last_undegraded":"2023-10-06T04:45:25.034572+0000","last_fullsized":"2023-10-06T04:45:25.034572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:45.709185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.036823+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:45:25.036823+0000","last_peered":"2023-10-06T04:45:25.036823+0000","last_clean":"2023-10-06T04:45:25.036823+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:45:25.036823+0000","last_undegraded":"2023-10-06T04:45:25.036823+0000","last_fullsized":"2023-10-06T04:45:25.036823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.053635+0000","last_change":"2023-10-06T04:45:25.048854+0000","last_active":"2023-10-06T04:45:25.053635+0000","last_peered":"2023-10-06T04:45:25.053635+0000","last_clean":"2023-10-06T04:45:25.053635+0000","last_became_active":"2023-10-06T04:45:25.048608+0000","last_became_peered":"2023-10-06T04:45:25.048608+0000","last_unstale":"2023-10-06T04:45:25.053635+0000","last_undegraded":"2023-10-06T04:45:25.053635+0000","last_fullsized":"2023-10-06T04:45:25.053635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:17.232105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.053985+0000","last_change":"2023-10-06T04:45:24.040958+0000","last_active":"2023-10-06T04:45:25.053985+0000","last_peered":"2023-10-06T04:45:25.053985+0000","last_clean":"2023-10-06T04:45:25.053985+0000","last_became_active":"2023-10-06T04:45:24.040708+0000","last_became_peered":"2023-10-06T04:45:24.040708+0000","last_unstale":"2023-10-06T04:45:25.053985+0000","last_undegraded":"2023-10-06T04:45:25.053985+0000","last_fullsized":"2023-10-06T04:45:25.053985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:53.190787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031224+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:45:25.031224+0000","last_peered":"2023-10-06T04:45:25.031224+0000","last_clean":"2023-10-06T04:45:25.031224+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:45:25.031224+0000","last_undegraded":"2023-10-06T04:45:25.031224+0000","last_fullsized":"2023-10-06T04:45:25.031224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032722+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:45:25.032722+0000","last_peered":"2023-10-06T04:45:25.032722+0000","last_clean":"2023-10-06T04:45:25.032722+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:45:25.032722+0000","last_undegraded":"2023-10-06T04:45:25.032722+0000","last_fullsized":"2023-10-06T04:45:25.032722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.061540+0000","last_change":"2023-10-06T04:45:25.058535+0000","last_active":"2023-10-06T04:45:25.061540+0000","last_peered":"2023-10-06T04:45:25.061540+0000","last_clean":"2023-10-06T04:45:25.061540+0000","last_became_active":"2023-10-06T04:45:25.058002+0000","last_became_peered":"2023-10-06T04:45:25.058002+0000","last_unstale":"2023-10-06T04:45:25.061540+0000","last_undegraded":"2023-10-06T04:45:25.061540+0000","last_fullsized":"2023-10-06T04:45:25.061540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:54.036388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.030053+0000","last_change":"2023-10-06T04:45:24.043108+0000","last_active":"2023-10-06T04:45:25.030053+0000","last_peered":"2023-10-06T04:45:25.030053+0000","last_clean":"2023-10-06T04:45:25.030053+0000","last_became_active":"2023-10-06T04:45:24.042819+0000","last_became_peered":"2023-10-06T04:45:24.042819+0000","last_unstale":"2023-10-06T04:45:25.030053+0000","last_undegraded":"2023-10-06T04:45:25.030053+0000","last_fullsized":"2023-10-06T04:45:25.030053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:35.981900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034413+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:45:25.034413+0000","last_peered":"2023-10-06T04:45:25.034413+0000","last_clean":"2023-10-06T04:45:25.034413+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:45:25.034413+0000","last_undegraded":"2023-10-06T04:45:25.034413+0000","last_fullsized":"2023-10-06T04:45:25.034413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.060490+0000","last_change":"2023-10-06T04:45:25.056909+0000","last_active":"2023-10-06T04:45:25.060490+0000","last_peered":"2023-10-06T04:45:25.060490+0000","last_clean":"2023-10-06T04:45:25.060490+0000","last_became_active":"2023-10-06T04:45:25.056637+0000","last_became_peered":"2023-10-06T04:45:25.056637+0000","last_unstale":"2023-10-06T04:45:25.060490+0000","last_undegraded":"2023-10-06T04:45:25.060490+0000","last_fullsized":"2023-10-06T04:45:25.060490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:54.036388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.034554+0000","last_change":"2023-10-06T04:45:24.049099+0000","last_active":"2023-10-06T04:45:25.034554+0000","last_peered":"2023-10-06T04:45:25.034554+0000","last_clean":"2023-10-06T04:45:25.034554+0000","last_became_active":"2023-10-06T04:45:24.048803+0000","last_became_peered":"2023-10-06T04:45:24.048803+0000","last_unstale":"2023-10-06T04:45:25.034554+0000","last_undegraded":"2023-10-06T04:45:25.034554+0000","last_fullsized":"2023-10-06T04:45:25.034554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:32.652101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032637+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:45:25.032637+0000","last_peered":"2023-10-06T04:45:25.032637+0000","last_clean":"2023-10-06T04:45:25.032637+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:45:25.032637+0000","last_undegraded":"2023-10-06T04:45:25.032637+0000","last_fullsized":"2023-10-06T04:45:25.032637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.057765+0000","last_change":"2023-10-06T04:45:25.051257+0000","last_active":"2023-10-06T04:45:25.057765+0000","last_peered":"2023-10-06T04:45:25.057765+0000","last_clean":"2023-10-06T04:45:25.057765+0000","last_became_active":"2023-10-06T04:45:25.050992+0000","last_became_peered":"2023-10-06T04:45:25.050992+0000","last_unstale":"2023-10-06T04:45:25.057765+0000","last_undegraded":"2023-10-06T04:45:25.057765+0000","last_fullsized":"2023-10-06T04:45:25.057765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:54.036388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.027145+0000","last_change":"2023-10-06T04:45:24.040171+0000","last_active":"2023-10-06T04:45:25.027145+0000","last_peered":"2023-10-06T04:45:25.027145+0000","last_clean":"2023-10-06T04:45:25.027145+0000","last_became_active":"2023-10-06T04:45:24.039922+0000","last_became_peered":"2023-10-06T04:45:24.039922+0000","last_unstale":"2023-10-06T04:45:25.027145+0000","last_undegraded":"2023-10-06T04:45:25.027145+0000","last_fullsized":"2023-10-06T04:45:25.027145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:02.029986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.028062+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:45:25.028062+0000","last_peered":"2023-10-06T04:45:25.028062+0000","last_clean":"2023-10-06T04:45:25.028062+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:45:25.028062+0000","last_undegraded":"2023-10-06T04:45:25.028062+0000","last_fullsized":"2023-10-06T04:45:25.028062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.049642+0000","last_change":"2023-10-06T04:45:25.041365+0000","last_active":"2023-10-06T04:45:25.049642+0000","last_peered":"2023-10-06T04:45:25.049642+0000","last_clean":"2023-10-06T04:45:25.049642+0000","last_became_active":"2023-10-06T04:45:25.041060+0000","last_became_peered":"2023-10-06T04:45:25.041060+0000","last_unstale":"2023-10-06T04:45:25.049642+0000","last_undegraded":"2023-10-06T04:45:25.049642+0000","last_fullsized":"2023-10-06T04:45:25.049642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:35.153566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.033141+0000","last_change":"2023-10-06T04:45:24.042570+0000","last_active":"2023-10-06T04:45:25.033141+0000","last_peered":"2023-10-06T04:45:25.033141+0000","last_clean":"2023-10-06T04:45:25.033141+0000","last_became_active":"2023-10-06T04:45:24.042247+0000","last_became_peered":"2023-10-06T04:45:24.042247+0000","last_unstale":"2023-10-06T04:45:25.033141+0000","last_undegraded":"2023-10-06T04:45:25.033141+0000","last_fullsized":"2023-10-06T04:45:25.033141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:52.768810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.031742+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:45:25.031742+0000","last_peered":"2023-10-06T04:45:25.031742+0000","last_clean":"2023-10-06T04:45:25.031742+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:45:25.031742+0000","last_undegraded":"2023-10-06T04:45:25.031742+0000","last_fullsized":"2023-10-06T04:45:25.031742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.055348+0000","last_change":"2023-10-06T04:45:25.052680+0000","last_active":"2023-10-06T04:45:25.055348+0000","last_peered":"2023-10-06T04:45:25.055348+0000","last_clean":"2023-10-06T04:45:25.055348+0000","last_became_active":"2023-10-06T04:45:25.052385+0000","last_became_peered":"2023-10-06T04:45:25.052385+0000","last_unstale":"2023-10-06T04:45:25.055348+0000","last_undegraded":"2023-10-06T04:45:25.055348+0000","last_fullsized":"2023-10-06T04:45:25.055348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:24.015637+0000","last_clean_scrub_stamp":"2023-10-06T04:45:24.015637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:20.941027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.026600+0000","last_change":"2023-10-06T04:45:24.046407+0000","last_active":"2023-10-06T04:45:25.026600+0000","last_peered":"2023-10-06T04:45:25.026600+0000","last_clean":"2023-10-06T04:45:25.026600+0000","last_became_active":"2023-10-06T04:45:24.045925+0000","last_became_peered":"2023-10-06T04:45:24.045925+0000","last_unstale":"2023-10-06T04:45:25.026600+0000","last_undegraded":"2023-10-06T04:45:25.026600+0000","last_fullsized":"2023-10-06T04:45:25.026600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:23.012155+0000","last_clean_scrub_stamp":"2023-10-06T04:45:23.012155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:47.815368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T04:45:25.032651+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:45:25.032651+0000","last_peered":"2023-10-06T04:45:25.032651+0000","last_clean":"2023-10-06T04:45:25.032651+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:45:25.032651+0000","last_undegraded":"2023-10-06T04:45:25.032651+0000","last_fullsized":"2023-10-06T04:45:25.032651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298244,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073596,"statfs":{"total":96636764160,"available":96331362304,"internally_reserved":0,"allocated":978944,"data_stored":740701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.3070000000000004,"5min":9.3070000000000004,"15min":9.3070000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.2129999999999992,"5min":9.2129999999999992,"15min":9.2129999999999992},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":9.0850000000000009,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":9.0969999999999995},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.90700000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.878},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.92300000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.83499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":149281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.37},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.498}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.72099999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":739185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.2509999999999994,"5min":9.2509999999999994,"15min":9.2509999999999994},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":6.4000000000000004,"5min":6.4000000000000004,"15min":6.4000000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.4450000000000003,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.73799999999999999},{"interface":"front","average":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":19.992999999999999,"5min":19.992999999999999,"15min":19.992999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":6.476,"5min":6.476,"15min":6.476},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.9050000000000002,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":2.056,"5min":2.056,"15min":2.056},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":19.960999999999999,"5min":19.960999999999999,"15min":19.960999999999999},"last":0.92700000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":148761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.63}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.75700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":148797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.35799999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":11.241,"5min":11.241,"15min":11.241},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.273,"5min":11.273,"15min":11.273},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.436}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":11.125999999999999,"5min":11.125999999999999,"15min":11.125999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":11.208,"5min":11.208,"15min":11.208},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.622},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":5.327,"5min":5.327,"15min":5.327},"last":0.749}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.66100000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297664,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074176,"statfs":{"total":96636764160,"available":96331956224,"internally_reserved":0,"allocated":385024,"data_stored":150297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.745}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":149303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.74399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.71999999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":148839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.73399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:45:34.744 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:45:34.744 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T04:45:34.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.970+0000 7f0009bff700 1 Processor -- start 2023-10-06T04:45:34.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.971+0000 7f0009bff700 1 -- start start 2023-10-06T04:45:34.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.972+0000 7f0009bff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0004155800 0x7f00040694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:34.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.972+0000 7f0009bff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000406e240 con 0x7f00040ae6f0 2023-10-06T04:45:34.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.972+0000 7f0009bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000406d630 con 0x7f00041596c0 2023-10-06T04:45:34.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.972+0000 7f0009bff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000406d910 con 0x7f0004155800 2023-10-06T04:45:34.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.972+0000 7f0003fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f00040ae6f0 0x7f00041579a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53046/0 (socket says 172.21.15.124:53046) 2023-10-06T04:45:34.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.972+0000 7f0003fff700 1 -- 172.21.15.124:0/1675331172 learned_addr learned my addr 172.21.15.124:0/1675331172 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:34.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.972+0000 7f00037fe700 1 --2- 172.21.15.124:0/1675331172 >> v2:172.21.15.158:3300/0 conn(0x7f0004155800 0x7f00040694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:34.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.972+0000 7f00027fc700 1 -- 172.21.15.124:0/1675331172 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015096330 0 0) 0x7f000406e240 con 0x7f00040ae6f0 2023-10-06T04:45:34.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.973+0000 7f00027fc700 1 -- 172.21.15.124:0/1675331172 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec003570 con 0x7f00040ae6f0 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.973+0000 7f00037fe700 1 -- 172.21.15.124:0/1675331172 >> v1:172.21.15.158:6789/0 conn(0x7f00041596c0 legacy=0x7f0004157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.973+0000 7f00037fe700 1 -- 172.21.15.124:0/1675331172 >> v1:172.21.15.124:6789/0 conn(0x7f00040ae6f0 legacy=0x7f00041579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.973+0000 7f00027fc700 1 -- 172.21.15.124:0/1675331172 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1585298749 0 0) 0x7effec003570 con 0x7f00040ae6f0 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.973+0000 7f00037fe700 1 -- 172.21.15.124:0/1675331172 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000406dbf0 con 0x7f0004155800 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.973+0000 7f00037fe700 1 --2- 172.21.15.124:0/1675331172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0004155800 0x7f00040694c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efff400aa90 tx=0x7efff400a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c96a8cbc3ed4416f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.973+0000 7f00027fc700 1 -- 172.21.15.124:0/1675331172 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc0017f0 con 0x7f0004155800 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.973+0000 7f00027fc700 1 -- 172.21.15.124:0/1675331172 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400c660 con 0x7f0004155800 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.973+0000 7f00027fc700 1 -- 172.21.15.124:0/1675331172 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400ca00 con 0x7f0004155800 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.974+0000 7f0009bff700 1 -- 172.21.15.124:0/1675331172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0004155800 msgr2=0x7f00040694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.974+0000 7f0009bff700 1 --2- 172.21.15.124:0/1675331172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0004155800 0x7f00040694c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efff400aa90 tx=0x7efff400a330 comp rx=0 tx=0).stop 2023-10-06T04:45:34.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.974+0000 7f0009bff700 1 -- 172.21.15.124:0/1675331172 shutdown_connections 2023-10-06T04:45:34.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.974+0000 7f0009bff700 1 --2- 172.21.15.124:0/1675331172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0004155800 0x7f00040694c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.974+0000 7f0009bff700 1 -- 172.21.15.124:0/1675331172 >> 172.21.15.124:0/1675331172 conn(0x7f00040680c0 msgr2=0x7f00040cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:34.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.974+0000 7f0009bff700 1 -- 172.21.15.124:0/1675331172 shutdown_connections 2023-10-06T04:45:34.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.974+0000 7f0009bff700 1 -- 172.21.15.124:0/1675331172 wait complete. 2023-10-06T04:45:34.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.976+0000 7f0009bff700 1 Processor -- start 2023-10-06T04:45:34.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.976+0000 7f0009bff700 1 -- start start 2023-10-06T04:45:34.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.977+0000 7f0009bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00040ae6f0 0x7f00040ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:34.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0009bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0004155800 0x7f00041673a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:34.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0009bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00041596c0 0x7f00040c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:34.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0009bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040aa510 con 0x7f00041596c0 2023-10-06T04:45:34.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0009bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040aadb0 con 0x7f00040ae6f0 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0009bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040ab780 con 0x7f0004155800 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0003fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00041596c0 0x7f00040c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0003fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00041596c0 0x7f00040c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55018/0 (socket says 172.21.15.124:55018) 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0003fff700 1 -- 172.21.15.124:0/3280412367 learned_addr learned my addr 172.21.15.124:0/3280412367 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f00037fe700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00040ae6f0 0x7f00040ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0002ffd700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0004155800 0x7f00041673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0003fff700 1 -- 172.21.15.124:0/3280412367 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0004155800 msgr2=0x7f00041673a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0003fff700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0004155800 0x7f00041673a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0003fff700 1 -- 172.21.15.124:0/3280412367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00040ae6f0 msgr2=0x7f00040ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0003fff700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00040ae6f0 0x7f00040ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:34.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f0003fff700 1 -- 172.21.15.124:0/3280412367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff400a5d0 con 0x7f00041596c0 2023-10-06T04:45:34.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.978+0000 7f00037fe700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00040ae6f0 0x7f00040ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:34.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.979+0000 7f0003fff700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00041596c0 0x7f00040c5270 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efffc00cb90 tx=0x7efffc007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:34.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.979+0000 7effeb7fe700 1 -- 172.21.15.124:0/3280412367 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc004dc0 con 0x7f00041596c0 2023-10-06T04:45:34.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.979+0000 7effeb7fe700 1 -- 172.21.15.124:0/3280412367 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc00a5d0 con 0x7f00041596c0 2023-10-06T04:45:34.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.979+0000 7f0009bff700 1 -- 172.21.15.124:0/3280412367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000416e310 con 0x7f00041596c0 2023-10-06T04:45:34.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.979+0000 7effeb7fe700 1 -- 172.21.15.124:0/3280412367 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00a990 con 0x7f00041596c0 2023-10-06T04:45:34.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.979+0000 7f0009bff700 1 -- 172.21.15.124:0/3280412367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040aaa40 con 0x7f00041596c0 2023-10-06T04:45:34.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.980+0000 7f0009bff700 1 -- 172.21.15.124:0/3280412367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0004064850 con 0x7f00041596c0 2023-10-06T04:45:34.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.981+0000 7effeb7fe700 1 -- 172.21.15.124:0/3280412367 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efffc007150 con 0x7f00041596c0 2023-10-06T04:45:34.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.982+0000 7effeb7fe700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efff0066f30 0x7efff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:34.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.982+0000 7effeb7fe700 1 -- 172.21.15.124:0/3280412367 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efffc0841f0 con 0x7f00041596c0 2023-10-06T04:45:34.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.982+0000 7f00037fe700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efff0066f30 0x7efff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:34.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.983+0000 7f00037fe700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efff0066f30 0x7efff00693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efff400a370 tx=0x7efff4019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:34.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:34.986+0000 7effeb7fe700 1 -- 172.21.15.124:0/3280412367 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efffc051260 con 0x7f00041596c0 2023-10-06T04:45:35.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.250+0000 7f0009bff700 1 -- 172.21.15.124:0/3280412367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f00040aaf20 con 0x7f00041596c0 2023-10-06T04:45:35.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.254+0000 7effeb7fe700 1 -- 172.21.15.124:0/3280412367 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7efffc054880 con 0x7f00041596c0 2023-10-06T04:45:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 -- 172.21.15.124:0/3280412367 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efff0066f30 msgr2=0x7efff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efff0066f30 0x7efff00693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efff400a370 tx=0x7efff4019000 comp rx=0 tx=0).stop 2023-10-06T04:45:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 -- 172.21.15.124:0/3280412367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00041596c0 msgr2=0x7f00040c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00041596c0 0x7f00040c5270 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efffc00cb90 tx=0x7efffc007ca0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 -- 172.21.15.124:0/3280412367 shutdown_connections 2023-10-06T04:45:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00041596c0 0x7f00040c5270 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00040ae6f0 0x7f00040ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efff0066f30 0x7efff00693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 --2- 172.21.15.124:0/3280412367 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0004155800 0x7f00041673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 -- 172.21.15.124:0/3280412367 >> 172.21.15.124:0/3280412367 conn(0x7f00040680c0 msgr2=0x7f00040c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:35.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 -- 172.21.15.124:0/3280412367 shutdown_connections 2023-10-06T04:45:35.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.256+0000 7f0009bff700 1 -- 172.21.15.124:0/3280412367 wait complete. 2023-10-06T04:45:35.260 INFO:teuthology.orchestra.run.smithi124.stderr:updated caps for client.0 2023-10-06T04:45:35.276 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:35.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.464+0000 7f8bb6dff700 1 Processor -- start 2023-10-06T04:45:35.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.464+0000 7f8bb6dff700 1 -- start start 2023-10-06T04:45:35.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.465+0000 7f8bb6dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8bb00ccd30 0x7f8bb0099610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:35.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.465+0000 7f8bb6dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8bb00690b0 0x7f8bb00abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:35.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.465+0000 7f8bb6dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb00acc40 con 0x7f8bb00abb60 2023-10-06T04:45:35.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.465+0000 7f8bb6dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb00ad0d0 con 0x7f8bb00ccd30 2023-10-06T04:45:35.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.465+0000 7f8bb6dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb006ae30 con 0x7f8bb00690b0 2023-10-06T04:45:35.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8bb4b9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f8bb00abb60 0x7f8bb0098f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53056/0 (socket says 172.21.15.124:53056) 2023-10-06T04:45:35.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8baffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8bb00ccd30 0x7f8bb0099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:35.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8bb4b9b700 1 -- 172.21.15.124:0/3990152249 learned_addr learned my addr 172.21.15.124:0/3990152249 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:35.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8bb539c700 1 --2- 172.21.15.124:0/3990152249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8bb00690b0 0x7f8bb00abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:35.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8baf7fe700 1 -- 172.21.15.124:0/3990152249 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032266724 0 0) 0x7f8bb00acc40 con 0x7f8bb00abb60 2023-10-06T04:45:35.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8baf7fe700 1 -- 172.21.15.124:0/3990152249 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba0003570 con 0x7f8bb00abb60 2023-10-06T04:45:35.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8baffff700 1 -- 172.21.15.124:0/3990152249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8bb00690b0 msgr2=0x7f8bb00abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:35.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8baffff700 1 --2- 172.21.15.124:0/3990152249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8bb00690b0 0x7f8bb00abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8baffff700 1 -- 172.21.15.124:0/3990152249 >> v1:172.21.15.124:6789/0 conn(0x7f8bb00abb60 legacy=0x7f8bb0098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:35.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8baffff700 1 -- 172.21.15.124:0/3990152249 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb00ac5f0 con 0x7f8bb00ccd30 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.466+0000 7f8baffff700 1 --2- 172.21.15.124:0/3990152249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00ccd30 0x7f8bb0099610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0098e0 tx=0x7f8b9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cfd698c8e7cf72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8baf7fe700 1 -- 172.21.15.124:0/3990152249 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00f6b0 con 0x7f8bb00ccd30 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8baf7fe700 1 -- 172.21.15.124:0/3990152249 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c00f810 con 0x7f8bb00ccd30 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8baf7fe700 1 -- 172.21.15.124:0/3990152249 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00fbb0 con 0x7f8bb00ccd30 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8bb6dff700 1 -- 172.21.15.124:0/3990152249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00ccd30 msgr2=0x7f8bb0099610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8bb6dff700 1 --2- 172.21.15.124:0/3990152249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00ccd30 0x7f8bb0099610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0098e0 tx=0x7f8b9c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8bb6dff700 1 -- 172.21.15.124:0/3990152249 shutdown_connections 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8bb6dff700 1 --2- 172.21.15.124:0/3990152249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8bb00690b0 0x7f8bb00abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8bb6dff700 1 --2- 172.21.15.124:0/3990152249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00ccd30 0x7f8bb0099610 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8bb6dff700 1 -- 172.21.15.124:0/3990152249 >> 172.21.15.124:0/3990152249 conn(0x7f8bb00cc050 msgr2=0x7f8bb00cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8bb6dff700 1 -- 172.21.15.124:0/3990152249 shutdown_connections 2023-10-06T04:45:35.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.467+0000 7f8bb6dff700 1 -- 172.21.15.124:0/3990152249 wait complete. 2023-10-06T04:45:35.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.469+0000 7f8bb6dff700 1 Processor -- start 2023-10-06T04:45:35.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.469+0000 7f8bb6dff700 1 -- start start 2023-10-06T04:45:35.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb6dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00690b0 0x7f8bb00a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:35.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb6dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8bb00abb60 0x7f8bb00aa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:35.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb6dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8bb00ccd30 0x7f8bb00c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:35.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb6dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb0156640 con 0x7f8bb00690b0 2023-10-06T04:45:35.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb6dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb00a7d20 con 0x7f8bb00ccd30 2023-10-06T04:45:35.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb6dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb00a8000 con 0x7f8bb00abb60 2023-10-06T04:45:35.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb4b9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00690b0 0x7f8bb00a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:35.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb4b9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00690b0 0x7f8bb00a7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55042/0 (socket says 172.21.15.124:55042) 2023-10-06T04:45:35.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb4b9b700 1 -- 172.21.15.124:0/1386453201 learned_addr learned my addr 172.21.15.124:0/1386453201 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:35.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb4b9b700 1 -- 172.21.15.124:0/1386453201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8bb00abb60 msgr2=0x7f8bb00aa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:35.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb4b9b700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8bb00abb60 0x7f8bb00aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb4b9b700 1 -- 172.21.15.124:0/1386453201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8bb00ccd30 msgr2=0x7f8bb00c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:35.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb4b9b700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8bb00ccd30 0x7f8bb00c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.470+0000 7f8bb4b9b700 1 -- 172.21.15.124:0/1386453201 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c009420 con 0x7f8bb00690b0 2023-10-06T04:45:35.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.471+0000 7f8bb4b9b700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00690b0 0x7f8bb00a7620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40011e0 tx=0x7f8ba4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:35.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.471+0000 7f8bacff9700 1 -- 172.21.15.124:0/1386453201 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4005b30 con 0x7f8bb00690b0 2023-10-06T04:45:35.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.471+0000 7f8bacff9700 1 -- 172.21.15.124:0/1386453201 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba4005c90 con 0x7f8bb00690b0 2023-10-06T04:45:35.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.471+0000 7f8bacff9700 1 -- 172.21.15.124:0/1386453201 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4007320 con 0x7f8bb00690b0 2023-10-06T04:45:35.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.471+0000 7f8bb6dff700 1 -- 172.21.15.124:0/1386453201 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb00a82e0 con 0x7f8bb00690b0 2023-10-06T04:45:35.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.471+0000 7f8bb6dff700 1 -- 172.21.15.124:0/1386453201 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb00a88a0 con 0x7f8bb00690b0 2023-10-06T04:45:35.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.472+0000 7f8bb6dff700 1 -- 172.21.15.124:0/1386453201 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb00717a0 con 0x7f8bb00690b0 2023-10-06T04:45:35.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.473+0000 7f8bacff9700 1 -- 172.21.15.124:0/1386453201 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ba4007690 con 0x7f8bb00690b0 2023-10-06T04:45:35.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.474+0000 7f8bacff9700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8b94066f30 0x7f8b940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:35.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.474+0000 7f8bacff9700 1 -- 172.21.15.124:0/1386453201 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ba4083be0 con 0x7f8bb00690b0 2023-10-06T04:45:35.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.474+0000 7f8baffff700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8b94066f30 0x7f8b940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:35.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.475+0000 7f8baffff700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8b94066f30 0x7f8b940693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00a010 tx=0x7f8b9c019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:35.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.478+0000 7f8bacff9700 1 -- 172.21.15.124:0/1386453201 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ba4050c50 con 0x7f8bb00690b0 2023-10-06T04:45:35.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.709+0000 7f8bb6dff700 1 -- 172.21.15.124:0/1386453201 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bb00cbc00 con 0x7f8bb00690b0 2023-10-06T04:45:35.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.709+0000 7f8bacff9700 1 -- 172.21.15.124:0/1386453201 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f8ba4017020 con 0x7f8bb00690b0 2023-10-06T04:45:35.712 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:35.712 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/518958812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":518958812},{"type":"v1","addr":"172.21.15.158:6834","nonce":518958812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/120181660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":120181660},{"type":"v1","addr":"172.21.15.158:6835","nonce":120181660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1421870244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1421870244},{"type":"v1","addr":"172.21.15.124:6836","nonce":1421870244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:24.506230+0000","modified":"2023-10-06T04:45:28.049891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.124:6837/1031472040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1031472040},{"type":"v1","addr":"172.21.15.124:6837","nonce":1031472040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:45:35.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 -- 172.21.15.124:0/1386453201 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8b94066f30 msgr2=0x7f8b940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8b94066f30 0x7f8b940693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00a010 tx=0x7f8b9c019000 comp rx=0 tx=0).stop 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 -- 172.21.15.124:0/1386453201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00690b0 msgr2=0x7f8bb00a7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00690b0 0x7f8bb00a7620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40011e0 tx=0x7f8ba4007df0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 -- 172.21.15.124:0/1386453201 shutdown_connections 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8bb00ccd30 0x7f8bb00c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8bb00690b0 0x7f8bb00a7620 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8b94066f30 0x7f8b940693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 --2- 172.21.15.124:0/1386453201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8bb00abb60 0x7f8bb00aa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 -- 172.21.15.124:0/1386453201 >> 172.21.15.124:0/1386453201 conn(0x7f8bb00cc050 msgr2=0x7f8bb006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 -- 172.21.15.124:0/1386453201 shutdown_connections 2023-10-06T04:45:35.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:35.712+0000 7f8bb6dff700 1 -- 172.21.15.124:0/1386453201 wait complete. 2023-10-06T04:45:35.716 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2023-10-06T04:45:36.134 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:45:24.506230+0000', 'modified': '2023-10-06T04:45:28.049891+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4968}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4968': {'gid': 4968, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.124:6837/1031472040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.124:6835', 'nonce': 1031472040}, {'type': 'v1', 'addr': '172.21.15.124:6837', 'nonce': 1031472040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:45:36.134 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:45:36.134 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T04:45:36.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.324+0000 7f23b1bff700 1 Processor -- start 2023-10-06T04:45:36.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.325+0000 7f23b1bff700 1 -- start start 2023-10-06T04:45:36.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.326+0000 7f23b1bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f23ac1594b0 0x7f23ac0b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.326+0000 7f23b1bff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0b4410 con 0x7f23ac15a580 2023-10-06T04:45:36.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.326+0000 7f23b1bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0b46f0 con 0x7f23ac0b1ea0 2023-10-06T04:45:36.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.326+0000 7f23b1bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac0b49d0 con 0x7f23ac1594b0 2023-10-06T04:45:36.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.326+0000 7f23ab7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f23ac1594b0 0x7f23ac0b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.326+0000 7f23aaffd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f23ac15a580 0x7f23ac0b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53066/0 (socket says 172.21.15.124:53066) 2023-10-06T04:45:36.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.326+0000 7f23aaffd700 1 -- 172.21.15.124:0/523141101 learned_addr learned my addr 172.21.15.124:0/523141101 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:36.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.327+0000 7f23ab7fe700 1 -- 172.21.15.124:0/523141101 >> v1:172.21.15.158:6789/0 conn(0x7f23ac0b1ea0 legacy=0x7f23ac0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.327+0000 7f23ab7fe700 1 -- 172.21.15.124:0/523141101 >> v1:172.21.15.124:6789/0 conn(0x7f23ac15a580 legacy=0x7f23ac0b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.327+0000 7f23ab7fe700 1 -- 172.21.15.124:0/523141101 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0b4cb0 con 0x7f23ac1594b0 2023-10-06T04:45:36.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.327+0000 7f23aa7fc700 1 -- 172.21.15.124:0/523141101 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548528159 0 0) 0x7f23ac0b4410 con 0x7f23ac15a580 2023-10-06T04:45:36.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.327+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/523141101 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 0x7f23ac0b3d30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f239c0098e0 tx=0x7f239c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf0bbab39a2d59d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:36.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.327+0000 7f23aa7fc700 1 -- 172.21.15.124:0/523141101 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c009e80 con 0x7f23ac1594b0 2023-10-06T04:45:36.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.327+0000 7f23aa7fc700 1 -- 172.21.15.124:0/523141101 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c00b860 con 0x7f23ac1594b0 2023-10-06T04:45:36.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.327+0000 7f23aa7fc700 1 -- 172.21.15.124:0/523141101 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c00bbe0 con 0x7f23ac1594b0 2023-10-06T04:45:36.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.328+0000 7f23b1bff700 1 -- 172.21.15.124:0/523141101 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 msgr2=0x7f23ac0b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.328+0000 7f23b1bff700 1 --2- 172.21.15.124:0/523141101 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 0x7f23ac0b3d30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f239c0098e0 tx=0x7f239c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.328+0000 7f23b1bff700 1 -- 172.21.15.124:0/523141101 shutdown_connections 2023-10-06T04:45:36.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.328+0000 7f23b1bff700 1 --2- 172.21.15.124:0/523141101 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 0x7f23ac0b3d30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.328+0000 7f23b1bff700 1 -- 172.21.15.124:0/523141101 >> 172.21.15.124:0/523141101 conn(0x7f23ac06ed20 msgr2=0x7f23ac06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:36.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.328+0000 7f23b1bff700 1 -- 172.21.15.124:0/523141101 shutdown_connections 2023-10-06T04:45:36.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.328+0000 7f23b1bff700 1 -- 172.21.15.124:0/523141101 wait complete. 2023-10-06T04:45:36.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.329+0000 7f23b1bff700 1 Processor -- start 2023-10-06T04:45:36.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.329+0000 7f23b1bff700 1 -- start start 2023-10-06T04:45:36.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.330+0000 7f23b1bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23ac0b1ea0 0x7f23ac148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.330+0000 7f23b1bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 0x7f23ac0cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.330+0000 7f23b1bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23ac15a580 0x7f23ac0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.330+0000 7f23b1bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0c8f70 con 0x7f23ac1594b0 2023-10-06T04:45:36.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.330+0000 7f23b1bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0c6c30 con 0x7f23ac0b1ea0 2023-10-06T04:45:36.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.330+0000 7f23b1bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0c8920 con 0x7f23ac15a580 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23aaffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 0x7f23ac0cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23aaffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 0x7f23ac0cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55058/0 (socket says 172.21.15.124:55058) 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23aaffd700 1 -- 172.21.15.124:0/2999052850 learned_addr learned my addr 172.21.15.124:0/2999052850 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23ac0b1ea0 0x7f23ac148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23abfff700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23ac15a580 0x7f23ac0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23aaffd700 1 -- 172.21.15.124:0/2999052850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23ac15a580 msgr2=0x7f23ac0cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23aaffd700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23ac15a580 0x7f23ac0cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23aaffd700 1 -- 172.21.15.124:0/2999052850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23ac0b1ea0 msgr2=0x7f23ac148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23aaffd700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23ac0b1ea0 0x7f23ac148f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23aaffd700 1 -- 172.21.15.124:0/2999052850 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c009420 con 0x7f23ac1594b0 2023-10-06T04:45:36.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23aaffd700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 0x7f23ac0cac20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f23a000c560 tx=0x7f23a0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:36.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.331+0000 7f23937fe700 1 -- 172.21.15.124:0/2999052850 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0005b30 con 0x7f23ac1594b0 2023-10-06T04:45:36.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.332+0000 7f23937fe700 1 -- 172.21.15.124:0/2999052850 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a0005c90 con 0x7f23ac1594b0 2023-10-06T04:45:36.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.332+0000 7f23937fe700 1 -- 172.21.15.124:0/2999052850 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0007320 con 0x7f23ac1594b0 2023-10-06T04:45:36.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.332+0000 7f23b1bff700 1 -- 172.21.15.124:0/2999052850 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0c8c00 con 0x7f23ac1594b0 2023-10-06T04:45:36.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.332+0000 7f23b1bff700 1 -- 172.21.15.124:0/2999052850 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac0c6f10 con 0x7f23ac1594b0 2023-10-06T04:45:36.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.334+0000 7f23937fe700 1 -- 172.21.15.124:0/2999052850 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23a001b3b0 con 0x7f23ac1594b0 2023-10-06T04:45:36.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.334+0000 7f23937fe700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2398066f30 0x7f23980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.335+0000 7f23937fe700 1 -- 172.21.15.124:0/2999052850 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23a0083b90 con 0x7f23ac1594b0 2023-10-06T04:45:36.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.335+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2398066f30 0x7f23980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.335+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2398066f30 0x7f23980693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f239c0093f0 tx=0x7f239c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:36.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.337+0000 7f23c023cb80 1 Processor -- start 2023-10-06T04:45:36.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.337+0000 7f23c023cb80 1 -- start start 2023-10-06T04:45:36.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.338+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac0203450 0x555ac0203820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.338+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 0x555ac020bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.338+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac020c4d0 0x555ac020c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.338+0000 7f23c023cb80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ac00d6310 con 0x555ac020c4d0 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.338+0000 7f23c023cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ac0113130 con 0x555ac01e8f40 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.338+0000 7f23c023cb80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ac0110af0 con 0x555ac0203450 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.338+0000 7f23abfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac020c4d0 0x555ac020c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.338+0000 7f23abfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac020c4d0 0x555ac020c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55074/0 (socket says 172.21.15.124:55074) 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.338+0000 7f23abfff700 1 -- 172.21.15.124:0/2141766460 learned_addr learned my addr 172.21.15.124:0/2141766460 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.338+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/2141766460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac0203450 0x555ac0203820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f23aaffd700 1 --2- 172.21.15.124:0/2141766460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 0x555ac020bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f23abfff700 1 -- 172.21.15.124:0/2141766460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac0203450 msgr2=0x555ac0203820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f23abfff700 1 --2- 172.21.15.124:0/2141766460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac0203450 0x555ac0203820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f23abfff700 1 -- 172.21.15.124:0/2141766460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 msgr2=0x555ac020bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:36.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f23abfff700 1 --2- 172.21.15.124:0/2141766460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 0x555ac020bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f23abfff700 1 -- 172.21.15.124:0/2141766460 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555abff12790 con 0x555ac020c4d0 2023-10-06T04:45:36.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f23aaffd700 1 --2- 172.21.15.124:0/2141766460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 0x555ac020bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:36.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f23abfff700 1 --2- 172.21.15.124:0/2141766460 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac020c4d0 0x555ac020c940 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f23a4003d60 tx=0x7f23a4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43114685ba15fe7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:36.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f2390ff9700 1 -- 172.21.15.124:0/2141766460 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a40032e0 con 0x555ac020c4d0 2023-10-06T04:45:36.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f2390ff9700 1 -- 172.21.15.124:0/2141766460 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a400e6c0 con 0x555ac020c4d0 2023-10-06T04:45:36.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.339+0000 7f2390ff9700 1 -- 172.21.15.124:0/2141766460 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a400ea40 con 0x555ac020c4d0 2023-10-06T04:45:36.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.340+0000 7f23c023cb80 1 -- 172.21.15.124:0/2141766460 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac020c4d0 msgr2=0x555ac020c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.340+0000 7f23c023cb80 1 --2- 172.21.15.124:0/2141766460 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac020c4d0 0x555ac020c940 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f23a4003d60 tx=0x7f23a4009040 comp rx=0 tx=0).stop 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.340+0000 7f23c023cb80 1 -- 172.21.15.124:0/2141766460 shutdown_connections 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.340+0000 7f23c023cb80 1 --2- 172.21.15.124:0/2141766460 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac020c4d0 0x555ac020c940 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.340+0000 7f23c023cb80 1 --2- 172.21.15.124:0/2141766460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac0203450 0x555ac0203820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.340+0000 7f23c023cb80 1 --2- 172.21.15.124:0/2141766460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 0x555ac020bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.340+0000 7f23c023cb80 1 -- 172.21.15.124:0/2141766460 >> 172.21.15.124:0/2141766460 conn(0x555ac0206880 msgr2=0x555ac0206c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.340+0000 7f23c023cb80 1 -- 172.21.15.124:0/2141766460 shutdown_connections 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.340+0000 7f23c023cb80 1 -- 172.21.15.124:0/2141766460 wait complete. 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.341+0000 7f23c023cb80 1 -- start start 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.341+0000 7f23c023cb80 1 Processor -- start 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 0x555ac01be120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01dd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac020c4d0 0x555ac01dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23c023cb80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ac010c8e0 con 0x555ac0203450 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23c023cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ac00b8980 con 0x555ac01e8f40 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23c023cb80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ac00b8620 con 0x555ac020c4d0 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23c023cb80 10 client.0 _ll_register_callbacks cb 0x555abff1ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23aaffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01dd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23aaffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01dd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55084/0 (socket says 172.21.15.124:55084) 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23aaffd700 1 -- 172.21.15.124:0/1114034044 learned_addr learned my addr 172.21.15.124:0/1114034044 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23aaffd700 1 -- 172.21.15.124:0/1114034044 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac020c4d0 msgr2=0x555ac01dffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23aaffd700 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac020c4d0 0x555ac01dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23aaffd700 1 -- 172.21.15.124:0/1114034044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 msgr2=0x555ac01be120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:36.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 0x555ac01be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23aaffd700 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 0x555ac01be120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23aaffd700 1 -- 172.21.15.124:0/1114034044 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a400f040 con 0x555ac0203450 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.342+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 0x555ac01be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f23aaffd700 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01dd770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f23a000cc00 tx=0x7f23a0081e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e6d8b00ba00d56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f2389ffb700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f2389ffb700 1 -- 172.21.15.124:0/1114034044 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0005e00 con 0x555ac0203450 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f2389ffb700 1 -- 172.21.15.124:0/1114034044 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23a0052c60 con 0x555ac0203450 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f23c023cb80 1 -- 172.21.15.124:0/1114034044 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ac01b0d60 con 0x555ac0203450 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f2389ffb700 1 -- 172.21.15.124:0/1114034044 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23a005b5e0 con 0x555ac0203450 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f23c023cb80 10 client.5190 fetch_fsmap learned FSMap version 17 2023-10-06T04:45:36.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f23c023cb80 1 -- 172.21.15.124:0/1114034044 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555abffff0a0 con 0x555ac0203450 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f2389ffb700 1 -- 172.21.15.124:0/1114034044 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ac01b0d60 con 0x555ac0203450 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f2389ffb700 1 -- 172.21.15.124:0/1114034044 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f23a0070250 con 0x555ac0203450 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f23c023cb80 10 client.5190 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f23c023cb80 10 client.5190 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f23c023cb80 20 client.5190 populate_metadata read hostname 'smithi124' 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f23c023cb80 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.124:6835/1031472040,v1:172.21.15.124:6837/1031472040] conn(0x555ac0215d90 0x555ac0216160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f23c023cb80 4 client.5190 mds_command: new command op to 4968 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.343+0000 7f23c023cb80 1 -- 172.21.15.124:0/1114034044 --> [v2:172.21.15.124:6835/1031472040,v1:172.21.15.124:6837/1031472040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ac018db30 con 0x555ac0215d90 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.344+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.124:6835/1031472040,v1:172.21.15.124:6837/1031472040] conn(0x555ac0215d90 0x555ac0216160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.344+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.124:6835/1031472040,v1:172.21.15.124:6837/1031472040] conn(0x555ac0215d90 0x555ac0216160 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b72336fb7553603e server_cookie=a51dee268b874130 in_seq=0 out_seq=0 2023-10-06T04:45:36.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.344+0000 7f2389ffb700 10 client.5190 ms_handle_connect on v2:172.21.15.124:6835/1031472040 2023-10-06T04:45:36.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f2389ffb700 1 -- 172.21.15.124:0/1114034044 <== mds.0 v2:172.21.15.124:6835/1031472040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555ac018db30 con 0x555ac0215d90 2023-10-06T04:45:36.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f2389ffb700 10 client.5190 handle_command_reply: tid=0 2023-10-06T04:45:36.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 client.5190 shutdown 2023-10-06T04:45:36.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 -- 172.21.15.124:0/1114034044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 msgr2=0x555ac01dd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01dd770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f23a000cc00 tx=0x7f23a0081e10 comp rx=0 tx=0).stop 2023-10-06T04:45:36.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 -- 172.21.15.124:0/1114034044 shutdown_connections 2023-10-06T04:45:36.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.124:6835/1031472040,v1:172.21.15.124:6837/1031472040] conn(0x555ac0215d90 0x555ac0216160 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac020c4d0 0x555ac01dffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac01e8f40 0x555ac01be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f2389ffb700 0 client.5190 ms_handle_reset on v2:172.21.15.124:6835/1031472040 2023-10-06T04:45:36.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 --2- 172.21.15.124:0/1114034044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01dd770 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 -- 172.21.15.124:0/1114034044 >> 172.21.15.124:0/1114034044 conn(0x555ac0206880 msgr2=0x555ac01b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:36.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 -- 172.21.15.124:0/1114034044 shutdown_connections 2023-10-06T04:45:36.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.345+0000 7f23c023cb80 1 -- 172.21.15.124:0/1114034044 wait complete. 2023-10-06T04:45:36.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.346+0000 7f23c023cb80 20 client.5190 trim_cache size 0 max 16384 2023-10-06T04:45:36.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.362+0000 7f23c023cb80 1 Processor -- start 2023-10-06T04:45:36.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.363+0000 7f23c023cb80 1 -- start start 2023-10-06T04:45:36.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.363+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac01e8f40 0x555ac01e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.363+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac0203450 0x555ac01dfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.363+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac020c4d0 0x555ac01b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.363+0000 7f23c023cb80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x555abffa41e0 con 0x555ac01e8f40 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.363+0000 7f23c023cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ac01baba0 con 0x555ac0203450 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.363+0000 7f23c023cb80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ac021c3a0 con 0x555ac020c4d0 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23ab7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac01e8f40 0x555ac01e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23ab7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac01e8f40 0x555ac01e3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55090/0 (socket says 172.21.15.124:55090) 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23ab7fe700 1 -- 172.21.15.124:0/1454522033 learned_addr learned my addr 172.21.15.124:0/1454522033 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23ab7fe700 1 -- 172.21.15.124:0/1454522033 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac020c4d0 msgr2=0x555ac01b8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/1454522033 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac020c4d0 0x555ac01b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23ab7fe700 1 -- 172.21.15.124:0/1454522033 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac0203450 msgr2=0x555ac01dfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:36.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/1454522033 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac0203450 0x555ac01dfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23ab7fe700 1 -- 172.21.15.124:0/1454522033 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ac00db3c0 con 0x555ac01e8f40 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/1454522033 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac01e8f40 0x555ac01e3b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f239c013000 tx=0x7f239c029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46f0d497bea409c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23917fa700 1 -- 172.21.15.124:0/1454522033 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c01ac70 con 0x555ac01e8f40 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23917fa700 1 -- 172.21.15.124:0/1454522033 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c02e040 con 0x555ac01e8f40 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.364+0000 7f23917fa700 1 -- 172.21.15.124:0/1454522033 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c01add0 con 0x555ac01e8f40 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.365+0000 7f23c023cb80 1 -- 172.21.15.124:0/1454522033 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac01e8f40 msgr2=0x555ac01e3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.365+0000 7f23c023cb80 1 --2- 172.21.15.124:0/1454522033 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac01e8f40 0x555ac01e3b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f239c013000 tx=0x7f239c029040 comp rx=0 tx=0).stop 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.365+0000 7f23c023cb80 1 -- 172.21.15.124:0/1454522033 shutdown_connections 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.365+0000 7f23c023cb80 1 --2- 172.21.15.124:0/1454522033 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac020c4d0 0x555ac01b8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.365+0000 7f23c023cb80 1 --2- 172.21.15.124:0/1454522033 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac01e8f40 0x555ac01e3b10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.365+0000 7f23c023cb80 1 --2- 172.21.15.124:0/1454522033 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac0203450 0x555ac01dfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.365+0000 7f23c023cb80 1 -- 172.21.15.124:0/1454522033 >> 172.21.15.124:0/1454522033 conn(0x555ac0206880 msgr2=0x555ac021c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:36.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.365+0000 7f23c023cb80 1 -- 172.21.15.124:0/1454522033 shutdown_connections 2023-10-06T04:45:36.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.365+0000 7f23c023cb80 1 -- 172.21.15.124:0/1454522033 wait complete. 2023-10-06T04:45:36.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.366+0000 7f23c023cb80 1 -- start start 2023-10-06T04:45:36.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.366+0000 7f23c023cb80 1 Processor -- start 2023-10-06T04:45:36.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac01e8f40 0x555ac025b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01eb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23c023cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac020c4d0 0x555ac01ebd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23c023cb80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ac0268e50 con 0x555ac0203450 2023-10-06T04:45:36.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23c023cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ac01e50d0 con 0x555ac020c4d0 2023-10-06T04:45:36.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23c023cb80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ac01e1980 con 0x555ac01e8f40 2023-10-06T04:45:36.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23c023cb80 10 client.0 _ll_register_callbacks cb 0x555abff1ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:45:36.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23aaffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01eb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23aaffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01eb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55100/0 (socket says 172.21.15.124:55100) 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23aaffd700 1 -- 172.21.15.124:0/2304424352 learned_addr learned my addr 172.21.15.124:0/2304424352 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23abfff700 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac020c4d0 0x555ac01ebd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23aaffd700 1 -- 172.21.15.124:0/2304424352 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac01e8f40 msgr2=0x555ac025b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac01e8f40 0x555ac025b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23aaffd700 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac01e8f40 0x555ac025b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23aaffd700 1 -- 172.21.15.124:0/2304424352 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac020c4d0 msgr2=0x555ac01ebd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23aaffd700 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac020c4d0 0x555ac01ebd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23aaffd700 1 -- 172.21.15.124:0/2304424352 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac0b4cb0 con 0x555ac0203450 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.367+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac01e8f40 0x555ac025b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:36.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f23aaffd700 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01eb810 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f23a00545c0 tx=0x7f23a006a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3628447e42b184a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f2389ffb700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f2389ffb700 1 -- 172.21.15.124:0/2304424352 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a005b5e0 con 0x555ac0203450 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f2389ffb700 1 -- 172.21.15.124:0/2304424352 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23a0052c60 con 0x555ac0203450 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f23c023cb80 1 -- 172.21.15.124:0/2304424352 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f23a400e6c0 con 0x555ac0203450 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f2389ffb700 1 -- 172.21.15.124:0/2304424352 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23a0054400 con 0x555ac0203450 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f23c023cb80 10 client.5196 fetch_fsmap learned FSMap version 17 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f23c023cb80 1 -- 172.21.15.124:0/2304424352 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555abff731d0 con 0x555ac0203450 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f2389ffb700 1 -- 172.21.15.124:0/2304424352 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a400e6c0 con 0x555ac0203450 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f2389ffb700 1 -- 172.21.15.124:0/2304424352 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f23a00506b0 con 0x555ac0203450 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f23c023cb80 10 client.5196 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f23c023cb80 10 client.5196 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:45:36.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f23c023cb80 20 client.5196 populate_metadata read hostname 'smithi124' 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f23c023cb80 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.124:6835/1031472040,v1:172.21.15.124:6837/1031472040] conn(0x555ac01bc390 0x555ac01bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f23c023cb80 4 client.5196 mds_command: new command op to 4968 tid=0[{"prefix": "status"}] 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.368+0000 7f23c023cb80 1 -- 172.21.15.124:0/2304424352 --> [v2:172.21.15.124:6835/1031472040,v1:172.21.15.124:6837/1031472040] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555ac00af8d0 con 0x555ac01bc390 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.369+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.124:6835/1031472040,v1:172.21.15.124:6837/1031472040] conn(0x555ac01bc390 0x555ac01bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.369+0000 7f23ab7fe700 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.124:6835/1031472040,v1:172.21.15.124:6837/1031472040] conn(0x555ac01bc390 0x555ac01bc760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d412b20ade96ebc server_cookie=7f8852661f941031 in_seq=0 out_seq=0 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.369+0000 7f2389ffb700 10 client.5196 ms_handle_connect on v2:172.21.15.124:6835/1031472040 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.369+0000 7f2389ffb700 1 -- 172.21.15.124:0/2304424352 <== mds.0 v2:172.21.15.124:6835/1031472040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x555ac00af8d0 con 0x555ac01bc390 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.369+0000 7f2389ffb700 10 client.5196 handle_command_reply: tid=0 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.369+0000 7f23c023cb80 1 client.5196 shutdown 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.369+0000 7f23c023cb80 1 -- 172.21.15.124:0/2304424352 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 msgr2=0x555ac01eb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.369+0000 7f23c023cb80 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01eb810 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f23a00545c0 tx=0x7f23a006a000 comp rx=0 tx=0).stop 2023-10-06T04:45:36.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23c023cb80 1 -- 172.21.15.124:0/2304424352 shutdown_connections 2023-10-06T04:45:36.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23c023cb80 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.124:6835/1031472040,v1:172.21.15.124:6837/1031472040] conn(0x555ac01bc390 0x555ac01bc760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23c023cb80 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555ac020c4d0 0x555ac01ebd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23c023cb80 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x555ac01e8f40 0x555ac025b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f2389ffb700 0 client.5196 ms_handle_reset on v2:172.21.15.124:6835/1031472040 2023-10-06T04:45:36.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23c023cb80 1 --2- 172.21.15.124:0/2304424352 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x555ac0203450 0x555ac01eb810 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23c023cb80 1 -- 172.21.15.124:0/2304424352 >> 172.21.15.124:0/2304424352 conn(0x555ac0206880 msgr2=0x555ac021c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:36.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23c023cb80 1 -- 172.21.15.124:0/2304424352 shutdown_connections 2023-10-06T04:45:36.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23c023cb80 1 -- 172.21.15.124:0/2304424352 wait complete. 2023-10-06T04:45:36.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23c023cb80 20 client.5196 trim_cache size 0 max 16384 2023-10-06T04:45:36.379 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:45:36.379 INFO:teuthology.orchestra.run.smithi124.stdout: "cluster_fsid": "8703c690-5fd4-410f-8b5d-95264116cbcb", 2023-10-06T04:45:36.379 INFO:teuthology.orchestra.run.smithi124.stdout: "whoami": 0, 2023-10-06T04:45:36.379 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 4968, 2023-10-06T04:45:36.379 INFO:teuthology.orchestra.run.smithi124.stdout: "want_state": "up:active", 2023-10-06T04:45:36.379 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "up:active", 2023-10-06T04:45:36.379 INFO:teuthology.orchestra.run.smithi124.stdout: "fs_name": "cephfs", 2023-10-06T04:45:36.379 INFO:teuthology.orchestra.run.smithi124.stdout: "rank_uptime": 11.3474234, 2023-10-06T04:45:36.379 INFO:teuthology.orchestra.run.smithi124.stdout: "mdsmap_epoch": 17, 2023-10-06T04:45:36.379 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch": 33, 2023-10-06T04:45:36.380 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch_barrier": 33, 2023-10-06T04:45:36.380 INFO:teuthology.orchestra.run.smithi124.stdout: "uptime": 20.638113398000002 2023-10-06T04:45:36.380 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:45:36.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23b1bff700 1 -- 172.21.15.124:0/2999052850 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2398066f30 msgr2=0x7f23980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23b1bff700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2398066f30 0x7f23980693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f239c0093f0 tx=0x7f239c017000 comp rx=0 tx=0).stop 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23b1bff700 1 -- 172.21.15.124:0/2999052850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 msgr2=0x7f23ac0cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.370+0000 7f23b1bff700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 0x7f23ac0cac20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f23a000c560 tx=0x7f23a0000fe0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.371+0000 7f23b1bff700 1 -- 172.21.15.124:0/2999052850 shutdown_connections 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.371+0000 7f23b1bff700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2398066f30 0x7f23980693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.371+0000 7f23b1bff700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23ac15a580 0x7f23ac0cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.371+0000 7f23b1bff700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23ac0b1ea0 0x7f23ac148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.371+0000 7f23b1bff700 1 --2- 172.21.15.124:0/2999052850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23ac1594b0 0x7f23ac0cac20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.371+0000 7f23b1bff700 1 -- 172.21.15.124:0/2999052850 >> 172.21.15.124:0/2999052850 conn(0x7f23ac06ed20 msgr2=0x7f23ac159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.371+0000 7f23b1bff700 1 -- 172.21.15.124:0/2999052850 shutdown_connections 2023-10-06T04:45:36.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.371+0000 7f23b1bff700 1 -- 172.21.15.124:0/2999052850 wait complete. 2023-10-06T04:45:36.390 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:45:36.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.578+0000 7f96a07ff700 1 Processor -- start 2023-10-06T04:45:36.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.578+0000 7f96a07ff700 1 -- start start 2023-10-06T04:45:36.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.580+0000 7f96a07ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f96981598e0 0x7f96980afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.580+0000 7f96a07ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96980c1d10 con 0x7f96980cb250 2023-10-06T04:45:36.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.580+0000 7f96a07ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96980688a0 con 0x7f96980cae80 2023-10-06T04:45:36.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.580+0000 7f96a07ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96980cd430 con 0x7f96981598e0 2023-10-06T04:45:36.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.580+0000 7f969dd9a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f96980cb250 0x7f96981591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53082/0 (socket says 172.21.15.124:53082) 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.580+0000 7f969dd9a700 1 -- 172.21.15.124:0/2254599864 learned_addr learned my addr 172.21.15.124:0/2254599864 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.580+0000 7f969ed9c700 1 --2- 172.21.15.124:0/2254599864 >> v2:172.21.15.158:3300/0 conn(0x7f96981598e0 0x7f96980afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.580+0000 7f969d599700 1 -- 172.21.15.124:0/2254599864 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179075645 0 0) 0x7f96980c1d10 con 0x7f96980cb250 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.580+0000 7f969d599700 1 -- 172.21.15.124:0/2254599864 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9684003570 con 0x7f96980cb250 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.581+0000 7f969d599700 1 -- 172.21.15.124:0/2254599864 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212939119 0 0) 0x7f96980688a0 con 0x7f96980cae80 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.581+0000 7f969d599700 1 -- 172.21.15.124:0/2254599864 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96980c1d10 con 0x7f96980cae80 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.581+0000 7f969ed9c700 1 -- 172.21.15.124:0/2254599864 >> v1:172.21.15.158:6789/0 conn(0x7f96980cae80 legacy=0x7f96980cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.581+0000 7f969ed9c700 1 -- 172.21.15.124:0/2254599864 >> v1:172.21.15.124:6789/0 conn(0x7f96980cb250 legacy=0x7f96981591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.581+0000 7f969d599700 1 -- 172.21.15.124:0/2254599864 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2917807747 0 0) 0x7f9684003570 con 0x7f96980cb250 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.581+0000 7f969ed9c700 1 -- 172.21.15.124:0/2254599864 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9698068b80 con 0x7f96981598e0 2023-10-06T04:45:36.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.581+0000 7f969ed9c700 1 --2- 172.21.15.124:0/2254599864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96981598e0 0x7f96980afe40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9690009e60 tx=0x7f9690009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=210f363fd728d210 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:36.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.581+0000 7f969d599700 1 -- 172.21.15.124:0/2254599864 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000e070 con 0x7f96981598e0 2023-10-06T04:45:36.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.581+0000 7f969d599700 1 -- 172.21.15.124:0/2254599864 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969000b7a0 con 0x7f96981598e0 2023-10-06T04:45:36.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.581+0000 7f969d599700 1 -- 172.21.15.124:0/2254599864 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688001470 con 0x7f96981598e0 2023-10-06T04:45:36.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.582+0000 7f96a07ff700 1 -- 172.21.15.124:0/2254599864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96981598e0 msgr2=0x7f96980afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.582+0000 7f96a07ff700 1 --2- 172.21.15.124:0/2254599864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96981598e0 0x7f96980afe40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9690009e60 tx=0x7f9690009780 comp rx=0 tx=0).stop 2023-10-06T04:45:36.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.582+0000 7f96a07ff700 1 -- 172.21.15.124:0/2254599864 shutdown_connections 2023-10-06T04:45:36.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.582+0000 7f96a07ff700 1 --2- 172.21.15.124:0/2254599864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96981598e0 0x7f96980afe40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.582+0000 7f96a07ff700 1 -- 172.21.15.124:0/2254599864 >> 172.21.15.124:0/2254599864 conn(0x7f96980974f0 msgr2=0x7f96980639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:36.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.582+0000 7f96a07ff700 1 -- 172.21.15.124:0/2254599864 shutdown_connections 2023-10-06T04:45:36.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.582+0000 7f96a07ff700 1 -- 172.21.15.124:0/2254599864 wait complete. 2023-10-06T04:45:36.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.583+0000 7f96a07ff700 1 Processor -- start 2023-10-06T04:45:36.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.584+0000 7f96a07ff700 1 -- start start 2023-10-06T04:45:36.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.584+0000 7f96a07ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96980cae80 0x7f96981486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.584+0000 7f96a07ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96980cb250 0x7f96980cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f96a07ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96981598e0 0x7f96980ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f96a07ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9698157ed0 con 0x7f96980cb250 2023-10-06T04:45:36.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f96a07ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9698148c10 con 0x7f96981598e0 2023-10-06T04:45:36.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f96a07ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96980c5e90 con 0x7f96980cae80 2023-10-06T04:45:36.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969dd9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96980cb250 0x7f96980cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969dd9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96980cb250 0x7f96980cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55114/0 (socket says 172.21.15.124:55114) 2023-10-06T04:45:36.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969dd9a700 1 -- 172.21.15.124:0/2415846452 learned_addr learned my addr 172.21.15.124:0/2415846452 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:36.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969ed9c700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96981598e0 0x7f96980ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969e59b700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96980cae80 0x7f96981486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969dd9a700 1 -- 172.21.15.124:0/2415846452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96980cae80 msgr2=0x7f96981486d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969dd9a700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96980cae80 0x7f96981486d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969dd9a700 1 -- 172.21.15.124:0/2415846452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96981598e0 msgr2=0x7f96980ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969dd9a700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96981598e0 0x7f96980ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969dd9a700 1 -- 172.21.15.124:0/2415846452 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690009a20 con 0x7f96980cb250 2023-10-06T04:45:36.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.585+0000 7f969dd9a700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96980cb250 0x7f96980cc7f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f968800cb70 tx=0x7f9688001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:36.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.586+0000 7f968e7fc700 1 -- 172.21.15.124:0/2415846452 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688001d00 con 0x7f96980cb250 2023-10-06T04:45:36.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.586+0000 7f968e7fc700 1 -- 172.21.15.124:0/2415846452 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688007360 con 0x7f96980cb250 2023-10-06T04:45:36.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.586+0000 7f968e7fc700 1 -- 172.21.15.124:0/2415846452 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688004830 con 0x7f96980cb250 2023-10-06T04:45:36.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.586+0000 7f96a07ff700 1 -- 172.21.15.124:0/2415846452 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96980c6170 con 0x7f96980cb250 2023-10-06T04:45:36.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.586+0000 7f96a07ff700 1 -- 172.21.15.124:0/2415846452 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9698099ff0 con 0x7f96980cb250 2023-10-06T04:45:36.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.587+0000 7f96a07ff700 1 -- 172.21.15.124:0/2415846452 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96980717a0 con 0x7f96980cb250 2023-10-06T04:45:36.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.588+0000 7f968e7fc700 1 -- 172.21.15.124:0/2415846452 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9688004ba0 con 0x7f96980cb250 2023-10-06T04:45:36.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.588+0000 7f968e7fc700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f967c066f30 0x7f967c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:36.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.589+0000 7f968e7fc700 1 -- 172.21.15.124:0/2415846452 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9688083fc0 con 0x7f96980cb250 2023-10-06T04:45:36.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.589+0000 7f969e59b700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f967c066f30 0x7f967c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:36.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.589+0000 7f969e59b700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f967c066f30 0x7f967c0693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9694003870 tx=0x7f9694009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:36.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.593+0000 7f968e7fc700 1 -- 172.21.15.124:0/2415846452 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96880510b0 con 0x7f96980cb250 2023-10-06T04:45:36.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.828+0000 7f96a07ff700 1 -- 172.21.15.124:0/2415846452 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9698068e60 con 0x7f96980cb250 2023-10-06T04:45:36.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.828+0000 7f968e7fc700 1 -- 172.21.15.124:0/2415846452 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9688018020 con 0x7f96980cb250 2023-10-06T04:45:36.831 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:45:36.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 -- 172.21.15.124:0/2415846452 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f967c066f30 msgr2=0x7f967c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f967c066f30 0x7f967c0693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9694003870 tx=0x7f9694009040 comp rx=0 tx=0).stop 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 -- 172.21.15.124:0/2415846452 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96980cb250 msgr2=0x7f96980cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96980cb250 0x7f96980cc7f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f968800cb70 tx=0x7f9688001ab0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 -- 172.21.15.124:0/2415846452 shutdown_connections 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96981598e0 0x7f96980ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f967c066f30 0x7f967c0693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96980cae80 0x7f96981486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 --2- 172.21.15.124:0/2415846452 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96980cb250 0x7f96980cc7f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 -- 172.21.15.124:0/2415846452 >> 172.21.15.124:0/2415846452 conn(0x7f96980974f0 msgr2=0x7f9698069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 -- 172.21.15.124:0/2415846452 shutdown_connections 2023-10-06T04:45:36.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:36.831+0000 7f96a07ff700 1 -- 172.21.15.124:0/2415846452 wait complete. 2023-10-06T04:45:36.850 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:45:36.851 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:45:36.851 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2023-10-06T04:45:36.851 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:45:36.851 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:45:36.851 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:45:36.851 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T04:45:36.851 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:45:36.851 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:45:36.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:36.852 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2023-10-06T04:45:36.898 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f0 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:45:36.899 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f1 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42222sec preferred_lft 42222sec 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::ec4:7aff:fe8f:d5c5/64 scope link 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 4e:9e:1a:d5:9e:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:45:36.900 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:45:36.901 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::c4a5:a6ff:fe18:bdf9/64 scope link 2023-10-06T04:45:36.901 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:45:36.901 INFO:teuthology.orchestra.run.smithi124.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:45:36.901 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 4e:9e:1a:d5:9e:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:45:36.901 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::4c9e:1aff:fed5:9e13/64 scope link 2023-10-06T04:45:36.901 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:45:36.901 INFO:teuthology.orchestra.run.smithi124.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:45:36.901 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether ca:1e:a5:85:3d:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:45:36.901 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::c81e:a5ff:fe85:3d1a/64 scope link 2023-10-06T04:45:36.901 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:45:36.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:36.902 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:45:36.970 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-06T04:45:36.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:36.973 DEBUG:teuthology.orchestra.run.smithi124:> route 2023-10-06T04:45:37.023 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2023-10-06T04:45:37.023 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:45:37.023 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:45:37.023 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:45:37.024 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:45:37.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:37.024 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:45:37.024 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:45:37.024 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:45:37.024 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:45:37.025 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:45:37.025 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:45:37.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:37.194 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T04:45:37.240 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:45:37.240 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:45:37.241 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:45:37.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:37.241 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.0 up 2023-10-06T04:45:37.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:45:37.352 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:45:37.398 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:45:37.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:45:37.399 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:45:37.484 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T04:45:37.485 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:45:37.485 DEBUG:teuthology.orchestra.run.smithi124:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:45:37.624 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:45:37.624 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:45:37.650 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:45:37.650 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:45:37.650 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-06T04:45:37.650 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 0@8703c690-5fd4-410f-8b5d-95264116cbcb.cephfs=/ 2023-10-06T04:45:37.650 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.124:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-06T04:45:37.654 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:45:37.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:37.654 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:45:37.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:37.724 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent) 2023-10-06T04:45:37.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:37.779 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child) 2023-10-06T04:45:37.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:37.828 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent/child/file) 2023-10-06T04:45:37.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:37.876 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child/grandchild) 2023-10-06T04:45:37.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:37.925 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent/child/grandchild/file) 2023-10-06T04:45:37.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:37.973 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T04:45:38.027 INFO:teuthology.orchestra.run.smithi124.stdout:./ 2023-10-06T04:45:38.027 INFO:teuthology.orchestra.run.smithi124.stdout:./parent 2023-10-06T04:45:38.027 INFO:teuthology.orchestra.run.smithi124.stdout:./parent/child 2023-10-06T04:45:38.027 INFO:teuthology.orchestra.run.smithi124.stdout:./parent/child/grandchild 2023-10-06T04:45:38.027 INFO:teuthology.orchestra.run.smithi124.stdout:./parent/child/grandchild/file 2023-10-06T04:45:38.027 INFO:teuthology.orchestra.run.smithi124.stdout:./parent/child/file 2023-10-06T04:45:38.029 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:45:38.029 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:45:38.029 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:45:38.029 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:45:38.029 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T04:45:38.029 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:45:38.141 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-06T04:45:38.326 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:45:38.327 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:45:38.327 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:45:38.327 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:45:38.327 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2023-10-06T04:45:38.327 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:45:38.479 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627776 2023-10-06T04:45:38.664 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:45:38.665 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:45:38.665 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:45:38.665 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:45:38.665 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child").st_ino) 2023-10-06T04:45:38.665 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:45:38.817 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627777 2023-10-06T04:45:39.002 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:45:39.002 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:45:39.002 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:45:39.002 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:45:39.007 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child/grandchild").st_ino) 2023-10-06T04:45:39.007 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:45:39.154 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628279 2023-10-06T04:45:39.340 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:45:39.340 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:45:39.340 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:45:39.340 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:45:39.341 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child/grandchild/file").st_ino) 2023-10-06T04:45:39.341 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:45:39.492 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628280 2023-10-06T04:45:39.677 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:45:39.677 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:45:39.677 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:45:39.677 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:45:39.677 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child/file").st_ino) 2023-10-06T04:45:39.677 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:45:39.830 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627778 2023-10-06T04:45:40.015 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:40.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.244+0000 7f72241ff700 1 Processor -- start 2023-10-06T04:45:40.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.244+0000 7f72241ff700 1 -- start start 2023-10-06T04:45:40.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.245+0000 7f72241ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f721c0cb250 0x7f721c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:40.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.245+0000 7f72241ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f721c159710 0x7f721c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:40.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.245+0000 7f72241ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c0c1d10 con 0x7f721c0cae80 2023-10-06T04:45:40.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.245+0000 7f72241ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0cd430 con 0x7f721c0cb250 2023-10-06T04:45:40.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.245+0000 7f72241ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c159b70 con 0x7f721c159710 2023-10-06T04:45:40.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.246+0000 7f722179a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f721c0cb250 0x7f721c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:40.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.246+0000 7f722179a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f721c0cb250 0x7f721c1591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55118/0 (socket says 172.21.15.124:55118) 2023-10-06T04:45:40.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.246+0000 7f722179a700 1 -- 172.21.15.124:0/1665582871 learned_addr learned my addr 172.21.15.124:0/1665582871 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:40.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.246+0000 7f722279c700 1 --2- 172.21.15.124:0/1665582871 >> v2:172.21.15.158:3300/0 conn(0x7f721c159710 0x7f721c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:40.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.246+0000 7f722179a700 1 -- 172.21.15.124:0/1665582871 >> v2:172.21.15.158:3300/0 conn(0x7f721c159710 msgr2=0x7f721c0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:40.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.246+0000 7f722179a700 1 --2- 172.21.15.124:0/1665582871 >> v2:172.21.15.158:3300/0 conn(0x7f721c159710 0x7f721c0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:40.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.246+0000 7f722179a700 1 -- 172.21.15.124:0/1665582871 >> v1:172.21.15.158:6789/0 conn(0x7f721c0cae80 legacy=0x7f721c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:40.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.246+0000 7f722179a700 1 -- 172.21.15.124:0/1665582871 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0688a0 con 0x7f721c0cb250 2023-10-06T04:45:40.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.246+0000 7f722179a700 1 --2- 172.21.15.124:0/1665582871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 0x7f721c1591d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f721c0c1ca0 tx=0x7f720c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20deb3c3765d6461 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f7220f99700 1 -- 172.21.15.124:0/1665582871 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c009e70 con 0x7f721c0cb250 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f7220f99700 1 -- 172.21.15.124:0/1665582871 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c00b860 con 0x7f721c0cb250 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f7220f99700 1 -- 172.21.15.124:0/1665582871 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c00bc00 con 0x7f721c0cb250 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f72241ff700 1 -- 172.21.15.124:0/1665582871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 msgr2=0x7f721c1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f72241ff700 1 --2- 172.21.15.124:0/1665582871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 0x7f721c1591d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f721c0c1ca0 tx=0x7f720c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f72241ff700 1 -- 172.21.15.124:0/1665582871 shutdown_connections 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f72241ff700 1 --2- 172.21.15.124:0/1665582871 >> v2:172.21.15.158:3300/0 conn(0x7f721c159710 0x7f721c0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f72241ff700 1 --2- 172.21.15.124:0/1665582871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 0x7f721c1591d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f72241ff700 1 -- 172.21.15.124:0/1665582871 >> 172.21.15.124:0/1665582871 conn(0x7f721c0974f0 msgr2=0x7f721c0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f72241ff700 1 -- 172.21.15.124:0/1665582871 shutdown_connections 2023-10-06T04:45:40.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.247+0000 7f72241ff700 1 -- 172.21.15.124:0/1665582871 wait complete. 2023-10-06T04:45:40.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.249+0000 7f72241ff700 1 Processor -- start 2023-10-06T04:45:40.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.249+0000 7f72241ff700 1 -- start start 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f72241ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f721c0cae80 0x7f721c158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f72241ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 0x7f721c16c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f72241ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f721c159710 0x7f721c0c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f72241ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c16d850 con 0x7f721c0cb250 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f72241ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c16d290 con 0x7f721c159710 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f72241ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c16d570 con 0x7f721c0cae80 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f722179a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 0x7f721c16c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f722179a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 0x7f721c16c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55130/0 (socket says 172.21.15.124:55130) 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f722179a700 1 -- 172.21.15.124:0/2424247361 learned_addr learned my addr 172.21.15.124:0/2424247361 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f722279c700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f721c159710 0x7f721c0c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:40.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f7221f9b700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f721c0cae80 0x7f721c158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f722179a700 1 -- 172.21.15.124:0/2424247361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f721c0cae80 msgr2=0x7f721c158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f722179a700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f721c0cae80 0x7f721c158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f722179a700 1 -- 172.21.15.124:0/2424247361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f721c159710 msgr2=0x7f721c0c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f722179a700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f721c159710 0x7f721c0c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f722179a700 1 -- 172.21.15.124:0/2424247361 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c0094f0 con 0x7f721c0cb250 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.250+0000 7f7221f9b700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f721c0cae80 0x7f721c158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.251+0000 7f722179a700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 0x7f721c16c920 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f721c0641d0 tx=0x7f720c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.251+0000 7f7211ffb700 1 -- 172.21.15.124:0/2424247361 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c011420 con 0x7f721c0cb250 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.251+0000 7f7211ffb700 1 -- 172.21.15.124:0/2424247361 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c011580 con 0x7f721c0cb250 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.251+0000 7f72241ff700 1 -- 172.21.15.124:0/2424247361 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c15bb20 con 0x7f721c0cb250 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.251+0000 7f7211ffb700 1 -- 172.21.15.124:0/2424247361 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c011940 con 0x7f721c0cb250 2023-10-06T04:45:40.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.251+0000 7f72241ff700 1 -- 172.21.15.124:0/2424247361 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c0c52a0 con 0x7f721c0cb250 2023-10-06T04:45:40.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.252+0000 7f72241ff700 1 -- 172.21.15.124:0/2424247361 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c0717a0 con 0x7f721c0cb250 2023-10-06T04:45:40.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.253+0000 7f7211ffb700 1 -- 172.21.15.124:0/2424247361 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f720c02c3b0 con 0x7f721c0cb250 2023-10-06T04:45:40.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.254+0000 7f7211ffb700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7200066f30 0x7f72000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:40.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.254+0000 7f7211ffb700 1 -- 172.21.15.124:0/2424247361 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f720c085de0 con 0x7f721c0cb250 2023-10-06T04:45:40.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.254+0000 7f7221f9b700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7200066f30 0x7f72000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:40.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.255+0000 7f7221f9b700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7200066f30 0x7f72000693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7218001840 tx=0x7f7218009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:40.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.259+0000 7f7211ffb700 1 -- 172.21.15.124:0/2424247361 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f720c052e50 con 0x7f721c0cb250 2023-10-06T04:45:40.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.490+0000 7f72241ff700 1 -- 172.21.15.124:0/2424247361 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f721c068b80 con 0x7f721c0cb250 2023-10-06T04:45:40.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.491+0000 7f7211ffb700 1 -- 172.21.15.124:0/2424247361 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f720c015090 con 0x7f721c0cb250 2023-10-06T04:45:40.493 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:40.494 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/518958812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":518958812},{"type":"v1","addr":"172.21.15.158:6834","nonce":518958812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/120181660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":120181660},{"type":"v1","addr":"172.21.15.158:6835","nonce":120181660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1421870244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1421870244},{"type":"v1","addr":"172.21.15.124:6836","nonce":1421870244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:24.506230+0000","modified":"2023-10-06T04:45:28.049891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.124:6837/1031472040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1031472040},{"type":"v1","addr":"172.21.15.124:6837","nonce":1031472040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:45:40.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 -- 172.21.15.124:0/2424247361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7200066f30 msgr2=0x7f72000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:40.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7200066f30 0x7f72000693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7218001840 tx=0x7f7218009040 comp rx=0 tx=0).stop 2023-10-06T04:45:40.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 -- 172.21.15.124:0/2424247361 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 msgr2=0x7f721c16c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:40.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 0x7f721c16c920 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f721c0641d0 tx=0x7f720c017000 comp rx=0 tx=0).stop 2023-10-06T04:45:40.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 -- 172.21.15.124:0/2424247361 shutdown_connections 2023-10-06T04:45:40.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f721c159710 0x7f721c0c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:40.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7200066f30 0x7f72000693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:40.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f721c0cae80 0x7f721c158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:40.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 --2- 172.21.15.124:0/2424247361 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f721c0cb250 0x7f721c16c920 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:40.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 -- 172.21.15.124:0/2424247361 >> 172.21.15.124:0/2424247361 conn(0x7f721c0974f0 msgr2=0x7f721c0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:40.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 -- 172.21.15.124:0/2424247361 shutdown_connections 2023-10-06T04:45:40.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:40.493+0000 7f72241ff700 1 -- 172.21.15.124:0/2424247361 wait complete. 2023-10-06T04:45:40.497 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2023-10-06T04:45:40.514 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump tree /parent/child 1 2023-10-06T04:45:40.723 INFO:teuthology.orchestra.run.smithi124.stdout:[{"ino":1099511628279,"rdev":0,"ctime":"2023-10-06T04:45:37.968891+0000","btime":"2023-10-06T04:45:37.920892+0000","mode":16893,"uid":1000,"gid":1285,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2023-10-06T04:45:37.968891+0000","atime":"2023-10-06T04:45:37.920892+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2023-10-06T04:45:37.968891+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2023-10-06T04:45:37.968891+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2023-10-06T04:45:37.968891+0000"},"version":6,"file_data_version":0,"xattr_version":1,"backtrace_version":4,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:cephfs_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"waiter":0,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5205,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":6}],"loner":5205,"want_loner":5205,"mds_caps_wanted":[],"dirfrags":[{"path":"/parent/child/grandchild","dirfrag":"0x100000001f7","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"parent/child/grandchild/file","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511628280,"remote_type":"","version":2,"projected_version":2,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}]},{"ino":1099511627778,"rdev":0,"ctime":"2023-10-06T04:45:37.871892+0000","btime":"2023-10-06T04:45:37.871892+0000","mode":33204,"uid":1000,"gid":1285,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":6,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2023-10-06T04:45:37.871892+0000","atime":"2023-10-06T04:45:37.871892+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[{"client":5205,"byte range":{"first":0,"last":4194304},"follows":1}],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:cephfs_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"caps":1,"dirtyparent":1,"dirty":1},"nref":3,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5205,"pending":"pAsxLsXsxFsxcrwb","issued":"pAsxLsXsxFsxcrwb","wanted":"pAsxXsxFxwb","last_sent":3}],"loner":5205,"want_loner":5205,"mds_caps_wanted":[],"dirfrags":[]},{"ino":1099511627777,"rdev":0,"ctime":"2023-10-06T04:45:37.920892+0000","btime":"2023-10-06T04:45:37.823893+0000","mode":16893,"uid":1000,"gid":1285,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2023-10-06T04:45:37.920892+0000","atime":"2023-10-06T04:45:37.823893+0000","time_warp_seq":0,"change_attr":2,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2023-10-06T04:45:37.920892+0000","num_files":1,"num_subdirs":1,"change_attr":2},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":2,"rsnaps":0,"rctime":"2023-10-06T04:45:37.920892+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":2,"rsnaps":0,"rctime":"2023-10-06T04:45:37.920892+0000"},"version":6,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:cephfs_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirtyscattered":1,"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"waiter":0,"authpin":0},"nref":5,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5205,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":7}],"loner":5205,"want_loner":5205,"mds_caps_wanted":[],"dirfrags":[{"path":"/parent/child","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"7","version":"7","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"parent/child/grandchild","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511628279,"remote_type":"","version":6,"projected_version":6,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"parent/child/file","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511627778,"remote_type":"","version":2,"projected_version":2,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}]}] 2023-10-06T04:45:40.725 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "2023-10-06T04:45:37.968891+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2023-10-06T04:45:37.920892+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 4, "btime": "2023-10-06T04:45:37.920892+0000", "change_attr": 1, "client_caps": [ { "client_id": 5205, "issued": "pAsLsXsFsx", "last_sent": 6, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2023-10-06T04:45:37.968891+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511628280, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "parent/child/grandchild/file", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 2, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000001f7", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/parent/child/grandchild", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2023-10-06T04:45:37.968891+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 1285, "ino": 1099511628279, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 5205, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2023-10-06T04:45:37.968891+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0, "waiter": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2023-10-06T04:45:37.968891+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 6, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 5205, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:cephfs_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2023-10-06T04:45:37.871892+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2023-10-06T04:45:37.871892+0000", "change_attr": 0, "client_caps": [ { "client_id": 5205, "issued": "pAsxLsXsxFsxcrwb", "last_sent": 3, "pending": "pAsxLsXsxFsxcrwb", "wanted": "pAsxXsxFxwb" } ], "client_ranges": [ { "byte range": { "first": 0, "last": 4194304 }, "client": 5205, "follows": 1 } ], "ctime": "2023-10-06T04:45:37.871892+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 1285, "ino": 1099511627778, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 6, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 5205, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33204, "mtime": "2023-10-06T04:45:37.871892+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "caps": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 5205, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:cephfs_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 0, "rctime": "2023-10-06T04:45:37.920892+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "atime": "2023-10-06T04:45:37.823893+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2023-10-06T04:45:37.823893+0000", "change_attr": 2, "client_caps": [ { "client_id": 5205, "issued": "pAsLsXsFsx", "last_sent": 7, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2023-10-06T04:45:37.920892+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511628279, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "parent/child/grandchild", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 6, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 6, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511627778, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "parent/child/file", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 2, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/parent/child", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 2, "mtime": "2023-10-06T04:45:37.920892+0000", "num_files": 1, "num_subdirs": 1, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 1285, "ino": 1099511627777, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 5205, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2023-10-06T04:45:37.920892+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 5, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "dirtyscattered": 1, "lock": 0, "request": 0, "waiter": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2023-10-06T04:45:37.920892+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 6, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 5205, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:cephfs_t:s0\u0000" } ] } ] 2023-10-06T04:45:40.726 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:45:40.726 DEBUG:teuthology.orchestra.run.smithi124:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:45:40.827 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:45:40.941 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:45:40.942 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:45:40.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:45:40.942 DEBUG:teuthology.orchestra.run.smithi124:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T04:45:41.044 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:45:41.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:45:41.044 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:45:41.102 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:41.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.290+0000 7efd8f9ff700 1 Processor -- start 2023-10-06T04:45:41.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.290+0000 7efd8f9ff700 1 -- start start 2023-10-06T04:45:41.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.291+0000 7efd8f9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880ac3d0 0x7efd880aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.291+0000 7efd8f9ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efd880af350 0x7efd8806a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.291+0000 7efd8f9ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd88069cb0 con 0x7efd880b1a70 2023-10-06T04:45:41.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.291+0000 7efd8f9ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd88156110 con 0x7efd880af350 2023-10-06T04:45:41.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.291+0000 7efd8f9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8806eaa0 con 0x7efd880ac3d0 2023-10-06T04:45:41.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.291+0000 7efd8df9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7efd880b1a70 0x7efd880add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53090/0 (socket says 172.21.15.124:53090) 2023-10-06T04:45:41.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.291+0000 7efd8df9c700 1 -- 172.21.15.124:0/3378141880 learned_addr learned my addr 172.21.15.124:0/3378141880 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:41.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.291+0000 7efd8d79b700 1 --2- 172.21.15.124:0/3378141880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880ac3d0 0x7efd880aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.291+0000 7efd8cf9a700 1 --2- 172.21.15.124:0/3378141880 >> v2:172.21.15.158:3300/0 conn(0x7efd880af350 0x7efd8806a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.292+0000 7efd7ffff700 1 -- 172.21.15.124:0/3378141880 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576404085 0 0) 0x7efd88069cb0 con 0x7efd880b1a70 2023-10-06T04:45:41.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.292+0000 7efd7ffff700 1 -- 172.21.15.124:0/3378141880 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd74003570 con 0x7efd880b1a70 2023-10-06T04:45:41.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.292+0000 7efd8d79b700 1 -- 172.21.15.124:0/3378141880 >> v2:172.21.15.158:3300/0 conn(0x7efd880af350 msgr2=0x7efd8806a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:41.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.292+0000 7efd8d79b700 1 --2- 172.21.15.124:0/3378141880 >> v2:172.21.15.158:3300/0 conn(0x7efd880af350 0x7efd8806a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.292+0000 7efd8d79b700 1 -- 172.21.15.124:0/3378141880 >> v1:172.21.15.124:6789/0 conn(0x7efd880b1a70 legacy=0x7efd880add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.292+0000 7efd8d79b700 1 -- 172.21.15.124:0/3378141880 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8806ed80 con 0x7efd880ac3d0 2023-10-06T04:45:41.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.292+0000 7efd8cf9a700 1 --2- 172.21.15.124:0/3378141880 >> v2:172.21.15.158:3300/0 conn(0x7efd880af350 0x7efd8806a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:41.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.292+0000 7efd8d79b700 1 --2- 172.21.15.124:0/3378141880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880ac3d0 0x7efd880aee10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd8400aa90 tx=0x7efd8400a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da2a41d0b005225 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:41.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd7ffff700 1 -- 172.21.15.124:0/3378141880 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400ca00 con 0x7efd880ac3d0 2023-10-06T04:45:41.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd7ffff700 1 -- 172.21.15.124:0/3378141880 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8400cb60 con 0x7efd880ac3d0 2023-10-06T04:45:41.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd7ffff700 1 -- 172.21.15.124:0/3378141880 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84018400 con 0x7efd880ac3d0 2023-10-06T04:45:41.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd8f9ff700 1 -- 172.21.15.124:0/3378141880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880ac3d0 msgr2=0x7efd880aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd8f9ff700 1 --2- 172.21.15.124:0/3378141880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880ac3d0 0x7efd880aee10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd8400aa90 tx=0x7efd8400a330 comp rx=0 tx=0).stop 2023-10-06T04:45:41.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd8f9ff700 1 -- 172.21.15.124:0/3378141880 shutdown_connections 2023-10-06T04:45:41.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd8f9ff700 1 --2- 172.21.15.124:0/3378141880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880ac3d0 0x7efd880aee10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd8f9ff700 1 --2- 172.21.15.124:0/3378141880 >> v2:172.21.15.158:3300/0 conn(0x7efd880af350 0x7efd8806a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd8f9ff700 1 -- 172.21.15.124:0/3378141880 >> 172.21.15.124:0/3378141880 conn(0x7efd880cc050 msgr2=0x7efd880cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:41.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd8f9ff700 1 -- 172.21.15.124:0/3378141880 shutdown_connections 2023-10-06T04:45:41.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.293+0000 7efd8f9ff700 1 -- 172.21.15.124:0/3378141880 wait complete. 2023-10-06T04:45:41.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.295+0000 7efd8f9ff700 1 Processor -- start 2023-10-06T04:45:41.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.295+0000 7efd8f9ff700 1 -- start start 2023-10-06T04:45:41.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8f9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd880ac3d0 0x7efd880ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8f9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880af350 0x7efd880c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8f9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd880b1a70 0x7efd880c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8f9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8816a460 con 0x7efd880b1a70 2023-10-06T04:45:41.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8f9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd88156300 con 0x7efd880ac3d0 2023-10-06T04:45:41.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8f9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd881565e0 con 0x7efd880af350 2023-10-06T04:45:41.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8df9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd880b1a70 0x7efd880c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8df9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd880b1a70 0x7efd880c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55142/0 (socket says 172.21.15.124:55142) 2023-10-06T04:45:41.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8df9c700 1 -- 172.21.15.124:0/2939256617 learned_addr learned my addr 172.21.15.124:0/2939256617 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8d79b700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd880ac3d0 0x7efd880ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8cf9a700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880af350 0x7efd880c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8df9c700 1 -- 172.21.15.124:0/2939256617 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880af350 msgr2=0x7efd880c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8df9c700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880af350 0x7efd880c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8df9c700 1 -- 172.21.15.124:0/2939256617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd880ac3d0 msgr2=0x7efd880ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8df9c700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd880ac3d0 0x7efd880ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8df9c700 1 -- 172.21.15.124:0/2939256617 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78009420 con 0x7efd880b1a70 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8d79b700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd880ac3d0 0x7efd880ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.296+0000 7efd8cf9a700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880af350 0x7efd880c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.297+0000 7efd8df9c700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd880b1a70 0x7efd880c6770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efd80001460 tx=0x7efd80001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.297+0000 7efd7d7fa700 1 -- 172.21.15.124:0/2939256617 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8000a950 con 0x7efd880b1a70 2023-10-06T04:45:41.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.297+0000 7efd7d7fa700 1 -- 172.21.15.124:0/2939256617 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8000aab0 con 0x7efd880b1a70 2023-10-06T04:45:41.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.297+0000 7efd7d7fa700 1 -- 172.21.15.124:0/2939256617 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8000ae30 con 0x7efd880b1a70 2023-10-06T04:45:41.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.297+0000 7efd8f9ff700 1 -- 172.21.15.124:0/2939256617 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8400a5d0 con 0x7efd880b1a70 2023-10-06T04:45:41.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.297+0000 7efd8f9ff700 1 -- 172.21.15.124:0/2939256617 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd88156c20 con 0x7efd880b1a70 2023-10-06T04:45:41.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.298+0000 7efd8f9ff700 1 -- 172.21.15.124:0/2939256617 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd880717a0 con 0x7efd880b1a70 2023-10-06T04:45:41.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.299+0000 7efd7d7fa700 1 -- 172.21.15.124:0/2939256617 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd80007300 con 0x7efd880b1a70 2023-10-06T04:45:41.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.300+0000 7efd7d7fa700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd6c066f30 0x7efd6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.300+0000 7efd7d7fa700 1 -- 172.21.15.124:0/2939256617 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efd80084b40 con 0x7efd880b1a70 2023-10-06T04:45:41.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.300+0000 7efd8d79b700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd6c066f30 0x7efd6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.300+0000 7efd8d79b700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd6c066f30 0x7efd6c0693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd84006d60 tx=0x7efd8401a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:41.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.304+0000 7efd7d7fa700 1 -- 172.21.15.124:0/2939256617 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd80051c30 con 0x7efd880b1a70 2023-10-06T04:45:41.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.535+0000 7efd8f9ff700 1 -- 172.21.15.124:0/2939256617 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd8806b5a0 con 0x7efd880b1a70 2023-10-06T04:45:41.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.535+0000 7efd7d7fa700 1 -- 172.21.15.124:0/2939256617 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7efd80055250 con 0x7efd880b1a70 2023-10-06T04:45:41.538 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:41.538 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/518958812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":518958812},{"type":"v1","addr":"172.21.15.158:6834","nonce":518958812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/120181660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":120181660},{"type":"v1","addr":"172.21.15.158:6835","nonce":120181660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1421870244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1421870244},{"type":"v1","addr":"172.21.15.124:6836","nonce":1421870244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:24.506230+0000","modified":"2023-10-06T04:45:28.049891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.124:6837/1031472040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1031472040},{"type":"v1","addr":"172.21.15.124:6837","nonce":1031472040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:45:41.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 -- 172.21.15.124:0/2939256617 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd6c066f30 msgr2=0x7efd6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd6c066f30 0x7efd6c0693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd84006d60 tx=0x7efd8401a000 comp rx=0 tx=0).stop 2023-10-06T04:45:41.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 -- 172.21.15.124:0/2939256617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd880b1a70 msgr2=0x7efd880c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd880b1a70 0x7efd880c6770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efd80001460 tx=0x7efd80001a40 comp rx=0 tx=0).stop 2023-10-06T04:45:41.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 -- 172.21.15.124:0/2939256617 shutdown_connections 2023-10-06T04:45:41.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd880b1a70 0x7efd880c6770 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd880ac3d0 0x7efd880ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7efd6c066f30 0x7efd6c0693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 --2- 172.21.15.124:0/2939256617 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd880af350 0x7efd880c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 -- 172.21.15.124:0/2939256617 >> 172.21.15.124:0/2939256617 conn(0x7efd880cc050 msgr2=0x7efd880cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:41.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 -- 172.21.15.124:0/2939256617 shutdown_connections 2023-10-06T04:45:41.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.538+0000 7efd8f9ff700 1 -- 172.21.15.124:0/2939256617 wait complete. 2023-10-06T04:45:41.542 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2023-10-06T04:45:41.558 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:41.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.745+0000 7f91ecfff700 1 Processor -- start 2023-10-06T04:45:41.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.745+0000 7f91ecfff700 1 -- start start 2023-10-06T04:45:41.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.746+0000 7f91ecfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f91e80cdfe0 0x7f91e80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.746+0000 7f91ecfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91e80ccf80 0x7f91e80cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.746+0000 7f91ecfff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e80cf6b0 con 0x7f91e80ccbb0 2023-10-06T04:45:41.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.746+0000 7f91ecfff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80d0250 con 0x7f91e80cdfe0 2023-10-06T04:45:41.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.746+0000 7f91ecfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80ceaa0 con 0x7f91e80ccf80 2023-10-06T04:45:41.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.746+0000 7f91e5d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f91e80cdfe0 0x7f91e80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.747+0000 7f91e5d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f91e80cdfe0 0x7f91e80ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55152/0 (socket says 172.21.15.124:55152) 2023-10-06T04:45:41.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.747+0000 7f91e5d9b700 1 -- 172.21.15.124:0/857723556 learned_addr learned my addr 172.21.15.124:0/857723556 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:41.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.747+0000 7f91e6d9d700 1 --2- 172.21.15.124:0/857723556 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91e80ccf80 0x7f91e80cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.747+0000 7f91e5d9b700 1 -- 172.21.15.124:0/857723556 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91e80ccf80 msgr2=0x7f91e80cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:41.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.747+0000 7f91e5d9b700 1 --2- 172.21.15.124:0/857723556 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91e80ccf80 0x7f91e80cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.747+0000 7f91e5d9b700 1 -- 172.21.15.124:0/857723556 >> v1:172.21.15.124:6789/0 conn(0x7f91e80ccbb0 legacy=0x7f91e80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.747+0000 7f91e5d9b700 1 -- 172.21.15.124:0/857723556 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80ced80 con 0x7f91e80cdfe0 2023-10-06T04:45:41.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.747+0000 7f91e5d9b700 1 --2- 172.21.15.124:0/857723556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80cdfe0 0x7f91e80ce450 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0099b0 tx=0x7f91dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676b7004df626120 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:41.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.747+0000 7f91e559a700 1 -- 172.21.15.124:0/857723556 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc009ea0 con 0x7f91e80cdfe0 2023-10-06T04:45:41.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.748+0000 7f91e559a700 1 -- 172.21.15.124:0/857723556 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc00b860 con 0x7f91e80cdfe0 2023-10-06T04:45:41.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.748+0000 7f91e559a700 1 -- 172.21.15.124:0/857723556 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00bc00 con 0x7f91e80cdfe0 2023-10-06T04:45:41.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.748+0000 7f91ecfff700 1 -- 172.21.15.124:0/857723556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80cdfe0 msgr2=0x7f91e80ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.748+0000 7f91ecfff700 1 --2- 172.21.15.124:0/857723556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80cdfe0 0x7f91e80ce450 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0099b0 tx=0x7f91dc009250 comp rx=0 tx=0).stop 2023-10-06T04:45:41.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.748+0000 7f91ecfff700 1 -- 172.21.15.124:0/857723556 shutdown_connections 2023-10-06T04:45:41.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.748+0000 7f91ecfff700 1 --2- 172.21.15.124:0/857723556 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91e80ccf80 0x7f91e80cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.748+0000 7f91ecfff700 1 --2- 172.21.15.124:0/857723556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80cdfe0 0x7f91e80ce450 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.748+0000 7f91ecfff700 1 -- 172.21.15.124:0/857723556 >> 172.21.15.124:0/857723556 conn(0x7f91e8099710 msgr2=0x7f91e806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:41.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.748+0000 7f91ecfff700 1 -- 172.21.15.124:0/857723556 shutdown_connections 2023-10-06T04:45:41.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.748+0000 7f91ecfff700 1 -- 172.21.15.124:0/857723556 wait complete. 2023-10-06T04:45:41.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.750+0000 7f91ecfff700 1 Processor -- start 2023-10-06T04:45:41.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.750+0000 7f91ecfff700 1 -- start start 2023-10-06T04:45:41.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.750+0000 7f91ecfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80ccbb0 0x7f91e816a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91ecfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91e80ccf80 0x7f91e80b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91ecfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91e80cdfe0 0x7f91e809b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91ecfff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e809bfa0 con 0x7f91e80ccbb0 2023-10-06T04:45:41.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91ecfff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80cade0 con 0x7f91e80ccf80 2023-10-06T04:45:41.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91ecfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e809c430 con 0x7f91e80cdfe0 2023-10-06T04:45:41.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e659c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80ccbb0 0x7f91e816a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e659c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80ccbb0 0x7f91e816a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55154/0 (socket says 172.21.15.124:55154) 2023-10-06T04:45:41.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e659c700 1 -- 172.21.15.124:0/849793911 learned_addr learned my addr 172.21.15.124:0/849793911 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:41.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e5d9b700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91e80ccf80 0x7f91e80b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e6d9d700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91e80cdfe0 0x7f91e809b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e659c700 1 -- 172.21.15.124:0/849793911 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91e80cdfe0 msgr2=0x7f91e809b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e659c700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91e80cdfe0 0x7f91e809b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e659c700 1 -- 172.21.15.124:0/849793911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91e80ccf80 msgr2=0x7f91e80b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e659c700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91e80ccf80 0x7f91e80b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e659c700 1 -- 172.21.15.124:0/849793911 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0094f0 con 0x7f91e80ccbb0 2023-10-06T04:45:41.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e5d9b700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91e80ccf80 0x7f91e80b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:41.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.751+0000 7f91e659c700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80ccbb0 0x7f91e816a3b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c5c0 tx=0x7f91d800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:41.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.752+0000 7f91d67fc700 1 -- 172.21.15.124:0/849793911 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8011590 con 0x7f91e80ccbb0 2023-10-06T04:45:41.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.752+0000 7f91d67fc700 1 -- 172.21.15.124:0/849793911 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d8011710 con 0x7f91e80ccbb0 2023-10-06T04:45:41.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.752+0000 7f91d67fc700 1 -- 172.21.15.124:0/849793911 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8011ad0 con 0x7f91e80ccbb0 2023-10-06T04:45:41.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.752+0000 7f91ecfff700 1 -- 172.21.15.124:0/849793911 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e809ccd0 con 0x7f91e80ccbb0 2023-10-06T04:45:41.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.752+0000 7f91ecfff700 1 -- 172.21.15.124:0/849793911 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e809c680 con 0x7f91e80ccbb0 2023-10-06T04:45:41.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.753+0000 7f91ecfff700 1 -- 172.21.15.124:0/849793911 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e816a8f0 con 0x7f91e80ccbb0 2023-10-06T04:45:41.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.754+0000 7f91d67fc700 1 -- 172.21.15.124:0/849793911 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91d801b3b0 con 0x7f91e80ccbb0 2023-10-06T04:45:41.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.755+0000 7f91d67fc700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f91c8066f30 0x7f91c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:41.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.755+0000 7f91d67fc700 1 -- 172.21.15.124:0/849793911 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f91d8083c70 con 0x7f91e80ccbb0 2023-10-06T04:45:41.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.755+0000 7f91e5d9b700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f91c8066f30 0x7f91c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:41.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.756+0000 7f91e5d9b700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f91c8066f30 0x7f91c80693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0099b0 tx=0x7f91dc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:41.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.759+0000 7f91d67fc700 1 -- 172.21.15.124:0/849793911 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91d8050d80 con 0x7f91e80ccbb0 2023-10-06T04:45:41.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.954+0000 7f91ecfff700 1 -- 172.21.15.124:0/849793911 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91e80717a0 con 0x7f91e80ccbb0 2023-10-06T04:45:41.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.955+0000 7f91d67fc700 1 -- 172.21.15.124:0/849793911 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f91d8017020 con 0x7f91e80ccbb0 2023-10-06T04:45:41.958 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:41.958 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":33,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:45:26.035018+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:22.109975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:23.489027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:41.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 -- 172.21.15.124:0/849793911 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f91c8066f30 msgr2=0x7f91c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f91c8066f30 0x7f91c80693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0099b0 tx=0x7f91dc017000 comp rx=0 tx=0).stop 2023-10-06T04:45:41.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 -- 172.21.15.124:0/849793911 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80ccbb0 msgr2=0x7f91e816a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80ccbb0 0x7f91e816a3b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c5c0 tx=0x7f91d800c980 comp rx=0 tx=0).stop 2023-10-06T04:45:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 -- 172.21.15.124:0/849793911 shutdown_connections 2023-10-06T04:45:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f91c8066f30 0x7f91c80693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91e80cdfe0 0x7f91e809b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91e80ccbb0 0x7f91e816a3b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 --2- 172.21.15.124:0/849793911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91e80ccf80 0x7f91e80b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 -- 172.21.15.124:0/849793911 >> 172.21.15.124:0/849793911 conn(0x7f91e8099710 msgr2=0x7f91e80cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 -- 172.21.15.124:0/849793911 shutdown_connections 2023-10-06T04:45:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:41.958+0000 7f91ecfff700 1 -- 172.21.15.124:0/849793911 wait complete. 2023-10-06T04:45:41.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:45:22.109975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:45:23.489027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:45:41.978 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:45:42.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.170+0000 7f7d7ddff700 1 Processor -- start 2023-10-06T04:45:42.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.170+0000 7f7d7ddff700 1 -- start start 2023-10-06T04:45:42.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d7ddff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7d780ce860 0x7f7d781571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d7ddff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7d780cb780 0x7f7d78159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d7ddff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d780cb2f0 con 0x7f7d78156de0 2023-10-06T04:45:42.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d7ddff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7815a8b0 con 0x7f7d780ce860 2023-10-06T04:45:42.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d7ddff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d780caca0 con 0x7f7d780cb780 2023-10-06T04:45:42.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d76ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7d780ce860 0x7f7d781571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d76ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7d780ce860 0x7f7d781571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55158/0 (socket says 172.21.15.124:55158) 2023-10-06T04:45:42.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d76ffd700 1 -- 172.21.15.124:0/3933937312 learned_addr learned my addr 172.21.15.124:0/3933937312 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:42.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d77fff700 1 --2- 172.21.15.124:0/3933937312 >> v2:172.21.15.158:3300/0 conn(0x7f7d780cb780 0x7f7d78159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d76ffd700 1 -- 172.21.15.124:0/3933937312 >> v2:172.21.15.158:3300/0 conn(0x7f7d780cb780 msgr2=0x7f7d78159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:42.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d76ffd700 1 --2- 172.21.15.124:0/3933937312 >> v2:172.21.15.158:3300/0 conn(0x7f7d780cb780 0x7f7d78159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d76ffd700 1 -- 172.21.15.124:0/3933937312 >> v1:172.21.15.158:6789/0 conn(0x7f7d78156de0 legacy=0x7f7d780ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:42.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d76ffd700 1 -- 172.21.15.124:0/3933937312 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780caf80 con 0x7f7d780ce860 2023-10-06T04:45:42.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.172+0000 7f7d77fff700 1 --2- 172.21.15.124:0/3933937312 >> v2:172.21.15.158:3300/0 conn(0x7f7d780cb780 0x7f7d78159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:42.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.173+0000 7f7d76ffd700 1 --2- 172.21.15.124:0/3933937312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d780ce860 0x7f7d781571b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7d7806f350 tx=0x7f7d6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6bcc3f74b0fd7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:42.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.173+0000 7f7d767fc700 1 -- 172.21.15.124:0/3933937312 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00b820 con 0x7f7d780ce860 2023-10-06T04:45:42.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.173+0000 7f7d767fc700 1 -- 172.21.15.124:0/3933937312 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c00b980 con 0x7f7d780ce860 2023-10-06T04:45:42.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.173+0000 7f7d767fc700 1 -- 172.21.15.124:0/3933937312 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00bd20 con 0x7f7d780ce860 2023-10-06T04:45:42.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.173+0000 7f7d7ddff700 1 -- 172.21.15.124:0/3933937312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d780ce860 msgr2=0x7f7d781571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.173+0000 7f7d7ddff700 1 --2- 172.21.15.124:0/3933937312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d780ce860 0x7f7d781571b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7d7806f350 tx=0x7f7d6c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:42.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.174+0000 7f7d7ddff700 1 -- 172.21.15.124:0/3933937312 shutdown_connections 2023-10-06T04:45:42.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.174+0000 7f7d7ddff700 1 --2- 172.21.15.124:0/3933937312 >> v2:172.21.15.158:3300/0 conn(0x7f7d780cb780 0x7f7d78159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.174+0000 7f7d7ddff700 1 --2- 172.21.15.124:0/3933937312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d780ce860 0x7f7d781571b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.174+0000 7f7d7ddff700 1 -- 172.21.15.124:0/3933937312 >> 172.21.15.124:0/3933937312 conn(0x7f7d780675f0 msgr2=0x7f7d780679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:42.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.174+0000 7f7d7ddff700 1 -- 172.21.15.124:0/3933937312 shutdown_connections 2023-10-06T04:45:42.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.174+0000 7f7d7ddff700 1 -- 172.21.15.124:0/3933937312 wait complete. 2023-10-06T04:45:42.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.175+0000 7f7d7ddff700 1 Processor -- start 2023-10-06T04:45:42.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.175+0000 7f7d7ddff700 1 -- start start 2023-10-06T04:45:42.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.176+0000 7f7d7ddff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d780cb780 0x7f7d780b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.176+0000 7f7d7ddff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d780ce860 0x7f7d780c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.176+0000 7f7d7ddff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d78156de0 0x7f7d780c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.176+0000 7f7d7ddff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780c8450 con 0x7f7d78156de0 2023-10-06T04:45:42.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.176+0000 7f7d7ddff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78154870 con 0x7f7d780cb780 2023-10-06T04:45:42.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.176+0000 7f7d7ddff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7816a650 con 0x7f7d780ce860 2023-10-06T04:45:42.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.176+0000 7f7d77fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d78156de0 0x7f7d780c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.176+0000 7f7d77fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d78156de0 0x7f7d780c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55162/0 (socket says 172.21.15.124:55162) 2023-10-06T04:45:42.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.176+0000 7f7d77fff700 1 -- 172.21.15.124:0/2161346116 learned_addr learned my addr 172.21.15.124:0/2161346116 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:42.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d777fe700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d780cb780 0x7f7d780b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d76ffd700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d780ce860 0x7f7d780c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d77fff700 1 -- 172.21.15.124:0/2161346116 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d780ce860 msgr2=0x7f7d780c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d77fff700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d780ce860 0x7f7d780c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d77fff700 1 -- 172.21.15.124:0/2161346116 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d780cb780 msgr2=0x7f7d780b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d77fff700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d780cb780 0x7f7d780b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d77fff700 1 -- 172.21.15.124:0/2161346116 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c0094f0 con 0x7f7d78156de0 2023-10-06T04:45:42.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d777fe700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d780cb780 0x7f7d780b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:42.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d77fff700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d78156de0 0x7f7d780c7dd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000a380 tx=0x7f7d70007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:42.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d5f7fe700 1 -- 172.21.15.124:0/2161346116 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7000ae10 con 0x7f7d78156de0 2023-10-06T04:45:42.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d5f7fe700 1 -- 172.21.15.124:0/2161346116 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7000d650 con 0x7f7d78156de0 2023-10-06T04:45:42.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d5f7fe700 1 -- 172.21.15.124:0/2161346116 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7000da10 con 0x7f7d78156de0 2023-10-06T04:45:42.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.177+0000 7f7d7ddff700 1 -- 172.21.15.124:0/2161346116 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d78169b00 con 0x7f7d78156de0 2023-10-06T04:45:42.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.178+0000 7f7d7ddff700 1 -- 172.21.15.124:0/2161346116 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d780b3ec0 con 0x7f7d78156de0 2023-10-06T04:45:42.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.178+0000 7f7d7ddff700 1 -- 172.21.15.124:0/2161346116 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7816a7c0 con 0x7f7d78156de0 2023-10-06T04:45:42.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.179+0000 7f7d5f7fe700 1 -- 172.21.15.124:0/2161346116 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d7001e3b0 con 0x7f7d78156de0 2023-10-06T04:45:42.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.180+0000 7f7d5f7fe700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7d64066f30 0x7f7d640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.180+0000 7f7d5f7fe700 1 -- 172.21.15.124:0/2161346116 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d70085120 con 0x7f7d78156de0 2023-10-06T04:45:42.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.180+0000 7f7d777fe700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7d64066f30 0x7f7d640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.181+0000 7f7d777fe700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7d64066f30 0x7f7d640693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7d78069c90 tx=0x7f7d68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:42.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.184+0000 7f7d5f7fe700 1 -- 172.21.15.124:0/2161346116 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d70052190 con 0x7f7d78156de0 2023-10-06T04:45:42.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.375+0000 7f7d7ddff700 1 -- 172.21.15.124:0/2161346116 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7d7804c380 con 0x7f7d78156de0 2023-10-06T04:45:42.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.376+0000 7f7d5f7fe700 1 -- 172.21.15.124:0/2161346116 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7d7001a020 con 0x7f7d78156de0 2023-10-06T04:45:42.378 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:45:42.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 -- 172.21.15.124:0/2161346116 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7d64066f30 msgr2=0x7f7d640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7d64066f30 0x7f7d640693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7d78069c90 tx=0x7f7d68008040 comp rx=0 tx=0).stop 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 -- 172.21.15.124:0/2161346116 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d78156de0 msgr2=0x7f7d780c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d78156de0 0x7f7d780c7dd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000a380 tx=0x7f7d70007900 comp rx=0 tx=0).stop 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 -- 172.21.15.124:0/2161346116 shutdown_connections 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7d78156de0 0x7f7d780c7dd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d780cb780 0x7f7d780b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7d64066f30 0x7f7d640693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 --2- 172.21.15.124:0/2161346116 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d780ce860 0x7f7d780c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 -- 172.21.15.124:0/2161346116 >> 172.21.15.124:0/2161346116 conn(0x7f7d780675f0 msgr2=0x7f7d780c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 -- 172.21.15.124:0/2161346116 shutdown_connections 2023-10-06T04:45:42.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.378+0000 7f7d7ddff700 1 -- 172.21.15.124:0/2161346116 wait complete. 2023-10-06T04:45:42.398 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:45:42.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.589+0000 7f21d6dff700 1 Processor -- start 2023-10-06T04:45:42.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.589+0000 7f21d6dff700 1 -- start start 2023-10-06T04:45:42.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.590+0000 7f21d6dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f21d0159480 0x7f21d015dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.590+0000 7f21d6dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21d006d770 0x7f21d0069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.590+0000 7f21d6dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d0068700 con 0x7f21d00c8840 2023-10-06T04:45:42.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.590+0000 7f21d6dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d00c9030 con 0x7f21d0159480 2023-10-06T04:45:42.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.590+0000 7f21d6dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0068950 con 0x7f21d006d770 2023-10-06T04:45:42.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.591+0000 7f21d4b9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f21d0159480 0x7f21d015dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.591+0000 7f21d4b9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f21d0159480 0x7f21d015dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55166/0 (socket says 172.21.15.124:55166) 2023-10-06T04:45:42.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.591+0000 7f21d4b9b700 1 -- 172.21.15.124:0/1046252442 learned_addr learned my addr 172.21.15.124:0/1046252442 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:42.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.591+0000 7f21d539c700 1 --2- 172.21.15.124:0/1046252442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21d006d770 0x7f21d0069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.591+0000 7f21d4b9b700 1 -- 172.21.15.124:0/1046252442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21d006d770 msgr2=0x7f21d0069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:42.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.591+0000 7f21d4b9b700 1 --2- 172.21.15.124:0/1046252442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21d006d770 0x7f21d0069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.591+0000 7f21d4b9b700 1 -- 172.21.15.124:0/1046252442 >> v1:172.21.15.158:6789/0 conn(0x7f21d00c8840 legacy=0x7f21d006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.591+0000 7f21d4b9b700 1 -- 172.21.15.124:0/1046252442 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0068c30 con 0x7f21d0159480 2023-10-06T04:45:42.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.591+0000 7f21d4b9b700 1 --2- 172.21.15.124:0/1046252442 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d0159480 0x7f21d015dce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21c40099b0 tx=0x7f21c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c04dee39779857d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:42.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.591+0000 7f21cf7fe700 1 -- 172.21.15.124:0/1046252442 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c400b860 con 0x7f21d0159480 2023-10-06T04:45:42.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.592+0000 7f21cf7fe700 1 -- 172.21.15.124:0/1046252442 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c400b9c0 con 0x7f21d0159480 2023-10-06T04:45:42.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.592+0000 7f21cf7fe700 1 -- 172.21.15.124:0/1046252442 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c400bd60 con 0x7f21d0159480 2023-10-06T04:45:42.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.592+0000 7f21d6dff700 1 -- 172.21.15.124:0/1046252442 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d0159480 msgr2=0x7f21d015dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.592+0000 7f21d6dff700 1 --2- 172.21.15.124:0/1046252442 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d0159480 0x7f21d015dce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21c40099b0 tx=0x7f21c4009250 comp rx=0 tx=0).stop 2023-10-06T04:45:42.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.592+0000 7f21d6dff700 1 -- 172.21.15.124:0/1046252442 shutdown_connections 2023-10-06T04:45:42.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.592+0000 7f21d6dff700 1 --2- 172.21.15.124:0/1046252442 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d0159480 0x7f21d015dce0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.592+0000 7f21d6dff700 1 --2- 172.21.15.124:0/1046252442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21d006d770 0x7f21d0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.592+0000 7f21d6dff700 1 -- 172.21.15.124:0/1046252442 >> 172.21.15.124:0/1046252442 conn(0x7f21d0063cc0 msgr2=0x7f21d00ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:42.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.592+0000 7f21d6dff700 1 -- 172.21.15.124:0/1046252442 shutdown_connections 2023-10-06T04:45:42.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.592+0000 7f21d6dff700 1 -- 172.21.15.124:0/1046252442 wait complete. 2023-10-06T04:45:42.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.594+0000 7f21d6dff700 1 Processor -- start 2023-10-06T04:45:42.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.594+0000 7f21d6dff700 1 -- start start 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21d6dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21d006d770 0x7f21d00c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21d6dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d00c8840 0x7f21d00c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21d6dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21d0159480 0x7f21d0154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21d6dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c7ed0 con 0x7f21d00c8840 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21d6dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c7ce0 con 0x7f21d0159480 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21d6dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c5d80 con 0x7f21d006d770 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21cffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d00c8840 0x7f21d00c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21cffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d00c8840 0x7f21d00c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55168/0 (socket says 172.21.15.124:55168) 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21cffff700 1 -- 172.21.15.124:0/2149885358 learned_addr learned my addr 172.21.15.124:0/2149885358 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21d539c700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21d0159480 0x7f21d0154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21d4b9b700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21d006d770 0x7f21d00c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21cffff700 1 -- 172.21.15.124:0/2149885358 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21d006d770 msgr2=0x7f21d00c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21cffff700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21d006d770 0x7f21d00c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21cffff700 1 -- 172.21.15.124:0/2149885358 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21d0159480 msgr2=0x7f21d0154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21cffff700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21d0159480 0x7f21d0154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.595+0000 7f21cffff700 1 -- 172.21.15.124:0/2149885358 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40094f0 con 0x7f21d00c8840 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.596+0000 7f21cffff700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d00c8840 0x7f21d00c77a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c590 tx=0x7f21bc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.596+0000 7f21ccff9700 1 -- 172.21.15.124:0/2149885358 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc011590 con 0x7f21d00c8840 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.596+0000 7f21ccff9700 1 -- 172.21.15.124:0/2149885358 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc011710 con 0x7f21d00c8840 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.596+0000 7f21ccff9700 1 -- 172.21.15.124:0/2149885358 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc011ad0 con 0x7f21d00c8840 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.596+0000 7f21d6dff700 1 -- 172.21.15.124:0/2149885358 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d00c5450 con 0x7f21d00c8840 2023-10-06T04:45:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.596+0000 7f21d6dff700 1 -- 172.21.15.124:0/2149885358 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d00c5a10 con 0x7f21d00c8840 2023-10-06T04:45:42.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.597+0000 7f21d6dff700 1 -- 172.21.15.124:0/2149885358 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d00c5f30 con 0x7f21d00c8840 2023-10-06T04:45:42.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.598+0000 7f21ccff9700 1 -- 172.21.15.124:0/2149885358 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21bc01b3b0 con 0x7f21d00c8840 2023-10-06T04:45:42.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.599+0000 7f21ccff9700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21b4066f30 0x7f21b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:42.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.599+0000 7f21ccff9700 1 -- 172.21.15.124:0/2149885358 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21bc083b40 con 0x7f21d00c8840 2023-10-06T04:45:42.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.599+0000 7f21d4b9b700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21b4066f30 0x7f21b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:42.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.600+0000 7f21d4b9b700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21b4066f30 0x7f21b40693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f21c40099b0 tx=0x7f21c4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:42.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.603+0000 7f21ccff9700 1 -- 172.21.15.124:0/2149885358 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21d00c5f30 con 0x7f21d00c8840 2023-10-06T04:45:42.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.792+0000 7f21d6dff700 1 -- 172.21.15.124:0/2149885358 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21d00c5ef0 con 0x7f21d00c8840 2023-10-06T04:45:42.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.793+0000 7f21ccff9700 1 -- 172.21.15.124:0/2149885358 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21bc017070 con 0x7f21d00c8840 2023-10-06T04:45:42.795 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:45:42.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 -- 172.21.15.124:0/2149885358 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21b4066f30 msgr2=0x7f21b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21b4066f30 0x7f21b40693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f21c40099b0 tx=0x7f21c4017000 comp rx=0 tx=0).stop 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 -- 172.21.15.124:0/2149885358 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d00c8840 msgr2=0x7f21d00c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d00c8840 0x7f21d00c77a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c590 tx=0x7f21bc00c8a0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 -- 172.21.15.124:0/2149885358 shutdown_connections 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21d0159480 0x7f21d0154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f21b4066f30 0x7f21b40693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21d006d770 0x7f21d00c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 --2- 172.21.15.124:0/2149885358 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21d00c8840 0x7f21d00c77a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 -- 172.21.15.124:0/2149885358 >> 172.21.15.124:0/2149885358 conn(0x7f21d0063cc0 msgr2=0x7f21d00b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 -- 172.21.15.124:0/2149885358 shutdown_connections 2023-10-06T04:45:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:42.795+0000 7f21d6dff700 1 -- 172.21.15.124:0/2149885358 wait complete. 2023-10-06T04:45:42.815 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:45:43.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.005+0000 7f580c9ff700 1 Processor -- start 2023-10-06T04:45:43.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.005+0000 7f580c9ff700 1 -- start start 2023-10-06T04:45:43.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.006+0000 7f580c9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58081592b0 0x7f58080b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.006+0000 7f580c9ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f58080cc780 0x7f58080ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.006+0000 7f580c9ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580815d620 con 0x7f5808159680 2023-10-06T04:45:43.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.006+0000 7f580c9ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580815d0d0 con 0x7f58080cc780 2023-10-06T04:45:43.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.006+0000 7f580c9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080b2ed0 con 0x7f58081592b0 2023-10-06T04:45:43.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.006+0000 7f5806d9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f58080cc780 0x7f58080ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f5806d9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f58080cc780 0x7f58080ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46404/0 (socket says 172.21.15.124:46404) 2023-10-06T04:45:43.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f5806d9d700 1 -- 172.21.15.124:0/3384436238 learned_addr learned my addr 172.21.15.124:0/3384436238 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:43.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f580659c700 1 --2- 172.21.15.124:0/3384436238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58081592b0 0x7f58080b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f5806d9d700 1 -- 172.21.15.124:0/3384436238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58081592b0 msgr2=0x7f58080b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:43.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f5806d9d700 1 --2- 172.21.15.124:0/3384436238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58081592b0 0x7f58080b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f5806d9d700 1 -- 172.21.15.124:0/3384436238 >> v1:172.21.15.158:6789/0 conn(0x7f5808159680 legacy=0x7f580815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f5806d9d700 1 -- 172.21.15.124:0/3384436238 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080ccc20 con 0x7f58080cc780 2023-10-06T04:45:43.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f580659c700 1 --2- 172.21.15.124:0/3384436238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58081592b0 0x7f58080b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:43.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f5806d9d700 1 --2- 172.21.15.124:0/3384436238 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58080cc780 0x7f58080ccea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5800009f20 tx=0x7f5800009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcb74634d60feb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:43.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f580559a700 1 -- 172.21.15.124:0/3384436238 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580000e070 con 0x7f58080cc780 2023-10-06T04:45:43.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.007+0000 7f580559a700 1 -- 172.21.15.124:0/3384436238 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580000ba80 con 0x7f58080cc780 2023-10-06T04:45:43.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.008+0000 7f580559a700 1 -- 172.21.15.124:0/3384436238 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000092e0 con 0x7f58080cc780 2023-10-06T04:45:43.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.008+0000 7f580c9ff700 1 -- 172.21.15.124:0/3384436238 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58080cc780 msgr2=0x7f58080ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.008+0000 7f580c9ff700 1 --2- 172.21.15.124:0/3384436238 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58080cc780 0x7f58080ccea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5800009f20 tx=0x7f5800009840 comp rx=0 tx=0).stop 2023-10-06T04:45:43.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.008+0000 7f580c9ff700 1 -- 172.21.15.124:0/3384436238 shutdown_connections 2023-10-06T04:45:43.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.008+0000 7f580c9ff700 1 --2- 172.21.15.124:0/3384436238 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58080cc780 0x7f58080ccea0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.008+0000 7f580c9ff700 1 --2- 172.21.15.124:0/3384436238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58081592b0 0x7f58080b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.008+0000 7f580c9ff700 1 -- 172.21.15.124:0/3384436238 >> 172.21.15.124:0/3384436238 conn(0x7f580806ed20 msgr2=0x7f580806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:43.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.008+0000 7f580c9ff700 1 -- 172.21.15.124:0/3384436238 shutdown_connections 2023-10-06T04:45:43.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.008+0000 7f580c9ff700 1 -- 172.21.15.124:0/3384436238 wait complete. 2023-10-06T04:45:43.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.010+0000 7f580c9ff700 1 Processor -- start 2023-10-06T04:45:43.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.010+0000 7f580c9ff700 1 -- start start 2023-10-06T04:45:43.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f580c9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58080cc780 0x7f5808155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f580c9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58081592b0 0x7f58080d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f580c9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5808159680 0x7f58080ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f580c9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080d12b0 con 0x7f5808159680 2023-10-06T04:45:43.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f580c9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080c74b0 con 0x7f58081592b0 2023-10-06T04:45:43.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f580c9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080c7a30 con 0x7f58080cc780 2023-10-06T04:45:43.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f5806d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5808159680 0x7f58080ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f5806d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5808159680 0x7f58080ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46406/0 (socket says 172.21.15.124:46406) 2023-10-06T04:45:43.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f5806d9d700 1 -- 172.21.15.124:0/4236665273 learned_addr learned my addr 172.21.15.124:0/4236665273 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:43.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f580659c700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58080cc780 0x7f5808155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f5805d9b700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58081592b0 0x7f58080d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f5806d9d700 1 -- 172.21.15.124:0/4236665273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58080cc780 msgr2=0x7f5808155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f5806d9d700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58080cc780 0x7f5808155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f5806d9d700 1 -- 172.21.15.124:0/4236665273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58081592b0 msgr2=0x7f58080d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f5806d9d700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58081592b0 0x7f58080d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f5806d9d700 1 -- 172.21.15.124:0/4236665273 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800009ae0 con 0x7f5808159680 2023-10-06T04:45:43.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.011+0000 7f5805d9b700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58081592b0 0x7f58080d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:43.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.012+0000 7f5806d9d700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5808159680 0x7f58080ce670 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5808063e60 tx=0x7f5800018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:43.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.012+0000 7f57f67fc700 1 -- 172.21.15.124:0/4236665273 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800008e80 con 0x7f5808159680 2023-10-06T04:45:43.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.012+0000 7f57f67fc700 1 -- 172.21.15.124:0/4236665273 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58000092e0 con 0x7f5808159680 2023-10-06T04:45:43.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.012+0000 7f57f67fc700 1 -- 172.21.15.124:0/4236665273 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000266b0 con 0x7f5808159680 2023-10-06T04:45:43.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.012+0000 7f580c9ff700 1 -- 172.21.15.124:0/4236665273 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58080d0cf0 con 0x7f5808159680 2023-10-06T04:45:43.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.012+0000 7f580c9ff700 1 -- 172.21.15.124:0/4236665273 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58080c76c0 con 0x7f5808159680 2023-10-06T04:45:43.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.013+0000 7f580c9ff700 1 -- 172.21.15.124:0/4236665273 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580804c380 con 0x7f5808159680 2023-10-06T04:45:43.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.014+0000 7f57f67fc700 1 -- 172.21.15.124:0/4236665273 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5800003040 con 0x7f5808159680 2023-10-06T04:45:43.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.015+0000 7f57f67fc700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f57e8066f30 0x7f57e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.015+0000 7f57f67fc700 1 -- 172.21.15.124:0/4236665273 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5800086780 con 0x7f5808159680 2023-10-06T04:45:43.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.015+0000 7f580659c700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f57e8066f30 0x7f57e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.016+0000 7f580659c700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f57e8066f30 0x7f57e80693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f57f8006f00 tx=0x7f57f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:43.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.019+0000 7f57f67fc700 1 -- 172.21.15.124:0/4236665273 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58000537f0 con 0x7f5808159680 2023-10-06T04:45:43.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.209+0000 7f580c9ff700 1 -- 172.21.15.124:0/4236665273 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58080c7b70 con 0x7f5808159680 2023-10-06T04:45:43.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.209+0000 7f57f67fc700 1 -- 172.21.15.124:0/4236665273 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5800056e10 con 0x7f5808159680 2023-10-06T04:45:43.212 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-06T04:45:43.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 -- 172.21.15.124:0/4236665273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f57e8066f30 msgr2=0x7f57e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f57e8066f30 0x7f57e80693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f57f8006f00 tx=0x7f57f8008040 comp rx=0 tx=0).stop 2023-10-06T04:45:43.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 -- 172.21.15.124:0/4236665273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5808159680 msgr2=0x7f58080ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5808159680 0x7f58080ce670 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5808063e60 tx=0x7f5800018000 comp rx=0 tx=0).stop 2023-10-06T04:45:43.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 -- 172.21.15.124:0/4236665273 shutdown_connections 2023-10-06T04:45:43.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5808159680 0x7f58080ce670 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f57e8066f30 0x7f57e80693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58080cc780 0x7f5808155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 --2- 172.21.15.124:0/4236665273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58081592b0 0x7f58080d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 -- 172.21.15.124:0/4236665273 >> 172.21.15.124:0/4236665273 conn(0x7f580806ed20 msgr2=0x7f58080b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:43.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 -- 172.21.15.124:0/4236665273 shutdown_connections 2023-10-06T04:45:43.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.212+0000 7f580c9ff700 1 -- 172.21.15.124:0/4236665273 wait complete. 2023-10-06T04:45:43.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:45:43.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.420+0000 7f10f83ff700 1 Processor -- start 2023-10-06T04:45:43.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.420+0000 7f10f83ff700 1 -- start start 2023-10-06T04:45:43.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.422+0000 7f10f83ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f0157700 0x7f10f006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.422+0000 7f10f83ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f0157ad0 con 0x7f10f00694c0 2023-10-06T04:45:43.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.422+0000 7f10f83ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f006db30 con 0x7f10f006a3d0 2023-10-06T04:45:43.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.422+0000 7f10f83ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f006de10 con 0x7f10f0157700 2023-10-06T04:45:43.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.422+0000 7f10f699c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f10f00694c0 0x7f10f006ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:58326/0 (socket says 172.21.15.124:58326) 2023-10-06T04:45:43.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.422+0000 7f10f699c700 1 -- 172.21.15.124:0/4078607541 learned_addr learned my addr 172.21.15.124:0/4078607541 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:43.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.422+0000 7f10f619b700 1 --2- 172.21.15.124:0/4078607541 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f0157700 0x7f10f006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.422+0000 7f10f5199700 1 -- 172.21.15.124:0/4078607541 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118406128 0 0) 0x7f10f0157ad0 con 0x7f10f00694c0 2023-10-06T04:45:43.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.422+0000 7f10f5199700 1 -- 172.21.15.124:0/4078607541 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10dc003570 con 0x7f10f00694c0 2023-10-06T04:45:43.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.423+0000 7f10f5199700 1 -- 172.21.15.124:0/4078607541 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999115033 0 0) 0x7f10f006db30 con 0x7f10f006a3d0 2023-10-06T04:45:43.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.423+0000 7f10f5199700 1 -- 172.21.15.124:0/4078607541 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f0157ad0 con 0x7f10f006a3d0 2023-10-06T04:45:43.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.423+0000 7f10f619b700 1 -- 172.21.15.124:0/4078607541 >> v1:172.21.15.158:6789/0 conn(0x7f10f006a3d0 legacy=0x7f10f00aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.423+0000 7f10f619b700 1 -- 172.21.15.124:0/4078607541 >> v1:172.21.15.124:6789/0 conn(0x7f10f00694c0 legacy=0x7f10f006ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.423+0000 7f10f5199700 1 -- 172.21.15.124:0/4078607541 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3283768729 0 0) 0x7f10dc003570 con 0x7f10f00694c0 2023-10-06T04:45:43.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.423+0000 7f10f619b700 1 -- 172.21.15.124:0/4078607541 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f006e0f0 con 0x7f10f0157700 2023-10-06T04:45:43.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.423+0000 7f10f619b700 1 --2- 172.21.15.124:0/4078607541 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f0157700 0x7f10f006d2e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009910 tx=0x7f10ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4524f7cbe77e10d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:43.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.423+0000 7f10f5199700 1 -- 172.21.15.124:0/4078607541 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e80017f0 con 0x7f10f0157700 2023-10-06T04:45:43.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.423+0000 7f10f5199700 1 -- 172.21.15.124:0/4078607541 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec011420 con 0x7f10f0157700 2023-10-06T04:45:43.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.423+0000 7f10f5199700 1 -- 172.21.15.124:0/4078607541 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0117c0 con 0x7f10f0157700 2023-10-06T04:45:43.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.424+0000 7f10f83ff700 1 -- 172.21.15.124:0/4078607541 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f0157700 msgr2=0x7f10f006d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.424+0000 7f10f83ff700 1 --2- 172.21.15.124:0/4078607541 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f0157700 0x7f10f006d2e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009910 tx=0x7f10ec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.424+0000 7f10f83ff700 1 -- 172.21.15.124:0/4078607541 shutdown_connections 2023-10-06T04:45:43.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.424+0000 7f10f83ff700 1 --2- 172.21.15.124:0/4078607541 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f0157700 0x7f10f006d2e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.424+0000 7f10f83ff700 1 -- 172.21.15.124:0/4078607541 >> 172.21.15.124:0/4078607541 conn(0x7f10f00680c0 msgr2=0x7f10f00cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:43.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.424+0000 7f10f83ff700 1 -- 172.21.15.124:0/4078607541 shutdown_connections 2023-10-06T04:45:43.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.424+0000 7f10f83ff700 1 -- 172.21.15.124:0/4078607541 wait complete. 2023-10-06T04:45:43.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.426+0000 7f10f83ff700 1 Processor -- start 2023-10-06T04:45:43.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.426+0000 7f10f83ff700 1 -- start start 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.427+0000 7f10f83ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f00694c0 0x7f10f0157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.427+0000 7f10f83ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10f006a3d0 0x7f10f0159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.427+0000 7f10f83ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10f0157700 0x7f10f00bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.427+0000 7f10f83ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f01584e0 con 0x7f10f0157700 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.427+0000 7f10f83ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00c3a70 con 0x7f10f006a3d0 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.427+0000 7f10f83ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00c3d50 con 0x7f10f00694c0 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.428+0000 7f10f699c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10f0157700 0x7f10f00bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.428+0000 7f10f699c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10f0157700 0x7f10f00bea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46418/0 (socket says 172.21.15.124:46418) 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.428+0000 7f10f699c700 1 -- 172.21.15.124:0/1611009476 learned_addr learned my addr 172.21.15.124:0/1611009476 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.428+0000 7f10f619b700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f00694c0 0x7f10f0157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.428+0000 7f10f599a700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10f006a3d0 0x7f10f0159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.428+0000 7f10f699c700 1 -- 172.21.15.124:0/1611009476 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f00694c0 msgr2=0x7f10f0157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.428+0000 7f10f699c700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f00694c0 0x7f10f0157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.428+0000 7f10f699c700 1 -- 172.21.15.124:0/1611009476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10f006a3d0 msgr2=0x7f10f0159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.428+0000 7f10f699c700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10f006a3d0 0x7f10f0159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.428+0000 7f10f699c700 1 -- 172.21.15.124:0/1611009476 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec009420 con 0x7f10f0157700 2023-10-06T04:45:43.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.429+0000 7f10f699c700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10f0157700 0x7f10f00bea10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f10e800cc80 tx=0x7f10e8007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:43.433 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.429+0000 7f10e67fc700 1 -- 172.21.15.124:0/1611009476 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8004dc0 con 0x7f10f0157700 2023-10-06T04:45:43.433 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.429+0000 7f10e67fc700 1 -- 172.21.15.124:0/1611009476 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e800a660 con 0x7f10f0157700 2023-10-06T04:45:43.433 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.429+0000 7f10f83ff700 1 -- 172.21.15.124:0/1611009476 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f00c4030 con 0x7f10f0157700 2023-10-06T04:45:43.433 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.429+0000 7f10e67fc700 1 -- 172.21.15.124:0/1611009476 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800aa20 con 0x7f10f0157700 2023-10-06T04:45:43.433 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.429+0000 7f10f83ff700 1 -- 172.21.15.124:0/1611009476 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f01581d0 con 0x7f10f0157700 2023-10-06T04:45:43.433 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.430+0000 7f10f83ff700 1 -- 172.21.15.124:0/1611009476 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f00c4550 con 0x7f10f0157700 2023-10-06T04:45:43.433 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.431+0000 7f10e67fc700 1 -- 172.21.15.124:0/1611009476 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10e8007150 con 0x7f10f0157700 2023-10-06T04:45:43.434 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.432+0000 7f10e67fc700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d4066f30 0x7f10d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.434 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.432+0000 7f10e67fc700 1 -- 172.21.15.124:0/1611009476 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f10e8083d00 con 0x7f10f0157700 2023-10-06T04:45:43.434 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.432+0000 7f10f619b700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d4066f30 0x7f10d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.435 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.433+0000 7f10f619b700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d4066f30 0x7f10d40693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0030c0 tx=0x7f10ec016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:43.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.436+0000 7f10e67fc700 1 -- 172.21.15.124:0/1611009476 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10f00c4550 con 0x7f10f0157700 2023-10-06T04:45:43.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.624+0000 7f10f83ff700 1 -- 172.21.15.124:0/1611009476 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10f00c4550 con 0x7f10f0157700 2023-10-06T04:45:43.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.624+0000 7f10e67fc700 1 -- 172.21.15.124:0/1611009476 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10f00c4550 con 0x7f10f0157700 2023-10-06T04:45:43.627 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-06T04:45:43.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.626+0000 7f10f83ff700 1 -- 172.21.15.124:0/1611009476 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d4066f30 msgr2=0x7f10d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.626+0000 7f10f83ff700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d4066f30 0x7f10d40693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0030c0 tx=0x7f10ec016000 comp rx=0 tx=0).stop 2023-10-06T04:45:43.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.626+0000 7f10f83ff700 1 -- 172.21.15.124:0/1611009476 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10f0157700 msgr2=0x7f10f00bea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.626+0000 7f10f83ff700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10f0157700 0x7f10f00bea10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f10e800cc80 tx=0x7f10e8007d20 comp rx=0 tx=0).stop 2023-10-06T04:45:43.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.627+0000 7f10f83ff700 1 -- 172.21.15.124:0/1611009476 shutdown_connections 2023-10-06T04:45:43.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.627+0000 7f10f83ff700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10f0157700 0x7f10f00bea10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.627+0000 7f10f83ff700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f10d4066f30 0x7f10d40693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.627+0000 7f10f83ff700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10f00694c0 0x7f10f0157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.627+0000 7f10f83ff700 1 --2- 172.21.15.124:0/1611009476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10f006a3d0 0x7f10f0159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.627+0000 7f10f83ff700 1 -- 172.21.15.124:0/1611009476 >> 172.21.15.124:0/1611009476 conn(0x7f10f00680c0 msgr2=0x7f10f0155360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:43.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.627+0000 7f10f83ff700 1 -- 172.21.15.124:0/1611009476 shutdown_connections 2023-10-06T04:45:43.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.627+0000 7f10f83ff700 1 -- 172.21.15.124:0/1611009476 wait complete. 2023-10-06T04:45:43.647 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:43.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.835+0000 7ff365bff700 1 Processor -- start 2023-10-06T04:45:43.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.835+0000 7ff365bff700 1 -- start start 2023-10-06T04:45:43.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.836+0000 7ff365bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3600abb60 0x7ff3600abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.836+0000 7ff365bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff3600690b0 0x7ff360099610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.836+0000 7ff365bff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3600acc40 con 0x7ff3600ccd30 2023-10-06T04:45:43.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.836+0000 7ff365bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3600ad0d0 con 0x7ff3600690b0 2023-10-06T04:45:43.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.836+0000 7ff365bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36006ae30 con 0x7ff3600abb60 2023-10-06T04:45:43.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff3600690b0 0x7ff360099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff3600690b0 0x7ff360099610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46424/0 (socket says 172.21.15.124:46424) 2023-10-06T04:45:43.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35ffff700 1 -- 172.21.15.124:0/2340723466 learned_addr learned my addr 172.21.15.124:0/2340723466 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:43.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35effd700 1 --1- 172.21.15.124:0/2340723466 >> v1:172.21.15.124:6789/0 conn(0x7ff3600ccd30 0x7ff360098f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:58336/0 (socket says 172.21.15.124:58336) 2023-10-06T04:45:43.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35f7fe700 1 --2- 172.21.15.124:0/2340723466 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3600abb60 0x7ff3600abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35ffff700 1 -- 172.21.15.124:0/2340723466 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3600abb60 msgr2=0x7ff3600abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:43.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35ffff700 1 --2- 172.21.15.124:0/2340723466 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3600abb60 0x7ff3600abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35ffff700 1 -- 172.21.15.124:0/2340723466 >> v1:172.21.15.124:6789/0 conn(0x7ff3600ccd30 legacy=0x7ff360098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35ffff700 1 -- 172.21.15.124:0/2340723466 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600ac5f0 con 0x7ff3600690b0 2023-10-06T04:45:43.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35e7fc700 1 -- 172.21.15.124:0/2340723466 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129643931 0 0) 0x7ff3600acc40 con 0x7ff3600ccd30 2023-10-06T04:45:43.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35ffff700 1 --2- 172.21.15.124:0/2340723466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 0x7ff360099610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff358009f20 tx=0x7ff358009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0e8001dbb4d6b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:43.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.837+0000 7ff35e7fc700 1 -- 172.21.15.124:0/2340723466 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800e070 con 0x7ff3600690b0 2023-10-06T04:45:43.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.838+0000 7ff35e7fc700 1 -- 172.21.15.124:0/2340723466 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35800b9d0 con 0x7ff3600690b0 2023-10-06T04:45:43.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.838+0000 7ff35e7fc700 1 -- 172.21.15.124:0/2340723466 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580092e0 con 0x7ff3600690b0 2023-10-06T04:45:43.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.838+0000 7ff365bff700 1 -- 172.21.15.124:0/2340723466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 msgr2=0x7ff360099610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.838+0000 7ff365bff700 1 --2- 172.21.15.124:0/2340723466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 0x7ff360099610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff358009f20 tx=0x7ff358009840 comp rx=0 tx=0).stop 2023-10-06T04:45:43.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.838+0000 7ff365bff700 1 -- 172.21.15.124:0/2340723466 shutdown_connections 2023-10-06T04:45:43.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.838+0000 7ff365bff700 1 --2- 172.21.15.124:0/2340723466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 0x7ff360099610 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.838+0000 7ff365bff700 1 --2- 172.21.15.124:0/2340723466 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3600abb60 0x7ff3600abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.838+0000 7ff365bff700 1 -- 172.21.15.124:0/2340723466 >> 172.21.15.124:0/2340723466 conn(0x7ff3600cc050 msgr2=0x7ff3600cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:43.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.838+0000 7ff365bff700 1 -- 172.21.15.124:0/2340723466 shutdown_connections 2023-10-06T04:45:43.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.838+0000 7ff365bff700 1 -- 172.21.15.124:0/2340723466 wait complete. 2023-10-06T04:45:43.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.840+0000 7ff365bff700 1 Processor -- start 2023-10-06T04:45:43.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.840+0000 7ff365bff700 1 -- start start 2023-10-06T04:45:43.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff365bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 0x7ff3600a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff365bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3600abb60 0x7ff3601539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff365bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3600ccd30 0x7ff3600a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff365bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600a8580 con 0x7ff3600690b0 2023-10-06T04:45:43.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff365bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600a7970 con 0x7ff3600abb60 2023-10-06T04:45:43.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff365bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600a7c50 con 0x7ff3600ccd30 2023-10-06T04:45:43.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 0x7ff3600a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 0x7ff3600a7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46432/0 (socket says 172.21.15.124:46432) 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35f7fe700 1 -- 172.21.15.124:0/922535219 learned_addr learned my addr 172.21.15.124:0/922535219 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35ffff700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3600ccd30 0x7ff3600a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35effd700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3600abb60 0x7ff3601539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35f7fe700 1 -- 172.21.15.124:0/922535219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3600ccd30 msgr2=0x7ff3600a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35f7fe700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3600ccd30 0x7ff3600a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35f7fe700 1 -- 172.21.15.124:0/922535219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3600abb60 msgr2=0x7ff3601539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35f7fe700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3600abb60 0x7ff3601539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35f7fe700 1 -- 172.21.15.124:0/922535219 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358009ae0 con 0x7ff3600690b0 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.841+0000 7ff35f7fe700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 0x7ff3600a7090 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff35000ec80 tx=0x7ff3500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.842+0000 7ff3477fe700 1 -- 172.21.15.124:0/922535219 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000c9d0 con 0x7ff3600690b0 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.842+0000 7ff3477fe700 1 -- 172.21.15.124:0/922535219 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35000cb30 con 0x7ff3600690b0 2023-10-06T04:45:43.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.842+0000 7ff365bff700 1 -- 172.21.15.124:0/922535219 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3600a7f30 con 0x7ff3600690b0 2023-10-06T04:45:43.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.842+0000 7ff3477fe700 1 -- 172.21.15.124:0/922535219 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350013470 con 0x7ff3600690b0 2023-10-06T04:45:43.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.842+0000 7ff365bff700 1 -- 172.21.15.124:0/922535219 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3600a75d0 con 0x7ff3600690b0 2023-10-06T04:45:43.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.843+0000 7ff365bff700 1 -- 172.21.15.124:0/922535219 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3600717a0 con 0x7ff3600690b0 2023-10-06T04:45:43.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.844+0000 7ff3477fe700 1 -- 172.21.15.124:0/922535219 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff350013820 con 0x7ff3600690b0 2023-10-06T04:45:43.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.845+0000 7ff3477fe700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff34c066f30 0x7ff34c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:43.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.845+0000 7ff3477fe700 1 -- 172.21.15.124:0/922535219 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff350084a80 con 0x7ff3600690b0 2023-10-06T04:45:43.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.845+0000 7ff35effd700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff34c066f30 0x7ff34c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:43.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.845+0000 7ff35effd700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff34c066f30 0x7ff34c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff3601598a0 tx=0x7ff354007bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:43.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:43.849+0000 7ff3477fe700 1 -- 172.21.15.124:0/922535219 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff350051b90 con 0x7ff3600690b0 2023-10-06T04:45:44.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.086+0000 7ff365bff700 1 -- 172.21.15.124:0/922535219 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff360159ad0 con 0x7ff3600690b0 2023-10-06T04:45:44.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.086+0000 7ff3477fe700 1 -- 172.21.15.124:0/922535219 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7ff3500551b0 con 0x7ff3600690b0 2023-10-06T04:45:44.089 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:44.089 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/518958812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":518958812},{"type":"v1","addr":"172.21.15.158:6834","nonce":518958812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/120181660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":120181660},{"type":"v1","addr":"172.21.15.158:6835","nonce":120181660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1421870244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1421870244},{"type":"v1","addr":"172.21.15.124:6836","nonce":1421870244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:24.506230+0000","modified":"2023-10-06T04:45:28.049891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.124:6837/1031472040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1031472040},{"type":"v1","addr":"172.21.15.124:6837","nonce":1031472040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:45:44.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.089+0000 7ff365bff700 1 -- 172.21.15.124:0/922535219 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff34c066f30 msgr2=0x7ff34c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.089+0000 7ff365bff700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff34c066f30 0x7ff34c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff3601598a0 tx=0x7ff354007bf0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.089+0000 7ff365bff700 1 -- 172.21.15.124:0/922535219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 msgr2=0x7ff3600a7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.089+0000 7ff365bff700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 0x7ff3600a7090 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff35000ec80 tx=0x7ff3500091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.089+0000 7ff365bff700 1 -- 172.21.15.124:0/922535219 shutdown_connections 2023-10-06T04:45:44.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.089+0000 7ff365bff700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff34c066f30 0x7ff34c0693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.089+0000 7ff365bff700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3600ccd30 0x7ff3600a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.089+0000 7ff365bff700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3600690b0 0x7ff3600a7090 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.089+0000 7ff365bff700 1 --2- 172.21.15.124:0/922535219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3600abb60 0x7ff3601539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.089+0000 7ff365bff700 1 -- 172.21.15.124:0/922535219 >> 172.21.15.124:0/922535219 conn(0x7ff3600cc050 msgr2=0x7ff360097280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:44.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.090+0000 7ff365bff700 1 -- 172.21.15.124:0/922535219 shutdown_connections 2023-10-06T04:45:44.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.090+0000 7ff365bff700 1 -- 172.21.15.124:0/922535219 wait complete. 2023-10-06T04:45:44.093 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2023-10-06T04:45:44.111 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:44.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.298+0000 7f8e187ff700 1 Processor -- start 2023-10-06T04:45:44.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.298+0000 7f8e187ff700 1 -- start start 2023-10-06T04:45:44.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.299+0000 7f8e187ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8e100cae80 0x7f8e100cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.299+0000 7f8e187ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8e101598e0 0x7f8e100afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.299+0000 7f8e187ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e100c1d10 con 0x7f8e100ccec0 2023-10-06T04:45:44.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.299+0000 7f8e187ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e100cd430 con 0x7f8e100cae80 2023-10-06T04:45:44.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.299+0000 7f8e187ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e100688a0 con 0x7f8e101598e0 2023-10-06T04:45:44.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.300+0000 7f8e1659b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8e100cae80 0x7f8e100cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.300+0000 7f8e1659b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8e100cae80 0x7f8e100cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46436/0 (socket says 172.21.15.124:46436) 2023-10-06T04:45:44.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.300+0000 7f8e1659b700 1 -- 172.21.15.124:0/238371397 learned_addr learned my addr 172.21.15.124:0/238371397 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:44.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.300+0000 7f8e16d9c700 1 --2- 172.21.15.124:0/238371397 >> v2:172.21.15.158:3300/0 conn(0x7f8e101598e0 0x7f8e100afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.300+0000 7f8e1659b700 1 -- 172.21.15.124:0/238371397 >> v2:172.21.15.158:3300/0 conn(0x7f8e101598e0 msgr2=0x7f8e100afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:44.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.300+0000 7f8e1659b700 1 --2- 172.21.15.124:0/238371397 >> v2:172.21.15.158:3300/0 conn(0x7f8e101598e0 0x7f8e100afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.300+0000 7f8e1659b700 1 -- 172.21.15.124:0/238371397 >> v1:172.21.15.158:6789/0 conn(0x7f8e100ccec0 legacy=0x7f8e101591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.300+0000 7f8e1659b700 1 -- 172.21.15.124:0/238371397 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10068b80 con 0x7f8e100cae80 2023-10-06T04:45:44.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.300+0000 7f8e1659b700 1 --2- 172.21.15.124:0/238371397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100cae80 0x7f8e100cc980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8e100c1ca0 tx=0x7f8e0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e87f90707c2651 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:44.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e15599700 1 -- 172.21.15.124:0/238371397 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c009e70 con 0x7f8e100cae80 2023-10-06T04:45:44.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e15599700 1 -- 172.21.15.124:0/238371397 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c00b860 con 0x7f8e100cae80 2023-10-06T04:45:44.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e15599700 1 -- 172.21.15.124:0/238371397 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00bc00 con 0x7f8e100cae80 2023-10-06T04:45:44.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e187ff700 1 -- 172.21.15.124:0/238371397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100cae80 msgr2=0x7f8e100cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e187ff700 1 --2- 172.21.15.124:0/238371397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100cae80 0x7f8e100cc980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8e100c1ca0 tx=0x7f8e0c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:44.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e187ff700 1 -- 172.21.15.124:0/238371397 shutdown_connections 2023-10-06T04:45:44.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e187ff700 1 --2- 172.21.15.124:0/238371397 >> v2:172.21.15.158:3300/0 conn(0x7f8e101598e0 0x7f8e100afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e187ff700 1 --2- 172.21.15.124:0/238371397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100cae80 0x7f8e100cc980 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e187ff700 1 -- 172.21.15.124:0/238371397 >> 172.21.15.124:0/238371397 conn(0x7f8e100974f0 msgr2=0x7f8e100639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:44.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e187ff700 1 -- 172.21.15.124:0/238371397 shutdown_connections 2023-10-06T04:45:44.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.301+0000 7f8e187ff700 1 -- 172.21.15.124:0/238371397 wait complete. 2023-10-06T04:45:44.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.303+0000 7f8e187ff700 1 Processor -- start 2023-10-06T04:45:44.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.303+0000 7f8e187ff700 1 -- start start 2023-10-06T04:45:44.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e187ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e100cae80 0x7f8e10069e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e187ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100ccec0 0x7f8e100c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e187ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e101598e0 0x7f8e100c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e187ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100c8070 con 0x7f8e100ccec0 2023-10-06T04:45:44.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e187ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100c73f0 con 0x7f8e100cae80 2023-10-06T04:45:44.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e187ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100c76d0 con 0x7f8e101598e0 2023-10-06T04:45:44.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e15d9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100ccec0 0x7f8e100c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e15d9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100ccec0 0x7f8e100c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46448/0 (socket says 172.21.15.124:46448) 2023-10-06T04:45:44.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e15d9a700 1 -- 172.21.15.124:0/4000470636 learned_addr learned my addr 172.21.15.124:0/4000470636 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:44.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e1659b700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e100cae80 0x7f8e10069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e16d9c700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e101598e0 0x7f8e100c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.304+0000 7f8e15d9a700 1 -- 172.21.15.124:0/4000470636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e101598e0 msgr2=0x7f8e100c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.305+0000 7f8e15d9a700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e101598e0 0x7f8e100c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.305+0000 7f8e15d9a700 1 -- 172.21.15.124:0/4000470636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e100cae80 msgr2=0x7f8e10069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.305+0000 7f8e15d9a700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e100cae80 0x7f8e10069e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.305+0000 7f8e15d9a700 1 -- 172.21.15.124:0/4000470636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c0094f0 con 0x7f8e100ccec0 2023-10-06T04:45:44.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.305+0000 7f8e15d9a700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100ccec0 0x7f8e100c6680 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000c590 tx=0x7f8e0000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:44.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.305+0000 7f8e067fc700 1 -- 172.21.15.124:0/4000470636 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00011590 con 0x7f8e100ccec0 2023-10-06T04:45:44.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.305+0000 7f8e067fc700 1 -- 172.21.15.124:0/4000470636 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e000116f0 con 0x7f8e100ccec0 2023-10-06T04:45:44.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.305+0000 7f8e187ff700 1 -- 172.21.15.124:0/4000470636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e100c79b0 con 0x7f8e100ccec0 2023-10-06T04:45:44.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.305+0000 7f8e067fc700 1 -- 172.21.15.124:0/4000470636 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00011ab0 con 0x7f8e100ccec0 2023-10-06T04:45:44.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.305+0000 7f8e187ff700 1 -- 172.21.15.124:0/4000470636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e100c7100 con 0x7f8e100ccec0 2023-10-06T04:45:44.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.306+0000 7f8e187ff700 1 -- 172.21.15.124:0/4000470636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e100717a0 con 0x7f8e100ccec0 2023-10-06T04:45:44.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.307+0000 7f8e067fc700 1 -- 172.21.15.124:0/4000470636 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e0001b3b0 con 0x7f8e100ccec0 2023-10-06T04:45:44.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.308+0000 7f8e067fc700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8df4066f30 0x7f8df40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.308+0000 7f8e067fc700 1 -- 172.21.15.124:0/4000470636 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8e00083be0 con 0x7f8e100ccec0 2023-10-06T04:45:44.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.308+0000 7f8e1659b700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8df4066f30 0x7f8df40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.309+0000 7f8e1659b700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8df4066f30 0x7f8df40693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8e100c1ca0 tx=0x7f8e0c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:44.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.312+0000 7f8e067fc700 1 -- 172.21.15.124:0/4000470636 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e00050cf0 con 0x7f8e100ccec0 2023-10-06T04:45:44.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.502+0000 7f8e187ff700 1 -- 172.21.15.124:0/4000470636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e10068e60 con 0x7f8e100ccec0 2023-10-06T04:45:44.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.503+0000 7f8e067fc700 1 -- 172.21.15.124:0/4000470636 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f8e00017070 con 0x7f8e100ccec0 2023-10-06T04:45:44.506 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:44.506 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":33,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:45:26.035018+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:22.109975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:23.489027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:44.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 -- 172.21.15.124:0/4000470636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8df4066f30 msgr2=0x7f8df40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8df4066f30 0x7f8df40693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8e100c1ca0 tx=0x7f8e0c017000 comp rx=0 tx=0).stop 2023-10-06T04:45:44.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 -- 172.21.15.124:0/4000470636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100ccec0 msgr2=0x7f8e100c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100ccec0 0x7f8e100c6680 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000c590 tx=0x7f8e0000c950 comp rx=0 tx=0).stop 2023-10-06T04:45:44.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 -- 172.21.15.124:0/4000470636 shutdown_connections 2023-10-06T04:45:44.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8df4066f30 0x7f8df40693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e101598e0 0x7f8e100c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e100cae80 0x7f8e10069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 --2- 172.21.15.124:0/4000470636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e100ccec0 0x7f8e100c6680 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 -- 172.21.15.124:0/4000470636 >> 172.21.15.124:0/4000470636 conn(0x7f8e100974f0 msgr2=0x7f8e1006cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:44.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 -- 172.21.15.124:0/4000470636 shutdown_connections 2023-10-06T04:45:44.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.506+0000 7f8e187ff700 1 -- 172.21.15.124:0/4000470636 wait complete. 2023-10-06T04:45:44.526 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:45:44.527 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:44.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.715+0000 7f6af37ff700 1 Processor -- start 2023-10-06T04:45:44.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.716+0000 7f6af37ff700 1 -- start start 2023-10-06T04:45:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af37ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6aec0b1a70 0x7f6aec06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af37ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6aec06a140 0x7f6aec06a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af37ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec06e870 con 0x7f6aec0ac3d0 2023-10-06T04:45:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af37ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec069cb0 con 0x7f6aec06a140 2023-10-06T04:45:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af37ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec156110 con 0x7f6aec0b1a70 2023-10-06T04:45:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af1d9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6aec06a140 0x7f6aec06a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af1d9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6aec06a140 0x7f6aec06a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46464/0 (socket says 172.21.15.124:46464) 2023-10-06T04:45:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af1d9c700 1 -- 172.21.15.124:0/3154999422 learned_addr learned my addr 172.21.15.124:0/3154999422 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af0d9a700 1 --2- 172.21.15.124:0/3154999422 >> v2:172.21.15.158:3300/0 conn(0x7f6aec0b1a70 0x7f6aec06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af1d9c700 1 -- 172.21.15.124:0/3154999422 >> v2:172.21.15.158:3300/0 conn(0x7f6aec0b1a70 msgr2=0x7f6aec06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af1d9c700 1 --2- 172.21.15.124:0/3154999422 >> v2:172.21.15.158:3300/0 conn(0x7f6aec0b1a70 0x7f6aec06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af1d9c700 1 -- 172.21.15.124:0/3154999422 >> v1:172.21.15.158:6789/0 conn(0x7f6aec0ac3d0 legacy=0x7f6aec0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.717+0000 7f6af1d9c700 1 -- 172.21.15.124:0/3154999422 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec06aa80 con 0x7f6aec06a140 2023-10-06T04:45:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.718+0000 7f6af1d9c700 1 --2- 172.21.15.124:0/3154999422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec06a140 0x7f6aec06a540 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0ab9a0 tx=0x7f6ae4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35127ad4cc333a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.718+0000 7f6ae3fff700 1 -- 172.21.15.124:0/3154999422 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40092e0 con 0x7f6aec06a140 2023-10-06T04:45:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.718+0000 7f6ae3fff700 1 -- 172.21.15.124:0/3154999422 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae400caf0 con 0x7f6aec06a140 2023-10-06T04:45:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.718+0000 7f6ae3fff700 1 -- 172.21.15.124:0/3154999422 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4010480 con 0x7f6aec06a140 2023-10-06T04:45:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.718+0000 7f6af37ff700 1 -- 172.21.15.124:0/3154999422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec06a140 msgr2=0x7f6aec06a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.718+0000 7f6af37ff700 1 --2- 172.21.15.124:0/3154999422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec06a140 0x7f6aec06a540 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0ab9a0 tx=0x7f6ae4009840 comp rx=0 tx=0).stop 2023-10-06T04:45:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.719+0000 7f6af37ff700 1 -- 172.21.15.124:0/3154999422 shutdown_connections 2023-10-06T04:45:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.719+0000 7f6af37ff700 1 --2- 172.21.15.124:0/3154999422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec06a140 0x7f6aec06a540 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.719+0000 7f6af37ff700 1 --2- 172.21.15.124:0/3154999422 >> v2:172.21.15.158:3300/0 conn(0x7f6aec0b1a70 0x7f6aec06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.719+0000 7f6af37ff700 1 -- 172.21.15.124:0/3154999422 >> 172.21.15.124:0/3154999422 conn(0x7f6aec0cc050 msgr2=0x7f6aec0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:44.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.719+0000 7f6af37ff700 1 -- 172.21.15.124:0/3154999422 shutdown_connections 2023-10-06T04:45:44.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.719+0000 7f6af37ff700 1 -- 172.21.15.124:0/3154999422 wait complete. 2023-10-06T04:45:44.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.721+0000 7f6af37ff700 1 Processor -- start 2023-10-06T04:45:44.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.721+0000 7f6af37ff700 1 -- start start 2023-10-06T04:45:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.722+0000 7f6af37ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aec06a140 0x7f6aec0ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.722+0000 7f6af37ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ac3d0 0x7f6aec0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.722+0000 7f6af37ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec0b1a70 0x7f6aec0ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.722+0000 7f6af37ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec0ab580 con 0x7f6aec0b1a70 2023-10-06T04:45:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.722+0000 7f6af37ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec165e50 con 0x7f6aec06a140 2023-10-06T04:45:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.722+0000 7f6af37ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec1660c0 con 0x7f6aec0ac3d0 2023-10-06T04:45:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.722+0000 7f6af1d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec0b1a70 0x7f6aec0ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.722+0000 7f6af1d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec0b1a70 0x7f6aec0ab040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46472/0 (socket says 172.21.15.124:46472) 2023-10-06T04:45:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.722+0000 7f6af1d9c700 1 -- 172.21.15.124:0/3116801448 learned_addr learned my addr 172.21.15.124:0/3116801448 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.722+0000 7f6af159b700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aec06a140 0x7f6aec0ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6af0d9a700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ac3d0 0x7f6aec0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6af1d9c700 1 -- 172.21.15.124:0/3116801448 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ac3d0 msgr2=0x7f6aec0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6af1d9c700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ac3d0 0x7f6aec0aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6af1d9c700 1 -- 172.21.15.124:0/3116801448 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aec06a140 msgr2=0x7f6aec0ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6af1d9c700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aec06a140 0x7f6aec0ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6af1d9c700 1 -- 172.21.15.124:0/3116801448 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae400d040 con 0x7f6aec0b1a70 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6af0d9a700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ac3d0 0x7f6aec0aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6af1d9c700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec0b1a70 0x7f6aec0ab040 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400c7d0 tx=0x7f6ae4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6ae17fa700 1 -- 172.21.15.124:0/3116801448 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4020070 con 0x7f6aec0b1a70 2023-10-06T04:45:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6ae17fa700 1 -- 172.21.15.124:0/3116801448 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae40092e0 con 0x7f6aec0b1a70 2023-10-06T04:45:44.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6ae17fa700 1 -- 172.21.15.124:0/3116801448 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40196d0 con 0x7f6aec0b1a70 2023-10-06T04:45:44.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6af37ff700 1 -- 172.21.15.124:0/3116801448 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec166400 con 0x7f6aec0b1a70 2023-10-06T04:45:44.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.723+0000 7f6af37ff700 1 -- 172.21.15.124:0/3116801448 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec0ae3d0 con 0x7f6aec0b1a70 2023-10-06T04:45:44.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.725+0000 7f6af37ff700 1 -- 172.21.15.124:0/3116801448 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec0ae5f0 con 0x7f6aec0b1a70 2023-10-06T04:45:44.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.725+0000 7f6ae17fa700 1 -- 172.21.15.124:0/3116801448 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ae4003050 con 0x7f6aec0b1a70 2023-10-06T04:45:44.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.726+0000 7f6ae17fa700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ad0066f00 0x7f6ad00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:44.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.726+0000 7f6ae17fa700 1 -- 172.21.15.124:0/3116801448 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ae4014030 con 0x7f6aec0b1a70 2023-10-06T04:45:44.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.726+0000 7f6af159b700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ad0066f00 0x7f6ad00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:44.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.727+0000 7f6af159b700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ad0066f00 0x7f6ad00693b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8003a80 tx=0x7f6ae8007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:44.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.730+0000 7f6ae17fa700 1 -- 172.21.15.124:0/3116801448 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ae4054ce0 con 0x7f6aec0b1a70 2023-10-06T04:45:44.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.964+0000 7f6af37ff700 1 -- 172.21.15.124:0/3116801448 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6aec0717a0 con 0x7f6aec0b1a70 2023-10-06T04:45:44.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.965+0000 7f6ae17fa700 1 -- 172.21.15.124:0/3116801448 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f6ae402a070 con 0x7f6aec0b1a70 2023-10-06T04:45:44.968 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:44.968 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/518958812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":518958812},{"type":"v1","addr":"172.21.15.158:6834","nonce":518958812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/120181660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":120181660},{"type":"v1","addr":"172.21.15.158:6835","nonce":120181660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1421870244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1421870244},{"type":"v1","addr":"172.21.15.124:6836","nonce":1421870244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:24.506230+0000","modified":"2023-10-06T04:45:28.049891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.124:6837/1031472040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1031472040},{"type":"v1","addr":"172.21.15.124:6837","nonce":1031472040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:45:44.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 -- 172.21.15.124:0/3116801448 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ad0066f00 msgr2=0x7f6ad00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ad0066f00 0x7f6ad00693b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8003a80 tx=0x7f6ae8007ec0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 -- 172.21.15.124:0/3116801448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec0b1a70 msgr2=0x7f6aec0ab040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:44.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec0b1a70 0x7f6aec0ab040 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400c7d0 tx=0x7f6ae4017000 comp rx=0 tx=0).stop 2023-10-06T04:45:44.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 -- 172.21.15.124:0/3116801448 shutdown_connections 2023-10-06T04:45:44.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6aec0b1a70 0x7f6aec0ab040 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aec06a140 0x7f6aec0ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6ad0066f00 0x7f6ad00693b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 --2- 172.21.15.124:0/3116801448 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ac3d0 0x7f6aec0aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:44.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 -- 172.21.15.124:0/3116801448 >> 172.21.15.124:0/3116801448 conn(0x7f6aec0cc050 msgr2=0x7f6aec153510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:44.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.967+0000 7f6af37ff700 1 -- 172.21.15.124:0/3116801448 shutdown_connections 2023-10-06T04:45:44.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:44.968+0000 7f6af37ff700 1 -- 172.21.15.124:0/3116801448 wait complete. 2023-10-06T04:45:44.971 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2023-10-06T04:45:44.987 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:45.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.175+0000 7f66fa5ff700 1 Processor -- start 2023-10-06T04:45:45.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.176+0000 7f66fa5ff700 1 -- start start 2023-10-06T04:45:45.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.177+0000 7f66fa5ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f66f40cae80 0x7f66f40cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.177+0000 7f66fa5ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f40c1d10 con 0x7f66f40ccec0 2023-10-06T04:45:45.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.177+0000 7f66fa5ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f40688a0 con 0x7f66f41598e0 2023-10-06T04:45:45.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.177+0000 7f66fa5ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f40cd430 con 0x7f66f40cae80 2023-10-06T04:45:45.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.177+0000 7f66f3fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f66f40cae80 0x7f66f40cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.177+0000 7f66f37fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f66f40ccec0 0x7f66f41591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:58348/0 (socket says 172.21.15.124:58348) 2023-10-06T04:45:45.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.177+0000 7f66f37fe700 1 -- 172.21.15.124:0/1286972853 learned_addr learned my addr 172.21.15.124:0/1286972853 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:45.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.177+0000 7f66f3fff700 1 -- 172.21.15.124:0/1286972853 >> v1:172.21.15.158:6789/0 conn(0x7f66f41598e0 legacy=0x7f66f40afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:45.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.178+0000 7f66f3fff700 1 -- 172.21.15.124:0/1286972853 >> v1:172.21.15.124:6789/0 conn(0x7f66f40ccec0 legacy=0x7f66f41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.178+0000 7f66f3fff700 1 -- 172.21.15.124:0/1286972853 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f4068b80 con 0x7f66f40cae80 2023-10-06T04:45:45.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.178+0000 7f66f2ffd700 1 -- 172.21.15.124:0/1286972853 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462814784 0 0) 0x7f66f40c1d10 con 0x7f66f40ccec0 2023-10-06T04:45:45.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.178+0000 7f66f3fff700 1 --2- 172.21.15.124:0/1286972853 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 0x7f66f40cc980 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f66e40098e0 tx=0x7f66e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c276008818651745 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:45.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.178+0000 7f66f2ffd700 1 -- 172.21.15.124:0/1286972853 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4009e80 con 0x7f66f40cae80 2023-10-06T04:45:45.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.178+0000 7f66f2ffd700 1 -- 172.21.15.124:0/1286972853 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e400b820 con 0x7f66f40cae80 2023-10-06T04:45:45.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.178+0000 7f66f2ffd700 1 -- 172.21.15.124:0/1286972853 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400bba0 con 0x7f66f40cae80 2023-10-06T04:45:45.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.178+0000 7f66fa5ff700 1 -- 172.21.15.124:0/1286972853 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 msgr2=0x7f66f40cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.178+0000 7f66fa5ff700 1 --2- 172.21.15.124:0/1286972853 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 0x7f66f40cc980 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f66e40098e0 tx=0x7f66e40091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.179+0000 7f66fa5ff700 1 -- 172.21.15.124:0/1286972853 shutdown_connections 2023-10-06T04:45:45.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.179+0000 7f66fa5ff700 1 --2- 172.21.15.124:0/1286972853 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 0x7f66f40cc980 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.179+0000 7f66fa5ff700 1 -- 172.21.15.124:0/1286972853 >> 172.21.15.124:0/1286972853 conn(0x7f66f40974f0 msgr2=0x7f66f40639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:45.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.179+0000 7f66fa5ff700 1 -- 172.21.15.124:0/1286972853 shutdown_connections 2023-10-06T04:45:45.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.179+0000 7f66fa5ff700 1 -- 172.21.15.124:0/1286972853 wait complete. 2023-10-06T04:45:45.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.180+0000 7f66fa5ff700 1 Processor -- start 2023-10-06T04:45:45.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.180+0000 7f66fa5ff700 1 -- start start 2023-10-06T04:45:45.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.181+0000 7f66fa5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 0x7f66f40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.181+0000 7f66fa5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f40ccec0 0x7f66f40b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.181+0000 7f66fa5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f41598e0 0x7f66f416d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.181+0000 7f66fa5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f416ad00 con 0x7f66f40cae80 2023-10-06T04:45:45.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.181+0000 7f66fa5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f40c5a90 con 0x7f66f41598e0 2023-10-06T04:45:45.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.181+0000 7f66fa5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f416aa20 con 0x7f66f40ccec0 2023-10-06T04:45:45.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.181+0000 7f66f3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 0x7f66f40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.181+0000 7f66f3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 0x7f66f40b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46482/0 (socket says 172.21.15.124:46482) 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.181+0000 7f66f3fff700 1 -- 172.21.15.124:0/3155296706 learned_addr learned my addr 172.21.15.124:0/3155296706 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66f8b9c700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f41598e0 0x7f66f416d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66f37fe700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f40ccec0 0x7f66f40b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66f3fff700 1 -- 172.21.15.124:0/3155296706 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f40ccec0 msgr2=0x7f66f40b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66f3fff700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f40ccec0 0x7f66f40b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66f3fff700 1 -- 172.21.15.124:0/3155296706 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f41598e0 msgr2=0x7f66f416d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66f3fff700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f41598e0 0x7f66f416d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66f3fff700 1 -- 172.21.15.124:0/3155296706 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4009420 con 0x7f66f40cae80 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66f8b9c700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f41598e0 0x7f66f416d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:45.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66f37fe700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f40ccec0 0x7f66f40b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:45.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66f3fff700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 0x7f66f40b0070 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f66e40030c0 tx=0x7f66e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:45.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66dbfff700 1 -- 172.21.15.124:0/3155296706 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400ba10 con 0x7f66f40cae80 2023-10-06T04:45:45.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66dbfff700 1 -- 172.21.15.124:0/3155296706 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4020070 con 0x7f66f40cae80 2023-10-06T04:45:45.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66fa5ff700 1 -- 172.21.15.124:0/3155296706 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f40c5440 con 0x7f66f40cae80 2023-10-06T04:45:45.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66dbfff700 1 -- 172.21.15.124:0/3155296706 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e401b6a0 con 0x7f66f40cae80 2023-10-06T04:45:45.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.182+0000 7f66fa5ff700 1 -- 172.21.15.124:0/3155296706 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f40c5f20 con 0x7f66f40cae80 2023-10-06T04:45:45.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.183+0000 7f66fa5ff700 1 -- 172.21.15.124:0/3155296706 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f40c52a0 con 0x7f66f40cae80 2023-10-06T04:45:45.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.184+0000 7f66dbfff700 1 -- 172.21.15.124:0/3155296706 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66e4022030 con 0x7f66f40cae80 2023-10-06T04:45:45.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.185+0000 7f66dbfff700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f66e0066f30 0x7f66e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.185+0000 7f66dbfff700 1 -- 172.21.15.124:0/3155296706 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f66e4086750 con 0x7f66f40cae80 2023-10-06T04:45:45.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.185+0000 7f66f37fe700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f66e0066f30 0x7f66e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.186+0000 7f66f37fe700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f66e0066f30 0x7f66e00693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f66f406f7f0 tx=0x7f66e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:45.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.189+0000 7f66dbfff700 1 -- 172.21.15.124:0/3155296706 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66f40c52a0 con 0x7f66f40cae80 2023-10-06T04:45:45.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.423+0000 7f66fa5ff700 1 -- 172.21.15.124:0/3155296706 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66f40c52a0 con 0x7f66f40cae80 2023-10-06T04:45:45.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.424+0000 7f66dbfff700 1 -- 172.21.15.124:0/3155296706 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f66f40c52a0 con 0x7f66f40cae80 2023-10-06T04:45:45.426 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:45.426 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/518958812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":518958812},{"type":"v1","addr":"172.21.15.158:6834","nonce":518958812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/120181660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":120181660},{"type":"v1","addr":"172.21.15.158:6835","nonce":120181660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1421870244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1421870244},{"type":"v1","addr":"172.21.15.124:6836","nonce":1421870244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:24.506230+0000","modified":"2023-10-06T04:45:28.049891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.124:6837/1031472040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1031472040},{"type":"v1","addr":"172.21.15.124:6837","nonce":1031472040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:45:45.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 -- 172.21.15.124:0/3155296706 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f66e0066f30 msgr2=0x7f66e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f66e0066f30 0x7f66e00693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f66f406f7f0 tx=0x7f66e8009040 comp rx=0 tx=0).stop 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 -- 172.21.15.124:0/3155296706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 msgr2=0x7f66f40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 0x7f66f40b0070 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f66e40030c0 tx=0x7f66e4016000 comp rx=0 tx=0).stop 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 -- 172.21.15.124:0/3155296706 shutdown_connections 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f41598e0 0x7f66f416d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66f40cae80 0x7f66f40b0070 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f66e0066f30 0x7f66e00693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 --2- 172.21.15.124:0/3155296706 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f40ccec0 0x7f66f40b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 -- 172.21.15.124:0/3155296706 >> 172.21.15.124:0/3155296706 conn(0x7f66f40974f0 msgr2=0x7f66f406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 -- 172.21.15.124:0/3155296706 shutdown_connections 2023-10-06T04:45:45.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.426+0000 7f66fa5ff700 1 -- 172.21.15.124:0/3155296706 wait complete. 2023-10-06T04:45:45.430 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2023-10-06T04:45:45.446 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:45.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.634+0000 7fd5a3fff700 1 Processor -- start 2023-10-06T04:45:45.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.634+0000 7fd5a3fff700 1 -- start start 2023-10-06T04:45:45.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.635+0000 7fd5a3fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd59c0abb60 0x7fd59c0abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.635+0000 7fd5a3fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd59c0ccd30 0x7fd59c098f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.635+0000 7fd5a3fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd59c0690b0 0x7fd59c099440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.635+0000 7fd5a3fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c0acc40 con 0x7fd59c0abb60 2023-10-06T04:45:45.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.635+0000 7fd5a3fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c099980 con 0x7fd59c0ccd30 2023-10-06T04:45:45.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.635+0000 7fd5a3fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0ad0d0 con 0x7fd59c0690b0 2023-10-06T04:45:45.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.635+0000 7fd5a1d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd59c0abb60 0x7fd59c0abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a1d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd59c0abb60 0x7fd59c0abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46498/0 (socket says 172.21.15.124:46498) 2023-10-06T04:45:45.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a1d9b700 1 -- 172.21.15.124:0/260451356 learned_addr learned my addr 172.21.15.124:0/260451356 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:45.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a159a700 1 --2- 172.21.15.124:0/260451356 >> v2:172.21.15.158:3300/0 conn(0x7fd59c0ccd30 0x7fd59c098f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a259c700 1 --2- 172.21.15.124:0/260451356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd59c0690b0 0x7fd59c099440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a1d9b700 1 -- 172.21.15.124:0/260451356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd59c0690b0 msgr2=0x7fd59c099440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:45.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a1d9b700 1 --2- 172.21.15.124:0/260451356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd59c0690b0 0x7fd59c099440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a1d9b700 1 -- 172.21.15.124:0/260451356 >> v2:172.21.15.158:3300/0 conn(0x7fd59c0ccd30 msgr2=0x7fd59c098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:45.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a1d9b700 1 --2- 172.21.15.124:0/260451356 >> v2:172.21.15.158:3300/0 conn(0x7fd59c0ccd30 0x7fd59c098f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a1d9b700 1 -- 172.21.15.124:0/260451356 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c06ae30 con 0x7fd59c0abb60 2023-10-06T04:45:45.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a1d9b700 1 --2- 172.21.15.124:0/260451356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0abb60 0x7fd59c0abf30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd59c099f90 tx=0x7fd598009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215cbf041a8ee8ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:45.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.636+0000 7fd5a0d99700 1 -- 172.21.15.124:0/260451356 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800b860 con 0x7fd59c0abb60 2023-10-06T04:45:45.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a0d99700 1 -- 172.21.15.124:0/260451356 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59800b9c0 con 0x7fd59c0abb60 2023-10-06T04:45:45.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a0d99700 1 -- 172.21.15.124:0/260451356 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800bd60 con 0x7fd59c0abb60 2023-10-06T04:45:45.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a3fff700 1 -- 172.21.15.124:0/260451356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0abb60 msgr2=0x7fd59c0abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a3fff700 1 --2- 172.21.15.124:0/260451356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0abb60 0x7fd59c0abf30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd59c099f90 tx=0x7fd598009250 comp rx=0 tx=0).stop 2023-10-06T04:45:45.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a3fff700 1 -- 172.21.15.124:0/260451356 shutdown_connections 2023-10-06T04:45:45.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a3fff700 1 --2- 172.21.15.124:0/260451356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd59c0690b0 0x7fd59c099440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a3fff700 1 --2- 172.21.15.124:0/260451356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0abb60 0x7fd59c0abf30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a3fff700 1 --2- 172.21.15.124:0/260451356 >> v2:172.21.15.158:3300/0 conn(0x7fd59c0ccd30 0x7fd59c098f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a3fff700 1 -- 172.21.15.124:0/260451356 >> 172.21.15.124:0/260451356 conn(0x7fd59c0cc050 msgr2=0x7fd59c0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:45.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a3fff700 1 -- 172.21.15.124:0/260451356 shutdown_connections 2023-10-06T04:45:45.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.637+0000 7fd5a3fff700 1 -- 172.21.15.124:0/260451356 wait complete. 2023-10-06T04:45:45.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.639+0000 7fd5a3fff700 1 Processor -- start 2023-10-06T04:45:45.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.639+0000 7fd5a3fff700 1 -- start start 2023-10-06T04:45:45.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a3fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd59c0690b0 0x7fd59c146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a3fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd59c0abb60 0x7fd59c0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0ccd30 0x7fd59c0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a3fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c146a60 con 0x7fd59c0ccd30 2023-10-06T04:45:45.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a3fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0a7130 con 0x7fd59c0690b0 2023-10-06T04:45:45.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a3fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0a7410 con 0x7fd59c0abb60 2023-10-06T04:45:45.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0ccd30 0x7fd59c0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0ccd30 0x7fd59c0cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46500/0 (socket says 172.21.15.124:46500) 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a259c700 1 -- 172.21.15.124:0/976793162 learned_addr learned my addr 172.21.15.124:0/976793162 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a159a700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd59c0abb60 0x7fd59c0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a1d9b700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd59c0690b0 0x7fd59c146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a259c700 1 -- 172.21.15.124:0/976793162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd59c0abb60 msgr2=0x7fd59c0caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a259c700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd59c0abb60 0x7fd59c0caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a259c700 1 -- 172.21.15.124:0/976793162 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd59c0690b0 msgr2=0x7fd59c146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a259c700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd59c0690b0 0x7fd59c146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.640+0000 7fd5a259c700 1 -- 172.21.15.124:0/976793162 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980094f0 con 0x7fd59c0ccd30 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.641+0000 7fd5a259c700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0ccd30 0x7fd59c0cb4a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd594007f20 tx=0x7fd594009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.641+0000 7fd591ffb700 1 -- 172.21.15.124:0/976793162 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400eca0 con 0x7fd59c0ccd30 2023-10-06T04:45:45.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.641+0000 7fd591ffb700 1 -- 172.21.15.124:0/976793162 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59400ee20 con 0x7fd59c0ccd30 2023-10-06T04:45:45.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.641+0000 7fd591ffb700 1 -- 172.21.15.124:0/976793162 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594014670 con 0x7fd59c0ccd30 2023-10-06T04:45:45.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.641+0000 7fd5a3fff700 1 -- 172.21.15.124:0/976793162 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c0a76f0 con 0x7fd59c0ccd30 2023-10-06T04:45:45.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.641+0000 7fd5a3fff700 1 -- 172.21.15.124:0/976793162 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c0a7cb0 con 0x7fd59c0ccd30 2023-10-06T04:45:45.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.642+0000 7fd5a3fff700 1 -- 172.21.15.124:0/976793162 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c0a81d0 con 0x7fd59c0ccd30 2023-10-06T04:45:45.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.643+0000 7fd591ffb700 1 -- 172.21.15.124:0/976793162 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5940149e0 con 0x7fd59c0ccd30 2023-10-06T04:45:45.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.643+0000 7fd591ffb700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd580066f30 0x7fd5800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:45.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.644+0000 7fd591ffb700 1 -- 172.21.15.124:0/976793162 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd594084e60 con 0x7fd59c0ccd30 2023-10-06T04:45:45.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.644+0000 7fd5a1d9b700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd580066f30 0x7fd5800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:45.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.644+0000 7fd5a1d9b700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd580066f30 0x7fd5800693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd59c099f90 tx=0x7fd598017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:45.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.648+0000 7fd591ffb700 1 -- 172.21.15.124:0/976793162 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd594051ed0 con 0x7fd59c0ccd30 2023-10-06T04:45:45.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.844+0000 7fd5a3fff700 1 -- 172.21.15.124:0/976793162 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd59c0a7ed0 con 0x7fd59c0ccd30 2023-10-06T04:45:45.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.845+0000 7fd591ffb700 1 -- 172.21.15.124:0/976793162 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fd5940554f0 con 0x7fd59c0ccd30 2023-10-06T04:45:45.847 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:45.848 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":33,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:45:26.035018+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:22.109975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:23.489027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:45.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 -- 172.21.15.124:0/976793162 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd580066f30 msgr2=0x7fd5800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd580066f30 0x7fd5800693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd59c099f90 tx=0x7fd598017000 comp rx=0 tx=0).stop 2023-10-06T04:45:45.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 -- 172.21.15.124:0/976793162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0ccd30 msgr2=0x7fd59c0cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:45.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0ccd30 0x7fd59c0cb4a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd594007f20 tx=0x7fd594009860 comp rx=0 tx=0).stop 2023-10-06T04:45:45.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 -- 172.21.15.124:0/976793162 shutdown_connections 2023-10-06T04:45:45.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd59c0ccd30 0x7fd59c0cb4a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd59c0690b0 0x7fd59c146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd580066f30 0x7fd5800693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 --2- 172.21.15.124:0/976793162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd59c0abb60 0x7fd59c0caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:45.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 -- 172.21.15.124:0/976793162 >> 172.21.15.124:0/976793162 conn(0x7fd59c0cc050 msgr2=0x7fd59c1561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:45.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 -- 172.21.15.124:0/976793162 shutdown_connections 2023-10-06T04:45:45.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:45.847+0000 7fd5a3fff700 1 -- 172.21.15.124:0/976793162 wait complete. 2023-10-06T04:45:45.868 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:45:46.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.057+0000 7f2cf1dff700 1 Processor -- start 2023-10-06T04:45:46.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.057+0000 7f2cf1dff700 1 -- start start 2023-10-06T04:45:46.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.058+0000 7f2cf1dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec15b130 0x7f2cec06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.058+0000 7f2cf1dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec06dba0 con 0x7f2cec15b500 2023-10-06T04:45:46.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.058+0000 7f2cf1dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec06d390 con 0x7f2cec15bbe0 2023-10-06T04:45:46.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.058+0000 7f2cf1dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0699b0 con 0x7f2cec15b130 2023-10-06T04:45:46.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cebfff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2cec15b500 0x7f2cec0adda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:58362/0 (socket says 172.21.15.124:58362) 2023-10-06T04:45:46.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cebfff700 1 -- 172.21.15.124:0/1923727166 learned_addr learned my addr 172.21.15.124:0/1923727166 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:46.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2ceb7fe700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec15b130 0x7f2cec06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195572379 0 0) 0x7f2ce4001490 con 0x7f2cec15b500 2023-10-06T04:45:46.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd4003570 con 0x7f2cec15b500 2023-10-06T04:45:46.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227509292 0 0) 0x7f2cec06d390 con 0x7f2cec15bbe0 2023-10-06T04:45:46.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ce4001490 con 0x7f2cec15bbe0 2023-10-06T04:45:46.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2344524943 0 0) 0x7f2cd4003570 con 0x7f2cec15b500 2023-10-06T04:45:46.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec15b130 msgr2=0x7f2cec06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:46.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cea7fc700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec15b130 0x7f2cec06efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 >> v1:172.21.15.158:6789/0 conn(0x7f2cec15bbe0 legacy=0x7f2cec151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:46.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec06d5e0 con 0x7f2cec15b500 2023-10-06T04:45:46.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.059+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f2ce4001980 con 0x7f2cec15b500 2023-10-06T04:45:46.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 >> v1:172.21.15.124:6789/0 conn(0x7f2cec15b500 legacy=0x7f2cec0adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:46.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2cea7fc700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 0x7f2cd4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2cea7fc700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec15b130 0x7f2cd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2cea7fc700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cd4004d50 0x7f2cd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0699b0 con 0x7f2cd4003c20 2023-10-06T04:45:46.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd400bb40 con 0x7f2cd4004d50 2023-10-06T04:45:46.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd400bd00 con 0x7f2cec15b130 2023-10-06T04:45:46.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2ceb7fe700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 0x7f2cd4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2ceaffd700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec15b130 0x7f2cd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2cebfff700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cd4004d50 0x7f2cd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2ceb7fe700 1 -- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec15b130 msgr2=0x7f2cd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:46.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2ceb7fe700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec15b130 0x7f2cd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2ceb7fe700 1 -- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cd4004d50 msgr2=0x7f2cd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:46.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2ceb7fe700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cd4004d50 0x7f2cd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2ceb7fe700 1 -- 172.21.15.124:0/1923727166 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd4003570 con 0x7f2cd4003c20 2023-10-06T04:45:46.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.060+0000 7f2ceb7fe700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 0x7f2cd4004010 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009c00 tx=0x7f2cdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff41acec64b751b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:46.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.061+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc00e710 con 0x7f2cd4003c20 2023-10-06T04:45:46.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.061+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc00e870 con 0x7f2cd4003c20 2023-10-06T04:45:46.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.061+0000 7f2cea7fc700 1 -- 172.21.15.124:0/1923727166 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc00ec30 con 0x7f2cd4003c20 2023-10-06T04:45:46.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.061+0000 7f2cf1dff700 1 -- 172.21.15.124:0/1923727166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 msgr2=0x7f2cd4004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:46.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.061+0000 7f2cf1dff700 1 --2- 172.21.15.124:0/1923727166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 0x7f2cd4004010 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009c00 tx=0x7f2cdc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.061+0000 7f2cebfff700 1 -- 172.21.15.124:0/1923727166 reap_dead start 2023-10-06T04:45:46.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.061+0000 7f2cf1dff700 1 -- 172.21.15.124:0/1923727166 shutdown_connections 2023-10-06T04:45:46.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.061+0000 7f2cf1dff700 1 -- 172.21.15.124:0/1923727166 >> 172.21.15.124:0/1923727166 conn(0x7f2cec0cc080 msgr2=0x7f2cec0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:46.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.061+0000 7f2cf1dff700 1 -- 172.21.15.124:0/1923727166 shutdown_connections 2023-10-06T04:45:46.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.061+0000 7f2cf1dff700 1 -- 172.21.15.124:0/1923727166 wait complete. 2023-10-06T04:45:46.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.063+0000 7f2cf1dff700 1 Processor -- start 2023-10-06T04:45:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.063+0000 7f2cf1dff700 1 -- start start 2023-10-06T04:45:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2cf1dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 0x7f2cec169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2cf1dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cec0c8260 0x7f2cec097270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2cf1dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec0977b0 0x7f2cec0ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2cf1dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1554f0 con 0x7f2cd4003c20 2023-10-06T04:45:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2cf1dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0ad160 con 0x7f2cec0c8260 2023-10-06T04:45:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2cf1dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0ad440 con 0x7f2cec0977b0 2023-10-06T04:45:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2ceb7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 0x7f2cec169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2ceb7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 0x7f2cec169e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46510/0 (socket says 172.21.15.124:46510) 2023-10-06T04:45:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2ceb7fe700 1 -- 172.21.15.124:0/3370599133 learned_addr learned my addr 172.21.15.124:0/3370599133 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2cebfff700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec0977b0 0x7f2cec0ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2ceaffd700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cec0c8260 0x7f2cec097270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2ceb7fe700 1 -- 172.21.15.124:0/3370599133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec0977b0 msgr2=0x7f2cec0ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2ceb7fe700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec0977b0 0x7f2cec0ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2ceb7fe700 1 -- 172.21.15.124:0/3370599133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cec0c8260 msgr2=0x7f2cec097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.064+0000 7f2ceb7fe700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cec0c8260 0x7f2cec097270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.065+0000 7f2ceb7fe700 1 -- 172.21.15.124:0/3370599133 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec16a680 con 0x7f2cd4003c20 2023-10-06T04:45:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.065+0000 7f2cebfff700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec0977b0 0x7f2cec0ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:46.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.065+0000 7f2ceaffd700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cec0c8260 0x7f2cec097270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:46.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.065+0000 7f2ceb7fe700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 0x7f2cec169e00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc013ef0 tx=0x7f2cdc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:46.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.065+0000 7f2cd37fe700 1 -- 172.21.15.124:0/3370599133 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc022070 con 0x7f2cd4003c20 2023-10-06T04:45:46.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.065+0000 7f2cd37fe700 1 -- 172.21.15.124:0/3370599133 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc00e9e0 con 0x7f2cd4003c20 2023-10-06T04:45:46.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.065+0000 7f2cf1dff700 1 -- 172.21.15.124:0/3370599133 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec16a960 con 0x7f2cd4003c20 2023-10-06T04:45:46.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.065+0000 7f2cd37fe700 1 -- 172.21.15.124:0/3370599133 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc027470 con 0x7f2cd4003c20 2023-10-06T04:45:46.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.065+0000 7f2cf1dff700 1 -- 172.21.15.124:0/3370599133 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec16a340 con 0x7f2cd4003c20 2023-10-06T04:45:46.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.066+0000 7f2cf1dff700 1 -- 172.21.15.124:0/3370599133 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec0717a0 con 0x7f2cd4003c20 2023-10-06T04:45:46.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.067+0000 7f2cd37fe700 1 -- 172.21.15.124:0/3370599133 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cdc01c450 con 0x7f2cd4003c20 2023-10-06T04:45:46.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.068+0000 7f2cd37fe700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cd8066f30 0x7f2cd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.068+0000 7f2cd37fe700 1 -- 172.21.15.124:0/3370599133 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2cdc086360 con 0x7f2cd4003c20 2023-10-06T04:45:46.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.068+0000 7f2ceaffd700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cd8066f30 0x7f2cd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.069+0000 7f2ceaffd700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cd8066f30 0x7f2cd80693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2cec15c010 tx=0x7f2ce0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:46.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.072+0000 7f2cd37fe700 1 -- 172.21.15.124:0/3370599133 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cdc0533d0 con 0x7f2cd4003c20 2023-10-06T04:45:46.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.310+0000 7f2cf1dff700 1 -- 172.21.15.124:0/3370599133 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2cec0c8b90 con 0x7f2cd4003c20 2023-10-06T04:45:46.313 INFO:tasks.ceph.mon.a.smithi124.stderr:2023-10-06T04:45:46.311+0000 7fc5395f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:45:46.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.315+0000 7f2cd37fe700 1 -- 172.21.15.124:0/3370599133 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2cdc0569f0 con 0x7f2cd4003c20 2023-10-06T04:45:46.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 -- 172.21.15.124:0/3370599133 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cd8066f30 msgr2=0x7f2cd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:46.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cd8066f30 0x7f2cd80693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2cec15c010 tx=0x7f2ce0009040 comp rx=0 tx=0).stop 2023-10-06T04:45:46.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 -- 172.21.15.124:0/3370599133 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 msgr2=0x7f2cec169e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:46.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 0x7f2cec169e00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc013ef0 tx=0x7f2cdc01a000 comp rx=0 tx=0).stop 2023-10-06T04:45:46.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 -- 172.21.15.124:0/3370599133 shutdown_connections 2023-10-06T04:45:46.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2cd8066f30 0x7f2cd80693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cec0977b0 0x7f2cec0ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd4003c20 0x7f2cec169e00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 --2- 172.21.15.124:0/3370599133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cec0c8260 0x7f2cec097270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 -- 172.21.15.124:0/3370599133 >> 172.21.15.124:0/3370599133 conn(0x7f2cec0cc080 msgr2=0x7f2cec155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:46.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 -- 172.21.15.124:0/3370599133 shutdown_connections 2023-10-06T04:45:46.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.318+0000 7f2cf1dff700 1 -- 172.21.15.124:0/3370599133 wait complete. 2023-10-06T04:45:46.322 INFO:teuthology.orchestra.run.smithi124.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:45:46.326 INFO:tasks.ceph.mds.a.smithi124.stderr: -4830> 2023-10-06T04:45:27.506+0000 7f0deb7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:45:46.339 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:45:46.375 INFO:tasks.ceph.mds.a.smithi124.stdout:starting mds.a at 2023-10-06T04:45:46.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.531+0000 7f2d795ff700 1 Processor -- start 2023-10-06T04:45:46.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.531+0000 7f2d795ff700 1 -- start start 2023-10-06T04:45:46.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.532+0000 7f2d795ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2d74157700 0x7f2d7406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.532+0000 7f2d795ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2d740694c0 0x7f2d74069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.532+0000 7f2d795ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d74157ad0 con 0x7f2d7406a3d0 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.532+0000 7f2d795ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d74069e40 con 0x7f2d74157700 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.532+0000 7f2d795ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7406db30 con 0x7f2d740694c0 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.533+0000 7f2d72ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2d74157700 0x7f2d7406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.533+0000 7f2d72ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2d74157700 0x7f2d7406d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46520/0 (socket says 172.21.15.124:46520) 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.533+0000 7f2d72ffd700 1 -- 172.21.15.124:0/2393876165 learned_addr learned my addr 172.21.15.124:0/2393876165 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.533+0000 7f2d737fe700 1 --2- 172.21.15.124:0/2393876165 >> v2:172.21.15.158:3300/0 conn(0x7f2d740694c0 0x7f2d74069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.533+0000 7f2d72ffd700 1 -- 172.21.15.124:0/2393876165 >> v2:172.21.15.158:3300/0 conn(0x7f2d740694c0 msgr2=0x7f2d74069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.533+0000 7f2d72ffd700 1 --2- 172.21.15.124:0/2393876165 >> v2:172.21.15.158:3300/0 conn(0x7f2d740694c0 0x7f2d74069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.533+0000 7f2d72ffd700 1 -- 172.21.15.124:0/2393876165 >> v1:172.21.15.158:6789/0 conn(0x7f2d7406a3d0 legacy=0x7f2d740aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.533+0000 7f2d72ffd700 1 -- 172.21.15.124:0/2393876165 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7406de10 con 0x7f2d74157700 2023-10-06T04:45:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.533+0000 7f2d72ffd700 1 --2- 172.21.15.124:0/2393876165 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d74157700 0x7f2d7406d2e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2d740cbeb0 tx=0x7f2d64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdb595c0c25bd12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:46.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.533+0000 7f2d71ffb700 1 -- 172.21.15.124:0/2393876165 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400b820 con 0x7f2d74157700 2023-10-06T04:45:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.534+0000 7f2d71ffb700 1 -- 172.21.15.124:0/2393876165 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6400b980 con 0x7f2d74157700 2023-10-06T04:45:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.534+0000 7f2d71ffb700 1 -- 172.21.15.124:0/2393876165 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400bd20 con 0x7f2d74157700 2023-10-06T04:45:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.534+0000 7f2d795ff700 1 -- 172.21.15.124:0/2393876165 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d74157700 msgr2=0x7f2d7406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.534+0000 7f2d795ff700 1 --2- 172.21.15.124:0/2393876165 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d74157700 0x7f2d7406d2e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2d740cbeb0 tx=0x7f2d64009250 comp rx=0 tx=0).stop 2023-10-06T04:45:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.534+0000 7f2d795ff700 1 -- 172.21.15.124:0/2393876165 shutdown_connections 2023-10-06T04:45:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.534+0000 7f2d795ff700 1 --2- 172.21.15.124:0/2393876165 >> v2:172.21.15.158:3300/0 conn(0x7f2d740694c0 0x7f2d74069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.534+0000 7f2d795ff700 1 --2- 172.21.15.124:0/2393876165 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d74157700 0x7f2d7406d2e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.534+0000 7f2d795ff700 1 -- 172.21.15.124:0/2393876165 >> 172.21.15.124:0/2393876165 conn(0x7f2d740680c0 msgr2=0x7f2d740cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.534+0000 7f2d795ff700 1 -- 172.21.15.124:0/2393876165 shutdown_connections 2023-10-06T04:45:46.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.534+0000 7f2d795ff700 1 -- 172.21.15.124:0/2393876165 wait complete. 2023-10-06T04:45:46.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.536+0000 7f2d795ff700 1 Processor -- start 2023-10-06T04:45:46.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.536+0000 7f2d795ff700 1 -- start start 2023-10-06T04:45:46.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d795ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d740694c0 0x7f2d740c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d795ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d7406a3d0 0x7f2d740c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d795ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d74157700 0x7f2d74153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d795ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74159010 con 0x7f2d7406a3d0 2023-10-06T04:45:46.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d795ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7415a640 con 0x7f2d740694c0 2023-10-06T04:45:46.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d795ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74158a50 con 0x7f2d74157700 2023-10-06T04:45:46.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d727fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d7406a3d0 0x7f2d740c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d727fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d7406a3d0 0x7f2d740c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46534/0 (socket says 172.21.15.124:46534) 2023-10-06T04:45:46.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d727fc700 1 -- 172.21.15.124:0/2495222475 learned_addr learned my addr 172.21.15.124:0/2495222475 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:46.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d72ffd700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d740694c0 0x7f2d740c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d737fe700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d74157700 0x7f2d74153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d727fc700 1 -- 172.21.15.124:0/2495222475 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d74157700 msgr2=0x7f2d74153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:46.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d727fc700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d74157700 0x7f2d74153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d727fc700 1 -- 172.21.15.124:0/2495222475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d740694c0 msgr2=0x7f2d740c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:46.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d727fc700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d740694c0 0x7f2d740c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:46.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.538+0000 7f2d727fc700 1 -- 172.21.15.124:0/2495222475 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d640094f0 con 0x7f2d7406a3d0 2023-10-06T04:45:46.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.539+0000 7f2d727fc700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d7406a3d0 0x7f2d740c57e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c5d0 tx=0x7f2d68007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:46.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.539+0000 7f2d5affd700 1 -- 172.21.15.124:0/2495222475 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68011590 con 0x7f2d7406a3d0 2023-10-06T04:45:46.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.539+0000 7f2d5affd700 1 -- 172.21.15.124:0/2495222475 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d68011730 con 0x7f2d7406a3d0 2023-10-06T04:45:46.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.539+0000 7f2d5affd700 1 -- 172.21.15.124:0/2495222475 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68011af0 con 0x7f2d7406a3d0 2023-10-06T04:45:46.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.539+0000 7f2d795ff700 1 -- 172.21.15.124:0/2495222475 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d74158d30 con 0x7f2d7406a3d0 2023-10-06T04:45:46.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.539+0000 7f2d795ff700 1 -- 172.21.15.124:0/2495222475 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7415a140 con 0x7f2d7406a3d0 2023-10-06T04:45:46.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.540+0000 7f2d795ff700 1 -- 172.21.15.124:0/2495222475 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7415a300 con 0x7f2d7406a3d0 2023-10-06T04:45:46.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.541+0000 7f2d5affd700 1 -- 172.21.15.124:0/2495222475 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d6801c460 con 0x7f2d7406a3d0 2023-10-06T04:45:46.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.542+0000 7f2d5affd700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2d60066f30 0x7f2d600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:46.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.542+0000 7f2d5affd700 1 -- 172.21.15.124:0/2495222475 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f2d680843c0 con 0x7f2d7406a3d0 2023-10-06T04:45:46.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.542+0000 7f2d72ffd700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2d60066f30 0x7f2d600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:46.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.543+0000 7f2d72ffd700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2d60066f30 0x7f2d600693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2d740cbeb0 tx=0x7f2d64016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:46.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.546+0000 7f2d5affd700 1 -- 172.21.15.124:0/2495222475 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d68051400 con 0x7f2d7406a3d0 2023-10-06T04:45:46.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:46.778+0000 7f2d795ff700 1 -- 172.21.15.124:0/2495222475 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2d74159cc0 con 0x7f2d7406a3d0 2023-10-06T04:45:47.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.316+0000 7f2d5affd700 1 -- 172.21.15.124:0/2495222475 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2d74159cc0 con 0x7f2d7406a3d0 2023-10-06T04:45:47.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 -- 172.21.15.124:0/2495222475 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2d60066f30 msgr2=0x7f2d600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:47.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2d60066f30 0x7f2d600693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2d740cbeb0 tx=0x7f2d64016000 comp rx=0 tx=0).stop 2023-10-06T04:45:47.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 -- 172.21.15.124:0/2495222475 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d7406a3d0 msgr2=0x7f2d740c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:47.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d7406a3d0 0x7f2d740c57e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c5d0 tx=0x7f2d68007f60 comp rx=0 tx=0).stop 2023-10-06T04:45:47.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 -- 172.21.15.124:0/2495222475 shutdown_connections 2023-10-06T04:45:47.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2d60066f30 0x7f2d600693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:47.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d74157700 0x7f2d74153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:47.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d740694c0 0x7f2d740c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:47.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 --2- 172.21.15.124:0/2495222475 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d7406a3d0 0x7f2d740c57e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:47.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 -- 172.21.15.124:0/2495222475 >> 172.21.15.124:0/2495222475 conn(0x7f2d740680c0 msgr2=0x7f2d740aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:47.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 -- 172.21.15.124:0/2495222475 shutdown_connections 2023-10-06T04:45:47.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.319+0000 7f2d795ff700 1 -- 172.21.15.124:0/2495222475 wait complete. 2023-10-06T04:45:47.341 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:45:47.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.576+0000 7f571a9ff700 1 Processor -- start 2023-10-06T04:45:47.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.576+0000 7f571a9ff700 1 -- start start 2023-10-06T04:45:47.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f571a9ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f57140cc5e0 0x7f571406b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:47.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f571a9ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f571415d260 0x7f571406beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:47.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f571a9ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57140cc270 con 0x7f571406ce90 2023-10-06T04:45:47.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f571a9ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571415d740 con 0x7f571415d260 2023-10-06T04:45:47.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f571a9ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571415da20 con 0x7f57140cc5e0 2023-10-06T04:45:47.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f57137fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f571415d260 0x7f571406beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:47.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f57137fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f571415d260 0x7f571406beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46540/0 (socket says 172.21.15.124:46540) 2023-10-06T04:45:47.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f57137fe700 1 -- 172.21.15.124:0/3989950379 learned_addr learned my addr 172.21.15.124:0/3989950379 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:47.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f5713fff700 1 --2- 172.21.15.124:0/3989950379 >> v2:172.21.15.158:3300/0 conn(0x7f57140cc5e0 0x7f571406b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:47.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f57137fe700 1 -- 172.21.15.124:0/3989950379 >> v2:172.21.15.158:3300/0 conn(0x7f57140cc5e0 msgr2=0x7f571406b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:47.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.578+0000 7f57137fe700 1 --2- 172.21.15.124:0/3989950379 >> v2:172.21.15.158:3300/0 conn(0x7f57140cc5e0 0x7f571406b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:47.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.579+0000 7f57137fe700 1 -- 172.21.15.124:0/3989950379 >> v1:172.21.15.158:6789/0 conn(0x7f571406ce90 legacy=0x7f571406d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:47.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.579+0000 7f57137fe700 1 -- 172.21.15.124:0/3989950379 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571415dd00 con 0x7f571415d260 2023-10-06T04:45:47.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.579+0000 7f57137fe700 1 --2- 172.21.15.124:0/3989950379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 0x7f571406beb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f57140cbf30 tx=0x7f5708009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d30e30c3463bca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:47.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.579+0000 7f5712ffd700 1 -- 172.21.15.124:0/3989950379 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800b860 con 0x7f571415d260 2023-10-06T04:45:47.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.579+0000 7f5712ffd700 1 -- 172.21.15.124:0/3989950379 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570800b9c0 con 0x7f571415d260 2023-10-06T04:45:47.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.579+0000 7f5712ffd700 1 -- 172.21.15.124:0/3989950379 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800bd60 con 0x7f571415d260 2023-10-06T04:45:47.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.580+0000 7f571a9ff700 1 -- 172.21.15.124:0/3989950379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 msgr2=0x7f571406beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:47.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.580+0000 7f571a9ff700 1 --2- 172.21.15.124:0/3989950379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 0x7f571406beb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f57140cbf30 tx=0x7f5708009250 comp rx=0 tx=0).stop 2023-10-06T04:45:47.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.580+0000 7f571a9ff700 1 -- 172.21.15.124:0/3989950379 shutdown_connections 2023-10-06T04:45:47.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.580+0000 7f571a9ff700 1 --2- 172.21.15.124:0/3989950379 >> v2:172.21.15.158:3300/0 conn(0x7f57140cc5e0 0x7f571406b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:47.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.580+0000 7f571a9ff700 1 --2- 172.21.15.124:0/3989950379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 0x7f571406beb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:47.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.580+0000 7f571a9ff700 1 -- 172.21.15.124:0/3989950379 >> 172.21.15.124:0/3989950379 conn(0x7f57140ce400 msgr2=0x7f57140ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:47.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.580+0000 7f571a9ff700 1 -- 172.21.15.124:0/3989950379 shutdown_connections 2023-10-06T04:45:47.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.580+0000 7f571a9ff700 1 -- 172.21.15.124:0/3989950379 wait complete. 2023-10-06T04:45:47.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.581+0000 7f571a9ff700 1 Processor -- start 2023-10-06T04:45:47.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.581+0000 7f571a9ff700 1 -- start start 2023-10-06T04:45:47.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.582+0000 7f571a9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f571406ce90 0x7f57140c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:47.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.582+0000 7f571a9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57140cc5e0 0x7f57140b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:47.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.582+0000 7f571a9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 0x7f57140b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:47.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.582+0000 7f571a9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140b2040 con 0x7f571415d260 2023-10-06T04:45:47.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.582+0000 7f571a9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140c7f60 con 0x7f57140cc5e0 2023-10-06T04:45:47.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.582+0000 7f571a9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57140b1430 con 0x7f571406ce90 2023-10-06T04:45:47.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.582+0000 7f5718f9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 0x7f57140b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:47.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f5718f9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 0x7f57140b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46552/0 (socket says 172.21.15.124:46552) 2023-10-06T04:45:47.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f5718f9c700 1 -- 172.21.15.124:0/713845272 learned_addr learned my addr 172.21.15.124:0/713845272 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:47.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f57137fe700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57140cc5e0 0x7f57140b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:47.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f5713fff700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f571406ce90 0x7f57140c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:47.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f5718f9c700 1 -- 172.21.15.124:0/713845272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f571406ce90 msgr2=0x7f57140c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:47.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f5718f9c700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f571406ce90 0x7f57140c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:47.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f5718f9c700 1 -- 172.21.15.124:0/713845272 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57140cc5e0 msgr2=0x7f57140b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:47.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f5718f9c700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57140cc5e0 0x7f57140b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:47.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f5718f9c700 1 -- 172.21.15.124:0/713845272 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57080094f0 con 0x7f571415d260 2023-10-06T04:45:47.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f5718f9c700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 0x7f57140b32e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c840 tx=0x7f570c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:47.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f56fbfff700 1 -- 172.21.15.124:0/713845272 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c012630 con 0x7f571415d260 2023-10-06T04:45:47.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f56fbfff700 1 -- 172.21.15.124:0/713845272 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c0127b0 con 0x7f571415d260 2023-10-06T04:45:47.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f571a9ff700 1 -- 172.21.15.124:0/713845272 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57140b1710 con 0x7f571415d260 2023-10-06T04:45:47.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.583+0000 7f56fbfff700 1 -- 172.21.15.124:0/713845272 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c012b70 con 0x7f571415d260 2023-10-06T04:45:47.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.584+0000 7f571a9ff700 1 -- 172.21.15.124:0/713845272 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57140b1cd0 con 0x7f571415d260 2023-10-06T04:45:47.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.585+0000 7f571a9ff700 1 -- 172.21.15.124:0/713845272 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57140b21b0 con 0x7f571415d260 2023-10-06T04:45:47.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.586+0000 7f56fbfff700 1 -- 172.21.15.124:0/713845272 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f570c01a3a0 con 0x7f571415d260 2023-10-06T04:45:47.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.586+0000 7f56fbfff700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5700066f30 0x7f57000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:47.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.586+0000 7f56fbfff700 1 -- 172.21.15.124:0/713845272 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f570c084810 con 0x7f571415d260 2023-10-06T04:45:47.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.587+0000 7f5713fff700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5700066f30 0x7f57000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:47.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.587+0000 7f5713fff700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5700066f30 0x7f57000693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f571415c3b0 tx=0x7f5704008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:47.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.591+0000 7f56fbfff700 1 -- 172.21.15.124:0/713845272 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f570c0518d0 con 0x7f571415d260 2023-10-06T04:45:47.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:47.784+0000 7f571a9ff700 1 -- 172.21.15.124:0/713845272 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f57140718b0 con 0x7f571415d260 2023-10-06T04:45:48.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.321+0000 7f56fbfff700 1 -- 172.21.15.124:0/713845272 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 181+0+0 (secure 0 0 0) 0x7f570c054ef0 con 0x7f571415d260 2023-10-06T04:45:48.326 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 -- 172.21.15.124:0/713845272 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5700066f30 msgr2=0x7f57000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5700066f30 0x7f57000693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f571415c3b0 tx=0x7f5704008040 comp rx=0 tx=0).stop 2023-10-06T04:45:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 -- 172.21.15.124:0/713845272 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 msgr2=0x7f57140b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 0x7f57140b32e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c840 tx=0x7f570c001670 comp rx=0 tx=0).stop 2023-10-06T04:45:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 -- 172.21.15.124:0/713845272 shutdown_connections 2023-10-06T04:45:48.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f571415d260 0x7f57140b32e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:48.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5700066f30 0x7f57000693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:48.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f571406ce90 0x7f57140c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:48.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 --2- 172.21.15.124:0/713845272 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57140cc5e0 0x7f57140b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:48.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 -- 172.21.15.124:0/713845272 >> 172.21.15.124:0/713845272 conn(0x7f57140ce400 msgr2=0x7f571415b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 -- 172.21.15.124:0/713845272 shutdown_connections 2023-10-06T04:45:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.324+0000 7f571a9ff700 1 -- 172.21.15.124:0/713845272 wait complete. 2023-10-06T04:45:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:45:48.345 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:45:48.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.536+0000 7f51511ff700 1 Processor -- start 2023-10-06T04:45:48.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.536+0000 7f51511ff700 1 -- start start 2023-10-06T04:45:48.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.537+0000 7f51511ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f514c0ae3d0 0x7f514c0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:48.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.537+0000 7f51511ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c0ccfe0 con 0x7f514c0af990 2023-10-06T04:45:48.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.537+0000 7f51511ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c0b0a30 con 0x7f514c1562e0 2023-10-06T04:45:48.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.537+0000 7f51511ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c0afe20 con 0x7f514c0ae3d0 2023-10-06T04:45:48.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.538+0000 7f514b59e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f514c0ae3d0 0x7f514c0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:48.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.538+0000 7f514a59c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f514c0af990 0x7f514c0accb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:58388/0 (socket says 172.21.15.124:58388) 2023-10-06T04:45:48.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.538+0000 7f514a59c700 1 -- 172.21.15.124:0/2402050493 learned_addr learned my addr 172.21.15.124:0/2402050493 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:48.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.538+0000 7f514b59e700 1 -- 172.21.15.124:0/2402050493 >> v1:172.21.15.158:6789/0 conn(0x7f514c1562e0 legacy=0x7f514c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:48.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.538+0000 7f514b59e700 1 -- 172.21.15.124:0/2402050493 >> v1:172.21.15.124:6789/0 conn(0x7f514c0af990 legacy=0x7f514c0accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:48.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.538+0000 7f514b59e700 1 -- 172.21.15.124:0/2402050493 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c0b0100 con 0x7f514c0ae3d0 2023-10-06T04:45:48.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.538+0000 7f5149d9b700 1 -- 172.21.15.124:0/2402050493 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250225088 0 0) 0x7f514c0ccfe0 con 0x7f514c0af990 2023-10-06T04:45:48.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.538+0000 7f514b59e700 1 --2- 172.21.15.124:0/2402050493 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c0ae3d0 0x7f514c0b0ec0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5144009e60 tx=0x7f5144009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e16c79e9abcd3f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:48.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.539+0000 7f5149d9b700 1 -- 172.21.15.124:0/2402050493 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514400e070 con 0x7f514c0ae3d0 2023-10-06T04:45:48.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.539+0000 7f5149d9b700 1 -- 172.21.15.124:0/2402050493 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514400bbf0 con 0x7f514c0ae3d0 2023-10-06T04:45:48.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.539+0000 7f5149d9b700 1 -- 172.21.15.124:0/2402050493 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144012430 con 0x7f514c0ae3d0 2023-10-06T04:45:48.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.539+0000 7f51511ff700 1 -- 172.21.15.124:0/2402050493 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c0ae3d0 msgr2=0x7f514c0b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:48.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.539+0000 7f51511ff700 1 --2- 172.21.15.124:0/2402050493 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c0ae3d0 0x7f514c0b0ec0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5144009e60 tx=0x7f5144009780 comp rx=0 tx=0).stop 2023-10-06T04:45:48.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.539+0000 7f51511ff700 1 -- 172.21.15.124:0/2402050493 shutdown_connections 2023-10-06T04:45:48.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.539+0000 7f51511ff700 1 --2- 172.21.15.124:0/2402050493 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c0ae3d0 0x7f514c0b0ec0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:48.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.539+0000 7f51511ff700 1 -- 172.21.15.124:0/2402050493 >> 172.21.15.124:0/2402050493 conn(0x7f514c068080 msgr2=0x7f514c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:48.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.539+0000 7f51511ff700 1 -- 172.21.15.124:0/2402050493 shutdown_connections 2023-10-06T04:45:48.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.539+0000 7f51511ff700 1 -- 172.21.15.124:0/2402050493 wait complete. 2023-10-06T04:45:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.541+0000 7f51511ff700 1 Processor -- start 2023-10-06T04:45:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.541+0000 7f51511ff700 1 -- start start 2023-10-06T04:45:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f51511ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f514c0ae3d0 0x7f514c152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f51511ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f514c0af990 0x7f514c158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f51511ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c1562e0 0x7f514c159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f51511ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c168f00 con 0x7f514c1562e0 2023-10-06T04:45:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f51511ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c1682f0 con 0x7f514c0ae3d0 2023-10-06T04:45:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f51511ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c1685d0 con 0x7f514c0af990 2023-10-06T04:45:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514b59e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c1562e0 0x7f514c159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514b59e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c1562e0 0x7f514c159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46572/0 (socket says 172.21.15.124:46572) 2023-10-06T04:45:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514b59e700 1 -- 172.21.15.124:0/816784380 learned_addr learned my addr 172.21.15.124:0/816784380 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514ad9d700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f514c0ae3d0 0x7f514c152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514a59c700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f514c0af990 0x7f514c158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514b59e700 1 -- 172.21.15.124:0/816784380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f514c0af990 msgr2=0x7f514c158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514b59e700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f514c0af990 0x7f514c158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514b59e700 1 -- 172.21.15.124:0/816784380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f514c0ae3d0 msgr2=0x7f514c152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514b59e700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f514c0ae3d0 0x7f514c152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514b59e700 1 -- 172.21.15.124:0/816784380 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144009a20 con 0x7f514c1562e0 2023-10-06T04:45:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.542+0000 7f514a59c700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f514c0af990 0x7f514c158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.543+0000 7f514b59e700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c1562e0 0x7f514c159320 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5144003000 tx=0x7f5144018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.543+0000 7f5132ffd700 1 -- 172.21.15.124:0/816784380 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514401d640 con 0x7f514c1562e0 2023-10-06T04:45:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.543+0000 7f5132ffd700 1 -- 172.21.15.124:0/816784380 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514401d7a0 con 0x7f514c1562e0 2023-10-06T04:45:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.543+0000 7f5132ffd700 1 -- 172.21.15.124:0/816784380 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514401db60 con 0x7f514c1562e0 2023-10-06T04:45:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.543+0000 7f51511ff700 1 -- 172.21.15.124:0/816784380 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c1688b0 con 0x7f514c1562e0 2023-10-06T04:45:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.543+0000 7f51511ff700 1 -- 172.21.15.124:0/816784380 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c152cd0 con 0x7f514c1562e0 2023-10-06T04:45:48.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.544+0000 7f51511ff700 1 -- 172.21.15.124:0/816784380 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c169070 con 0x7f514c1562e0 2023-10-06T04:45:48.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.545+0000 7f5132ffd700 1 -- 172.21.15.124:0/816784380 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5144024070 con 0x7f514c1562e0 2023-10-06T04:45:48.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.546+0000 7f5132ffd700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5138066f30 0x7f51380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:48.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.546+0000 7f5132ffd700 1 -- 172.21.15.124:0/816784380 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f51440870a0 con 0x7f514c1562e0 2023-10-06T04:45:48.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.546+0000 7f514ad9d700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5138066f30 0x7f51380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:48.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.547+0000 7f514ad9d700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5138066f30 0x7f51380693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f513c009af0 tx=0x7f513c009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:48.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.550+0000 7f5132ffd700 1 -- 172.21.15.124:0/816784380 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5144054270 con 0x7f514c1562e0 2023-10-06T04:45:48.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:48.740+0000 7f51511ff700 1 -- 172.21.15.124:0/816784380 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f514c0718b0 con 0x7f514c1562e0 2023-10-06T04:45:49.325 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.323+0000 7f5132ffd700 1 -- 172.21.15.124:0/816784380 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5144057890 con 0x7f514c1562e0 2023-10-06T04:45:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.326+0000 7f51511ff700 1 -- 172.21.15.124:0/816784380 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5138066f30 msgr2=0x7f51380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.326+0000 7f51511ff700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5138066f30 0x7f51380693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f513c009af0 tx=0x7f513c009060 comp rx=0 tx=0).stop 2023-10-06T04:45:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.326+0000 7f51511ff700 1 -- 172.21.15.124:0/816784380 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c1562e0 msgr2=0x7f514c159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.326+0000 7f51511ff700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c1562e0 0x7f514c159320 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5144003000 tx=0x7f5144018000 comp rx=0 tx=0).stop 2023-10-06T04:45:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.327+0000 7f51511ff700 1 -- 172.21.15.124:0/816784380 shutdown_connections 2023-10-06T04:45:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.327+0000 7f51511ff700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f514c1562e0 0x7f514c159320 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.327+0000 7f51511ff700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f514c0ae3d0 0x7f514c152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.327+0000 7f51511ff700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5138066f30 0x7f51380693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.327+0000 7f51511ff700 1 --2- 172.21.15.124:0/816784380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f514c0af990 0x7f514c158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.327+0000 7f51511ff700 1 -- 172.21.15.124:0/816784380 >> 172.21.15.124:0/816784380 conn(0x7f514c068080 msgr2=0x7f514c0ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.327+0000 7f51511ff700 1 -- 172.21.15.124:0/816784380 shutdown_connections 2023-10-06T04:45:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.327+0000 7f51511ff700 1 -- 172.21.15.124:0/816784380 wait complete. 2023-10-06T04:45:49.331 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' removed 2023-10-06T04:45:49.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T04:45:49.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.542+0000 7f9650bff700 1 Processor -- start 2023-10-06T04:45:49.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.543+0000 7f9650bff700 1 -- start start 2023-10-06T04:45:49.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.544+0000 7f9650bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f964c1562b0 0x7f964c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.544+0000 7f9650bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c156680 0x7f964c0adc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.544+0000 7f9650bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964c0ad790 con 0x7f964c0cca10 2023-10-06T04:45:49.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.544+0000 7f9650bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964c15af90 con 0x7f964c1562b0 2023-10-06T04:45:49.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.544+0000 7f9650bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0acb80 con 0x7f964c156680 2023-10-06T04:45:49.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.544+0000 7f964a59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f964c1562b0 0x7f964c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.544+0000 7f964a59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f964c1562b0 0x7f964c15aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46580/0 (socket says 172.21.15.124:46580) 2023-10-06T04:45:49.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.544+0000 7f964a59c700 1 -- 172.21.15.124:0/162521182 learned_addr learned my addr 172.21.15.124:0/162521182 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:49.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.544+0000 7f964ad9d700 1 --2- 172.21.15.124:0/162521182 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c156680 0x7f964c0adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.545+0000 7f964a59c700 1 -- 172.21.15.124:0/162521182 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c156680 msgr2=0x7f964c0adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:49.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.545+0000 7f964a59c700 1 --2- 172.21.15.124:0/162521182 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c156680 0x7f964c0adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.545+0000 7f964a59c700 1 -- 172.21.15.124:0/162521182 >> v1:172.21.15.158:6789/0 conn(0x7f964c0cca10 legacy=0x7f964c0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.545+0000 7f964a59c700 1 -- 172.21.15.124:0/162521182 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c0ace60 con 0x7f964c1562b0 2023-10-06T04:45:49.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.545+0000 7f964ad9d700 1 --2- 172.21.15.124:0/162521182 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c156680 0x7f964c0adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.545+0000 7f964a59c700 1 --2- 172.21.15.124:0/162521182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c1562b0 0x7f964c15aa50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f963c0099b0 tx=0x7f963c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcd67e2598cb509 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.545+0000 7f964959a700 1 -- 172.21.15.124:0/162521182 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00b860 con 0x7f964c1562b0 2023-10-06T04:45:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.545+0000 7f964959a700 1 -- 172.21.15.124:0/162521182 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c00b9c0 con 0x7f964c1562b0 2023-10-06T04:45:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.545+0000 7f964959a700 1 -- 172.21.15.124:0/162521182 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00bd60 con 0x7f964c1562b0 2023-10-06T04:45:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.546+0000 7f9650bff700 1 -- 172.21.15.124:0/162521182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c1562b0 msgr2=0x7f964c15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.546+0000 7f9650bff700 1 --2- 172.21.15.124:0/162521182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c1562b0 0x7f964c15aa50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f963c0099b0 tx=0x7f963c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.546+0000 7f9650bff700 1 -- 172.21.15.124:0/162521182 shutdown_connections 2023-10-06T04:45:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.546+0000 7f9650bff700 1 --2- 172.21.15.124:0/162521182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c1562b0 0x7f964c15aa50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.546+0000 7f9650bff700 1 --2- 172.21.15.124:0/162521182 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c156680 0x7f964c0adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.546+0000 7f9650bff700 1 -- 172.21.15.124:0/162521182 >> 172.21.15.124:0/162521182 conn(0x7f964c0680c0 msgr2=0x7f964c0cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:49.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.546+0000 7f9650bff700 1 -- 172.21.15.124:0/162521182 shutdown_connections 2023-10-06T04:45:49.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.546+0000 7f9650bff700 1 -- 172.21.15.124:0/162521182 wait complete. 2023-10-06T04:45:49.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.547+0000 7f9650bff700 1 Processor -- start 2023-10-06T04:45:49.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.548+0000 7f9650bff700 1 -- start start 2023-10-06T04:45:49.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.548+0000 7f9650bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964c0cca10 0x7f964c169a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.548+0000 7f9650bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c1562b0 0x7f964c15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.548+0000 7f9650bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c156680 0x7f964c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f9650bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0b09a0 con 0x7f964c156680 2023-10-06T04:45:49.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f9650bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0b0c80 con 0x7f964c0cca10 2023-10-06T04:45:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f9650bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964c15bc60 con 0x7f964c1562b0 2023-10-06T04:45:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f964ad9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c156680 0x7f964c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f964ad9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c156680 0x7f964c15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46592/0 (socket says 172.21.15.124:46592) 2023-10-06T04:45:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f964ad9d700 1 -- 172.21.15.124:0/2766344926 learned_addr learned my addr 172.21.15.124:0/2766344926 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f964a59c700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964c0cca10 0x7f964c169a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f9649d9b700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c1562b0 0x7f964c15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f964ad9d700 1 -- 172.21.15.124:0/2766344926 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c1562b0 msgr2=0x7f964c15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f964ad9d700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c1562b0 0x7f964c15dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f964ad9d700 1 -- 172.21.15.124:0/2766344926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964c0cca10 msgr2=0x7f964c169a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f964ad9d700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964c0cca10 0x7f964c169a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f964ad9d700 1 -- 172.21.15.124:0/2766344926 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c0094f0 con 0x7f964c156680 2023-10-06T04:45:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.549+0000 7f964ad9d700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c156680 0x7f964c15e160 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9644009fc0 tx=0x7f96440099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.550+0000 7f963a7fc700 1 -- 172.21.15.124:0/2766344926 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400dbe0 con 0x7f964c156680 2023-10-06T04:45:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.550+0000 7f963a7fc700 1 -- 172.21.15.124:0/2766344926 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964400f040 con 0x7f964c156680 2023-10-06T04:45:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.550+0000 7f9650bff700 1 -- 172.21.15.124:0/2766344926 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c15bf40 con 0x7f964c156680 2023-10-06T04:45:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.550+0000 7f963a7fc700 1 -- 172.21.15.124:0/2766344926 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644015440 con 0x7f964c156680 2023-10-06T04:45:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.550+0000 7f9650bff700 1 -- 172.21.15.124:0/2766344926 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c169fb0 con 0x7f964c156680 2023-10-06T04:45:49.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.551+0000 7f9650bff700 1 -- 172.21.15.124:0/2766344926 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964c15c3e0 con 0x7f964c156680 2023-10-06T04:45:49.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.552+0000 7f963a7fc700 1 -- 172.21.15.124:0/2766344926 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f964401e3b0 con 0x7f964c156680 2023-10-06T04:45:49.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.554+0000 7f963a7fc700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f962c066f30 0x7f962c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.554+0000 7f963a7fc700 1 -- 172.21.15.124:0/2766344926 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9644084770 con 0x7f964c156680 2023-10-06T04:45:49.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.554+0000 7f964a59c700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f962c066f30 0x7f962c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.554+0000 7f964a59c700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f962c066f30 0x7f962c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f963c0099b0 tx=0x7f963c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:49.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.557+0000 7f963a7fc700 1 -- 172.21.15.124:0/2766344926 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9644051b80 con 0x7f964c156680 2023-10-06T04:45:49.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.750+0000 7f9650bff700 1 -- 172.21.15.124:0/2766344926 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f964c15bab0 con 0x7f964c156680 2023-10-06T04:45:49.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.754+0000 7f963a7fc700 1 -- 172.21.15.124:0/2766344926 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f96440551a0 con 0x7f964c156680 2023-10-06T04:45:49.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 -- 172.21.15.124:0/2766344926 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f962c066f30 msgr2=0x7f962c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f962c066f30 0x7f962c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f963c0099b0 tx=0x7f963c017000 comp rx=0 tx=0).stop 2023-10-06T04:45:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 -- 172.21.15.124:0/2766344926 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c156680 msgr2=0x7f964c15e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c156680 0x7f964c15e160 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9644009fc0 tx=0x7f96440099b0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 -- 172.21.15.124:0/2766344926 shutdown_connections 2023-10-06T04:45:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f964c156680 0x7f964c15e160 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964c0cca10 0x7f964c169a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f962c066f30 0x7f962c0693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 --2- 172.21.15.124:0/2766344926 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964c1562b0 0x7f964c15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 -- 172.21.15.124:0/2766344926 >> 172.21.15.124:0/2766344926 conn(0x7f964c0680c0 msgr2=0x7f964c0c6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 -- 172.21.15.124:0/2766344926 shutdown_connections 2023-10-06T04:45:49.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.757+0000 7f9650bff700 1 -- 172.21.15.124:0/2766344926 wait complete. 2023-10-06T04:45:49.776 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic' 2023-10-06T04:45:49.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.967+0000 7f3bf3fff700 1 Processor -- start 2023-10-06T04:45:49.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.967+0000 7f3bf3fff700 1 -- start start 2023-10-06T04:45:49.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.968+0000 7f3bf3fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bec0ccbb0 0x7f3bec0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.968+0000 7f3bf3fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3bec0ce450 0x7f3bec0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.968+0000 7f3bf3fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec0cf6b0 con 0x7f3bec0cdfe0 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.968+0000 7f3bf3fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0ceaa0 con 0x7f3bec0ce450 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.968+0000 7f3bf3fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec0ced80 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.968+0000 7f3bf259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3bec0ce450 0x7f3bec0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.968+0000 7f3bf259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3bec0ce450 0x7f3bec0cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46606/0 (socket says 172.21.15.124:46606) 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.968+0000 7f3bf259c700 1 -- 172.21.15.124:0/2009528651 learned_addr learned my addr 172.21.15.124:0/2009528651 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.968+0000 7f3bf159a700 1 --1- 172.21.15.124:0/2009528651 >> v1:172.21.15.124:6789/0 conn(0x7f3bec0cdfe0 0x7f3bec0ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:58392/0 (socket says 172.21.15.124:58392) 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.968+0000 7f3bf1d9b700 1 --2- 172.21.15.124:0/2009528651 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bec0ccbb0 0x7f3bec0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.969+0000 7f3bf259c700 1 -- 172.21.15.124:0/2009528651 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bec0ccbb0 msgr2=0x7f3bec0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:49.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.969+0000 7f3bf259c700 1 --2- 172.21.15.124:0/2009528651 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bec0ccbb0 0x7f3bec0cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.969+0000 7f3bf259c700 1 -- 172.21.15.124:0/2009528651 >> v1:172.21.15.124:6789/0 conn(0x7f3bec0cdfe0 legacy=0x7f3bec0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.969+0000 7f3bf259c700 1 -- 172.21.15.124:0/2009528651 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0cf060 con 0x7f3bec0ce450 2023-10-06T04:45:49.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.969+0000 7f3bf0d99700 1 -- 172.21.15.124:0/2009528651 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847832878 0 0) 0x7f3bec0cf6b0 con 0x7f3bec0cdfe0 2023-10-06T04:45:49.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.969+0000 7f3bf259c700 1 --2- 172.21.15.124:0/2009528651 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ce450 0x7f3bec0cd690 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009f20 tx=0x7f3be4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511c17805226e671 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:49.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.969+0000 7f3bf0d99700 1 -- 172.21.15.124:0/2009528651 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400e070 con 0x7f3bec0ce450 2023-10-06T04:45:49.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.969+0000 7f3bf0d99700 1 -- 172.21.15.124:0/2009528651 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400b9d0 con 0x7f3bec0ce450 2023-10-06T04:45:49.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.969+0000 7f3bf0d99700 1 -- 172.21.15.124:0/2009528651 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40092e0 con 0x7f3bec0ce450 2023-10-06T04:45:49.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.970+0000 7f3bf3fff700 1 -- 172.21.15.124:0/2009528651 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ce450 msgr2=0x7f3bec0cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.970+0000 7f3bf3fff700 1 --2- 172.21.15.124:0/2009528651 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ce450 0x7f3bec0cd690 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009f20 tx=0x7f3be4009840 comp rx=0 tx=0).stop 2023-10-06T04:45:49.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.970+0000 7f3bf3fff700 1 -- 172.21.15.124:0/2009528651 shutdown_connections 2023-10-06T04:45:49.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.970+0000 7f3bf3fff700 1 --2- 172.21.15.124:0/2009528651 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ce450 0x7f3bec0cd690 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.970+0000 7f3bf3fff700 1 --2- 172.21.15.124:0/2009528651 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bec0ccbb0 0x7f3bec0cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.970+0000 7f3bf3fff700 1 -- 172.21.15.124:0/2009528651 >> 172.21.15.124:0/2009528651 conn(0x7f3bec099710 msgr2=0x7f3bec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:49.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.970+0000 7f3bf3fff700 1 -- 172.21.15.124:0/2009528651 shutdown_connections 2023-10-06T04:45:49.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.970+0000 7f3bf3fff700 1 -- 172.21.15.124:0/2009528651 wait complete. 2023-10-06T04:45:49.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.971+0000 7f3bf3fff700 1 Processor -- start 2023-10-06T04:45:49.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.972+0000 7f3bf3fff700 1 -- start start 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.972+0000 7f3bf3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ccbb0 0x7f3bec0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.972+0000 7f3bf3fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bec0cdfe0 0x7f3bec151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.972+0000 7f3bf3fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bec0ce450 0x7f3bec153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.972+0000 7f3bf3fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec153b80 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.972+0000 7f3bf3fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec153e60 con 0x7f3bec0cdfe0 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.972+0000 7f3bf3fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec154140 con 0x7f3bec0ce450 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf1d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ccbb0 0x7f3bec0b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf1d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ccbb0 0x7f3bec0b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46618/0 (socket says 172.21.15.124:46618) 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf1d9b700 1 -- 172.21.15.124:0/1094718940 learned_addr learned my addr 172.21.15.124:0/1094718940 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf259c700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bec0ce450 0x7f3bec153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf159a700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bec0cdfe0 0x7f3bec151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf1d9b700 1 -- 172.21.15.124:0/1094718940 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bec0ce450 msgr2=0x7f3bec153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf1d9b700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bec0ce450 0x7f3bec153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf1d9b700 1 -- 172.21.15.124:0/1094718940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bec0cdfe0 msgr2=0x7f3bec151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf1d9b700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bec0cdfe0 0x7f3bec151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf1d9b700 1 -- 172.21.15.124:0/1094718940 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4009ae0 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf159a700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bec0cdfe0 0x7f3bec151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.973+0000 7f3bf1d9b700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ccbb0 0x7f3bec0b0cc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3be800ec80 tx=0x7f3be80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.974+0000 7f3be1ffb700 1 -- 172.21.15.124:0/1094718940 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800c850 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.974+0000 7f3be1ffb700 1 -- 172.21.15.124:0/1094718940 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be800c9b0 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.974+0000 7f3be1ffb700 1 -- 172.21.15.124:0/1094718940 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800cd50 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.974+0000 7f3bf3fff700 1 -- 172.21.15.124:0/1094718940 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec154420 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.974+0000 7f3bf3fff700 1 -- 172.21.15.124:0/1094718940 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec151ea0 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.975+0000 7f3bf3fff700 1 -- 172.21.15.124:0/1094718940 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec0717a0 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.976+0000 7f3be1ffb700 1 -- 172.21.15.124:0/1094718940 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3be8013680 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.976+0000 7f3be1ffb700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bd0066f30 0x7f3bd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:49.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.976+0000 7f3be1ffb700 1 -- 172.21.15.124:0/1094718940 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3be80846f0 con 0x7f3bec0ccbb0 2023-10-06T04:45:49.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.977+0000 7f3bf159a700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bd0066f30 0x7f3bd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:49.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.977+0000 7f3bf159a700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bd0066f30 0x7f3bd00693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3bec15eb70 tx=0x7f3bdc007c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:49.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:49.981+0000 7f3be1ffb700 1 -- 172.21.15.124:0/1094718940 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3be8051a60 con 0x7f3bec0ccbb0 2023-10-06T04:45:50.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.252+0000 7f3bf3fff700 1 -- 172.21.15.124:0/1094718940 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]} v 0) v1 -- 0x7f3bec1591a0 con 0x7f3bec0ccbb0 2023-10-06T04:45:50.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.325+0000 7f3be1ffb700 1 -- 172.21.15.124:0/1094718940 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]}]=0 v95) v1 ==== 130+0+0 (secure 0 0 0) 0x7f3be8055080 con 0x7f3bec0ccbb0 2023-10-06T04:45:50.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.327+0000 7f3bf3fff700 1 -- 172.21.15.124:0/1094718940 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bd0066f30 msgr2=0x7f3bd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:50.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.327+0000 7f3bf3fff700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bd0066f30 0x7f3bd00693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3bec15eb70 tx=0x7f3bdc007c90 comp rx=0 tx=0).stop 2023-10-06T04:45:50.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.327+0000 7f3bf3fff700 1 -- 172.21.15.124:0/1094718940 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ccbb0 msgr2=0x7f3bec0b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:50.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.327+0000 7f3bf3fff700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ccbb0 0x7f3bec0b0cc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3be800ec80 tx=0x7f3be80091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.328+0000 7f3bf3fff700 1 -- 172.21.15.124:0/1094718940 shutdown_connections 2023-10-06T04:45:50.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.328+0000 7f3bf3fff700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3bd0066f30 0x7f3bd00693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.328+0000 7f3bf3fff700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3bec0ce450 0x7f3bec153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.328+0000 7f3bf3fff700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bec0ccbb0 0x7f3bec0b0cc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.328+0000 7f3bf3fff700 1 --2- 172.21.15.124:0/1094718940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3bec0cdfe0 0x7f3bec151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.328+0000 7f3bf3fff700 1 -- 172.21.15.124:0/1094718940 >> 172.21.15.124:0/1094718940 conn(0x7f3bec099710 msgr2=0x7f3bec069a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:50.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.328+0000 7f3bf3fff700 1 -- 172.21.15.124:0/1094718940 shutdown_connections 2023-10-06T04:45:50.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.328+0000 7f3bf3fff700 1 -- 172.21.15.124:0/1094718940 wait complete. 2023-10-06T04:45:50.347 INFO:tasks.cephfs_test_runner:test_basic (tasks.cephfs.test_dump_tree.TestDumpTree) ... ok 2023-10-06T04:45:50.347 INFO:tasks.cephfs_test_runner:Starting test: test_random (tasks.cephfs.test_dump_tree.TestDumpTree) 2023-10-06T04:45:50.348 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_random' 2023-10-06T04:45:50.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.544+0000 7f8c841ff700 1 Processor -- start 2023-10-06T04:45:50.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.544+0000 7f8c841ff700 1 -- start start 2023-10-06T04:45:50.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.545+0000 7f8c841ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8c7c0ac3d0 0x7f8c7c0aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:50.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.545+0000 7f8c841ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8c7c0af350 0x7f8c7c06a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:50.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.545+0000 7f8c841ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c069cb0 con 0x7f8c7c0b1a70 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.545+0000 7f8c841ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c156110 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.545+0000 7f8c841ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c06eaa0 con 0x7f8c7c0af350 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.546+0000 7f8c81f9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8c7c0ac3d0 0x7f8c7c0aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.546+0000 7f8c81f9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8c7c0ac3d0 0x7f8c7c0aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46634/0 (socket says 172.21.15.124:46634) 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.546+0000 7f8c81f9b700 1 -- 172.21.15.124:0/1042265755 learned_addr learned my addr 172.21.15.124:0/1042265755 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.546+0000 7f8c81f9b700 1 -- 172.21.15.124:0/1042265755 >> v2:172.21.15.158:3300/0 conn(0x7f8c7c0af350 msgr2=0x7f8c7c06a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.546+0000 7f8c8179a700 1 --2- 172.21.15.124:0/1042265755 >> v2:172.21.15.158:3300/0 conn(0x7f8c7c0af350 0x7f8c7c06a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.546+0000 7f8c81f9b700 1 --2- 172.21.15.124:0/1042265755 >> v2:172.21.15.158:3300/0 conn(0x7f8c7c0af350 0x7f8c7c06a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.546+0000 7f8c81f9b700 1 -- 172.21.15.124:0/1042265755 >> v1:172.21.15.158:6789/0 conn(0x7f8c7c0b1a70 legacy=0x7f8c7c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.546+0000 7f8c81f9b700 1 -- 172.21.15.124:0/1042265755 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c06ed80 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.546+0000 7f8c8179a700 1 --2- 172.21.15.124:0/1042265755 >> v2:172.21.15.158:3300/0 conn(0x7f8c7c0af350 0x7f8c7c06a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:50.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.546+0000 7f8c81f9b700 1 --2- 172.21.15.124:0/1042265755 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 0x7f8c7c0aee10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c06d2b0 tx=0x7f8c7800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470a718f61224fcd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c80f99700 1 -- 172.21.15.124:0/1042265755 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800ca90 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c80f99700 1 -- 172.21.15.124:0/1042265755 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7800cbf0 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c80f99700 1 -- 172.21.15.124:0/1042265755 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c780183f0 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c841ff700 1 -- 172.21.15.124:0/1042265755 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 msgr2=0x7f8c7c0aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c841ff700 1 --2- 172.21.15.124:0/1042265755 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 0x7f8c7c0aee10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c06d2b0 tx=0x7f8c7800a3f0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c841ff700 1 -- 172.21.15.124:0/1042265755 shutdown_connections 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c841ff700 1 --2- 172.21.15.124:0/1042265755 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 0x7f8c7c0aee10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c841ff700 1 --2- 172.21.15.124:0/1042265755 >> v2:172.21.15.158:3300/0 conn(0x7f8c7c0af350 0x7f8c7c06a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c841ff700 1 -- 172.21.15.124:0/1042265755 >> 172.21.15.124:0/1042265755 conn(0x7f8c7c0cc050 msgr2=0x7f8c7c0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c841ff700 1 -- 172.21.15.124:0/1042265755 shutdown_connections 2023-10-06T04:45:50.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.547+0000 7f8c841ff700 1 -- 172.21.15.124:0/1042265755 wait complete. 2023-10-06T04:45:50.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.549+0000 7f8c841ff700 1 Processor -- start 2023-10-06T04:45:50.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.549+0000 7f8c841ff700 1 -- start start 2023-10-06T04:45:50.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c841ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 0x7f8c7c146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:50.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c841ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8c7c0af350 0x7f8c7c156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:50.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c841ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8c7c0b1a70 0x7f8c7c0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:50.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c841ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c158380 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c841ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c157800 con 0x7f8c7c0b1a70 2023-10-06T04:45:50.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c841ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c157ae0 con 0x7f8c7c0af350 2023-10-06T04:45:50.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c81f9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 0x7f8c7c146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:50.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c81f9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 0x7f8c7c146af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46644/0 (socket says 172.21.15.124:46644) 2023-10-06T04:45:50.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c81f9b700 1 -- 172.21.15.124:0/3023424111 learned_addr learned my addr 172.21.15.124:0/3023424111 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:50.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c81f9b700 1 -- 172.21.15.124:0/3023424111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8c7c0af350 msgr2=0x7f8c7c156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:50.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c81f9b700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8c7c0af350 0x7f8c7c156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c81f9b700 1 -- 172.21.15.124:0/3023424111 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8c7c0b1a70 msgr2=0x7f8c7c0c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:50.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c81f9b700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8c7c0b1a70 0x7f8c7c0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:50.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.550+0000 7f8c81f9b700 1 -- 172.21.15.124:0/3023424111 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7800a690 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.551+0000 7f8c81f9b700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 0x7f8c7c146af0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c06c840 tx=0x7f8c78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:50.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.551+0000 7f8c71ffb700 1 -- 172.21.15.124:0/3023424111 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7801d070 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.551+0000 7f8c71ffb700 1 -- 172.21.15.124:0/3023424111 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c78006bc0 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.551+0000 7f8c841ff700 1 -- 172.21.15.124:0/3023424111 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c157dc0 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.551+0000 7f8c71ffb700 1 -- 172.21.15.124:0/3023424111 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78010940 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.551+0000 7f8c841ff700 1 -- 172.21.15.124:0/3023424111 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c147030 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.552+0000 7f8c841ff700 1 -- 172.21.15.124:0/3023424111 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c0717a0 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.553+0000 7f8c71ffb700 1 -- 172.21.15.124:0/3023424111 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c78010cf0 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.554+0000 7f8c71ffb700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8c60066f30 0x7f8c600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:50.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.554+0000 7f8c71ffb700 1 -- 172.21.15.124:0/3023424111 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8c78085a50 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.554+0000 7f8c8179a700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8c60066f30 0x7f8c600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:50.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.555+0000 7f8c8179a700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8c60066f30 0x7f8c600693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0c8290 tx=0x7f8c6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:50.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.558+0000 7f8c71ffb700 1 -- 172.21.15.124:0/3023424111 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c78052dc0 con 0x7f8c7c0ac3d0 2023-10-06T04:45:50.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:50.828+0000 7f8c841ff700 1 -- 172.21.15.124:0/3023424111 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]} v 0) v1 -- 0x7f8c7c099eb0 con 0x7f8c7c0ac3d0 2023-10-06T04:45:51.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.326+0000 7f8c71ffb700 1 -- 172.21.15.124:0/3023424111 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]}]=0 v96) v1 ==== 134+0+0 (secure 0 0 0) 0x7f8c78026020 con 0x7f8c7c0ac3d0 2023-10-06T04:45:51.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 -- 172.21.15.124:0/3023424111 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8c60066f30 msgr2=0x7f8c600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:51.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8c60066f30 0x7f8c600693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0c8290 tx=0x7f8c6c008040 comp rx=0 tx=0).stop 2023-10-06T04:45:51.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 -- 172.21.15.124:0/3023424111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 msgr2=0x7f8c7c146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:51.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 0x7f8c7c146af0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c06c840 tx=0x7f8c78017000 comp rx=0 tx=0).stop 2023-10-06T04:45:51.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 -- 172.21.15.124:0/3023424111 shutdown_connections 2023-10-06T04:45:51.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8c7c0b1a70 0x7f8c7c0c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c7c0ac3d0 0x7f8c7c146af0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8c60066f30 0x7f8c600693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 --2- 172.21.15.124:0/3023424111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8c7c0af350 0x7f8c7c156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 -- 172.21.15.124:0/3023424111 >> 172.21.15.124:0/3023424111 conn(0x7f8c7c0cc050 msgr2=0x7f8c7c154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:51.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 -- 172.21.15.124:0/3023424111 shutdown_connections 2023-10-06T04:45:51.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.329+0000 7f8c841ff700 1 -- 172.21.15.124:0/3023424111 wait complete. 2023-10-06T04:45:51.350 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T04:45:51.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.541+0000 7faeef9ff700 1 Processor -- start 2023-10-06T04:45:51.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.541+0000 7faeef9ff700 1 -- start start 2023-10-06T04:45:51.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.542+0000 7faeef9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80cca10 0x7faee80c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:51.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.542+0000 7faeef9ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee80ad790 con 0x7faee81562b0 2023-10-06T04:45:51.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.542+0000 7faeef9ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee80acb80 con 0x7faee80c6af0 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.542+0000 7faeef9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee80ace60 con 0x7faee80cca10 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.542+0000 7faeed79b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7faee81562b0 0x7faee815aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:58406/0 (socket says 172.21.15.124:58406) 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.542+0000 7faeed79b700 1 -- 172.21.15.124:0/21174956 learned_addr learned my addr 172.21.15.124:0/21174956 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faeecf9a700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80cca10 0x7faee80c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389135151 0 0) 0x7faee80ad790 con 0x7faee81562b0 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed4003570 con 0x7faee81562b0 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 923706862 0 0) 0x7faed4003570 con 0x7faee81562b0 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80cca10 msgr2=0x7faee80c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80cca10 0x7faee80c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 >> v1:172.21.15.158:6789/0 conn(0x7faee80c6af0 legacy=0x7faee80adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:51.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80ad140 con 0x7faee81562b0 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7faee4001470 con 0x7faee81562b0 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 >> v1:172.21.15.124:6789/0 conn(0x7faee81562b0 legacy=0x7faee815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faed4003a90 0x7faed4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80cca10 0x7faed4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed4004d50 0x7faed40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80ace60 con 0x7faed4003a90 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed400bb10 con 0x7faed4004d50 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.543+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed400bcd0 con 0x7faee80cca10 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faeed79b700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faed4003a90 0x7faed4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faeecf9a700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80cca10 0x7faed4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faeedf9c700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed4004d50 0x7faed40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:51.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faeed79b700 1 -- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80cca10 msgr2=0x7faed4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faeed79b700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80cca10 0x7faed4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faeed79b700 1 -- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed4004d50 msgr2=0x7faed40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faeed79b700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed4004d50 0x7faed40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faeed79b700 1 -- 172.21.15.124:0/21174956 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed4003570 con 0x7faed4003a90 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faeecf9a700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80cca10 0x7faed4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faeed79b700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faed4003a90 0x7faed4003e60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faee400c3c0 tx=0x7faee4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52b93a72b2af0e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400cc90 con 0x7faed4003a90 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee400cdf0 con 0x7faed4003a90 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.544+0000 7faedffff700 1 -- 172.21.15.124:0/21174956 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4005b70 con 0x7faed4003a90 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.545+0000 7faeef9ff700 1 -- 172.21.15.124:0/21174956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faed4003a90 msgr2=0x7faed4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.545+0000 7faeef9ff700 1 --2- 172.21.15.124:0/21174956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faed4003a90 0x7faed4003e60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faee400c3c0 tx=0x7faee4001e70 comp rx=0 tx=0).stop 2023-10-06T04:45:51.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.545+0000 7faeedf9c700 1 -- 172.21.15.124:0/21174956 reap_dead start 2023-10-06T04:45:51.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.545+0000 7faeef9ff700 1 -- 172.21.15.124:0/21174956 shutdown_connections 2023-10-06T04:45:51.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.545+0000 7faeef9ff700 1 -- 172.21.15.124:0/21174956 >> 172.21.15.124:0/21174956 conn(0x7faee80680c0 msgr2=0x7faee80cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:51.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.545+0000 7faeef9ff700 1 -- 172.21.15.124:0/21174956 shutdown_connections 2023-10-06T04:45:51.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.545+0000 7faeef9ff700 1 -- 172.21.15.124:0/21174956 wait complete. 2023-10-06T04:45:51.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.546+0000 7faeef9ff700 1 Processor -- start 2023-10-06T04:45:51.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.547+0000 7faeef9ff700 1 -- start start 2023-10-06T04:45:51.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.547+0000 7faeef9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed4003a90 0x7faee8148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:51.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.547+0000 7faeef9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80c4b60 0x7faee8149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:51.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.547+0000 7faeef9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faee80c2920 0x7faee81496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.547+0000 7faeef9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80af720 con 0x7faee80c2920 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.547+0000 7faeef9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80c50b0 con 0x7faed4003a90 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.547+0000 7faeef9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee80c5390 con 0x7faee80c4b60 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeedf9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faee80c2920 0x7faee81496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeedf9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faee80c2920 0x7faee81496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46672/0 (socket says 172.21.15.124:46672) 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeedf9c700 1 -- 172.21.15.124:0/4117185117 learned_addr learned my addr 172.21.15.124:0/4117185117 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeed79b700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed4003a90 0x7faee8148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeecf9a700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80c4b60 0x7faee8149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeedf9c700 1 -- 172.21.15.124:0/4117185117 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80c4b60 msgr2=0x7faee8149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeedf9c700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80c4b60 0x7faee8149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeedf9c700 1 -- 172.21.15.124:0/4117185117 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed4003a90 msgr2=0x7faee8148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeedf9c700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed4003a90 0x7faee8148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeedf9c700 1 -- 172.21.15.124:0/4117185117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80c5670 con 0x7faee80c2920 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeecf9a700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80c4b60 0x7faee8149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.548+0000 7faeedf9c700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faee80c2920 0x7faee81496d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faee80c9a90 tx=0x7faee0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.549+0000 7faedd7fa700 1 -- 172.21.15.124:0/4117185117 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee00032e0 con 0x7faee80c2920 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.549+0000 7faedd7fa700 1 -- 172.21.15.124:0/4117185117 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee0003440 con 0x7faee80c2920 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.549+0000 7faeef9ff700 1 -- 172.21.15.124:0/4117185117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee80c5950 con 0x7faee80c2920 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.549+0000 7faedd7fa700 1 -- 172.21.15.124:0/4117185117 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0001890 con 0x7faee80c2920 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.549+0000 7faeef9ff700 1 -- 172.21.15.124:0/4117185117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee8148c00 con 0x7faee80c2920 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.550+0000 7faeef9ff700 1 -- 172.21.15.124:0/4117185117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee8064850 con 0x7faee80c2920 2023-10-06T04:45:51.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.551+0000 7faedd7fa700 1 -- 172.21.15.124:0/4117185117 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faee0001c40 con 0x7faee80c2920 2023-10-06T04:45:51.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.551+0000 7faedd7fa700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faecc066f30 0x7faecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:51.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.551+0000 7faedd7fa700 1 -- 172.21.15.124:0/4117185117 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5292+0+0 (secure 0 0 0) 0x7faee0084300 con 0x7faee80c2920 2023-10-06T04:45:51.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.552+0000 7faeed79b700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faecc066f30 0x7faecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:51.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.552+0000 7faeed79b700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faecc066f30 0x7faecc0693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faee4001eb0 tx=0x7faee4015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:51.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.555+0000 7faedd7fa700 1 -- 172.21.15.124:0/4117185117 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faee0051670 con 0x7faee80c2920 2023-10-06T04:45:51.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.749+0000 7faeef9ff700 1 -- 172.21.15.124:0/4117185117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7faee804c380 con 0x7faee80c2920 2023-10-06T04:45:51.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.753+0000 7faedd7fa700 1 -- 172.21.15.124:0/4117185117 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7faee0054c90 con 0x7faee80c2920 2023-10-06T04:45:51.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 -- 172.21.15.124:0/4117185117 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faecc066f30 msgr2=0x7faecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:51.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faecc066f30 0x7faecc0693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faee4001eb0 tx=0x7faee4015000 comp rx=0 tx=0).stop 2023-10-06T04:45:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 -- 172.21.15.124:0/4117185117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faee80c2920 msgr2=0x7faee81496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faee80c2920 0x7faee81496d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faee80c9a90 tx=0x7faee0009040 comp rx=0 tx=0).stop 2023-10-06T04:45:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 -- 172.21.15.124:0/4117185117 shutdown_connections 2023-10-06T04:45:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faee80c2920 0x7faee81496d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed4003a90 0x7faee8148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faecc066f30 0x7faecc0693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 --2- 172.21.15.124:0/4117185117 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faee80c4b60 0x7faee8149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 -- 172.21.15.124:0/4117185117 >> 172.21.15.124:0/4117185117 conn(0x7faee80680c0 msgr2=0x7faee80c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 -- 172.21.15.124:0/4117185117 shutdown_connections 2023-10-06T04:45:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:51.756+0000 7faeef9ff700 1 -- 172.21.15.124:0/4117185117 wait complete. 2023-10-06T04:45:51.775 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:45:51.776 DEBUG:teuthology.orchestra.run.smithi124:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:45:51.877 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:45:51.986 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:45:51.987 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T04:45:51.987 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:52.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.175+0000 7f3c5a3ff700 1 Processor -- start 2023-10-06T04:45:52.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.176+0000 7f3c5a3ff700 1 -- start start 2023-10-06T04:45:52.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.177+0000 7f3c5a3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c540cb250 0x7f3c541591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.177+0000 7f3c5a3ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3c54159710 0x7f3c540afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.177+0000 7f3c5a3ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c54159b90 con 0x7f3c540cae80 2023-10-06T04:45:52.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.177+0000 7f3c5a3ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540cd430 con 0x7f3c54159710 2023-10-06T04:45:52.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.177+0000 7f3c5a3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540c1d10 con 0x7f3c540cb250 2023-10-06T04:45:52.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.177+0000 7f3c53fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f3c540cae80 0x7f3c540cc980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:58408/0 (socket says 172.21.15.124:58408) 2023-10-06T04:45:52.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.177+0000 7f3c53fff700 1 -- 172.21.15.124:0/4001218199 learned_addr learned my addr 172.21.15.124:0/4001218199 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:52.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.177+0000 7f3c5899c700 1 --2- 172.21.15.124:0/4001218199 >> v2:172.21.15.124:3300/0 conn(0x7f3c54159710 0x7f3c540afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.177+0000 7f3c537fe700 1 --2- 172.21.15.124:0/4001218199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c540cb250 0x7f3c541591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.178+0000 7f3c52ffd700 1 -- 172.21.15.124:0/4001218199 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158430427 0 0) 0x7f3c54159b90 con 0x7f3c540cae80 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.178+0000 7f3c5899c700 1 -- 172.21.15.124:0/4001218199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c540cb250 msgr2=0x7f3c541591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.178+0000 7f3c5899c700 1 --2- 172.21.15.124:0/4001218199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c540cb250 0x7f3c541591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.178+0000 7f3c5899c700 1 -- 172.21.15.124:0/4001218199 >> v1:172.21.15.124:6789/0 conn(0x7f3c540cae80 legacy=0x7f3c540cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.178+0000 7f3c5899c700 1 -- 172.21.15.124:0/4001218199 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540688a0 con 0x7f3c54159710 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.178+0000 7f3c537fe700 1 --2- 172.21.15.124:0/4001218199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c540cb250 0x7f3c541591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.178+0000 7f3c5899c700 1 --2- 172.21.15.124:0/4001218199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c54159710 0x7f3c540afe40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009e60 tx=0x7f3c4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7078afccc4da73df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.178+0000 7f3c52ffd700 1 -- 172.21.15.124:0/4001218199 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00e070 con 0x7f3c54159710 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.178+0000 7f3c52ffd700 1 -- 172.21.15.124:0/4001218199 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c00bc30 con 0x7f3c54159710 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.178+0000 7f3c52ffd700 1 -- 172.21.15.124:0/4001218199 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c012430 con 0x7f3c54159710 2023-10-06T04:45:52.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.179+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/4001218199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c54159710 msgr2=0x7f3c540afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:52.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.179+0000 7f3c5a3ff700 1 --2- 172.21.15.124:0/4001218199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c54159710 0x7f3c540afe40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009e60 tx=0x7f3c4c009780 comp rx=0 tx=0).stop 2023-10-06T04:45:52.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.179+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/4001218199 shutdown_connections 2023-10-06T04:45:52.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.179+0000 7f3c5a3ff700 1 --2- 172.21.15.124:0/4001218199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c54159710 0x7f3c540afe40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.179+0000 7f3c5a3ff700 1 --2- 172.21.15.124:0/4001218199 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c540cb250 0x7f3c541591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.179+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/4001218199 >> 172.21.15.124:0/4001218199 conn(0x7f3c540974f0 msgr2=0x7f3c540639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:52.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.179+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/4001218199 shutdown_connections 2023-10-06T04:45:52.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.179+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/4001218199 wait complete. 2023-10-06T04:45:52.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.180+0000 7f3c5a3ff700 1 Processor -- start 2023-10-06T04:45:52.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.180+0000 7f3c5a3ff700 1 -- start start 2023-10-06T04:45:52.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.181+0000 7f3c5a3ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c540cae80 0x7f3c540c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.181+0000 7f3c5a3ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c540cb250 0x7f3c541587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.181+0000 7f3c5a3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c54159710 0x7f3c540c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.181+0000 7f3c5a3ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5415ba50 con 0x7f3c540cae80 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.181+0000 7f3c5a3ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5415ae40 con 0x7f3c540cb250 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.181+0000 7f3c5a3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5415b120 con 0x7f3c54159710 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c53fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c540cae80 0x7f3c540c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c53fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c540cae80 0x7f3c540c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46684/0 (socket says 172.21.15.124:46684) 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c53fff700 1 -- 172.21.15.124:0/2493678650 learned_addr learned my addr 172.21.15.124:0/2493678650 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c5899c700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c54159710 0x7f3c540c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c537fe700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c540cb250 0x7f3c541587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c53fff700 1 -- 172.21.15.124:0/2493678650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c54159710 msgr2=0x7f3c540c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c53fff700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c54159710 0x7f3c540c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c53fff700 1 -- 172.21.15.124:0/2493678650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c540cb250 msgr2=0x7f3c541587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c53fff700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c540cb250 0x7f3c541587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c53fff700 1 -- 172.21.15.124:0/2493678650 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c009a20 con 0x7f3c540cae80 2023-10-06T04:45:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c537fe700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c540cb250 0x7f3c541587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c53fff700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c540cae80 0x7f3c540c52a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400c7e0 tx=0x7f3c44007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c3bfff700 1 -- 172.21.15.124:0/2493678650 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44005b30 con 0x7f3c540cae80 2023-10-06T04:45:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.182+0000 7f3c3bfff700 1 -- 172.21.15.124:0/2493678650 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c44005c90 con 0x7f3c540cae80 2023-10-06T04:45:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.183+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/2493678650 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5415b400 con 0x7f3c540cae80 2023-10-06T04:45:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.183+0000 7f3c3bfff700 1 -- 172.21.15.124:0/2493678650 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44007300 con 0x7f3c540cae80 2023-10-06T04:45:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.183+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/2493678650 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c540c57e0 con 0x7f3c540cae80 2023-10-06T04:45:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.184+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/2493678650 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c540717a0 con 0x7f3c540cae80 2023-10-06T04:45:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.184+0000 7f3c3bfff700 1 -- 172.21.15.124:0/2493678650 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c4401b400 con 0x7f3c540cae80 2023-10-06T04:45:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.185+0000 7f3c3bfff700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3c40066f30 0x7f3c400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.185+0000 7f3c3bfff700 1 -- 172.21.15.124:0/2493678650 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3c44083f30 con 0x7f3c540cae80 2023-10-06T04:45:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.185+0000 7f3c537fe700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3c40066f30 0x7f3c400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.186+0000 7f3c537fe700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3c40066f30 0x7f3c400693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3c48006f00 tx=0x7f3c48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:52.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.190+0000 7f3c3bfff700 1 -- 172.21.15.124:0/2493678650 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c44051320 con 0x7f3c540cae80 2023-10-06T04:45:52.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.422+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/2493678650 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c54068b80 con 0x7f3c540cae80 2023-10-06T04:45:52.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.422+0000 7f3c3bfff700 1 -- 172.21.15.124:0/2493678650 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f3c44054940 con 0x7f3c540cae80 2023-10-06T04:45:52.425 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:52.425 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/518958812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":518958812},{"type":"v1","addr":"172.21.15.158:6834","nonce":518958812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/120181660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":120181660},{"type":"v1","addr":"172.21.15.158:6835","nonce":120181660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1421870244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1421870244},{"type":"v1","addr":"172.21.15.124:6836","nonce":1421870244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/3387217190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":3387217190},{"type":"v1","addr":"172.21.15.124:6837","nonce":3387217190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-10-06T04:45:52.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/2493678650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3c40066f30 msgr2=0x7f3c400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:52.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3c40066f30 0x7f3c400693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3c48006f00 tx=0x7f3c48008040 comp rx=0 tx=0).stop 2023-10-06T04:45:52.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/2493678650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c540cae80 msgr2=0x7f3c540c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:52.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c540cae80 0x7f3c540c52a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400c7e0 tx=0x7f3c44007df0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/2493678650 shutdown_connections 2023-10-06T04:45:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3c40066f30 0x7f3c400693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c54159710 0x7f3c540c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c540cae80 0x7f3c540c52a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 --2- 172.21.15.124:0/2493678650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c540cb250 0x7f3c541587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/2493678650 >> 172.21.15.124:0/2493678650 conn(0x7f3c540974f0 msgr2=0x7f3c5406cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/2493678650 shutdown_connections 2023-10-06T04:45:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.425+0000 7f3c5a3ff700 1 -- 172.21.15.124:0/2493678650 wait complete. 2023-10-06T04:45:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 19 2023-10-06T04:45:52.445 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:45:52.445 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T04:45:52.445 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:45:52.445 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:52.446 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:45:52.446 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T04:45:52.446 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:45:52.446 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:52.446 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:45:52.446 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T04:45:52.447 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:45:52.447 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:52.447 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:45:52.447 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T04:45:52.447 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:45:52.447 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:52.459 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:45:52.459 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:45:52.460 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:45:52.460 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:45:52.464 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:45:52.465 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:45:52.465 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:45:52.466 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:45:52.504 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:45:52.504 DEBUG:teuthology.parallel:result is None 2023-10-06T04:45:52.507 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:45:52.507 DEBUG:teuthology.parallel:result is None 2023-10-06T04:45:52.510 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:45:52.510 DEBUG:teuthology.parallel:result is None 2023-10-06T04:45:52.513 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:45:52.513 DEBUG:teuthology.parallel:result is None 2023-10-06T04:45:52.513 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T04:45:52.647 INFO:tasks.ceph.mds.a.smithi124.stdout:starting mds.a at 2023-10-06T04:45:52.653 INFO:tasks.ceph.mds.c.smithi124.stdout:starting mds.c at 2023-10-06T04:45:52.658 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-06T04:45:52.658 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-06T04:45:52.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.714+0000 7f27fd5ff700 1 Processor -- start 2023-10-06T04:45:52.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.714+0000 7f27fd5ff700 1 -- start start 2023-10-06T04:45:52.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27fd5ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f27f80aa8f0 0x7f27f815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27fd5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27f815d600 0x7f27f80cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27fd5ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f815da70 con 0x7f27f80cb3b0 2023-10-06T04:45:52.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27fd5ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80cbf20 con 0x7f27f80aa8f0 2023-10-06T04:45:52.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27fd5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80c9e60 con 0x7f27f815d600 2023-10-06T04:45:52.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27f6ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f27f80aa8f0 0x7f27f815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27f77fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f27f80cb3b0 0x7f27f80cb810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:58416/0 (socket says 172.21.15.124:58416) 2023-10-06T04:45:52.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27f6ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f27f80aa8f0 0x7f27f815d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46728/0 (socket says 172.21.15.124:46728) 2023-10-06T04:45:52.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27f77fe700 1 -- 172.21.15.124:0/3180994793 learned_addr learned my addr 172.21.15.124:0/3180994793 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:52.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27f67fc700 1 --2- 172.21.15.124:0/3180994793 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27f815d600 0x7f27f80cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27f6ffd700 1 -- 172.21.15.124:0/3180994793 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27f815d600 msgr2=0x7f27f80cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:52.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27f6ffd700 1 --2- 172.21.15.124:0/3180994793 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27f815d600 0x7f27f80cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27f6ffd700 1 -- 172.21.15.124:0/3180994793 >> v1:172.21.15.124:6789/0 conn(0x7f27f80cb3b0 legacy=0x7f27f80cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:52.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27f6ffd700 1 -- 172.21.15.124:0/3180994793 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f80ca0b0 con 0x7f27f80aa8f0 2023-10-06T04:45:52.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.716+0000 7f27f5ffb700 1 -- 172.21.15.124:0/3180994793 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268093641 0 0) 0x7f27f815da70 con 0x7f27f80cb3b0 2023-10-06T04:45:52.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.717+0000 7f27f6ffd700 1 --2- 172.21.15.124:0/3180994793 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80aa8f0 0x7f27f815d0c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f27e80098e0 tx=0x7f27e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b44c3dd724865e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:52.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.717+0000 7f27f5ffb700 1 -- 172.21.15.124:0/3180994793 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800b640 con 0x7f27f80aa8f0 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.717+0000 7f27f5ffb700 1 -- 172.21.15.124:0/3180994793 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e800b7a0 con 0x7f27f80aa8f0 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.717+0000 7f27f5ffb700 1 -- 172.21.15.124:0/3180994793 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800bb40 con 0x7f27f80aa8f0 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.717+0000 7f27fd5ff700 1 -- 172.21.15.124:0/3180994793 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80aa8f0 msgr2=0x7f27f815d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.717+0000 7f27fd5ff700 1 --2- 172.21.15.124:0/3180994793 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80aa8f0 0x7f27f815d0c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f27e80098e0 tx=0x7f27e80091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.717+0000 7f27fd5ff700 1 -- 172.21.15.124:0/3180994793 shutdown_connections 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.717+0000 7f27fd5ff700 1 --2- 172.21.15.124:0/3180994793 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80aa8f0 0x7f27f815d0c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.717+0000 7f27fd5ff700 1 --2- 172.21.15.124:0/3180994793 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27f815d600 0x7f27f80cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.717+0000 7f27fd5ff700 1 -- 172.21.15.124:0/3180994793 >> 172.21.15.124:0/3180994793 conn(0x7f27f80cc080 msgr2=0x7f27f80cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.718+0000 7f27fd5ff700 1 -- 172.21.15.124:0/3180994793 shutdown_connections 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.718+0000 7f27fd5ff700 1 -- 172.21.15.124:0/3180994793 wait complete. 2023-10-06T04:45:52.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.719+0000 7f27fd5ff700 1 Processor -- start 2023-10-06T04:45:52.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.719+0000 7f27fd5ff700 1 -- start start 2023-10-06T04:45:52.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.720+0000 7f27fd5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27f80aa8f0 0x7f27f8098eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.720+0000 7f27fd5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80cb3b0 0x7f27f80ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.720+0000 7f27fd5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27f815d600 0x7f27f80ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.720+0000 7f27fd5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8145720 con 0x7f27f80cb3b0 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.720+0000 7f27fd5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8145a00 con 0x7f27f80aa8f0 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.720+0000 7f27fd5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8099730 con 0x7f27f815d600 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.720+0000 7f27f67fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80cb3b0 0x7f27f80ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.720+0000 7f27f67fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80cb3b0 0x7f27f80ac460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:46732/0 (socket says 172.21.15.124:46732) 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.720+0000 7f27f67fc700 1 -- 172.21.15.124:0/2049295078 learned_addr learned my addr 172.21.15.124:0/2049295078 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.720+0000 7f27f6ffd700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27f80aa8f0 0x7f27f8098eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27f77fe700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27f815d600 0x7f27f80ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27f67fc700 1 -- 172.21.15.124:0/2049295078 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27f815d600 msgr2=0x7f27f80ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27f67fc700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27f815d600 0x7f27f80ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27f67fc700 1 -- 172.21.15.124:0/2049295078 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27f80aa8f0 msgr2=0x7f27f8098eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:52.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27f67fc700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27f80aa8f0 0x7f27f8098eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:52.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27f67fc700 1 -- 172.21.15.124:0/2049295078 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e8009420 con 0x7f27f80cb3b0 2023-10-06T04:45:52.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27f67fc700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80cb3b0 0x7f27f80ac460 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00e930 tx=0x7f27ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:52.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27deffd700 1 -- 172.21.15.124:0/2049295078 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec013680 con 0x7f27f80cb3b0 2023-10-06T04:45:52.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27deffd700 1 -- 172.21.15.124:0/2049295078 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec0137e0 con 0x7f27f80cb3b0 2023-10-06T04:45:52.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27deffd700 1 -- 172.21.15.124:0/2049295078 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec013b80 con 0x7f27f80cb3b0 2023-10-06T04:45:52.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.721+0000 7f27fd5ff700 1 -- 172.21.15.124:0/2049295078 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f8099a10 con 0x7f27f80cb3b0 2023-10-06T04:45:52.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.722+0000 7f27fd5ff700 1 -- 172.21.15.124:0/2049295078 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f80993f0 con 0x7f27f80cb3b0 2023-10-06T04:45:52.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.722+0000 7f27fd5ff700 1 -- 172.21.15.124:0/2049295078 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f8145b70 con 0x7f27f80cb3b0 2023-10-06T04:45:52.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.723+0000 7f27deffd700 1 -- 172.21.15.124:0/2049295078 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27ec00c3e0 con 0x7f27f80cb3b0 2023-10-06T04:45:52.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.724+0000 7f27deffd700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f27e4066f30 0x7f27e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:52.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.724+0000 7f27deffd700 1 -- 172.21.15.124:0/2049295078 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f27ec0844b0 con 0x7f27f80cb3b0 2023-10-06T04:45:52.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.725+0000 7f27f6ffd700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f27e4066f30 0x7f27e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:52.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.725+0000 7f27f6ffd700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f27e4066f30 0x7f27e40693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27e80093f0 tx=0x7f27e8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:52.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.728+0000 7f27deffd700 1 -- 172.21.15.124:0/2049295078 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27ec051820 con 0x7f27f80cb3b0 2023-10-06T04:45:52.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:52.942+0000 7f27fd5ff700 1 -- 172.21.15.124:0/2049295078 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f27f80717a0 con 0x7f27f80cb3b0 2023-10-06T04:45:53.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.769+0000 7f27deffd700 1 -- 172.21.15.124:0/2049295078 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7f27ec054e40 con 0x7f27f80cb3b0 2023-10-06T04:45:53.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 -- 172.21.15.124:0/2049295078 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f27e4066f30 msgr2=0x7f27e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:53.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f27e4066f30 0x7f27e40693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27e80093f0 tx=0x7f27e8017000 comp rx=0 tx=0).stop 2023-10-06T04:45:53.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 -- 172.21.15.124:0/2049295078 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80cb3b0 msgr2=0x7f27f80ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:53.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80cb3b0 0x7f27f80ac460 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00e930 tx=0x7f27ec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:53.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 -- 172.21.15.124:0/2049295078 shutdown_connections 2023-10-06T04:45:53.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f27e4066f30 0x7f27e40693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:53.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27f815d600 0x7f27f80ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:53.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27f80aa8f0 0x7f27f8098eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:53.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 --2- 172.21.15.124:0/2049295078 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27f80cb3b0 0x7f27f80ac460 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:53.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 -- 172.21.15.124:0/2049295078 >> 172.21.15.124:0/2049295078 conn(0x7f27f80cc080 msgr2=0x7f27f80a8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:53.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 -- 172.21.15.124:0/2049295078 shutdown_connections 2023-10-06T04:45:53.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.772+0000 7f27fd5ff700 1 -- 172.21.15.124:0/2049295078 wait complete. 2023-10-06T04:45:53.776 INFO:teuthology.orchestra.run.smithi124.stderr: removed all blocklist entries 2023-10-06T04:45:53.794 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T04:45:53.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.987+0000 7ff0cf3ff700 1 Processor -- start 2023-10-06T04:45:53.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.987+0000 7ff0cf3ff700 1 -- start start 2023-10-06T04:45:53.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cf3ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff0c80ccbb0 0x7ff0c80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:53.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cf3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0c80cdfe0 0x7ff0c80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:53.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cf3ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff0c80ccf80 0x7ff0c80cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:53.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cf3ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c80cf6b0 con 0x7ff0c80ccf80 2023-10-06T04:45:53.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cf3ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c80ceaa0 con 0x7ff0c80ccbb0 2023-10-06T04:45:53.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cf3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80ced80 con 0x7ff0c80cdfe0 2023-10-06T04:45:53.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cd99c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff0c80ccf80 0x7ff0c80cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:53.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cd99c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff0c80ccf80 0x7ff0c80cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54812/0 (socket says 172.21.15.124:54812) 2023-10-06T04:45:53.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cd99c700 1 -- 172.21.15.124:0/590939228 learned_addr learned my addr 172.21.15.124:0/590939228 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:53.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cd19b700 1 --2- 172.21.15.124:0/590939228 >> v2:172.21.15.158:3300/0 conn(0x7ff0c80ccbb0 0x7ff0c80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:53.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cc99a700 1 --2- 172.21.15.124:0/590939228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0c80cdfe0 0x7ff0c80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:53.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cd99c700 1 -- 172.21.15.124:0/590939228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0c80cdfe0 msgr2=0x7ff0c80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:53.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cd99c700 1 --2- 172.21.15.124:0/590939228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0c80cdfe0 0x7ff0c80ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:53.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cd99c700 1 -- 172.21.15.124:0/590939228 >> v2:172.21.15.158:3300/0 conn(0x7ff0c80ccbb0 msgr2=0x7ff0c80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:53.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cd99c700 1 --2- 172.21.15.124:0/590939228 >> v2:172.21.15.158:3300/0 conn(0x7ff0c80ccbb0 0x7ff0c80cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:53.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.989+0000 7ff0cd99c700 1 -- 172.21.15.124:0/590939228 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c80cf060 con 0x7ff0c80ccf80 2023-10-06T04:45:53.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0cd99c700 1 --2- 172.21.15.124:0/590939228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80ccf80 0x7ff0c80cd400 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8089d60 tx=0x7ff0c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9522059784de13e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:53.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0bffff700 1 -- 172.21.15.124:0/590939228 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000e070 con 0x7ff0c80ccf80 2023-10-06T04:45:53.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0bffff700 1 -- 172.21.15.124:0/590939228 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c000ba50 con 0x7ff0c80ccf80 2023-10-06T04:45:53.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0bffff700 1 -- 172.21.15.124:0/590939228 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00092e0 con 0x7ff0c80ccf80 2023-10-06T04:45:53.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/590939228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80ccf80 msgr2=0x7ff0c80cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:53.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0cf3ff700 1 --2- 172.21.15.124:0/590939228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80ccf80 0x7ff0c80cd400 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8089d60 tx=0x7ff0c0009840 comp rx=0 tx=0).stop 2023-10-06T04:45:53.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/590939228 shutdown_connections 2023-10-06T04:45:53.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0cf3ff700 1 --2- 172.21.15.124:0/590939228 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80ccf80 0x7ff0c80cd400 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:53.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0cf3ff700 1 --2- 172.21.15.124:0/590939228 >> v2:172.21.15.158:3300/0 conn(0x7ff0c80ccbb0 0x7ff0c80cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:53.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0cf3ff700 1 --2- 172.21.15.124:0/590939228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0c80cdfe0 0x7ff0c80ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:53.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.990+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/590939228 >> 172.21.15.124:0/590939228 conn(0x7ff0c8099710 msgr2=0x7ff0c806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:54.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.991+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/590939228 shutdown_connections 2023-10-06T04:45:54.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.991+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/590939228 wait complete. 2023-10-06T04:45:54.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.992+0000 7ff0cf3ff700 1 Processor -- start 2023-10-06T04:45:54.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.992+0000 7ff0cf3ff700 1 -- start start 2023-10-06T04:45:54.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cf3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0c80ccbb0 0x7ff0c80c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cf3ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0c80ccf80 0x7ff0c80c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cf3ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80cdfe0 0x7ff0c814ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cf3ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80c55a0 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cf3ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80c4990 con 0x7ff0c80ccf80 2023-10-06T04:45:54.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cf3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80c4c70 con 0x7ff0c80ccbb0 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cd99c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80cdfe0 0x7ff0c814ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cd99c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80cdfe0 0x7ff0c814ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54820/0 (socket says 172.21.15.124:54820) 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cd99c700 1 -- 172.21.15.124:0/460787678 learned_addr learned my addr 172.21.15.124:0/460787678 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cd19b700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0c80ccbb0 0x7ff0c80c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.993+0000 7ff0cc99a700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0c80ccf80 0x7ff0c80c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0cd99c700 1 -- 172.21.15.124:0/460787678 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0c80ccbb0 msgr2=0x7ff0c80c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0cd99c700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0c80ccbb0 0x7ff0c80c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0cd99c700 1 -- 172.21.15.124:0/460787678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0c80ccf80 msgr2=0x7ff0c80c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0cd99c700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0c80ccf80 0x7ff0c80c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0cd99c700 1 -- 172.21.15.124:0/460787678 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c0009ae0 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0cd99c700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80cdfe0 0x7ff0c814ea50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8088b40 tx=0x7ff0c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:54.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0bd7fa700 1 -- 172.21.15.124:0/460787678 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00032f0 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0bd7fa700 1 -- 172.21.15.124:0/460787678 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c0008e80 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/460787678 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c80c4f50 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0bd7fa700 1 -- 172.21.15.124:0/460787678 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00266b0 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.994+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/460787678 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c814ef90 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.995+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/460787678 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c80717a0 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.996+0000 7ff0bd7fa700 1 -- 172.21.15.124:0/460787678 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0c0003040 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.997+0000 7ff0bd7fa700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0ac066f30 0x7ff0ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.997+0000 7ff0bd7fa700 1 -- 172.21.15.124:0/460787678 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff0c0085e70 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.997+0000 7ff0cd19b700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0ac066f30 0x7ff0ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:53.998+0000 7ff0cd19b700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0ac066f30 0x7ff0ac0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4006fd0 tx=0x7ff0c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:54.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.001+0000 7ff0bd7fa700 1 -- 172.21.15.124:0/460787678 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0c00532e0 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.265+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/460787678 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff0c80c56e0 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.265+0000 7ff0bd7fa700 1 -- 172.21.15.124:0/460787678 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff0c0009940 con 0x7ff0c80cdfe0 2023-10-06T04:45:54.269 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:54.269 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:45:54.269 INFO:teuthology.orchestra.run.smithi124.stdout: "auth_dump": [ 2023-10-06T04:45:54.270 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.270 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.a", 2023-10-06T04:45:54.270 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBzkB9lKBFMHxAAXgC27c+1ERz5OgJHsiAy4A==", 2023-10-06T04:45:54.270 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.270 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:54.270 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-06T04:45:54.271 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-06T04:45:54.271 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.271 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.271 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.271 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.271 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.b", 2023-10-06T04:45:54.271 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBzkB9lvdR3NhAANuznjRvM5pPthiP1y6Pz4Q==", 2023-10-06T04:45:54.271 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.271 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.c", 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBzkB9loGWOKhAAfZgSi/yqg2vp6u8ewu566w==", 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-06T04:45:54.272 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-06T04:45:54.273 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.273 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.273 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.273 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.273 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.d", 2023-10-06T04:45:54.273 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB0kB9lXmA5BhAA2JCdPcOUZw1qb5iNn0SLNg==", 2023-10-06T04:45:54.273 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.273 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:54.273 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-06T04:45:54.273 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-06T04:45:54.274 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.274 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.274 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.274 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.274 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.0", 2023-10-06T04:45:54.274 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB4kB9l+SyRGBAA39xHrh7excQVD8NW32swvg==", 2023-10-06T04:45:54.274 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.274 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:54.274 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:54.274 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.275 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.275 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.275 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.275 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.1", 2023-10-06T04:45:54.275 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB7kB9lfpKxGxAA3F2cmJ5/fCVxSTYpwim3QA==", 2023-10-06T04:45:54.275 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.275 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:54.275 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:54.275 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.275 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.276 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.276 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.276 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.2", 2023-10-06T04:45:54.276 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB+kB9lv5/HHxAAqoGgt106VO/Hz5cQHozPwg==", 2023-10-06T04:45:54.276 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.276 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:54.276 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:54.276 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.277 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.277 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.277 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.277 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.3", 2023-10-06T04:45:54.277 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCBkB9lwh+3IxAA7Eg9nU/Oxv+3UcIniSuZiA==", 2023-10-06T04:45:54.278 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.278 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:54.278 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:54.278 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.279 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.279 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.279 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.279 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.4", 2023-10-06T04:45:54.280 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCGkB9lxXs1BBAAwZEwn6qRy5C+8I7GhtEj1g==", 2023-10-06T04:45:54.280 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.280 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:54.280 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:54.281 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.281 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.281 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.281 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.281 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.5", 2023-10-06T04:45:54.282 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCJkB9lhGXKBxAAIlFlDabyRQva71ZvtM+l+g==", 2023-10-06T04:45:54.282 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.282 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:54.282 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:54.282 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.283 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.283 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.283 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.283 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.6", 2023-10-06T04:45:54.284 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCMkB9lMxz1ChAA824wwFpjXzKt7FvK3EgXFA==", 2023-10-06T04:45:54.284 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.284 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:54.284 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:54.285 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.285 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.285 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.285 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.286 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.7", 2023-10-06T04:45:54.286 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQCPkB9lcRe+DRAA+4LUd77sN+aMHaIh78oTjA==", 2023-10-06T04:45:54.286 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.286 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-06T04:45:54.286 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-06T04:45:54.286 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.287 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.287 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.287 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.287 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.0", 2023-10-06T04:45:54.287 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB0kB9lMOEjEBAAntffMklHDpj3DVWL1iTmTQ==", 2023-10-06T04:45:54.288 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.288 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:54.288 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow r", 2023-10-06T04:45:54.288 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T04:45:54.289 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.289 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.289 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.289 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.1", 2023-10-06T04:45:54.290 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB0kB9lT1B7HhAAJbSOHYRH/tQ8+HTJvLd5aA==", 2023-10-06T04:45:54.290 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.290 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:54.290 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-06T04:45:54.291 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-06T04:45:54.291 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-06T04:45:54.291 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.291 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.291 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.292 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.2", 2023-10-06T04:45:54.292 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB0kB9lg3JIFxAAPmfPWXfFG6FTOtQnvkJ/Hg==", 2023-10-06T04:45:54.292 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.292 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:54.293 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-06T04:45:54.293 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-06T04:45:54.293 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-06T04:45:54.293 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.294 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.294 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.294 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.3", 2023-10-06T04:45:54.295 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQB0kB9l5oq1JRAAKYKlHwhFevVgR4qCohC3Bg==", 2023-10-06T04:45:54.295 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.295 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-06T04:45:54.295 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-06T04:45:54.296 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-06T04:45:54.296 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-06T04:45:54.296 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.296 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.296 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.297 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.admin", 2023-10-06T04:45:54.297 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBykB9l55BBIxAAxEWs+lJJlID4rpF3szIvaQ==", 2023-10-06T04:45:54.297 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.297 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2023-10-06T04:45:54.298 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-06T04:45:54.298 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-06T04:45:54.298 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.299 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.299 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.299 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.300 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mgr.x", 2023-10-06T04:45:54.300 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBzkB9ligUHGBAAHbLmqM3wPTbD84xLUB/n2w==", 2023-10-06T04:45:54.300 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.300 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2023-10-06T04:45:54.301 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile mgr", 2023-10-06T04:45:54.301 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.301 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.301 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:54.301 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:54.301 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mgr.y", 2023-10-06T04:45:54.302 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBzkB9lI5AdDxAA2ySdMloWexLYXANF7ODlIQ==", 2023-10-06T04:45:54.302 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-06T04:45:54.302 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2023-10-06T04:45:54.302 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile mgr", 2023-10-06T04:45:54.302 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-06T04:45:54.302 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.302 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:54.302 INFO:teuthology.orchestra.run.smithi124.stdout: ] 2023-10-06T04:45:54.303 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:45:54.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.267+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/460787678 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0ac066f30 msgr2=0x7ff0ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0ac066f30 0x7ff0ac0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4006fd0 tx=0x7ff0c4008040 comp rx=0 tx=0).stop 2023-10-06T04:45:54.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/460787678 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80cdfe0 msgr2=0x7ff0c814ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80cdfe0 0x7ff0c814ea50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8088b40 tx=0x7ff0c0018000 comp rx=0 tx=0).stop 2023-10-06T04:45:54.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/460787678 shutdown_connections 2023-10-06T04:45:54.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff0c80cdfe0 0x7ff0c814ea50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff0ac066f30 0x7ff0ac0693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff0c80ccbb0 0x7ff0c80c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 --2- 172.21.15.124:0/460787678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0c80ccf80 0x7ff0c80c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/460787678 >> 172.21.15.124:0/460787678 conn(0x7ff0c8099710 msgr2=0x7ff0c81519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:54.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/460787678 shutdown_connections 2023-10-06T04:45:54.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.268+0000 7ff0cf3ff700 1 -- 172.21.15.124:0/460787678 wait complete. 2023-10-06T04:45:54.307 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:54.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.495+0000 7fce463ff700 1 Processor -- start 2023-10-06T04:45:54.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.495+0000 7fce463ff700 1 -- start start 2023-10-06T04:45:54.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.496+0000 7fce463ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fce400abb60 0x7fce400abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.496+0000 7fce463ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 0x7fce40098f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.496+0000 7fce463ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce400acc40 con 0x7fce400690b0 2023-10-06T04:45:54.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.496+0000 7fce463ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce400ad0d0 con 0x7fce400abb60 2023-10-06T04:45:54.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.496+0000 7fce463ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4006ae30 con 0x7fce400ccd30 2023-10-06T04:45:54.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.497+0000 7fce4499c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fce400690b0 0x7fce40099440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:51806/0 (socket says 172.21.15.124:51806) 2023-10-06T04:45:54.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.497+0000 7fce4499c700 1 -- 172.21.15.124:0/103666971 learned_addr learned my addr 172.21.15.124:0/103666971 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:54.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.497+0000 7fce3ffff700 1 --2- 172.21.15.124:0/103666971 >> v2:172.21.15.158:3300/0 conn(0x7fce400abb60 0x7fce400abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.497+0000 7fce3f7fe700 1 --2- 172.21.15.124:0/103666971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 0x7fce40098f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.497+0000 7fce3effd700 1 -- 172.21.15.124:0/103666971 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376911762 0 0) 0x7fce400acc40 con 0x7fce400690b0 2023-10-06T04:45:54.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.497+0000 7fce3effd700 1 -- 172.21.15.124:0/103666971 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce28003570 con 0x7fce400690b0 2023-10-06T04:45:54.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.497+0000 7fce3ffff700 1 -- 172.21.15.124:0/103666971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 msgr2=0x7fce40098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:54.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.497+0000 7fce3ffff700 1 --2- 172.21.15.124:0/103666971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 0x7fce40098f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.497+0000 7fce3ffff700 1 -- 172.21.15.124:0/103666971 >> v1:172.21.15.124:6789/0 conn(0x7fce400690b0 legacy=0x7fce40099440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.497+0000 7fce3effd700 1 -- 172.21.15.124:0/103666971 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199565831 0 0) 0x7fce28003570 con 0x7fce400690b0 2023-10-06T04:45:54.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.498+0000 7fce3ffff700 1 -- 172.21.15.124:0/103666971 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce400ac5f0 con 0x7fce400abb60 2023-10-06T04:45:54.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.498+0000 7fce3f7fe700 1 --2- 172.21.15.124:0/103666971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 0x7fce40098f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:54.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.498+0000 7fce3ffff700 1 --2- 172.21.15.124:0/103666971 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce400abb60 0x7fce400abf30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fce300098e0 tx=0x7fce300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=522e26eddf4465b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:54.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.498+0000 7fce3effd700 1 -- 172.21.15.124:0/103666971 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce380017f0 con 0x7fce400abb60 2023-10-06T04:45:54.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.498+0000 7fce3effd700 1 -- 172.21.15.124:0/103666971 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce30011420 con 0x7fce400abb60 2023-10-06T04:45:54.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.498+0000 7fce3effd700 1 -- 172.21.15.124:0/103666971 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce300117c0 con 0x7fce400abb60 2023-10-06T04:45:54.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.499+0000 7fce463ff700 1 -- 172.21.15.124:0/103666971 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce400abb60 msgr2=0x7fce400abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.499+0000 7fce463ff700 1 --2- 172.21.15.124:0/103666971 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce400abb60 0x7fce400abf30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fce300098e0 tx=0x7fce300091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.499+0000 7fce463ff700 1 -- 172.21.15.124:0/103666971 shutdown_connections 2023-10-06T04:45:54.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.499+0000 7fce463ff700 1 --2- 172.21.15.124:0/103666971 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce400abb60 0x7fce400abf30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.499+0000 7fce463ff700 1 --2- 172.21.15.124:0/103666971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 0x7fce40098f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.499+0000 7fce463ff700 1 -- 172.21.15.124:0/103666971 >> 172.21.15.124:0/103666971 conn(0x7fce400cc050 msgr2=0x7fce400cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:54.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.499+0000 7fce463ff700 1 -- 172.21.15.124:0/103666971 shutdown_connections 2023-10-06T04:45:54.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.499+0000 7fce463ff700 1 -- 172.21.15.124:0/103666971 wait complete. 2023-10-06T04:45:54.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.500+0000 7fce463ff700 1 Processor -- start 2023-10-06T04:45:54.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.500+0000 7fce463ff700 1 -- start start 2023-10-06T04:45:54.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.501+0000 7fce463ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce400690b0 0x7fce401547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.501+0000 7fce463ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce400abb60 0x7fce400c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.501+0000 7fce463ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 0x7fce401693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.501+0000 7fce463ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce400c2820 con 0x7fce400abb60 2023-10-06T04:45:54.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.501+0000 7fce463ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce400a96a0 con 0x7fce400690b0 2023-10-06T04:45:54.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.501+0000 7fce463ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce400a9980 con 0x7fce400ccd30 2023-10-06T04:45:54.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce400abb60 0x7fce400c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce400abb60 0x7fce400c22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54832/0 (socket says 172.21.15.124:54832) 2023-10-06T04:45:54.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3f7fe700 1 -- 172.21.15.124:0/3103035830 learned_addr learned my addr 172.21.15.124:0/3103035830 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:54.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3ffff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce400690b0 0x7fce401547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce4499c700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 0x7fce401693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3f7fe700 1 -- 172.21.15.124:0/3103035830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 msgr2=0x7fce401693a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3f7fe700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 0x7fce401693a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3f7fe700 1 -- 172.21.15.124:0/3103035830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce400690b0 msgr2=0x7fce401547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3f7fe700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce400690b0 0x7fce401547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3f7fe700 1 -- 172.21.15.124:0/3103035830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34009420 con 0x7fce400abb60 2023-10-06T04:45:54.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3ffff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce400690b0 0x7fce401547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:54.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce3f7fe700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce400abb60 0x7fce400c22e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fce3400ec80 tx=0x7fce340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:54.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce27fff700 1 -- 172.21.15.124:0/3103035830 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3400c9d0 con 0x7fce400abb60 2023-10-06T04:45:54.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce27fff700 1 -- 172.21.15.124:0/3103035830 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3400cb30 con 0x7fce400abb60 2023-10-06T04:45:54.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce27fff700 1 -- 172.21.15.124:0/3103035830 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3400ceb0 con 0x7fce400abb60 2023-10-06T04:45:54.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.502+0000 7fce463ff700 1 -- 172.21.15.124:0/3103035830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce30009420 con 0x7fce400abb60 2023-10-06T04:45:54.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.503+0000 7fce463ff700 1 -- 172.21.15.124:0/3103035830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce400a9f40 con 0x7fce400abb60 2023-10-06T04:45:54.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.504+0000 7fce463ff700 1 -- 172.21.15.124:0/3103035830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce400717a0 con 0x7fce400abb60 2023-10-06T04:45:54.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.505+0000 7fce27fff700 1 -- 172.21.15.124:0/3103035830 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce34013680 con 0x7fce400abb60 2023-10-06T04:45:54.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.506+0000 7fce27fff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fce2c066f30 0x7fce2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.506+0000 7fce27fff700 1 -- 172.21.15.124:0/3103035830 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fce34084830 con 0x7fce400abb60 2023-10-06T04:45:54.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.506+0000 7fce3ffff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fce2c066f30 0x7fce2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.507+0000 7fce3ffff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fce2c066f30 0x7fce2c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fce300093f0 tx=0x7fce30016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:54.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.510+0000 7fce27fff700 1 -- 172.21.15.124:0/3103035830 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce34051bf0 con 0x7fce400abb60 2023-10-06T04:45:54.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.705+0000 7fce463ff700 1 -- 172.21.15.124:0/3103035830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce400b1af0 con 0x7fce400abb60 2023-10-06T04:45:54.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.706+0000 7fce27fff700 1 -- 172.21.15.124:0/3103035830 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13794 (secure 0 0 0) 0x7fce34055210 con 0x7fce400abb60 2023-10-06T04:45:54.709 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:54.709 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":41,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:45:53.766258+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:54.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.708+0000 7fce463ff700 1 -- 172.21.15.124:0/3103035830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fce2c066f30 msgr2=0x7fce2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.708+0000 7fce463ff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fce2c066f30 0x7fce2c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fce300093f0 tx=0x7fce30016000 comp rx=0 tx=0).stop 2023-10-06T04:45:54.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.708+0000 7fce463ff700 1 -- 172.21.15.124:0/3103035830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce400abb60 msgr2=0x7fce400c22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.708+0000 7fce463ff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce400abb60 0x7fce400c22e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fce3400ec80 tx=0x7fce340091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.708+0000 7fce463ff700 1 -- 172.21.15.124:0/3103035830 shutdown_connections 2023-10-06T04:45:54.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.708+0000 7fce463ff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fce2c066f30 0x7fce2c0693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.708+0000 7fce463ff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce400ccd30 0x7fce401693a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.708+0000 7fce463ff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce400690b0 0x7fce401547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.708+0000 7fce463ff700 1 --2- 172.21.15.124:0/3103035830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fce400abb60 0x7fce400c22e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.708+0000 7fce463ff700 1 -- 172.21.15.124:0/3103035830 >> 172.21.15.124:0/3103035830 conn(0x7fce400cc050 msgr2=0x7fce400af450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:54.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.709+0000 7fce463ff700 1 -- 172.21.15.124:0/3103035830 shutdown_connections 2023-10-06T04:45:54.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.709+0000 7fce463ff700 1 -- 172.21.15.124:0/3103035830 wait complete. 2023-10-06T04:45:54.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:45:54.729 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:45:54.921 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.919+0000 7fd8b0bff700 1 Processor -- start 2023-10-06T04:45:54.921 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.919+0000 7fd8b0bff700 1 -- start start 2023-10-06T04:45:54.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.920+0000 7fd8b0bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd8ac1592b0 0x7fd8ac0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.920+0000 7fd8b0bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac159680 0x7fd8ac0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.920+0000 7fd8b0bff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd8ac15dab0 0x7fd8ac0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.920+0000 7fd8b0bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ac15d0d0 con 0x7fd8ac1592b0 2023-10-06T04:45:54.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.920+0000 7fd8b0bff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b2ed0 con 0x7fd8ac15dab0 2023-10-06T04:45:54.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.920+0000 7fd8b0bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0cccc0 con 0x7fd8ac159680 2023-10-06T04:45:54.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aa59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd8ac1592b0 0x7fd8ac0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aa59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd8ac1592b0 0x7fd8ac0b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54836/0 (socket says 172.21.15.124:54836) 2023-10-06T04:45:54.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aa59c700 1 -- 172.21.15.124:0/511231019 learned_addr learned my addr 172.21.15.124:0/511231019 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:54.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aad9d700 1 --2- 172.21.15.124:0/511231019 >> v2:172.21.15.158:3300/0 conn(0x7fd8ac15dab0 0x7fd8ac0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8a9d9b700 1 --2- 172.21.15.124:0/511231019 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac159680 0x7fd8ac0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aa59c700 1 -- 172.21.15.124:0/511231019 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac159680 msgr2=0x7fd8ac0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:54.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aa59c700 1 --2- 172.21.15.124:0/511231019 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac159680 0x7fd8ac0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aa59c700 1 -- 172.21.15.124:0/511231019 >> v2:172.21.15.158:3300/0 conn(0x7fd8ac15dab0 msgr2=0x7fd8ac0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:54.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aa59c700 1 --2- 172.21.15.124:0/511231019 >> v2:172.21.15.158:3300/0 conn(0x7fd8ac15dab0 0x7fd8ac0ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aa59c700 1 -- 172.21.15.124:0/511231019 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac15d620 con 0x7fd8ac1592b0 2023-10-06T04:45:54.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aad9d700 1 --2- 172.21.15.124:0/511231019 >> v2:172.21.15.158:3300/0 conn(0x7fd8ac15dab0 0x7fd8ac0ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:54.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8a9d9b700 1 --2- 172.21.15.124:0/511231019 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac159680 0x7fd8ac0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:54.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.921+0000 7fd8aa59c700 1 --2- 172.21.15.124:0/511231019 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac1592b0 0x7fd8ac0b0080 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0c3ea0 tx=0x7fd89c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3ff5fbdb5fdc1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:54.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8a959a700 1 -- 172.21.15.124:0/511231019 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00b860 con 0x7fd8ac1592b0 2023-10-06T04:45:54.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8a959a700 1 -- 172.21.15.124:0/511231019 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c00b9c0 con 0x7fd8ac1592b0 2023-10-06T04:45:54.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8a959a700 1 -- 172.21.15.124:0/511231019 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00bd60 con 0x7fd8ac1592b0 2023-10-06T04:45:54.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8b0bff700 1 -- 172.21.15.124:0/511231019 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac1592b0 msgr2=0x7fd8ac0b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8b0bff700 1 --2- 172.21.15.124:0/511231019 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac1592b0 0x7fd8ac0b0080 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0c3ea0 tx=0x7fd89c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:54.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8b0bff700 1 -- 172.21.15.124:0/511231019 shutdown_connections 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8b0bff700 1 --2- 172.21.15.124:0/511231019 >> v2:172.21.15.158:3300/0 conn(0x7fd8ac15dab0 0x7fd8ac0ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8b0bff700 1 --2- 172.21.15.124:0/511231019 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac1592b0 0x7fd8ac0b0080 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8b0bff700 1 --2- 172.21.15.124:0/511231019 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac159680 0x7fd8ac0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8b0bff700 1 -- 172.21.15.124:0/511231019 >> 172.21.15.124:0/511231019 conn(0x7fd8ac06ed20 msgr2=0x7fd8ac06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8b0bff700 1 -- 172.21.15.124:0/511231019 shutdown_connections 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.922+0000 7fd8b0bff700 1 -- 172.21.15.124:0/511231019 wait complete. 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.924+0000 7fd8b0bff700 1 Processor -- start 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.924+0000 7fd8b0bff700 1 -- start start 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8b0bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8ac1592b0 0x7fd8ac0c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8b0bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac159680 0x7fd8ac0b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8b0bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac15dab0 0x7fd8ac150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8b0bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b4f00 con 0x7fd8ac159680 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8b0bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0c8900 con 0x7fd8ac1592b0 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8b0bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b42f0 con 0x7fd8ac15dab0 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8a9d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac159680 0x7fd8ac0b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8a9d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac159680 0x7fd8ac0b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54840/0 (socket says 172.21.15.124:54840) 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8a9d9b700 1 -- 172.21.15.124:0/534971771 learned_addr learned my addr 172.21.15.124:0/534971771 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8aa59c700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8ac1592b0 0x7fd8ac0c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8aad9d700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac15dab0 0x7fd8ac150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8a9d9b700 1 -- 172.21.15.124:0/534971771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac15dab0 msgr2=0x7fd8ac150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8a9d9b700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac15dab0 0x7fd8ac150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8a9d9b700 1 -- 172.21.15.124:0/534971771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8ac1592b0 msgr2=0x7fd8ac0c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:54.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8a9d9b700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8ac1592b0 0x7fd8ac0c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:54.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.925+0000 7fd8a9d9b700 1 -- 172.21.15.124:0/534971771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0094f0 con 0x7fd8ac159680 2023-10-06T04:45:54.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.926+0000 7fd8a9d9b700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac159680 0x7fd8ac0b3c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000c880 tx=0x7fd8a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:54.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.926+0000 7fd89a7fc700 1 -- 172.21.15.124:0/534971771 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0011600 con 0x7fd8ac159680 2023-10-06T04:45:54.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.926+0000 7fd89a7fc700 1 -- 172.21.15.124:0/534971771 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0011760 con 0x7fd8ac159680 2023-10-06T04:45:54.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.926+0000 7fd89a7fc700 1 -- 172.21.15.124:0/534971771 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0011ae0 con 0x7fd8ac159680 2023-10-06T04:45:54.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.926+0000 7fd8b0bff700 1 -- 172.21.15.124:0/534971771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac0b45d0 con 0x7fd8ac159680 2023-10-06T04:45:54.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.926+0000 7fd8b0bff700 1 -- 172.21.15.124:0/534971771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ac0b4b90 con 0x7fd8ac159680 2023-10-06T04:45:54.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.927+0000 7fd8b0bff700 1 -- 172.21.15.124:0/534971771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ac0b4d50 con 0x7fd8ac159680 2023-10-06T04:45:54.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.928+0000 7fd89a7fc700 1 -- 172.21.15.124:0/534971771 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8a0010350 con 0x7fd8ac159680 2023-10-06T04:45:54.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.929+0000 7fd89a7fc700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd88c066f30 0x7fd88c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:54.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.929+0000 7fd89a7fc700 1 -- 172.21.15.124:0/534971771 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd8a0084330 con 0x7fd8ac159680 2023-10-06T04:45:54.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.929+0000 7fd8aa59c700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd88c066f30 0x7fd88c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:54.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.930+0000 7fd8aa59c700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd88c066f30 0x7fd88c0693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0c3ea0 tx=0x7fd89c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:54.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:54.933+0000 7fd89a7fc700 1 -- 172.21.15.124:0/534971771 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8a0055180 con 0x7fd8ac159680 2023-10-06T04:45:55.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.126+0000 7fd8b0bff700 1 -- 172.21.15.124:0/534971771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8ac064d10 con 0x7fd8ac159680 2023-10-06T04:45:55.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.126+0000 7fd89a7fc700 1 -- 172.21.15.124:0/534971771 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd8a0054d10 con 0x7fd8ac159680 2023-10-06T04:45:55.129 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:45:55.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.128+0000 7fd8b0bff700 1 -- 172.21.15.124:0/534971771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd88c066f30 msgr2=0x7fd88c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.128+0000 7fd8b0bff700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd88c066f30 0x7fd88c0693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0c3ea0 tx=0x7fd89c017000 comp rx=0 tx=0).stop 2023-10-06T04:45:55.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.128+0000 7fd8b0bff700 1 -- 172.21.15.124:0/534971771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac159680 msgr2=0x7fd8ac0b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.128+0000 7fd8b0bff700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac159680 0x7fd8ac0b3c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000c880 tx=0x7fd8a0008040 comp rx=0 tx=0).stop 2023-10-06T04:45:55.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.129+0000 7fd8b0bff700 1 -- 172.21.15.124:0/534971771 shutdown_connections 2023-10-06T04:45:55.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.129+0000 7fd8b0bff700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd88c066f30 0x7fd88c0693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.129+0000 7fd8b0bff700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8ac15dab0 0x7fd8ac150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.129+0000 7fd8b0bff700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8ac1592b0 0x7fd8ac0c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.129+0000 7fd8b0bff700 1 --2- 172.21.15.124:0/534971771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8ac159680 0x7fd8ac0b3c10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.129+0000 7fd8b0bff700 1 -- 172.21.15.124:0/534971771 >> 172.21.15.124:0/534971771 conn(0x7fd8ac06ed20 msgr2=0x7fd8ac159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:55.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.129+0000 7fd8b0bff700 1 -- 172.21.15.124:0/534971771 shutdown_connections 2023-10-06T04:45:55.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.129+0000 7fd8b0bff700 1 -- 172.21.15.124:0/534971771 wait complete. 2023-10-06T04:45:55.149 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:45:55.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.338+0000 7f20191ff700 1 Processor -- start 2023-10-06T04:45:55.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.339+0000 7f20191ff700 1 -- start start 2023-10-06T04:45:55.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f20191ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20141592b0 0x7f20140b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f20191ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2014159680 0x7f20140cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f20191ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f201415dab0 0x7f20140ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f20191ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201415d0d0 con 0x7f2014159680 2023-10-06T04:45:55.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f20191ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20140b2ed0 con 0x7f201415dab0 2023-10-06T04:45:55.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f20191ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140cccc0 con 0x7f20141592b0 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f201359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f201415dab0 0x7f20140ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f2012d9d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20141592b0 0x7f20140b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f201259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2014159680 0x7f20140cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f201359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f201415dab0 0x7f20140ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.124:60914/0 (socket says 172.21.15.124:60914) 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f201259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2014159680 0x7f20140cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54846/0 (socket says 172.21.15.124:54846) 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f2012d9d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20141592b0 0x7f20140b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:43324/0 (socket says 172.21.15.124:43324) 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.340+0000 7f201359e700 1 -- 172.21.15.124:0/4270267593 learned_addr learned my addr 172.21.15.124:0/4270267593 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.341+0000 7f201259c700 1 -- 172.21.15.124:0/4270267593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20141592b0 msgr2=0x7f20140b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.341+0000 7f201259c700 1 --2- 172.21.15.124:0/4270267593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20141592b0 0x7f20140b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.341+0000 7f201259c700 1 -- 172.21.15.124:0/4270267593 >> v2:172.21.15.158:3300/0 conn(0x7f201415dab0 msgr2=0x7f20140ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.341+0000 7f201259c700 1 --2- 172.21.15.124:0/4270267593 >> v2:172.21.15.158:3300/0 conn(0x7f201415dab0 0x7f20140ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.341+0000 7f201259c700 1 -- 172.21.15.124:0/4270267593 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201415d620 con 0x7f2014159680 2023-10-06T04:45:55.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.341+0000 7f201259c700 1 --2- 172.21.15.124:0/4270267593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2014159680 0x7f20140cc780 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f20140c3ea0 tx=0x7f20080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999e5b89f0a07d02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.341+0000 7f2011d9b700 1 -- 172.21.15.124:0/4270267593 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2008011630 con 0x7f2014159680 2023-10-06T04:45:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.341+0000 7f2011d9b700 1 -- 172.21.15.124:0/4270267593 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20080117b0 con 0x7f2014159680 2023-10-06T04:45:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.341+0000 7f2011d9b700 1 -- 172.21.15.124:0/4270267593 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2008011b70 con 0x7f2014159680 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.342+0000 7f20191ff700 1 -- 172.21.15.124:0/4270267593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2014159680 msgr2=0x7f20140cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.342+0000 7f20191ff700 1 --2- 172.21.15.124:0/4270267593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2014159680 0x7f20140cc780 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f20140c3ea0 tx=0x7f20080091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.342+0000 7f20191ff700 1 -- 172.21.15.124:0/4270267593 shutdown_connections 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.342+0000 7f20191ff700 1 --2- 172.21.15.124:0/4270267593 >> v2:172.21.15.158:3300/0 conn(0x7f201415dab0 0x7f20140ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.342+0000 7f20191ff700 1 --2- 172.21.15.124:0/4270267593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20141592b0 0x7f20140b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.342+0000 7f20191ff700 1 --2- 172.21.15.124:0/4270267593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2014159680 0x7f20140cc780 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.342+0000 7f20191ff700 1 -- 172.21.15.124:0/4270267593 >> 172.21.15.124:0/4270267593 conn(0x7f201406ed20 msgr2=0x7f201406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.342+0000 7f20191ff700 1 -- 172.21.15.124:0/4270267593 shutdown_connections 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.342+0000 7f20191ff700 1 -- 172.21.15.124:0/4270267593 wait complete. 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.343+0000 7f20191ff700 1 Processor -- start 2023-10-06T04:45:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.344+0000 7f20191ff700 1 -- start start 2023-10-06T04:45:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.344+0000 7f20191ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20141592b0 0x7f2014169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.344+0000 7f20191ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2014159680 0x7f20140c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.344+0000 7f20191ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201415dab0 0x7f2014155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f20191ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20140c48a0 con 0x7f201415dab0 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f20191ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20140c3f70 con 0x7f20141592b0 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f20191ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140c4250 con 0x7f2014159680 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f201359e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201415dab0 0x7f2014155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f2012d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20141592b0 0x7f2014169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f201359e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201415dab0 0x7f2014155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54852/0 (socket says 172.21.15.124:54852) 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f201359e700 1 -- 172.21.15.124:0/3103871356 learned_addr learned my addr 172.21.15.124:0/3103871356 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f201259c700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2014159680 0x7f20140c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f201359e700 1 -- 172.21.15.124:0/3103871356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2014159680 msgr2=0x7f20140c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f201359e700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2014159680 0x7f20140c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f201359e700 1 -- 172.21.15.124:0/3103871356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20141592b0 msgr2=0x7f2014169790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f201359e700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20141592b0 0x7f2014169790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f201359e700 1 -- 172.21.15.124:0/3103871356 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2008009420 con 0x7f201415dab0 2023-10-06T04:45:55.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.345+0000 7f201359e700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201415dab0 0x7f2014155a80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f200c009e50 tx=0x7f200c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:55.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.346+0000 7f1ffaffd700 1 -- 172.21.15.124:0/3103871356 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00c890 con 0x7f201415dab0 2023-10-06T04:45:55.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.346+0000 7f1ffaffd700 1 -- 172.21.15.124:0/3103871356 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c00f040 con 0x7f201415dab0 2023-10-06T04:45:55.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.346+0000 7f20191ff700 1 -- 172.21.15.124:0/3103871356 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20140c4530 con 0x7f201415dab0 2023-10-06T04:45:55.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.346+0000 7f1ffaffd700 1 -- 172.21.15.124:0/3103871356 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00cc40 con 0x7f201415dab0 2023-10-06T04:45:55.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.346+0000 7f20191ff700 1 -- 172.21.15.124:0/3103871356 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20140c8d10 con 0x7f201415dab0 2023-10-06T04:45:55.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.347+0000 7f20191ff700 1 -- 172.21.15.124:0/3103871356 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20140c4a10 con 0x7f201415dab0 2023-10-06T04:45:55.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.348+0000 7f1ffaffd700 1 -- 172.21.15.124:0/3103871356 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f200c014650 con 0x7f201415dab0 2023-10-06T04:45:55.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.348+0000 7f1ffaffd700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2000066f30 0x7f20000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.348+0000 7f1ffaffd700 1 -- 172.21.15.124:0/3103871356 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f200c0849c0 con 0x7f201415dab0 2023-10-06T04:45:55.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.349+0000 7f2012d9d700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2000066f30 0x7f20000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.349+0000 7f2012d9d700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2000066f30 0x7f20000693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f20140c7eb0 tx=0x7f20040091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:55.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.353+0000 7f1ffaffd700 1 -- 172.21.15.124:0/3103871356 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f200c051d80 con 0x7f201415dab0 2023-10-06T04:45:55.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.542+0000 7f20191ff700 1 -- 172.21.15.124:0/3103871356 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f201404c380 con 0x7f201415dab0 2023-10-06T04:45:55.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.542+0000 7f1ffaffd700 1 -- 172.21.15.124:0/3103871356 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f200c0553a0 con 0x7f201415dab0 2023-10-06T04:45:55.545 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:45:55.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 -- 172.21.15.124:0/3103871356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2000066f30 msgr2=0x7f20000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2000066f30 0x7f20000693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f20140c7eb0 tx=0x7f20040091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 -- 172.21.15.124:0/3103871356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201415dab0 msgr2=0x7f2014155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201415dab0 0x7f2014155a80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f200c009e50 tx=0x7f200c00b040 comp rx=0 tx=0).stop 2023-10-06T04:45:55.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 -- 172.21.15.124:0/3103871356 shutdown_connections 2023-10-06T04:45:55.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201415dab0 0x7f2014155a80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20141592b0 0x7f2014169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2000066f30 0x7f20000693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 --2- 172.21.15.124:0/3103871356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2014159680 0x7f20140c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 -- 172.21.15.124:0/3103871356 >> 172.21.15.124:0/3103871356 conn(0x7f201406ed20 msgr2=0x7f20140cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:55.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 -- 172.21.15.124:0/3103871356 shutdown_connections 2023-10-06T04:45:55.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.545+0000 7f20191ff700 1 -- 172.21.15.124:0/3103871356 wait complete. 2023-10-06T04:45:55.565 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:45:55.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.752+0000 7f96979ff700 1 Processor -- start 2023-10-06T04:45:55.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.752+0000 7f96979ff700 1 -- start start 2023-10-06T04:45:55.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.753+0000 7f96979ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f96900ade80 0x7f96901577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.753+0000 7f96979ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900ab910 con 0x7f96901573e0 2023-10-06T04:45:55.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.753+0000 7f96979ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900abbf0 con 0x7f96900a6c60 2023-10-06T04:45:55.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.753+0000 7f96979ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969006a4a0 con 0x7f96900ade80 2023-10-06T04:45:55.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.754+0000 7f969579b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f96901573e0 0x7f9690069a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:51808/0 (socket says 172.21.15.124:51808) 2023-10-06T04:45:55.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.754+0000 7f969579b700 1 -- 172.21.15.124:0/2932917469 learned_addr learned my addr 172.21.15.124:0/2932917469 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:55.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.754+0000 7f9695f9c700 1 --2- 172.21.15.124:0/2932917469 >> v2:172.21.15.124:3300/0 conn(0x7f96900ade80 0x7f96901577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.754+0000 7f9687fff700 1 -- 172.21.15.124:0/2932917469 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608227002 0 0) 0x7f96900ab910 con 0x7f96901573e0 2023-10-06T04:45:55.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.754+0000 7f9687fff700 1 -- 172.21.15.124:0/2932917469 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f967c003570 con 0x7f96901573e0 2023-10-06T04:45:55.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.754+0000 7f9695f9c700 1 -- 172.21.15.124:0/2932917469 >> v1:172.21.15.158:6789/0 conn(0x7f96900a6c60 legacy=0x7f96900ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.754+0000 7f9695f9c700 1 -- 172.21.15.124:0/2932917469 >> v1:172.21.15.124:6789/0 conn(0x7f96901573e0 legacy=0x7f9690069a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.754+0000 7f9695f9c700 1 -- 172.21.15.124:0/2932917469 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969006a780 con 0x7f96900ade80 2023-10-06T04:45:55.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.754+0000 7f9695f9c700 1 --2- 172.21.15.124:0/2932917469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 0x7f96901577b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9688009e60 tx=0x7f9688009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778ff6753abd215a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:55.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.755+0000 7f9687fff700 1 -- 172.21.15.124:0/2932917469 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800e070 con 0x7f96900ade80 2023-10-06T04:45:55.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.755+0000 7f9687fff700 1 -- 172.21.15.124:0/2932917469 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968800bb60 con 0x7f96900ade80 2023-10-06T04:45:55.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.755+0000 7f9687fff700 1 -- 172.21.15.124:0/2932917469 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688012430 con 0x7f96900ade80 2023-10-06T04:45:55.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.755+0000 7f96979ff700 1 -- 172.21.15.124:0/2932917469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 msgr2=0x7f96901577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.755+0000 7f96979ff700 1 --2- 172.21.15.124:0/2932917469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 0x7f96901577b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9688009e60 tx=0x7f9688009780 comp rx=0 tx=0).stop 2023-10-06T04:45:55.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.755+0000 7f96979ff700 1 -- 172.21.15.124:0/2932917469 shutdown_connections 2023-10-06T04:45:55.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.755+0000 7f96979ff700 1 --2- 172.21.15.124:0/2932917469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 0x7f96901577b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.755+0000 7f96979ff700 1 -- 172.21.15.124:0/2932917469 >> 172.21.15.124:0/2932917469 conn(0x7f96900cc050 msgr2=0x7f96900cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:55.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.755+0000 7f96979ff700 1 -- 172.21.15.124:0/2932917469 shutdown_connections 2023-10-06T04:45:55.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.755+0000 7f96979ff700 1 -- 172.21.15.124:0/2932917469 wait complete. 2023-10-06T04:45:55.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.757+0000 7f96979ff700 1 Processor -- start 2023-10-06T04:45:55.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.757+0000 7f96979ff700 1 -- start start 2023-10-06T04:45:55.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f96979ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 0x7f9690155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f96979ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96901573e0 0x7f96900aa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f96979ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96900aabb0 0x7f96900a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f96979ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900aa1e0 con 0x7f96900ade80 2023-10-06T04:45:55.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f96979ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900a95d0 con 0x7f96901573e0 2023-10-06T04:45:55.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f96979ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900a98b0 con 0x7f96900aabb0 2023-10-06T04:45:55.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f969579b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 0x7f9690155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f969579b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 0x7f9690155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54868/0 (socket says 172.21.15.124:54868) 2023-10-06T04:45:55.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f969579b700 1 -- 172.21.15.124:0/3964145564 learned_addr learned my addr 172.21.15.124:0/3964145564 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:55.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f9694f9a700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96901573e0 0x7f96900aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.758+0000 7f9695f9c700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96900aabb0 0x7f96900a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f969579b700 1 -- 172.21.15.124:0/3964145564 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96900aabb0 msgr2=0x7f96900a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f969579b700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96900aabb0 0x7f96900a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f969579b700 1 -- 172.21.15.124:0/3964145564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96901573e0 msgr2=0x7f96900aa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f969579b700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96901573e0 0x7f96900aa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f969579b700 1 -- 172.21.15.124:0/3964145564 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9688009a20 con 0x7f96900ade80 2023-10-06T04:45:55.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f969579b700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 0x7f9690155940 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c590 tx=0x7f968c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:55.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f96857fa700 1 -- 172.21.15.124:0/3964145564 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c005b30 con 0x7f96900ade80 2023-10-06T04:45:55.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f96857fa700 1 -- 172.21.15.124:0/3964145564 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c005cb0 con 0x7f96900ade80 2023-10-06T04:45:55.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f96979ff700 1 -- 172.21.15.124:0/3964145564 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96900a9b90 con 0x7f96900ade80 2023-10-06T04:45:55.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f96857fa700 1 -- 172.21.15.124:0/3964145564 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c007320 con 0x7f96900ade80 2023-10-06T04:45:55.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.759+0000 7f96979ff700 1 -- 172.21.15.124:0/3964145564 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969015c590 con 0x7f96900ade80 2023-10-06T04:45:55.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.760+0000 7f96979ff700 1 -- 172.21.15.124:0/3964145564 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96900aa030 con 0x7f96900ade80 2023-10-06T04:45:55.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.761+0000 7f96857fa700 1 -- 172.21.15.124:0/3964145564 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f968c01b3b0 con 0x7f96900ade80 2023-10-06T04:45:55.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.762+0000 7f96857fa700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9674066f30 0x7f96740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:55.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.762+0000 7f96857fa700 1 -- 172.21.15.124:0/3964145564 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f968c083a10 con 0x7f96900ade80 2023-10-06T04:45:55.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.762+0000 7f9694f9a700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9674066f30 0x7f96740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:55.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.763+0000 7f9694f9a700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9674066f30 0x7f96740693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9690156940 tx=0x7f9680009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:55.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.766+0000 7f96857fa700 1 -- 172.21.15.124:0/3964145564 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f968c050dd0 con 0x7f96900ade80 2023-10-06T04:45:55.962 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.959+0000 7f96979ff700 1 -- 172.21.15.124:0/3964145564 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f96900aa4c0 con 0x7f96900ade80 2023-10-06T04:45:55.962 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.959+0000 7f96857fa700 1 -- 172.21.15.124:0/3964145564 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+126 (secure 0 0 0) 0x7f968c017070 con 0x7f96900ade80 2023-10-06T04:45:55.962 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:55.962 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2023-10-06T04:45:55.962 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:55.962 INFO:teuthology.orchestra.run.smithi124.stdout: "poolnum": 1, 2023-10-06T04:45:55.963 INFO:teuthology.orchestra.run.smithi124.stdout: "poolname": "rbd" 2023-10-06T04:45:55.963 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T04:45:55.963 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-06T04:45:55.963 INFO:teuthology.orchestra.run.smithi124.stdout: "poolnum": 2, 2023-10-06T04:45:55.963 INFO:teuthology.orchestra.run.smithi124.stdout: "poolname": ".mgr" 2023-10-06T04:45:55.963 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T04:45:55.963 INFO:teuthology.orchestra.run.smithi124.stdout:] 2023-10-06T04:45:55.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 -- 172.21.15.124:0/3964145564 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9674066f30 msgr2=0x7f96740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9674066f30 0x7f96740693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9690156940 tx=0x7f9680009040 comp rx=0 tx=0).stop 2023-10-06T04:45:55.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 -- 172.21.15.124:0/3964145564 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 msgr2=0x7f9690155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:55.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 0x7f9690155940 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c590 tx=0x7f968c007e00 comp rx=0 tx=0).stop 2023-10-06T04:45:55.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 -- 172.21.15.124:0/3964145564 shutdown_connections 2023-10-06T04:45:55.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9674066f30 0x7f96740693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96900aabb0 0x7f96900a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96900ade80 0x7f9690155940 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 --2- 172.21.15.124:0/3964145564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96901573e0 0x7f96900aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:55.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 -- 172.21.15.124:0/3964145564 >> 172.21.15.124:0/3964145564 conn(0x7f96900cc050 msgr2=0x7f9690069610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:55.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 -- 172.21.15.124:0/3964145564 shutdown_connections 2023-10-06T04:45:55.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:55.962+0000 7f96979ff700 1 -- 172.21.15.124:0/3964145564 wait complete. 2023-10-06T04:45:55.982 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:45:55.982 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:45:56.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.173+0000 7f543e9ff700 1 Processor -- start 2023-10-06T04:45:56.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.173+0000 7f543e9ff700 1 -- start start 2023-10-06T04:45:56.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543e9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54381562e0 0x7f54380b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:56.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543e9ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54381566b0 0x7f54380accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:56.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543e9ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54380ccfe0 con 0x7f54380af990 2023-10-06T04:45:56.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543e9ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54380b0a30 con 0x7f54381566b0 2023-10-06T04:45:56.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543e9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54380afe20 con 0x7f54381562e0 2023-10-06T04:45:56.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543cf9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54381566b0 0x7f54380accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:56.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543cf9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54381566b0 0x7f54380accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54870/0 (socket says 172.21.15.124:54870) 2023-10-06T04:45:56.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543cf9c700 1 -- 172.21.15.124:0/893633803 learned_addr learned my addr 172.21.15.124:0/893633803 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:56.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f5437fff700 1 --2- 172.21.15.124:0/893633803 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54381562e0 0x7f54380b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:56.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543cf9c700 1 -- 172.21.15.124:0/893633803 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54381562e0 msgr2=0x7f54380b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:56.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543cf9c700 1 --2- 172.21.15.124:0/893633803 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54381562e0 0x7f54380b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543cf9c700 1 -- 172.21.15.124:0/893633803 >> v1:172.21.15.158:6789/0 conn(0x7f54380af990 legacy=0x7f54380cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543cf9c700 1 -- 172.21.15.124:0/893633803 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380b0100 con 0x7f54381566b0 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f5437fff700 1 --2- 172.21.15.124:0/893633803 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54381562e0 0x7f54380b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f543cf9c700 1 --2- 172.21.15.124:0/893633803 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 0x7f54380accb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5430009f20 tx=0x7f5430009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570b68e7fffc6af2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f5436ffd700 1 -- 172.21.15.124:0/893633803 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000e070 con 0x7f54381566b0 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f5436ffd700 1 -- 172.21.15.124:0/893633803 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543000ba40 con 0x7f54381566b0 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.176+0000 7f5436ffd700 1 -- 172.21.15.124:0/893633803 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300092e0 con 0x7f54381566b0 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.177+0000 7f543e9ff700 1 -- 172.21.15.124:0/893633803 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 msgr2=0x7f54380accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.177+0000 7f543e9ff700 1 --2- 172.21.15.124:0/893633803 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 0x7f54380accb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5430009f20 tx=0x7f5430009840 comp rx=0 tx=0).stop 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.177+0000 7f543e9ff700 1 -- 172.21.15.124:0/893633803 shutdown_connections 2023-10-06T04:45:56.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.177+0000 7f543e9ff700 1 --2- 172.21.15.124:0/893633803 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 0x7f54380accb0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:56.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.177+0000 7f543e9ff700 1 --2- 172.21.15.124:0/893633803 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54381562e0 0x7f54380b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:56.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.177+0000 7f543e9ff700 1 -- 172.21.15.124:0/893633803 >> 172.21.15.124:0/893633803 conn(0x7f5438068080 msgr2=0x7f54380cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:56.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.177+0000 7f543e9ff700 1 -- 172.21.15.124:0/893633803 shutdown_connections 2023-10-06T04:45:56.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.177+0000 7f543e9ff700 1 -- 172.21.15.124:0/893633803 wait complete. 2023-10-06T04:45:56.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.178+0000 7f543e9ff700 1 Processor -- start 2023-10-06T04:45:56.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.178+0000 7f543e9ff700 1 -- start start 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.179+0000 7f543e9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54380af990 0x7f5438157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.179+0000 7f543e9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54381562e0 0x7f543814a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.179+0000 7f543e9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 0x7f54380aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.179+0000 7f543e9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543814e9a0 con 0x7f54381566b0 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.179+0000 7f543e9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54381581f0 con 0x7f54381562e0 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.179+0000 7f543e9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54380aa540 con 0x7f54380af990 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f543cf9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 0x7f54380aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f543cf9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 0x7f54380aa9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54886/0 (socket says 172.21.15.124:54886) 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f543cf9c700 1 -- 172.21.15.124:0/539838917 learned_addr learned my addr 172.21.15.124:0/539838917 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f5437fff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54380af990 0x7f5438157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f54377fe700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54381562e0 0x7f543814a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:56.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f543cf9c700 1 -- 172.21.15.124:0/539838917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54380af990 msgr2=0x7f5438157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f543cf9c700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54380af990 0x7f5438157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f543cf9c700 1 -- 172.21.15.124:0/539838917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54381562e0 msgr2=0x7f543814a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f543cf9c700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54381562e0 0x7f543814a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f543cf9c700 1 -- 172.21.15.124:0/539838917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430009ae0 con 0x7f54381566b0 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f5437fff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54380af990 0x7f5438157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f54377fe700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54381562e0 0x7f543814a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f543cf9c700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 0x7f54380aa9d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f543000b6c0 tx=0x7f5430017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f541ffff700 1 -- 172.21.15.124:0/539838917 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430012e90 con 0x7f54381566b0 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f541ffff700 1 -- 172.21.15.124:0/539838917 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54300032f0 con 0x7f54381566b0 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.180+0000 7f541ffff700 1 -- 172.21.15.124:0/539838917 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543001d650 con 0x7f54381566b0 2023-10-06T04:45:56.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.181+0000 7f543e9ff700 1 -- 172.21.15.124:0/539838917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543814adb0 con 0x7f54381566b0 2023-10-06T04:45:56.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.181+0000 7f543e9ff700 1 -- 172.21.15.124:0/539838917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54380a9c10 con 0x7f54381566b0 2023-10-06T04:45:56.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.182+0000 7f543e9ff700 1 -- 172.21.15.124:0/539838917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54380aa6d0 con 0x7f54381566b0 2023-10-06T04:45:56.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.182+0000 7f541ffff700 1 -- 172.21.15.124:0/539838917 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f543001da80 con 0x7f54381566b0 2023-10-06T04:45:56.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.183+0000 7f541ffff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5424066f30 0x7f54240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:56.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.183+0000 7f541ffff700 1 -- 172.21.15.124:0/539838917 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5430085d00 con 0x7f54381566b0 2023-10-06T04:45:56.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.183+0000 7f5437fff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5424066f30 0x7f54240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:56.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.184+0000 7f5437fff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5424066f30 0x7f54240693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5428008b20 tx=0x7f5428008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:56.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.188+0000 7f541ffff700 1 -- 172.21.15.124:0/539838917 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54300530c0 con 0x7f54381566b0 2023-10-06T04:45:56.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:56.381+0000 7f543e9ff700 1 -- 172.21.15.124:0/539838917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f54380718b0 con 0x7f54381566b0 2023-10-06T04:45:57.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.349+0000 7f541ffff700 1 -- 172.21.15.124:0/539838917 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5430009420 con 0x7f54381566b0 2023-10-06T04:45:57.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.355+0000 7f543e9ff700 1 -- 172.21.15.124:0/539838917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5424066f30 msgr2=0x7f54240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:57.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.355+0000 7f543e9ff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5424066f30 0x7f54240693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5428008b20 tx=0x7f5428008040 comp rx=0 tx=0).stop 2023-10-06T04:45:57.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.355+0000 7f543e9ff700 1 -- 172.21.15.124:0/539838917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 msgr2=0x7f54380aa9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:57.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.355+0000 7f543e9ff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 0x7f54380aa9d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f543000b6c0 tx=0x7f5430017000 comp rx=0 tx=0).stop 2023-10-06T04:45:57.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.355+0000 7f543e9ff700 1 -- 172.21.15.124:0/539838917 shutdown_connections 2023-10-06T04:45:57.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.356+0000 7f543e9ff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54381566b0 0x7f54380aa9d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:57.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.356+0000 7f543e9ff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5424066f30 0x7f54240693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:57.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.356+0000 7f543e9ff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54380af990 0x7f5438157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:57.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.356+0000 7f543e9ff700 1 --2- 172.21.15.124:0/539838917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54381562e0 0x7f543814a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:57.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.356+0000 7f543e9ff700 1 -- 172.21.15.124:0/539838917 >> 172.21.15.124:0/539838917 conn(0x7f5438068080 msgr2=0x7f54380cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:57.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.356+0000 7f543e9ff700 1 -- 172.21.15.124:0/539838917 shutdown_connections 2023-10-06T04:45:57.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.357+0000 7f543e9ff700 1 -- 172.21.15.124:0/539838917 wait complete. 2023-10-06T04:45:57.362 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' created 2023-10-06T04:45:57.381 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:45:57.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.580+0000 7f5f303ff700 1 Processor -- start 2023-10-06T04:45:57.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.580+0000 7f5f303ff700 1 -- start start 2023-10-06T04:45:57.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.581+0000 7f5f303ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5f28155800 0x7f5f280694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:57.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.581+0000 7f5f303ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5f281596c0 0x7f5f28069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:57.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.581+0000 7f5f303ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2806e240 con 0x7f5f280ae6f0 2023-10-06T04:45:57.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.581+0000 7f5f303ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2806d630 con 0x7f5f28155800 2023-10-06T04:45:57.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.581+0000 7f5f303ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2806d910 con 0x7f5f281596c0 2023-10-06T04:45:57.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.581+0000 7f5f2e19b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5f28155800 0x7f5f280694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:57.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.581+0000 7f5f2e19b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5f28155800 0x7f5f280694c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54900/0 (socket says 172.21.15.124:54900) 2023-10-06T04:45:57.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.581+0000 7f5f2e19b700 1 -- 172.21.15.124:0/1290116545 learned_addr learned my addr 172.21.15.124:0/1290116545 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.582+0000 7f5f2e19b700 1 -- 172.21.15.124:0/1290116545 >> v2:172.21.15.158:3300/0 conn(0x7f5f281596c0 msgr2=0x7f5f28069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.582+0000 7f5f2d99a700 1 --2- 172.21.15.124:0/1290116545 >> v2:172.21.15.158:3300/0 conn(0x7f5f281596c0 0x7f5f28069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.582+0000 7f5f2e19b700 1 --2- 172.21.15.124:0/1290116545 >> v2:172.21.15.158:3300/0 conn(0x7f5f281596c0 0x7f5f28069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.582+0000 7f5f2e19b700 1 -- 172.21.15.124:0/1290116545 >> v1:172.21.15.158:6789/0 conn(0x7f5f280ae6f0 legacy=0x7f5f28157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.582+0000 7f5f2e19b700 1 -- 172.21.15.124:0/1290116545 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2806dbf0 con 0x7f5f28155800 2023-10-06T04:45:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.582+0000 7f5f2d99a700 1 --2- 172.21.15.124:0/1290116545 >> v2:172.21.15.158:3300/0 conn(0x7f5f281596c0 0x7f5f28069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.582+0000 7f5f2e19b700 1 --2- 172.21.15.124:0/1290116545 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f28155800 0x7f5f280694c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5f2815a7d0 tx=0x7f5f24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e72ab32bac98de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.582+0000 7f5f2d199700 1 -- 172.21.15.124:0/1290116545 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2400b820 con 0x7f5f28155800 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.582+0000 7f5f2d199700 1 -- 172.21.15.124:0/1290116545 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2400b980 con 0x7f5f28155800 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.582+0000 7f5f2d199700 1 -- 172.21.15.124:0/1290116545 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2400bd20 con 0x7f5f28155800 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.583+0000 7f5f303ff700 1 -- 172.21.15.124:0/1290116545 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f28155800 msgr2=0x7f5f280694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.583+0000 7f5f303ff700 1 --2- 172.21.15.124:0/1290116545 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f28155800 0x7f5f280694c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5f2815a7d0 tx=0x7f5f24009250 comp rx=0 tx=0).stop 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.583+0000 7f5f303ff700 1 -- 172.21.15.124:0/1290116545 shutdown_connections 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.583+0000 7f5f303ff700 1 --2- 172.21.15.124:0/1290116545 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f28155800 0x7f5f280694c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.583+0000 7f5f303ff700 1 --2- 172.21.15.124:0/1290116545 >> v2:172.21.15.158:3300/0 conn(0x7f5f281596c0 0x7f5f28069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.583+0000 7f5f303ff700 1 -- 172.21.15.124:0/1290116545 >> 172.21.15.124:0/1290116545 conn(0x7f5f280680c0 msgr2=0x7f5f280cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.583+0000 7f5f303ff700 1 -- 172.21.15.124:0/1290116545 shutdown_connections 2023-10-06T04:45:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.583+0000 7f5f303ff700 1 -- 172.21.15.124:0/1290116545 wait complete. 2023-10-06T04:45:57.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.584+0000 7f5f303ff700 1 Processor -- start 2023-10-06T04:45:57.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.585+0000 7f5f303ff700 1 -- start start 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.585+0000 7f5f303ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f280ae6f0 0x7f5f280c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.585+0000 7f5f303ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f28155800 0x7f5f28169590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.585+0000 7f5f303ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f281596c0 0x7f5f28156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f303ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28155030 con 0x7f5f280ae6f0 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f303ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280c9eb0 con 0x7f5f28155800 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f303ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28169e50 con 0x7f5f281596c0 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2e19b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f280ae6f0 0x7f5f280c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2e19b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f280ae6f0 0x7f5f280c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54902/0 (socket says 172.21.15.124:54902) 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2e19b700 1 -- 172.21.15.124:0/210055830 learned_addr learned my addr 172.21.15.124:0/210055830 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2d99a700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f28155800 0x7f5f28169590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2e99c700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f281596c0 0x7f5f28156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2e19b700 1 -- 172.21.15.124:0/210055830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f281596c0 msgr2=0x7f5f28156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2e19b700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f281596c0 0x7f5f28156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2e19b700 1 -- 172.21.15.124:0/210055830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f28155800 msgr2=0x7f5f28169590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2e19b700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f28155800 0x7f5f28169590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2e19b700 1 -- 172.21.15.124:0/210055830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f240094f0 con 0x7f5f280ae6f0 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2d99a700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f28155800 0x7f5f28169590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.586+0000 7f5f2e19b700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f280ae6f0 0x7f5f280c1d10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5f2806cd70 tx=0x7f5f24016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.587+0000 7f5f1e7fc700 1 -- 172.21.15.124:0/210055830 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24011de0 con 0x7f5f280ae6f0 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.587+0000 7f5f1e7fc700 1 -- 172.21.15.124:0/210055830 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f24020070 con 0x7f5f280ae6f0 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.587+0000 7f5f1e7fc700 1 -- 172.21.15.124:0/210055830 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2401b6a0 con 0x7f5f280ae6f0 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.587+0000 7f5f303ff700 1 -- 172.21.15.124:0/210055830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2816a130 con 0x7f5f280ae6f0 2023-10-06T04:45:57.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.587+0000 7f5f303ff700 1 -- 172.21.15.124:0/210055830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f280c9b40 con 0x7f5f280ae6f0 2023-10-06T04:45:57.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.588+0000 7f5f303ff700 1 -- 172.21.15.124:0/210055830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f28064850 con 0x7f5f280ae6f0 2023-10-06T04:45:57.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.589+0000 7f5f1e7fc700 1 -- 172.21.15.124:0/210055830 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f24022030 con 0x7f5f280ae6f0 2023-10-06T04:45:57.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.590+0000 7f5f1e7fc700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5f0c066f30 0x7f5f0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:57.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.590+0000 7f5f1e7fc700 1 -- 172.21.15.124:0/210055830 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f5f240868d0 con 0x7f5f280ae6f0 2023-10-06T04:45:57.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.590+0000 7f5f2d99a700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5f0c066f30 0x7f5f0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:57.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.590+0000 7f5f2d99a700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5f0c066f30 0x7f5f0c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f28158550 tx=0x7f5f18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:57.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.594+0000 7f5f1e7fc700 1 -- 172.21.15.124:0/210055830 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f24053ba0 con 0x7f5f280ae6f0 2023-10-06T04:45:57.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:57.782+0000 7f5f303ff700 1 -- 172.21.15.124:0/210055830 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5f28064850 con 0x7f5f280ae6f0 2023-10-06T04:45:58.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.364+0000 7f5f1e7fc700 1 -- 172.21.15.124:0/210055830 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5f240571c0 con 0x7f5f280ae6f0 2023-10-06T04:45:58.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.372+0000 7f5f303ff700 1 -- 172.21.15.124:0/210055830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5f0c066f30 msgr2=0x7f5f0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:58.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.372+0000 7f5f303ff700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5f0c066f30 0x7f5f0c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f28158550 tx=0x7f5f18008040 comp rx=0 tx=0).stop 2023-10-06T04:45:58.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.372+0000 7f5f303ff700 1 -- 172.21.15.124:0/210055830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f280ae6f0 msgr2=0x7f5f280c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:58.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.372+0000 7f5f303ff700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f280ae6f0 0x7f5f280c1d10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5f2806cd70 tx=0x7f5f24016000 comp rx=0 tx=0).stop 2023-10-06T04:45:58.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.372+0000 7f5f303ff700 1 -- 172.21.15.124:0/210055830 shutdown_connections 2023-10-06T04:45:58.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.372+0000 7f5f303ff700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5f0c066f30 0x7f5f0c0693e0 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f28158550 tx=0x7f5f18008040 comp rx=0 tx=0).stop 2023-10-06T04:45:58.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.372+0000 7f5f303ff700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f281596c0 0x7f5f28156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:58.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.372+0000 7f5f303ff700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f280ae6f0 0x7f5f280c1d10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:58.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.372+0000 7f5f303ff700 1 --2- 172.21.15.124:0/210055830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f28155800 0x7f5f28169590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:58.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.372+0000 7f5f303ff700 1 -- 172.21.15.124:0/210055830 >> 172.21.15.124:0/210055830 conn(0x7f5f280680c0 msgr2=0x7f5f280abf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:58.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.374+0000 7f5f303ff700 1 -- 172.21.15.124:0/210055830 shutdown_connections 2023-10-06T04:45:58.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.376+0000 7f5f303ff700 1 -- 172.21.15.124:0/210055830 wait complete. 2023-10-06T04:45:58.382 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' created 2023-10-06T04:45:58.402 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:45:58.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.593+0000 7f9923dff700 1 Processor -- start 2023-10-06T04:45:58.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.594+0000 7f9923dff700 1 -- start start 2023-10-06T04:45:58.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.595+0000 7f9923dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f991c1592b0 0x7f991c0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:58.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.595+0000 7f9923dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c15d620 con 0x7f991c0cc780 2023-10-06T04:45:58.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.595+0000 7f9923dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0ccbe0 con 0x7f991c159680 2023-10-06T04:45:58.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.595+0000 7f9923dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c15d0d0 con 0x7f991c1592b0 2023-10-06T04:45:58.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.595+0000 7f992239c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f991c0cc780 0x7f991c0ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:51820/0 (socket says 172.21.15.124:51820) 2023-10-06T04:45:58.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.595+0000 7f992239c700 1 -- 172.21.15.124:0/2275361114 learned_addr learned my addr 172.21.15.124:0/2275361114 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:58.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.595+0000 7f9921b9b700 1 --2- 172.21.15.124:0/2275361114 >> v2:172.21.15.158:3300/0 conn(0x7f991c1592b0 0x7f991c0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:58.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737312005 0 0) 0x7f991c15d620 con 0x7f991c0cc780 2023-10-06T04:45:58.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9908003570 con 0x7f991c0cc780 2023-10-06T04:45:58.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2143097923 0 0) 0x7f9908003570 con 0x7f991c0cc780 2023-10-06T04:45:58.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 >> v2:172.21.15.158:3300/0 conn(0x7f991c1592b0 msgr2=0x7f991c0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:58.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 --2- 172.21.15.124:0/2275361114 >> v2:172.21.15.158:3300/0 conn(0x7f991c1592b0 0x7f991c0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:58.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 >> v1:172.21.15.158:6789/0 conn(0x7f991c159680 legacy=0x7f991c15dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:58.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0b0760 con 0x7f991c0cc780 2023-10-06T04:45:58.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f99140017f0 con 0x7f991c0cc780 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9921b9b700 1 --2- 172.21.15.124:0/2275361114 >> v2:172.21.15.158:3300/0 conn(0x7f991c1592b0 0x7f991c0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 >> v1:172.21.15.124:6789/0 conn(0x7f991c0cc780 legacy=0x7f991c0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f9908003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9908004810 0x7f9908004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f99080051c0 0x7f990800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c15d0d0 con 0x7f9908003a60 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990800c0d0 con 0x7f9908004810 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990800c290 con 0x7f99080051c0 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f9921b9b700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f9908003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f992139a700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9908004810 0x7f9908004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:58.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.596+0000 7f992239c700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f99080051c0 0x7f990800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f9921b9b700 1 -- 172.21.15.124:0/2275361114 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f99080051c0 msgr2=0x7f990800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f9921b9b700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f99080051c0 0x7f990800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f9921b9b700 1 -- 172.21.15.124:0/2275361114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9908004810 msgr2=0x7f9908004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f9921b9b700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9908004810 0x7f9908004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f9921b9b700 1 -- 172.21.15.124:0/2275361114 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908003570 con 0x7f9908003a60 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f992139a700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9908004810 0x7f9908004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f992239c700 1 -- 172.21.15.124:0/2275361114 reap_dead start 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f9921b9b700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f9908003e70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9918009df0 tx=0x7f99180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b161bda5ca4f8720 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918009740 con 0x7f9908003a60 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991800e920 con 0x7f9908003a60 2023-10-06T04:45:58.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.597+0000 7f9920b99700 1 -- 172.21.15.124:0/2275361114 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991800ece0 con 0x7f9908003a60 2023-10-06T04:45:58.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.598+0000 7f9923dff700 1 -- 172.21.15.124:0/2275361114 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 msgr2=0x7f9908003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:58.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.598+0000 7f9923dff700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f9908003e70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9918009df0 tx=0x7f99180091a0 comp rx=0 tx=0).stop 2023-10-06T04:45:58.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.598+0000 7f9923dff700 1 -- 172.21.15.124:0/2275361114 shutdown_connections 2023-10-06T04:45:58.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.598+0000 7f9923dff700 1 --2- 172.21.15.124:0/2275361114 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f9908003e70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:58.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.598+0000 7f9923dff700 1 -- 172.21.15.124:0/2275361114 >> 172.21.15.124:0/2275361114 conn(0x7f991c06ed20 msgr2=0x7f991c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:58.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.598+0000 7f9923dff700 1 -- 172.21.15.124:0/2275361114 shutdown_connections 2023-10-06T04:45:58.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.598+0000 7f9923dff700 1 -- 172.21.15.124:0/2275361114 wait complete. 2023-10-06T04:45:58.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.599+0000 7f9923dff700 1 Processor -- start 2023-10-06T04:45:58.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.599+0000 7f9923dff700 1 -- start start 2023-10-06T04:45:58.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.600+0000 7f9923dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f991c14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:58.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.600+0000 7f9923dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f991c0cede0 0x7f991c0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:58.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.600+0000 7f9923dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991c0cf250 0x7f991c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:58.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.600+0000 7f9923dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0c7e70 con 0x7f9908003a60 2023-10-06T04:45:58.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.600+0000 7f9923dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c14bea0 con 0x7f991c0cf250 2023-10-06T04:45:58.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.600+0000 7f9923dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c169630 con 0x7f991c0cede0 2023-10-06T04:45:58.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.600+0000 7f9921b9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f991c14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:58.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.600+0000 7f9921b9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f991c14b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54916/0 (socket says 172.21.15.124:54916) 2023-10-06T04:45:58.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.600+0000 7f9921b9b700 1 -- 172.21.15.124:0/306680184 learned_addr learned my addr 172.21.15.124:0/306680184 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:58.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f992239c700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991c0cf250 0x7f991c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f992139a700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f991c0cede0 0x7f991c0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f9921b9b700 1 -- 172.21.15.124:0/306680184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f991c0cede0 msgr2=0x7f991c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f9921b9b700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f991c0cede0 0x7f991c0cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f9921b9b700 1 -- 172.21.15.124:0/306680184 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991c0cf250 msgr2=0x7f991c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f9921b9b700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991c0cf250 0x7f991c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f9921b9b700 1 -- 172.21.15.124:0/306680184 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0c3f00 con 0x7f9908003a60 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f992239c700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991c0cf250 0x7f991c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f9921b9b700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f991c14b960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f990800c0a0 tx=0x7f991801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f9911ffb700 1 -- 172.21.15.124:0/306680184 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918022070 con 0x7f9908003a60 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f9911ffb700 1 -- 172.21.15.124:0/306680184 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918009740 con 0x7f9908003a60 2023-10-06T04:45:58.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f9911ffb700 1 -- 172.21.15.124:0/306680184 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991801c450 con 0x7f9908003a60 2023-10-06T04:45:58.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.601+0000 7f9923dff700 1 -- 172.21.15.124:0/306680184 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c0c83d0 con 0x7f9908003a60 2023-10-06T04:45:58.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.602+0000 7f9923dff700 1 -- 172.21.15.124:0/306680184 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c0c4150 con 0x7f9908003a60 2023-10-06T04:45:58.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.603+0000 7f9923dff700 1 -- 172.21.15.124:0/306680184 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c0c86b0 con 0x7f9908003a60 2023-10-06T04:45:58.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.604+0000 7f9911ffb700 1 -- 172.21.15.124:0/306680184 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9918026070 con 0x7f9908003a60 2023-10-06T04:45:58.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.604+0000 7f9911ffb700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:58.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.605+0000 7f9911ffb700 1 -- 172.21.15.124:0/306680184 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f9918085fe0 con 0x7f9908003a60 2023-10-06T04:45:58.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.605+0000 7f992139a700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:58.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.605+0000 7f992139a700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9900066f30 0x7f99000693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f990c000c00 tx=0x7f990c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:58.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.609+0000 7f9911ffb700 1 -- 172.21.15.124:0/306680184 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99180530b0 con 0x7f9908003a60 2023-10-06T04:45:58.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:58.845+0000 7f9923dff700 1 -- 172.21.15.124:0/306680184 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f991c04c380 con 0x7f9908003a60 2023-10-06T04:45:58.934 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:45:58.939 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:45:59.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.361+0000 7f9911ffb700 1 -- 172.21.15.124:0/306680184 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f99180566d0 con 0x7f9908003a60 2023-10-06T04:45:59.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.369+0000 7f9923dff700 1 -- 172.21.15.124:0/306680184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9900066f30 msgr2=0x7f99000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:59.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.369+0000 7f9923dff700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9900066f30 0x7f99000693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f990c000c00 tx=0x7f990c009040 comp rx=0 tx=0).stop 2023-10-06T04:45:59.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.369+0000 7f9923dff700 1 -- 172.21.15.124:0/306680184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 msgr2=0x7f991c14b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:59.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.369+0000 7f9923dff700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f991c14b960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f990800c0a0 tx=0x7f991801a000 comp rx=0 tx=0).stop 2023-10-06T04:45:59.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.374+0000 7f9923dff700 1 -- 172.21.15.124:0/306680184 shutdown_connections 2023-10-06T04:45:59.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.374+0000 7f9923dff700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991c0cf250 0x7f991c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.374+0000 7f9923dff700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9908003a60 0x7f991c14b960 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.374+0000 7f9923dff700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.374+0000 7f9923dff700 1 --2- 172.21.15.124:0/306680184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f991c0cede0 0x7f991c0cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.374+0000 7f9923dff700 1 -- 172.21.15.124:0/306680184 >> 172.21.15.124:0/306680184 conn(0x7f991c06ed20 msgr2=0x7f991c1572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:59.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.374+0000 7f9923dff700 1 -- 172.21.15.124:0/306680184 shutdown_connections 2023-10-06T04:45:59.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.374+0000 7f9923dff700 1 -- 172.21.15.124:0/306680184 wait complete. 2023-10-06T04:45:59.386 INFO:teuthology.orchestra.run.smithi124.stderr:new fs with metadata pool 7 and data pool 8 2023-10-06T04:45:59.408 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:45:59.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.596+0000 7fd1127ff700 1 Processor -- start 2023-10-06T04:45:59.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.596+0000 7fd1127ff700 1 -- start start 2023-10-06T04:45:59.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.597+0000 7fd1127ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd10c0ce450 0x7fd10c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:59.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.597+0000 7fd1127ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10c0cf6b0 con 0x7fd10c0cdfe0 2023-10-06T04:45:59.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.597+0000 7fd1127ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10c0ceaa0 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.597+0000 7fd1127ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10c0d0250 con 0x7fd10c0ce450 2023-10-06T04:45:59.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.597+0000 7fd10b7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd10c0cdfe0 0x7fd10c0ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:51832/0 (socket says 172.21.15.124:51832) 2023-10-06T04:45:59.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.598+0000 7fd10b7fe700 1 -- 172.21.15.124:0/3665110474 learned_addr learned my addr 172.21.15.124:0/3665110474 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:45:59.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.598+0000 7fd110d9c700 1 --2- 172.21.15.124:0/3665110474 >> v2:172.21.15.158:3300/0 conn(0x7fd10c0ce450 0x7fd10c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:59.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.598+0000 7fd10affd700 1 -- 172.21.15.124:0/3665110474 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454416420 0 0) 0x7fd10c0cf6b0 con 0x7fd10c0cdfe0 2023-10-06T04:45:59.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.598+0000 7fd10affd700 1 -- 172.21.15.124:0/3665110474 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0f4003570 con 0x7fd10c0cdfe0 2023-10-06T04:45:59.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.598+0000 7fd10affd700 1 -- 172.21.15.124:0/3665110474 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508116409 0 0) 0x7fd10c0ceaa0 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.598+0000 7fd10affd700 1 -- 172.21.15.124:0/3665110474 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd10c0cf6b0 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.598+0000 7fd10affd700 1 -- 172.21.15.124:0/3665110474 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 910490709 0 0) 0x7fd0f4003570 con 0x7fd10c0cdfe0 2023-10-06T04:45:59.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.598+0000 7fd110d9c700 1 -- 172.21.15.124:0/3665110474 >> v1:172.21.15.158:6789/0 conn(0x7fd10c0ccbb0 legacy=0x7fd10c0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:59.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.598+0000 7fd110d9c700 1 -- 172.21.15.124:0/3665110474 >> v1:172.21.15.124:6789/0 conn(0x7fd10c0cdfe0 legacy=0x7fd10c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:59.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.598+0000 7fd110d9c700 1 -- 172.21.15.124:0/3665110474 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c0ced80 con 0x7fd10c0ce450 2023-10-06T04:45:59.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.599+0000 7fd110d9c700 1 --2- 172.21.15.124:0/3665110474 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd10c0ce450 0x7fd10c0cd690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd104009e60 tx=0x7fd104009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af796c83dba3ab57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:59.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.599+0000 7fd10affd700 1 -- 172.21.15.124:0/3665110474 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10400e070 con 0x7fd10c0ce450 2023-10-06T04:45:59.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.599+0000 7fd10affd700 1 -- 172.21.15.124:0/3665110474 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10400b7a0 con 0x7fd10c0ce450 2023-10-06T04:45:59.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.599+0000 7fd10affd700 1 -- 172.21.15.124:0/3665110474 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000013f0 con 0x7fd10c0ce450 2023-10-06T04:45:59.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.599+0000 7fd1127ff700 1 -- 172.21.15.124:0/3665110474 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd10c0ce450 msgr2=0x7fd10c0cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:59.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.599+0000 7fd1127ff700 1 --2- 172.21.15.124:0/3665110474 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd10c0ce450 0x7fd10c0cd690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd104009e60 tx=0x7fd104009780 comp rx=0 tx=0).stop 2023-10-06T04:45:59.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.599+0000 7fd1127ff700 1 -- 172.21.15.124:0/3665110474 shutdown_connections 2023-10-06T04:45:59.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.599+0000 7fd1127ff700 1 --2- 172.21.15.124:0/3665110474 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd10c0ce450 0x7fd10c0cd690 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.599+0000 7fd1127ff700 1 -- 172.21.15.124:0/3665110474 >> 172.21.15.124:0/3665110474 conn(0x7fd10c099710 msgr2=0x7fd10c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:59.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.600+0000 7fd1127ff700 1 -- 172.21.15.124:0/3665110474 shutdown_connections 2023-10-06T04:45:59.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.600+0000 7fd1127ff700 1 -- 172.21.15.124:0/3665110474 wait complete. 2023-10-06T04:45:59.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.601+0000 7fd1127ff700 1 Processor -- start 2023-10-06T04:45:59.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.601+0000 7fd1127ff700 1 -- start start 2023-10-06T04:45:59.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.602+0000 7fd1127ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd10c0ccbb0 0x7fd10c09d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:59.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.602+0000 7fd1127ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd10c0cdfe0 0x7fd10c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:59.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.602+0000 7fd1127ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd10c0ce450 0x7fd10c09a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:59.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.602+0000 7fd1127ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0c6750 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.602+0000 7fd1127ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0c6a30 con 0x7fd10c0cdfe0 2023-10-06T04:45:59.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.602+0000 7fd1127ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0c6d10 con 0x7fd10c0ce450 2023-10-06T04:45:59.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.602+0000 7fd10bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd10c0ccbb0 0x7fd10c09d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:59.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.602+0000 7fd10bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd10c0ccbb0 0x7fd10c09d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54932/0 (socket says 172.21.15.124:54932) 2023-10-06T04:45:59.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.602+0000 7fd10bfff700 1 -- 172.21.15.124:0/543487573 learned_addr learned my addr 172.21.15.124:0/543487573 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:45:59.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.602+0000 7fd10bfff700 1 -- 172.21.15.124:0/543487573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd10c0ce450 msgr2=0x7fd10c09a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:59.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.603+0000 7fd10bfff700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd10c0ce450 0x7fd10c09a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.603+0000 7fd10bfff700 1 -- 172.21.15.124:0/543487573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd10c0cdfe0 msgr2=0x7fd10c156a90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:45:59.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.603+0000 7fd10bfff700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd10c0cdfe0 0x7fd10c156a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.603+0000 7fd10bfff700 1 -- 172.21.15.124:0/543487573 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104009a20 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.603+0000 7fd10bfff700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd10c0ccbb0 0x7fd10c09d110 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c790 tx=0x7fd0fc007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:59.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.603+0000 7fd0f3fff700 1 -- 172.21.15.124:0/543487573 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc012630 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.603+0000 7fd0f3fff700 1 -- 172.21.15.124:0/543487573 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc0127b0 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.603+0000 7fd1127ff700 1 -- 172.21.15.124:0/543487573 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c0c4690 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.603+0000 7fd0f3fff700 1 -- 172.21.15.124:0/543487573 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc012b70 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.603+0000 7fd1127ff700 1 -- 172.21.15.124:0/543487573 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c09d650 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.604+0000 7fd1127ff700 1 -- 172.21.15.124:0/543487573 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c0717a0 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.605+0000 7fd0f3fff700 1 -- 172.21.15.124:0/543487573 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0fc01a3b0 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.606+0000 7fd0f3fff700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd0f8066f30 0x7fd0f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:59.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.606+0000 7fd0f3fff700 1 -- 172.21.15.124:0/543487573 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd0fc084640 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.606+0000 7fd10b7fe700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd0f8066f30 0x7fd0f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:59.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.607+0000 7fd10b7fe700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd0f8066f30 0x7fd0f80693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd10c063b90 tx=0x7fd1000012c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:59.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.610+0000 7fd0f3fff700 1 -- 172.21.15.124:0/543487573 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0fc0516b0 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.801+0000 7fd1127ff700 1 -- 172.21.15.124:0/543487573 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd10c0b3790 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.802+0000 7fd0f3fff700 1 -- 172.21.15.124:0/543487573 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fd0fc054cd0 con 0x7fd10c0ccbb0 2023-10-06T04:45:59.803 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:45:59.804 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":44,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:45:58.846923+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:56.420552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:57.820429+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:45:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 -- 172.21.15.124:0/543487573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd0f8066f30 msgr2=0x7fd0f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd0f8066f30 0x7fd0f80693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd10c063b90 tx=0x7fd1000012c0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 -- 172.21.15.124:0/543487573 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd10c0ccbb0 msgr2=0x7fd10c09d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd10c0ccbb0 0x7fd10c09d110 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c790 tx=0x7fd0fc007ea0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 -- 172.21.15.124:0/543487573 shutdown_connections 2023-10-06T04:45:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd0f8066f30 0x7fd0f80693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd10c0ce450 0x7fd10c09a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd10c0ccbb0 0x7fd10c09d110 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 --2- 172.21.15.124:0/543487573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd10c0cdfe0 0x7fd10c156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 -- 172.21.15.124:0/543487573 >> 172.21.15.124:0/543487573 conn(0x7fd10c099710 msgr2=0x7fd10c158980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:59.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 -- 172.21.15.124:0/543487573 shutdown_connections 2023-10-06T04:45:59.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:45:59.804+0000 7fd1127ff700 1 -- 172.21.15.124:0/543487573 wait complete. 2023-10-06T04:45:59.823 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:46:00.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.012+0000 7fe2633ff700 1 Processor -- start 2023-10-06T04:46:00.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.013+0000 7fe2633ff700 1 -- start start 2023-10-06T04:46:00.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.014+0000 7fe2633ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe25c0cae80 0x7fe25c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.014+0000 7fe2633ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c1598e0 0x7fe25c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.014+0000 7fe2633ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25c0c1d10 con 0x7fe25c0ccec0 2023-10-06T04:46:00.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.014+0000 7fe2633ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25c0cd430 con 0x7fe25c0cae80 2023-10-06T04:46:00.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.014+0000 7fe2633ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0688a0 con 0x7fe25c1598e0 2023-10-06T04:46:00.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.014+0000 7fe26199c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c1598e0 0x7fe25c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.014+0000 7fe26199c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c1598e0 0x7fe25c0afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:43386/0 (socket says 172.21.15.124:43386) 2023-10-06T04:46:00.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.014+0000 7fe26199c700 1 -- 172.21.15.124:0/462974452 learned_addr learned my addr 172.21.15.124:0/462974452 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:00.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.014+0000 7fe26119b700 1 --2- 172.21.15.124:0/462974452 >> v2:172.21.15.158:3300/0 conn(0x7fe25c0cae80 0x7fe25c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.015+0000 7fe26199c700 1 -- 172.21.15.124:0/462974452 >> v2:172.21.15.158:3300/0 conn(0x7fe25c0cae80 msgr2=0x7fe25c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:00.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.015+0000 7fe26199c700 1 --2- 172.21.15.124:0/462974452 >> v2:172.21.15.158:3300/0 conn(0x7fe25c0cae80 0x7fe25c0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.015+0000 7fe26199c700 1 -- 172.21.15.124:0/462974452 >> v1:172.21.15.158:6789/0 conn(0x7fe25c0ccec0 legacy=0x7fe25c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:00.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.015+0000 7fe26199c700 1 -- 172.21.15.124:0/462974452 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c068b80 con 0x7fe25c1598e0 2023-10-06T04:46:00.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.015+0000 7fe26199c700 1 --2- 172.21.15.124:0/462974452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c1598e0 0x7fe25c0afe40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe254009f20 tx=0x7fe254009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c05dd3cb9e9a009 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:00.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.015+0000 7fe253fff700 1 -- 172.21.15.124:0/462974452 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400e070 con 0x7fe25c1598e0 2023-10-06T04:46:00.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.015+0000 7fe253fff700 1 -- 172.21.15.124:0/462974452 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25400b990 con 0x7fe25c1598e0 2023-10-06T04:46:00.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.015+0000 7fe253fff700 1 -- 172.21.15.124:0/462974452 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540092e0 con 0x7fe25c1598e0 2023-10-06T04:46:00.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.016+0000 7fe2633ff700 1 -- 172.21.15.124:0/462974452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c1598e0 msgr2=0x7fe25c0afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:00.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.016+0000 7fe2633ff700 1 --2- 172.21.15.124:0/462974452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c1598e0 0x7fe25c0afe40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe254009f20 tx=0x7fe254009840 comp rx=0 tx=0).stop 2023-10-06T04:46:00.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.016+0000 7fe2633ff700 1 -- 172.21.15.124:0/462974452 shutdown_connections 2023-10-06T04:46:00.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.016+0000 7fe2633ff700 1 --2- 172.21.15.124:0/462974452 >> v2:172.21.15.158:3300/0 conn(0x7fe25c0cae80 0x7fe25c0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.016+0000 7fe2633ff700 1 --2- 172.21.15.124:0/462974452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c1598e0 0x7fe25c0afe40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.016+0000 7fe2633ff700 1 -- 172.21.15.124:0/462974452 >> 172.21.15.124:0/462974452 conn(0x7fe25c0974f0 msgr2=0x7fe25c0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:00.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.016+0000 7fe2633ff700 1 -- 172.21.15.124:0/462974452 shutdown_connections 2023-10-06T04:46:00.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.016+0000 7fe2633ff700 1 -- 172.21.15.124:0/462974452 wait complete. 2023-10-06T04:46:00.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.017+0000 7fe2633ff700 1 Processor -- start 2023-10-06T04:46:00.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.018+0000 7fe2633ff700 1 -- start start 2023-10-06T04:46:00.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.018+0000 7fe2633ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe25c0cae80 0x7fe25c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.018+0000 7fe2633ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c0ccec0 0x7fe25c098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe2633ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe25c1598e0 0x7fe25c0c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe2633ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0b3ff0 con 0x7fe25c1598e0 2023-10-06T04:46:00.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe2633ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0b3620 con 0x7fe25c0cae80 2023-10-06T04:46:00.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe2633ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c1580c0 con 0x7fe25c0ccec0 2023-10-06T04:46:00.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26199c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe25c1598e0 0x7fe25c0c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26199c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe25c1598e0 0x7fe25c0c6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54938/0 (socket says 172.21.15.124:54938) 2023-10-06T04:46:00.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26199c700 1 -- 172.21.15.124:0/3136009674 learned_addr learned my addr 172.21.15.124:0/3136009674 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:00.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26119b700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe25c0cae80 0x7fe25c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26099a700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c0ccec0 0x7fe25c098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26199c700 1 -- 172.21.15.124:0/3136009674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c0ccec0 msgr2=0x7fe25c098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:00.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26199c700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c0ccec0 0x7fe25c098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26199c700 1 -- 172.21.15.124:0/3136009674 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe25c0cae80 msgr2=0x7fe25c0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:00.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26199c700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe25c0cae80 0x7fe25c0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26199c700 1 -- 172.21.15.124:0/3136009674 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254009ae0 con 0x7fe25c1598e0 2023-10-06T04:46:00.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.019+0000 7fe26119b700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe25c0cae80 0x7fe25c0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:46:00.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.020+0000 7fe26199c700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe25c1598e0 0x7fe25c0c6020 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b610 tx=0x7fe254017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:00.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.020+0000 7fe2517fa700 1 -- 172.21.15.124:0/3136009674 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254012af0 con 0x7fe25c1598e0 2023-10-06T04:46:00.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.020+0000 7fe2517fa700 1 -- 172.21.15.124:0/3136009674 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe254012c50 con 0x7fe25c1598e0 2023-10-06T04:46:00.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.020+0000 7fe2517fa700 1 -- 172.21.15.124:0/3136009674 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25401e430 con 0x7fe25c1598e0 2023-10-06T04:46:00.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.020+0000 7fe2633ff700 1 -- 172.21.15.124:0/3136009674 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c0b07f0 con 0x7fe25c1598e0 2023-10-06T04:46:00.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.020+0000 7fe2633ff700 1 -- 172.21.15.124:0/3136009674 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c0b2fd0 con 0x7fe25c1598e0 2023-10-06T04:46:00.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.021+0000 7fe2633ff700 1 -- 172.21.15.124:0/3136009674 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25c0b3790 con 0x7fe25c1598e0 2023-10-06T04:46:00.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.022+0000 7fe2517fa700 1 -- 172.21.15.124:0/3136009674 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe25401e7e0 con 0x7fe25c1598e0 2023-10-06T04:46:00.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.023+0000 7fe2517fa700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe240066f30 0x7fe2400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.023+0000 7fe2517fa700 1 -- 172.21.15.124:0/3136009674 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2540860e0 con 0x7fe25c1598e0 2023-10-06T04:46:00.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.023+0000 7fe26119b700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe240066f30 0x7fe2400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.024+0000 7fe26119b700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe240066f30 0x7fe2400693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe258011480 tx=0x7fe2580091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:00.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.027+0000 7fe2517fa700 1 -- 172.21.15.124:0/3136009674 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe254053150 con 0x7fe25c1598e0 2023-10-06T04:46:00.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.219+0000 7fe2633ff700 1 -- 172.21.15.124:0/3136009674 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe25c0717f0 con 0x7fe25c1598e0 2023-10-06T04:46:00.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.220+0000 7fe2517fa700 1 -- 172.21.15.124:0/3136009674 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fe254056770 con 0x7fe25c1598e0 2023-10-06T04:46:00.221 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:46:00.222 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":44,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:45:58.846923+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:56.420552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:57.820429+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:46:00.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 -- 172.21.15.124:0/3136009674 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe240066f30 msgr2=0x7fe2400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:00.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe240066f30 0x7fe2400693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe258011480 tx=0x7fe2580091a0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 -- 172.21.15.124:0/3136009674 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe25c1598e0 msgr2=0x7fe25c0c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:00.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe25c1598e0 0x7fe25c0c6020 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b610 tx=0x7fe254017000 comp rx=0 tx=0).stop 2023-10-06T04:46:00.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 -- 172.21.15.124:0/3136009674 shutdown_connections 2023-10-06T04:46:00.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe25c1598e0 0x7fe25c0c6020 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe25c0cae80 0x7fe25c0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe240066f30 0x7fe2400693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 --2- 172.21.15.124:0/3136009674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe25c0ccec0 0x7fe25c098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 -- 172.21.15.124:0/3136009674 >> 172.21.15.124:0/3136009674 conn(0x7fe25c0974f0 msgr2=0x7fe25c0cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:00.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 -- 172.21.15.124:0/3136009674 shutdown_connections 2023-10-06T04:46:00.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.222+0000 7fe2633ff700 1 -- 172.21.15.124:0/3136009674 wait complete. 2023-10-06T04:46:00.242 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:46:00.437 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.435+0000 7f1cdbfff700 1 Processor -- start 2023-10-06T04:46:00.437 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.436+0000 7f1cdbfff700 1 -- start start 2023-10-06T04:46:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.437+0000 7f1cdbfff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1cd4068600 0x7f1cd406a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.437+0000 7f1cdbfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40aa0c0 0x7f1cd4159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.437+0000 7f1cdbfff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd415df90 con 0x7f1cd40a9cf0 2023-10-06T04:46:00.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.437+0000 7f1cdbfff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd40ab310 con 0x7f1cd4068600 2023-10-06T04:46:00.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.437+0000 7f1cdbfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd415d380 con 0x7f1cd40aa0c0 2023-10-06T04:46:00.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.438+0000 7f1cd959a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1cd4068600 0x7f1cd406a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.438+0000 7f1cda59c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40aa0c0 0x7f1cd4159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.438+0000 7f1cda59c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40aa0c0 0x7f1cd4159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:43402/0 (socket says 172.21.15.124:43402) 2023-10-06T04:46:00.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.438+0000 7f1cda59c700 1 -- 172.21.15.124:0/2407631247 learned_addr learned my addr 172.21.15.124:0/2407631247 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:00.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.438+0000 7f1cd959a700 1 -- 172.21.15.124:0/2407631247 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40aa0c0 msgr2=0x7f1cd4159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:00.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.438+0000 7f1cd959a700 1 --2- 172.21.15.124:0/2407631247 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40aa0c0 0x7f1cd4159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.438+0000 7f1cd959a700 1 -- 172.21.15.124:0/2407631247 >> v1:172.21.15.158:6789/0 conn(0x7f1cd40a9cf0 legacy=0x7f1cd4069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:00.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.438+0000 7f1cd959a700 1 -- 172.21.15.124:0/2407631247 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd415d660 con 0x7f1cd4068600 2023-10-06T04:46:00.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.438+0000 7f1cda59c700 1 --2- 172.21.15.124:0/2407631247 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40aa0c0 0x7f1cd4159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:46:00.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.438+0000 7f1cd959a700 1 --2- 172.21.15.124:0/2407631247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cd4068600 0x7f1cd406a690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40098e0 tx=0x7f1cc40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f90bbdeb7f983a2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:00.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cd8d99700 1 -- 172.21.15.124:0/2407631247 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400b640 con 0x7f1cd4068600 2023-10-06T04:46:00.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cd8d99700 1 -- 172.21.15.124:0/2407631247 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400b7a0 con 0x7f1cd4068600 2023-10-06T04:46:00.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cd8d99700 1 -- 172.21.15.124:0/2407631247 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400bb40 con 0x7f1cd4068600 2023-10-06T04:46:00.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cdbfff700 1 -- 172.21.15.124:0/2407631247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cd4068600 msgr2=0x7f1cd406a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:00.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cdbfff700 1 --2- 172.21.15.124:0/2407631247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cd4068600 0x7f1cd406a690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40098e0 tx=0x7f1cc40091a0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cdbfff700 1 -- 172.21.15.124:0/2407631247 shutdown_connections 2023-10-06T04:46:00.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cdbfff700 1 --2- 172.21.15.124:0/2407631247 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40aa0c0 0x7f1cd4159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cdbfff700 1 --2- 172.21.15.124:0/2407631247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cd4068600 0x7f1cd406a690 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cdbfff700 1 -- 172.21.15.124:0/2407631247 >> 172.21.15.124:0/2407631247 conn(0x7f1cd406bf10 msgr2=0x7f1cd40ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:00.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cdbfff700 1 -- 172.21.15.124:0/2407631247 shutdown_connections 2023-10-06T04:46:00.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.439+0000 7f1cdbfff700 1 -- 172.21.15.124:0/2407631247 wait complete. 2023-10-06T04:46:00.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.441+0000 7f1cdbfff700 1 Processor -- start 2023-10-06T04:46:00.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.442+0000 7f1cdbfff700 1 -- start start 2023-10-06T04:46:00.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cdbfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1cd4068600 0x7f1cd41535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cdbfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40a9cf0 0x7f1cd415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cdbfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cd40aa0c0 0x7f1cd415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cdbfff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd415b030 con 0x7f1cd4068600 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cdbfff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd41596c0 con 0x7f1cd40aa0c0 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cdbfff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd415aad0 con 0x7f1cd40a9cf0 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cd9d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1cd4068600 0x7f1cd41535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cd9d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1cd4068600 0x7f1cd41535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54942/0 (socket says 172.21.15.124:54942) 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cd9d9b700 1 -- 172.21.15.124:0/1679729063 learned_addr learned my addr 172.21.15.124:0/1679729063 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cda59c700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cd40aa0c0 0x7f1cd415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cd959a700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40a9cf0 0x7f1cd415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cd9d9b700 1 -- 172.21.15.124:0/1679729063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40a9cf0 msgr2=0x7f1cd415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cd9d9b700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40a9cf0 0x7f1cd415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cd9d9b700 1 -- 172.21.15.124:0/1679729063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cd40aa0c0 msgr2=0x7f1cd415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cd9d9b700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cd40aa0c0 0x7f1cd415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cd9d9b700 1 -- 172.21.15.124:0/1679729063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc009ae0 con 0x7f1cd4068600 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.443+0000 7f1cd959a700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40a9cf0 0x7f1cd415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.444+0000 7f1cd9d9b700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1cd4068600 0x7f1cd41535b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c5c0 tx=0x7f1cd000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.444+0000 7f1cc9ffb700 1 -- 172.21.15.124:0/1679729063 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0011590 con 0x7f1cd4068600 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.444+0000 7f1cc9ffb700 1 -- 172.21.15.124:0/1679729063 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd0011710 con 0x7f1cd4068600 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.444+0000 7f1cdbfff700 1 -- 172.21.15.124:0/1679729063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc4009420 con 0x7f1cd4068600 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.444+0000 7f1cc9ffb700 1 -- 172.21.15.124:0/1679729063 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0011ad0 con 0x7f1cd4068600 2023-10-06T04:46:00.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.444+0000 7f1cdbfff700 1 -- 172.21.15.124:0/1679729063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd4159070 con 0x7f1cd4068600 2023-10-06T04:46:00.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.445+0000 7f1cdbfff700 1 -- 172.21.15.124:0/1679729063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd404c380 con 0x7f1cd4068600 2023-10-06T04:46:00.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.446+0000 7f1cc9ffb700 1 -- 172.21.15.124:0/1679729063 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cd001b3b0 con 0x7f1cd4068600 2023-10-06T04:46:00.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.447+0000 7f1cc9ffb700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1cb8066f30 0x7f1cb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:00.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.447+0000 7f1cc9ffb700 1 -- 172.21.15.124:0/1679729063 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1cd0083d10 con 0x7f1cd4068600 2023-10-06T04:46:00.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.447+0000 7f1cd959a700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1cb8066f30 0x7f1cb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:00.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.448+0000 7f1cd959a700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1cb8066f30 0x7f1cb80693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4068a50 tx=0x7f1cc4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:00.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.451+0000 7f1cc9ffb700 1 -- 172.21.15.124:0/1679729063 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cd0089020 con 0x7f1cd4068600 2023-10-06T04:46:00.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:00.686+0000 7f1cdbfff700 1 -- 172.21.15.124:0/1679729063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1cd415d940 con 0x7f1cd4068600 2023-10-06T04:46:01.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.380+0000 7f1cc9ffb700 1 -- 172.21.15.124:0/1679729063 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1cd0017020 con 0x7f1cd4068600 2023-10-06T04:46:01.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.382+0000 7f1cdbfff700 1 -- 172.21.15.124:0/1679729063 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1cb8066f30 msgr2=0x7f1cb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:01.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.382+0000 7f1cdbfff700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1cb8066f30 0x7f1cb80693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4068a50 tx=0x7f1cc4017000 comp rx=0 tx=0).stop 2023-10-06T04:46:01.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.382+0000 7f1cdbfff700 1 -- 172.21.15.124:0/1679729063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1cd4068600 msgr2=0x7f1cd41535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:01.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.382+0000 7f1cdbfff700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1cd4068600 0x7f1cd41535b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c5c0 tx=0x7f1cd000c980 comp rx=0 tx=0).stop 2023-10-06T04:46:01.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.383+0000 7f1cdbfff700 1 -- 172.21.15.124:0/1679729063 shutdown_connections 2023-10-06T04:46:01.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.383+0000 7f1cdbfff700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cd40aa0c0 0x7f1cd415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:01.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.383+0000 7f1cdbfff700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1cd4068600 0x7f1cd41535b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:01.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.383+0000 7f1cdbfff700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1cb8066f30 0x7f1cb80693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:01.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.383+0000 7f1cdbfff700 1 --2- 172.21.15.124:0/1679729063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cd40a9cf0 0x7f1cd415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:01.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.383+0000 7f1cdbfff700 1 -- 172.21.15.124:0/1679729063 >> 172.21.15.124:0/1679729063 conn(0x7f1cd406bf10 msgr2=0x7f1cd40ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:01.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.383+0000 7f1cdbfff700 1 -- 172.21.15.124:0/1679729063 shutdown_connections 2023-10-06T04:46:01.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.383+0000 7f1cdbfff700 1 -- 172.21.15.124:0/1679729063 wait complete. 2023-10-06T04:46:01.404 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:46:01.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.603+0000 7fc178fff700 1 Processor -- start 2023-10-06T04:46:01.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.604+0000 7fc178fff700 1 -- start start 2023-10-06T04:46:01.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc178fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc1741592b0 0x7fc1740b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:01.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc178fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc1740cc780 0x7fc1740ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:01.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc178fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17415d620 con 0x7fc174159680 2023-10-06T04:46:01.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc178fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17415d0d0 con 0x7fc1741592b0 2023-10-06T04:46:01.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc178fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740b2ed0 con 0x7fc1740cc780 2023-10-06T04:46:01.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc17259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc1741592b0 0x7fc1740b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:01.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc16bfff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc174159680 0x7fc17415dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:51844/0 (socket says 172.21.15.124:51844) 2023-10-06T04:46:01.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc16bfff700 1 -- 172.21.15.124:0/3964475721 learned_addr learned my addr 172.21.15.124:0/3964475721 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:46:01.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc171d9b700 1 -- 172.21.15.124:0/3964475721 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237398185 0 0) 0x7fc17415d620 con 0x7fc174159680 2023-10-06T04:46:01.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc172d9d700 1 --2- 172.21.15.124:0/3964475721 >> v2:172.21.15.158:3300/0 conn(0x7fc1740cc780 0x7fc1740ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.605+0000 7fc171d9b700 1 -- 172.21.15.124:0/3964475721 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc160003570 con 0x7fc174159680 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.606+0000 7fc17259c700 1 -- 172.21.15.124:0/3964475721 >> v2:172.21.15.158:3300/0 conn(0x7fc1740cc780 msgr2=0x7fc1740ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.606+0000 7fc17259c700 1 --2- 172.21.15.124:0/3964475721 >> v2:172.21.15.158:3300/0 conn(0x7fc1740cc780 0x7fc1740ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.606+0000 7fc17259c700 1 -- 172.21.15.124:0/3964475721 >> v1:172.21.15.124:6789/0 conn(0x7fc174159680 legacy=0x7fc17415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.606+0000 7fc17259c700 1 -- 172.21.15.124:0/3964475721 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740ccbe0 con 0x7fc1741592b0 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.606+0000 7fc17259c700 1 --2- 172.21.15.124:0/3964475721 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1741592b0 0x7fc1740b0080 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc174089940 tx=0x7fc1640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f735050996eb20f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.606+0000 7fc171d9b700 1 -- 172.21.15.124:0/3964475721 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164011630 con 0x7fc1741592b0 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.606+0000 7fc171d9b700 1 -- 172.21.15.124:0/3964475721 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164011790 con 0x7fc1741592b0 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.606+0000 7fc171d9b700 1 -- 172.21.15.124:0/3964475721 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164011b30 con 0x7fc1741592b0 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.607+0000 7fc178fff700 1 -- 172.21.15.124:0/3964475721 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1741592b0 msgr2=0x7fc1740b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:01.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.607+0000 7fc178fff700 1 --2- 172.21.15.124:0/3964475721 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1741592b0 0x7fc1740b0080 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc174089940 tx=0x7fc1640091a0 comp rx=0 tx=0).stop 2023-10-06T04:46:01.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.607+0000 7fc178fff700 1 -- 172.21.15.124:0/3964475721 shutdown_connections 2023-10-06T04:46:01.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.607+0000 7fc178fff700 1 --2- 172.21.15.124:0/3964475721 >> v2:172.21.15.158:3300/0 conn(0x7fc1740cc780 0x7fc1740ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:01.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.607+0000 7fc178fff700 1 --2- 172.21.15.124:0/3964475721 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1741592b0 0x7fc1740b0080 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:01.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.607+0000 7fc178fff700 1 -- 172.21.15.124:0/3964475721 >> 172.21.15.124:0/3964475721 conn(0x7fc17406ed20 msgr2=0x7fc17406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:01.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.607+0000 7fc178fff700 1 -- 172.21.15.124:0/3964475721 shutdown_connections 2023-10-06T04:46:01.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.607+0000 7fc178fff700 1 -- 172.21.15.124:0/3964475721 wait complete. 2023-10-06T04:46:01.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.608+0000 7fc178fff700 1 Processor -- start 2023-10-06T04:46:01.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.608+0000 7fc178fff700 1 -- start start 2023-10-06T04:46:01.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.609+0000 7fc178fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1740cc780 0x7fc1741564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:01.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.609+0000 7fc178fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc1741592b0 0x7fc1740b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:01.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.609+0000 7fc178fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc174159680 0x7fc1740c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:01.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.609+0000 7fc178fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b4b50 con 0x7fc1740cc780 2023-10-06T04:46:01.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.609+0000 7fc178fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740c4ce0 con 0x7fc174159680 2023-10-06T04:46:01.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.609+0000 7fc178fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b3f40 con 0x7fc1741592b0 2023-10-06T04:46:01.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.609+0000 7fc17259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1740cc780 0x7fc1741564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.609+0000 7fc17259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1740cc780 0x7fc1741564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54960/0 (socket says 172.21.15.124:54960) 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.609+0000 7fc17259c700 1 -- 172.21.15.124:0/2028380848 learned_addr learned my addr 172.21.15.124:0/2028380848 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc17259c700 1 -- 172.21.15.124:0/2028380848 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc1741592b0 msgr2=0x7fc1740b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc17259c700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc1741592b0 0x7fc1740b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc17259c700 1 -- 172.21.15.124:0/2028380848 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc174159680 msgr2=0x7fc1740c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc17259c700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc174159680 0x7fc1740c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc17259c700 1 -- 172.21.15.124:0/2028380848 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc164009420 con 0x7fc1740cc780 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc17259c700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1740cc780 0x7fc1741564c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc174063e60 tx=0x7fc164017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc16a7fc700 1 -- 172.21.15.124:0/2028380848 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164011b10 con 0x7fc1740cc780 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc16a7fc700 1 -- 172.21.15.124:0/2028380848 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640253f0 con 0x7fc1740cc780 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc16a7fc700 1 -- 172.21.15.124:0/2028380848 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164025790 con 0x7fc1740cc780 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc178fff700 1 -- 172.21.15.124:0/2028380848 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1740b4220 con 0x7fc1740cc780 2023-10-06T04:46:01.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.610+0000 7fc178fff700 1 -- 172.21.15.124:0/2028380848 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1740b47e0 con 0x7fc1740cc780 2023-10-06T04:46:01.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.612+0000 7fc178fff700 1 -- 172.21.15.124:0/2028380848 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17404c380 con 0x7fc1740cc780 2023-10-06T04:46:01.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.612+0000 7fc16a7fc700 1 -- 172.21.15.124:0/2028380848 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc164025b80 con 0x7fc1740cc780 2023-10-06T04:46:01.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.613+0000 7fc16a7fc700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc154066f30 0x7fc1540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:01.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.613+0000 7fc16a7fc700 1 -- 172.21.15.124:0/2028380848 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc1640860c0 con 0x7fc1740cc780 2023-10-06T04:46:01.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.613+0000 7fc16bfff700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc154066f30 0x7fc1540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:01.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.614+0000 7fc16bfff700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc154066f30 0x7fc1540693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0058d0 tx=0x7fc15c0079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:01.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.617+0000 7fc16a7fc700 1 -- 172.21.15.124:0/2028380848 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc164053130 con 0x7fc1740cc780 2023-10-06T04:46:01.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:01.851+0000 7fc178fff700 1 -- 172.21.15.124:0/2028380848 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc1740b0760 con 0x7fc1740cc780 2023-10-06T04:46:02.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.385+0000 7fc16a7fc700 1 -- 172.21.15.124:0/2028380848 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc164056750 con 0x7fc1740cc780 2023-10-06T04:46:02.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.387+0000 7fc178fff700 1 -- 172.21.15.124:0/2028380848 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc154066f30 msgr2=0x7fc1540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:02.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.387+0000 7fc178fff700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc154066f30 0x7fc1540693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0058d0 tx=0x7fc15c0079d0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.387+0000 7fc178fff700 1 -- 172.21.15.124:0/2028380848 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1740cc780 msgr2=0x7fc1741564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:02.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.387+0000 7fc178fff700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1740cc780 0x7fc1741564c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc174063e60 tx=0x7fc164017000 comp rx=0 tx=0).stop 2023-10-06T04:46:02.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.387+0000 7fc178fff700 1 -- 172.21.15.124:0/2028380848 shutdown_connections 2023-10-06T04:46:02.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.387+0000 7fc178fff700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc174159680 0x7fc1740c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.387+0000 7fc178fff700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1740cc780 0x7fc1741564c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.387+0000 7fc178fff700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc154066f30 0x7fc1540693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.387+0000 7fc178fff700 1 --2- 172.21.15.124:0/2028380848 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc1741592b0 0x7fc1740b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.387+0000 7fc178fff700 1 -- 172.21.15.124:0/2028380848 >> 172.21.15.124:0/2028380848 conn(0x7fc17406ed20 msgr2=0x7fc17415c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:02.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.388+0000 7fc178fff700 1 -- 172.21.15.124:0/2028380848 shutdown_connections 2023-10-06T04:46:02.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.388+0000 7fc178fff700 1 -- 172.21.15.124:0/2028380848 wait complete. 2023-10-06T04:46:02.407 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:46:02.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.596+0000 7f26513ff700 1 Processor -- start 2023-10-06T04:46:02.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.596+0000 7f26513ff700 1 -- start start 2023-10-06T04:46:02.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f26513ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f264c0ccbb0 0x7f264c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:02.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f26513ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f264c0cdfe0 0x7f264c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:02.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f26513ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0ccf80 0x7f264c0cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:02.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f26513ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c0cf6b0 con 0x7f264c0ccbb0 2023-10-06T04:46:02.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f26513ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c0ceaa0 con 0x7f264c0cdfe0 2023-10-06T04:46:02.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f26513ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0ced80 con 0x7f264c0ccf80 2023-10-06T04:46:02.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f264affd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f264c0ccbb0 0x7f264c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:02.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f264affd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f264c0ccbb0 0x7f264c0cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54968/0 (socket says 172.21.15.124:54968) 2023-10-06T04:46:02.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f264affd700 1 -- 172.21.15.124:0/550003630 learned_addr learned my addr 172.21.15.124:0/550003630 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:02.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f264a7fc700 1 --2- 172.21.15.124:0/550003630 >> v2:172.21.15.158:3300/0 conn(0x7f264c0cdfe0 0x7f264c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:02.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.597+0000 7f264b7fe700 1 --2- 172.21.15.124:0/550003630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0ccf80 0x7f264c0cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:02.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.598+0000 7f264affd700 1 -- 172.21.15.124:0/550003630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0ccf80 msgr2=0x7f264c0cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:02.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.598+0000 7f264affd700 1 --2- 172.21.15.124:0/550003630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0ccf80 0x7f264c0cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.598+0000 7f264affd700 1 -- 172.21.15.124:0/550003630 >> v2:172.21.15.158:3300/0 conn(0x7f264c0cdfe0 msgr2=0x7f264c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:02.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.598+0000 7f264affd700 1 --2- 172.21.15.124:0/550003630 >> v2:172.21.15.158:3300/0 conn(0x7f264c0cdfe0 0x7f264c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.598+0000 7f264affd700 1 -- 172.21.15.124:0/550003630 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c0cf060 con 0x7f264c0ccbb0 2023-10-06T04:46:02.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.598+0000 7f264b7fe700 1 --2- 172.21.15.124:0/550003630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0ccf80 0x7f264c0cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:46:02.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.598+0000 7f264affd700 1 --2- 172.21.15.124:0/550003630 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 0x7f264c0cfb40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f264c0cdf90 tx=0x7f263c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488fe8779d8faa12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:02.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.598+0000 7f2649ffb700 1 -- 172.21.15.124:0/550003630 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c009e70 con 0x7f264c0ccbb0 2023-10-06T04:46:02.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.598+0000 7f2649ffb700 1 -- 172.21.15.124:0/550003630 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c00b860 con 0x7f264c0ccbb0 2023-10-06T04:46:02.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.598+0000 7f2649ffb700 1 -- 172.21.15.124:0/550003630 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c00bc00 con 0x7f264c0ccbb0 2023-10-06T04:46:02.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.599+0000 7f26513ff700 1 -- 172.21.15.124:0/550003630 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 msgr2=0x7f264c0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:02.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.599+0000 7f26513ff700 1 --2- 172.21.15.124:0/550003630 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 0x7f264c0cfb40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f264c0cdf90 tx=0x7f263c009250 comp rx=0 tx=0).stop 2023-10-06T04:46:02.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.599+0000 7f26513ff700 1 -- 172.21.15.124:0/550003630 shutdown_connections 2023-10-06T04:46:02.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.599+0000 7f26513ff700 1 --2- 172.21.15.124:0/550003630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0ccf80 0x7f264c0cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.599+0000 7f26513ff700 1 --2- 172.21.15.124:0/550003630 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 0x7f264c0cfb40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.599+0000 7f26513ff700 1 --2- 172.21.15.124:0/550003630 >> v2:172.21.15.158:3300/0 conn(0x7f264c0cdfe0 0x7f264c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.599+0000 7f26513ff700 1 -- 172.21.15.124:0/550003630 >> 172.21.15.124:0/550003630 conn(0x7f264c099710 msgr2=0x7f264c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:02.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.599+0000 7f26513ff700 1 -- 172.21.15.124:0/550003630 shutdown_connections 2023-10-06T04:46:02.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.599+0000 7f26513ff700 1 -- 172.21.15.124:0/550003630 wait complete. 2023-10-06T04:46:02.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.601+0000 7f26513ff700 1 Processor -- start 2023-10-06T04:46:02.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.601+0000 7f26513ff700 1 -- start start 2023-10-06T04:46:02.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.602+0000 7f26513ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 0x7f264c0b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:02.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.602+0000 7f26513ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f264c0ccf80 0x7f264c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:02.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.602+0000 7f26513ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0cdfe0 0x7f264c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:02.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.602+0000 7f26513ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0c7ee0 con 0x7f264c0ccbb0 2023-10-06T04:46:02.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.602+0000 7f26513ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0b2170 con 0x7f264c0ccf80 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.602+0000 7f26513ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0c75f0 con 0x7f264c0cdfe0 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 0x7f264c0b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 0x7f264c0b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54976/0 (socket says 172.21.15.124:54976) 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264affd700 1 -- 172.21.15.124:0/4130605704 learned_addr learned my addr 172.21.15.124:0/4130605704 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264a7fc700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f264c0ccf80 0x7f264c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264b7fe700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0cdfe0 0x7f264c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264affd700 1 -- 172.21.15.124:0/4130605704 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0cdfe0 msgr2=0x7f264c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264affd700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0cdfe0 0x7f264c0ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264affd700 1 -- 172.21.15.124:0/4130605704 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f264c0ccf80 msgr2=0x7f264c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264affd700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f264c0ccf80 0x7f264c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264affd700 1 -- 172.21.15.124:0/4130605704 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c0094f0 con 0x7f264c0ccbb0 2023-10-06T04:46:02.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264a7fc700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f264c0ccf80 0x7f264c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:02.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264b7fe700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0cdfe0 0x7f264c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:02.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.603+0000 7f264affd700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 0x7f264c0b1990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f263c009290 tx=0x7f263c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:02.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.604+0000 7f2632ffd700 1 -- 172.21.15.124:0/4130605704 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c00bbe0 con 0x7f264c0ccbb0 2023-10-06T04:46:02.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.604+0000 7f2632ffd700 1 -- 172.21.15.124:0/4130605704 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c01f070 con 0x7f264c0ccbb0 2023-10-06T04:46:02.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.604+0000 7f26513ff700 1 -- 172.21.15.124:0/4130605704 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c0b1ed0 con 0x7f264c0ccbb0 2023-10-06T04:46:02.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.604+0000 7f2632ffd700 1 -- 172.21.15.124:0/4130605704 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c0266b0 con 0x7f264c0ccbb0 2023-10-06T04:46:02.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.604+0000 7f26513ff700 1 -- 172.21.15.124:0/4130605704 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c0c7b70 con 0x7f264c0ccbb0 2023-10-06T04:46:02.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.605+0000 7f26513ff700 1 -- 172.21.15.124:0/4130605704 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c0717a0 con 0x7f264c0ccbb0 2023-10-06T04:46:02.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.606+0000 7f2632ffd700 1 -- 172.21.15.124:0/4130605704 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f263c026a60 con 0x7f264c0ccbb0 2023-10-06T04:46:02.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.606+0000 7f2632ffd700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2638066f30 0x7f26380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:02.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.607+0000 7f2632ffd700 1 -- 172.21.15.124:0/4130605704 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f263c021070 con 0x7f264c0ccbb0 2023-10-06T04:46:02.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.607+0000 7f264a7fc700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2638066f30 0x7f26380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:02.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.607+0000 7f264a7fc700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2638066f30 0x7f26380693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2640006f00 tx=0x7f2640008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:02.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.611+0000 7f2632ffd700 1 -- 172.21.15.124:0/4130605704 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f263c0534a0 con 0x7f264c0ccbb0 2023-10-06T04:46:02.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.843+0000 7f26513ff700 1 -- 172.21.15.124:0/4130605704 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f264c0640f0 con 0x7f264c0ccbb0 2023-10-06T04:46:02.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.844+0000 7f2632ffd700 1 -- 172.21.15.124:0/4130605704 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f264c0640f0 con 0x7f264c0ccbb0 2023-10-06T04:46:02.846 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:46:02.846 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/267826992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":267826992},{"type":"v1","addr":"172.21.15.158:6835","nonce":267826992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/361532770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":361532770},{"type":"v1","addr":"172.21.15.124:6835","nonce":361532770}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1150240645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6836","nonce":1150240645},{"type":"v1","addr":"172.21.15.124:6837","nonce":1150240645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:58.847255+0000","modified":"2023-10-06T04:46:02.379103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6834/1553392288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1553392288},{"type":"v1","addr":"172.21.15.158:6834","nonce":1553392288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:46:02.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.846+0000 7f26513ff700 1 -- 172.21.15.124:0/4130605704 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2638066f30 msgr2=0x7f26380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:02.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.846+0000 7f26513ff700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2638066f30 0x7f26380693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2640006f00 tx=0x7f2640008040 comp rx=0 tx=0).stop 2023-10-06T04:46:02.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.846+0000 7f26513ff700 1 -- 172.21.15.124:0/4130605704 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 msgr2=0x7f264c0b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:02.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.846+0000 7f26513ff700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 0x7f264c0b1990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f263c009290 tx=0x7f263c017000 comp rx=0 tx=0).stop 2023-10-06T04:46:02.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.846+0000 7f26513ff700 1 -- 172.21.15.124:0/4130605704 shutdown_connections 2023-10-06T04:46:02.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.846+0000 7f26513ff700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2638066f30 0x7f26380693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.846+0000 7f26513ff700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f264c0cdfe0 0x7f264c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.846+0000 7f26513ff700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f264c0ccbb0 0x7f264c0b1990 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.846+0000 7f26513ff700 1 --2- 172.21.15.124:0/4130605704 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f264c0ccf80 0x7f264c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:02.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.846+0000 7f26513ff700 1 -- 172.21.15.124:0/4130605704 >> 172.21.15.124:0/4130605704 conn(0x7f264c099710 msgr2=0x7f264c069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:02.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.847+0000 7f26513ff700 1 -- 172.21.15.124:0/4130605704 shutdown_connections 2023-10-06T04:46:02.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:02.847+0000 7f26513ff700 1 -- 172.21.15.124:0/4130605704 wait complete. 2023-10-06T04:46:02.849 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 25 2023-10-06T04:46:02.865 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:46:03.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.053+0000 7f99073ff700 1 Processor -- start 2023-10-06T04:46:03.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.053+0000 7f99073ff700 1 -- start start 2023-10-06T04:46:03.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.054+0000 7f99073ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f99000cb250 0x7f99001591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.055+0000 7f99073ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99000c1d10 con 0x7f99000cae80 2023-10-06T04:46:03.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.055+0000 7f99073ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9900159b70 con 0x7f9900159710 2023-10-06T04:46:03.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.055+0000 7f99073ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99000cd430 con 0x7f99000cb250 2023-10-06T04:46:03.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.055+0000 7f990519b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f99000cae80 0x7f99000cc980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53466/0 (socket says 172.21.15.124:53466) 2023-10-06T04:46:03.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.055+0000 7f990519b700 1 -- 172.21.15.124:0/3121533092 learned_addr learned my addr 172.21.15.124:0/3121533092 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:46:03.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.055+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137442661 0 0) 0x7f99000c1d10 con 0x7f99000cae80 2023-10-06T04:46:03.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.055+0000 7f990499a700 1 --2- 172.21.15.124:0/3121533092 >> v2:172.21.15.158:3300/0 conn(0x7f99000cb250 0x7f99001591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.055+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ec003570 con 0x7f99000cae80 2023-10-06T04:46:03.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 105540638 0 0) 0x7f98ec003570 con 0x7f99000cae80 2023-10-06T04:46:03.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 >> v2:172.21.15.158:3300/0 conn(0x7f99000cb250 msgr2=0x7f99001591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:03.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 --2- 172.21.15.124:0/3121533092 >> v2:172.21.15.158:3300/0 conn(0x7f99000cb250 0x7f99001591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 >> v1:172.21.15.158:6789/0 conn(0x7f9900159710 legacy=0x7f99000afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99000688a0 con 0x7f99000cae80 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f98fc001470 con 0x7f99000cae80 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 >> v1:172.21.15.124:6789/0 conn(0x7f99000cae80 legacy=0x7f99000cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98ec003a60 0x7f98ec003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98ec004810 0x7f98ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98ec0051c0 0x7f98ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99000cd430 con 0x7f98ec003a60 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec00c0b0 con 0x7f98ec0051c0 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec00c270 con 0x7f98ec004810 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f990519b700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98ec003a60 0x7f98ec003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f990599c700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98ec0051c0 0x7f98ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f990499a700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98ec004810 0x7f98ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f990519b700 1 -- 172.21.15.124:0/3121533092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98ec004810 msgr2=0x7f98ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f990519b700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98ec004810 0x7f98ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f990519b700 1 -- 172.21.15.124:0/3121533092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98ec0051c0 msgr2=0x7f98ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f990519b700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98ec0051c0 0x7f98ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f990519b700 1 -- 172.21.15.124:0/3121533092 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec003570 con 0x7f98ec003a60 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.056+0000 7f990599c700 1 -- 172.21.15.124:0/3121533092 reap_dead start 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.057+0000 7f990519b700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98ec003a60 0x7f98ec003e30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f98fc005130 tx=0x7f98fc008bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c30d7cb048c966e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.057+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc005920 con 0x7f98ec003a60 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.057+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc005a80 con 0x7f98ec003a60 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.057+0000 7f98f7fff700 1 -- 172.21.15.124:0/3121533092 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc005e40 con 0x7f98ec003a60 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.057+0000 7f99073ff700 1 -- 172.21.15.124:0/3121533092 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98ec003a60 msgr2=0x7f98ec003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.057+0000 7f99073ff700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98ec003a60 0x7f98ec003e30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f98fc005130 tx=0x7f98fc008bd0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.058+0000 7f99073ff700 1 -- 172.21.15.124:0/3121533092 shutdown_connections 2023-10-06T04:46:03.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.058+0000 7f99073ff700 1 --2- 172.21.15.124:0/3121533092 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f98ec003a60 0x7f98ec003e30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.058+0000 7f99073ff700 1 -- 172.21.15.124:0/3121533092 >> 172.21.15.124:0/3121533092 conn(0x7f99000974f0 msgr2=0x7f99000639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:03.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.058+0000 7f99073ff700 1 -- 172.21.15.124:0/3121533092 shutdown_connections 2023-10-06T04:46:03.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.058+0000 7f99073ff700 1 -- 172.21.15.124:0/3121533092 wait complete. 2023-10-06T04:46:03.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.059+0000 7f99073ff700 1 Processor -- start 2023-10-06T04:46:03.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.059+0000 7f99073ff700 1 -- start start 2023-10-06T04:46:03.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.060+0000 7f99073ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98ec003a60 0x7f9900158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.060+0000 7f99073ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f990015b100 0x7f99000b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.060+0000 7f99073ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f990015b570 0x7f99000b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.060+0000 7f99073ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990015dfd0 con 0x7f990015b570 2023-10-06T04:46:03.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.060+0000 7f99073ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990015d3c0 con 0x7f98ec003a60 2023-10-06T04:46:03.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.060+0000 7f99073ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990015d6a0 con 0x7f990015b100 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.060+0000 7f990599c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f990015b570 0x7f99000b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.060+0000 7f990599c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f990015b570 0x7f99000b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60722/0 (socket says 172.21.15.124:60722) 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.060+0000 7f990599c700 1 -- 172.21.15.124:0/2506253173 learned_addr learned my addr 172.21.15.124:0/2506253173 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f990499a700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f990015b100 0x7f99000b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f990519b700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98ec003a60 0x7f9900158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f990599c700 1 -- 172.21.15.124:0/2506253173 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f990015b100 msgr2=0x7f99000b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f990599c700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f990015b100 0x7f99000b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f990599c700 1 -- 172.21.15.124:0/2506253173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98ec003a60 msgr2=0x7f9900158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f990599c700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98ec003a60 0x7f9900158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f990599c700 1 -- 172.21.15.124:0/2506253173 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990015d980 con 0x7f990015b570 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f990519b700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98ec003a60 0x7f9900158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:03.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f990599c700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f990015b570 0x7f99000b36d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9900159ae0 tx=0x7f98f8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:03.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f98f57fa700 1 -- 172.21.15.124:0/2506253173 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8006db0 con 0x7f990015b570 2023-10-06T04:46:03.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f98f57fa700 1 -- 172.21.15.124:0/2506253173 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f8003070 con 0x7f990015b570 2023-10-06T04:46:03.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f99073ff700 1 -- 172.21.15.124:0/2506253173 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990015dc60 con 0x7f990015b570 2023-10-06T04:46:03.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f98f57fa700 1 -- 172.21.15.124:0/2506253173 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8003430 con 0x7f990015b570 2023-10-06T04:46:03.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.061+0000 7f99073ff700 1 -- 172.21.15.124:0/2506253173 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9900158cb0 con 0x7f990015b570 2023-10-06T04:46:03.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.062+0000 7f99073ff700 1 -- 172.21.15.124:0/2506253173 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990015e180 con 0x7f990015b570 2023-10-06T04:46:03.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.063+0000 7f98f57fa700 1 -- 172.21.15.124:0/2506253173 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98f8001790 con 0x7f990015b570 2023-10-06T04:46:03.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.064+0000 7f98f57fa700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f98e4066f30 0x7f98e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.064+0000 7f98f57fa700 1 -- 172.21.15.124:0/2506253173 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f98f8084080 con 0x7f990015b570 2023-10-06T04:46:03.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.064+0000 7f990519b700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f98e4066f30 0x7f98e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.065+0000 7f990519b700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f98e4066f30 0x7f98e40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f98fc008a60 tx=0x7f98fc016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:03.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.068+0000 7f98f57fa700 1 -- 172.21.15.124:0/2506253173 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f990015e180 con 0x7f990015b570 2023-10-06T04:46:03.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.260+0000 7f99073ff700 1 -- 172.21.15.124:0/2506253173 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99000717a0 con 0x7f990015b570 2023-10-06T04:46:03.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.261+0000 7f98f57fa700 1 -- 172.21.15.124:0/2506253173 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f98f8019090 con 0x7f990015b570 2023-10-06T04:46:03.263 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:46:03.263 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":45,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:46:00.366796+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:56.420552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:57.820429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:46:03.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.263+0000 7f99073ff700 1 -- 172.21.15.124:0/2506253173 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f98e4066f30 msgr2=0x7f98e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.263+0000 7f99073ff700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f98e4066f30 0x7f98e40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f98fc008a60 tx=0x7f98fc016000 comp rx=0 tx=0).stop 2023-10-06T04:46:03.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.263+0000 7f99073ff700 1 -- 172.21.15.124:0/2506253173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f990015b570 msgr2=0x7f99000b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.263+0000 7f99073ff700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f990015b570 0x7f99000b36d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9900159ae0 tx=0x7f98f8009040 comp rx=0 tx=0).stop 2023-10-06T04:46:03.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.264+0000 7f99073ff700 1 -- 172.21.15.124:0/2506253173 shutdown_connections 2023-10-06T04:46:03.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.264+0000 7f99073ff700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f990015b570 0x7f99000b36d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.264+0000 7f99073ff700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98ec003a60 0x7f9900158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.264+0000 7f99073ff700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f98e4066f30 0x7f98e40693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.264+0000 7f99073ff700 1 --2- 172.21.15.124:0/2506253173 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f990015b100 0x7f99000b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.264+0000 7f99073ff700 1 -- 172.21.15.124:0/2506253173 >> 172.21.15.124:0/2506253173 conn(0x7f99000974f0 msgr2=0x7f990006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:03.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.264+0000 7f99073ff700 1 -- 172.21.15.124:0/2506253173 shutdown_connections 2023-10-06T04:46:03.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.264+0000 7f99073ff700 1 -- 172.21.15.124:0/2506253173 wait complete. 2023-10-06T04:46:03.283 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:46:03.283 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:46:03.338 INFO:tasks.ceph.mds.b.smithi158.stderr:2023-10-06T04:46:03.336+0000 7fd39bbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:46:03.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.472+0000 7fc728fff700 1 Processor -- start 2023-10-06T04:46:03.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.473+0000 7fc728fff700 1 -- start start 2023-10-06T04:46:03.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.474+0000 7fc728fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc7240ccbb0 0x7fc7240cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.474+0000 7fc728fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7240cf6b0 con 0x7fc7240cdfe0 2023-10-06T04:46:03.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.474+0000 7fc728fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7240ceaa0 con 0x7fc7240ce450 2023-10-06T04:46:03.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.474+0000 7fc728fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7240ce8b0 con 0x7fc7240ccbb0 2023-10-06T04:46:03.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.474+0000 7fc721d9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc7240cdfe0 0x7fc7240ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53476/0 (socket says 172.21.15.124:53476) 2023-10-06T04:46:03.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.474+0000 7fc721d9b700 1 -- 172.21.15.124:0/4268433509 learned_addr learned my addr 172.21.15.124:0/4268433509 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:46:03.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.474+0000 7fc72259c700 1 --2- 172.21.15.124:0/4268433509 >> v2:172.21.15.158:3300/0 conn(0x7fc7240ccbb0 0x7fc7240cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.474+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391920175 0 0) 0x7fc7240cf6b0 con 0x7fc7240cdfe0 2023-10-06T04:46:03.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.474+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc70c003570 con 0x7fc7240cdfe0 2023-10-06T04:46:03.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4094184168 0 0) 0x7fc70c003570 con 0x7fc7240cdfe0 2023-10-06T04:46:03.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 >> v2:172.21.15.158:3300/0 conn(0x7fc7240ccbb0 msgr2=0x7fc7240cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 --2- 172.21.15.124:0/4268433509 >> v2:172.21.15.158:3300/0 conn(0x7fc7240ccbb0 0x7fc7240cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 >> v1:172.21.15.158:6789/0 conn(0x7fc7240ce450 legacy=0x7fc7240ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240ced80 con 0x7fc7240cdfe0 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fc718001470 con 0x7fc7240cdfe0 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 >> v1:172.21.15.124:6789/0 conn(0x7fc7240cdfe0 legacy=0x7fc7240ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc70c003ab0 0x7fc70c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc70c004810 0x7fc70c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc70c005210 0x7fc70c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c00c130 con 0x7fc70c003ab0 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c00c270 con 0x7fc70c004810 2023-10-06T04:46:03.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c00c430 con 0x7fc70c005210 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72259c700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc70c003ab0 0x7fc70c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc721d9b700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc70c004810 0x7fc70c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc722d9d700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc70c005210 0x7fc70c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72259c700 1 -- 172.21.15.124:0/4268433509 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc70c005210 msgr2=0x7fc70c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72259c700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc70c005210 0x7fc70c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72259c700 1 -- 172.21.15.124:0/4268433509 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc70c004810 msgr2=0x7fc70c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72259c700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc70c004810 0x7fc70c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.475+0000 7fc72259c700 1 -- 172.21.15.124:0/4268433509 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c003570 con 0x7fc70c003ab0 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.476+0000 7fc721d9b700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc70c004810 0x7fc70c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.476+0000 7fc722d9d700 1 -- 172.21.15.124:0/4268433509 reap_dead start 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.476+0000 7fc72259c700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc70c003ab0 0x7fc70c003ec0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc714009c00 tx=0x7fc7140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8646821f64f9cf3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:03.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.476+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71400e710 con 0x7fc70c003ab0 2023-10-06T04:46:03.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.476+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71400e870 con 0x7fc70c003ab0 2023-10-06T04:46:03.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.476+0000 7fc72159a700 1 -- 172.21.15.124:0/4268433509 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71400ec30 con 0x7fc70c003ab0 2023-10-06T04:46:03.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.476+0000 7fc728fff700 1 -- 172.21.15.124:0/4268433509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc70c003ab0 msgr2=0x7fc70c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.476+0000 7fc728fff700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc70c003ab0 0x7fc70c003ec0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc714009c00 tx=0x7fc7140091a0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.476+0000 7fc728fff700 1 -- 172.21.15.124:0/4268433509 shutdown_connections 2023-10-06T04:46:03.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.476+0000 7fc728fff700 1 --2- 172.21.15.124:0/4268433509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc70c003ab0 0x7fc70c003ec0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.477+0000 7fc728fff700 1 -- 172.21.15.124:0/4268433509 >> 172.21.15.124:0/4268433509 conn(0x7fc724099710 msgr2=0x7fc72406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:03.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.477+0000 7fc728fff700 1 -- 172.21.15.124:0/4268433509 shutdown_connections 2023-10-06T04:46:03.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.477+0000 7fc728fff700 1 -- 172.21.15.124:0/4268433509 wait complete. 2023-10-06T04:46:03.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.478+0000 7fc728fff700 1 Processor -- start 2023-10-06T04:46:03.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.478+0000 7fc728fff700 1 -- start start 2023-10-06T04:46:03.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.479+0000 7fc728fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc70c003ab0 0x7fc724156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.479+0000 7fc728fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7240b0dc0 0x7fc7240b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.479+0000 7fc728fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7241695b0 0x7fc724169a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.479+0000 7fc728fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc724169f60 con 0x7fc7241695b0 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.479+0000 7fc728fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240afd20 con 0x7fc7240b0dc0 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.479+0000 7fc728fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240b0000 con 0x7fc70c003ab0 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.479+0000 7fc722d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7241695b0 0x7fc724169a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.479+0000 7fc722d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7241695b0 0x7fc724169a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60734/0 (socket says 172.21.15.124:60734) 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.479+0000 7fc722d9d700 1 -- 172.21.15.124:0/3225394658 learned_addr learned my addr 172.21.15.124:0/3225394658 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc72259c700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc70c003ab0 0x7fc724156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc721d9b700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7240b0dc0 0x7fc7240b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc722d9d700 1 -- 172.21.15.124:0/3225394658 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc70c003ab0 msgr2=0x7fc724156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc722d9d700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc70c003ab0 0x7fc724156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc722d9d700 1 -- 172.21.15.124:0/3225394658 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7240b0dc0 msgr2=0x7fc7240b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc722d9d700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7240b0dc0 0x7fc7240b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc722d9d700 1 -- 172.21.15.124:0/3225394658 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240b02e0 con 0x7fc7241695b0 2023-10-06T04:46:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc722d9d700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7241695b0 0x7fc724169a20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc7240ce820 tx=0x7fc71c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc7127fc700 1 -- 172.21.15.124:0/3225394658 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c0032e0 con 0x7fc7241695b0 2023-10-06T04:46:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc7127fc700 1 -- 172.21.15.124:0/3225394658 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c003440 con 0x7fc7241695b0 2023-10-06T04:46:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc7127fc700 1 -- 172.21.15.124:0/3225394658 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c0017d0 con 0x7fc7241695b0 2023-10-06T04:46:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.480+0000 7fc728fff700 1 -- 172.21.15.124:0/3225394658 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7240b05c0 con 0x7fc7241695b0 2023-10-06T04:46:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.481+0000 7fc728fff700 1 -- 172.21.15.124:0/3225394658 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc724156ed0 con 0x7fc7241695b0 2023-10-06T04:46:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.481+0000 7fc728fff700 1 -- 172.21.15.124:0/3225394658 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7240717a0 con 0x7fc7241695b0 2023-10-06T04:46:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.482+0000 7fc7127fc700 1 -- 172.21.15.124:0/3225394658 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc71c001c00 con 0x7fc7241695b0 2023-10-06T04:46:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.483+0000 7fc7127fc700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc704066f30 0x7fc7040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.483+0000 7fc7127fc700 1 -- 172.21.15.124:0/3225394658 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc71c084630 con 0x7fc7241695b0 2023-10-06T04:46:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.484+0000 7fc72259c700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc704066f30 0x7fc7040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.484+0000 7fc72259c700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc704066f30 0x7fc7040693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7140091e0 tx=0x7fc71401a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:03.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.487+0000 7fc7127fc700 1 -- 172.21.15.124:0/3225394658 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc71c0516a0 con 0x7fc7241695b0 2023-10-06T04:46:03.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.672+0000 7fc728fff700 1 -- 172.21.15.124:0/3225394658 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7240cf060 con 0x7fc704066f30 2023-10-06T04:46:03.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.681+0000 7fc7127fc700 1 -- 172.21.15.124:0/3225394658 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308330 (secure 0 0 0) 0x7fc7240cf060 con 0x7fc704066f30 2023-10-06T04:46:03.687 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:46:03.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 -- 172.21.15.124:0/3225394658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc704066f30 msgr2=0x7fc7040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc704066f30 0x7fc7040693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7140091e0 tx=0x7fc71401a000 comp rx=0 tx=0).stop 2023-10-06T04:46:03.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 -- 172.21.15.124:0/3225394658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7241695b0 msgr2=0x7fc724169a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7241695b0 0x7fc724169a20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc7240ce820 tx=0x7fc71c009040 comp rx=0 tx=0).stop 2023-10-06T04:46:03.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 -- 172.21.15.124:0/3225394658 shutdown_connections 2023-10-06T04:46:03.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7241695b0 0x7fc724169a20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fc704066f30 0x7fc7040693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc70c003ab0 0x7fc724156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 --2- 172.21.15.124:0/3225394658 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7240b0dc0 0x7fc7240b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 -- 172.21.15.124:0/3225394658 >> 172.21.15.124:0/3225394658 conn(0x7fc724099710 msgr2=0x7fc7240ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:03.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 -- 172.21.15.124:0/3225394658 shutdown_connections 2023-10-06T04:46:03.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.686+0000 7fc728fff700 1 -- 172.21.15.124:0/3225394658 wait complete. 2023-10-06T04:46:03.690 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:46:03.705 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-10-06T04:46:01.924399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383332,"kb_used_data":5028,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591388,"statfs":{"total":773094113280,"available":770653581312,"internally_reserved":0,"allocated":5148672,"data_stored":2821504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.574921"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365902+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:18.477799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364925+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:05.341198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.376689+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:58.073785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363691+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:22.232903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367500+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364087+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:25.603030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377258+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:25.669595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.372203+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:29.243247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369766+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:05.791456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362889+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:39.627784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367835+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:10.969828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368171+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365107+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:07.136795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377017+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:43.829007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363667+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:06.672386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365492+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:11.474480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377205+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:44.696218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364256+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:21.379661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.375224+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:50.429560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369047+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:48.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366996+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:00.063314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.370855+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368251+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:56.746843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371723+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:46.147015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.376055+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:51.081341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368877+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362478+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:30.092271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367940+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:45.556503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371516+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:02.855835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364276+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:34.942328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.375743+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:57.112135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361046+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363741+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376757+0000","last_change":"2023-10-06T04:45:58.376757+0000","last_active":"2023-10-06T04:45:58.376757+0000","last_peered":"2023-10-06T04:45:58.376757+0000","last_clean":"2023-10-06T04:45:58.376757+0000","last_became_active":"2023-10-06T04:45:58.376419+0000","last_became_peered":"2023-10-06T04:45:58.376419+0000","last_unstale":"2023-10-06T04:45:58.376757+0000","last_undegraded":"2023-10-06T04:45:58.376757+0000","last_fullsized":"2023-10-06T04:45:58.376757+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:02.868440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360346+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:34.942328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379050+0000","last_change":"2023-10-06T04:45:58.379050+0000","last_active":"2023-10-06T04:45:58.379050+0000","last_peered":"2023-10-06T04:45:58.379050+0000","last_clean":"2023-10-06T04:45:58.379050+0000","last_became_active":"2023-10-06T04:45:58.378772+0000","last_became_peered":"2023-10-06T04:45:58.378772+0000","last_unstale":"2023-10-06T04:45:58.379050+0000","last_undegraded":"2023-10-06T04:45:58.379050+0000","last_fullsized":"2023-10-06T04:45:58.379050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:08.306889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369542+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:27.358669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.373937+0000","last_change":"2023-10-06T04:45:58.373937+0000","last_active":"2023-10-06T04:45:58.373937+0000","last_peered":"2023-10-06T04:45:58.373937+0000","last_clean":"2023-10-06T04:45:58.373937+0000","last_became_active":"2023-10-06T04:45:58.373648+0000","last_became_peered":"2023-10-06T04:45:58.373648+0000","last_unstale":"2023-10-06T04:45:58.373937+0000","last_undegraded":"2023-10-06T04:45:58.373937+0000","last_fullsized":"2023-10-06T04:45:58.373937+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:57.993530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371882+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:42.683982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379222+0000","last_change":"2023-10-06T04:45:58.379222+0000","last_active":"2023-10-06T04:45:58.379222+0000","last_peered":"2023-10-06T04:45:58.379222+0000","last_clean":"2023-10-06T04:45:58.379222+0000","last_became_active":"2023-10-06T04:45:58.378814+0000","last_became_peered":"2023-10-06T04:45:58.378814+0000","last_unstale":"2023-10-06T04:45:58.379222+0000","last_undegraded":"2023-10-06T04:45:58.379222+0000","last_fullsized":"2023-10-06T04:45:58.379222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:50.379050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366974+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386102+0000","last_change":"2023-10-06T04:45:58.386102+0000","last_active":"2023-10-06T04:45:58.386102+0000","last_peered":"2023-10-06T04:45:58.386102+0000","last_clean":"2023-10-06T04:45:58.386102+0000","last_became_active":"2023-10-06T04:45:58.385833+0000","last_became_peered":"2023-10-06T04:45:58.385833+0000","last_unstale":"2023-10-06T04:45:58.386102+0000","last_undegraded":"2023-10-06T04:45:58.386102+0000","last_fullsized":"2023-10-06T04:45:58.386102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:21.167993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363799+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:35.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376488+0000","last_change":"2023-10-06T04:45:58.376488+0000","last_active":"2023-10-06T04:45:58.376488+0000","last_peered":"2023-10-06T04:45:58.376488+0000","last_clean":"2023-10-06T04:45:58.376488+0000","last_became_active":"2023-10-06T04:45:58.376235+0000","last_became_peered":"2023-10-06T04:45:58.376235+0000","last_unstale":"2023-10-06T04:45:58.376488+0000","last_undegraded":"2023-10-06T04:45:58.376488+0000","last_fullsized":"2023-10-06T04:45:58.376488+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:42.023055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367820+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376414+0000","last_change":"2023-10-06T04:45:58.376414+0000","last_active":"2023-10-06T04:45:58.376414+0000","last_peered":"2023-10-06T04:45:58.376414+0000","last_clean":"2023-10-06T04:45:58.376414+0000","last_became_active":"2023-10-06T04:45:58.376107+0000","last_became_peered":"2023-10-06T04:45:58.376107+0000","last_unstale":"2023-10-06T04:45:58.376414+0000","last_undegraded":"2023-10-06T04:45:58.376414+0000","last_fullsized":"2023-10-06T04:45:58.376414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:25:56.264481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363935+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:43.030244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382839+0000","last_change":"2023-10-06T04:45:58.382839+0000","last_active":"2023-10-06T04:45:58.382839+0000","last_peered":"2023-10-06T04:45:58.382839+0000","last_clean":"2023-10-06T04:45:58.382839+0000","last_became_active":"2023-10-06T04:45:58.382554+0000","last_became_peered":"2023-10-06T04:45:58.382554+0000","last_unstale":"2023-10-06T04:45:58.382839+0000","last_undegraded":"2023-10-06T04:45:58.382839+0000","last_fullsized":"2023-10-06T04:45:58.382839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:10.467291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.373345+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379403+0000","last_change":"2023-10-06T04:45:58.379403+0000","last_active":"2023-10-06T04:45:58.379403+0000","last_peered":"2023-10-06T04:45:58.379403+0000","last_clean":"2023-10-06T04:45:58.379403+0000","last_became_active":"2023-10-06T04:45:58.379136+0000","last_became_peered":"2023-10-06T04:45:58.379136+0000","last_unstale":"2023-10-06T04:45:58.379403+0000","last_undegraded":"2023-10-06T04:45:58.379403+0000","last_fullsized":"2023-10-06T04:45:58.379403+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:33.707670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361359+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.387517+0000","last_change":"2023-10-06T04:45:58.387517+0000","last_active":"2023-10-06T04:45:58.387517+0000","last_peered":"2023-10-06T04:45:58.387517+0000","last_clean":"2023-10-06T04:45:58.387517+0000","last_became_active":"2023-10-06T04:45:58.387130+0000","last_became_peered":"2023-10-06T04:45:58.387130+0000","last_unstale":"2023-10-06T04:45:58.387517+0000","last_undegraded":"2023-10-06T04:45:58.387517+0000","last_fullsized":"2023-10-06T04:45:58.387517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:33.935139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368375+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:28.724681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.378636+0000","last_change":"2023-10-06T04:45:58.378636+0000","last_active":"2023-10-06T04:45:58.378636+0000","last_peered":"2023-10-06T04:45:58.378636+0000","last_clean":"2023-10-06T04:45:58.378636+0000","last_became_active":"2023-10-06T04:45:58.378361+0000","last_became_peered":"2023-10-06T04:45:58.378361+0000","last_unstale":"2023-10-06T04:45:58.378636+0000","last_undegraded":"2023-10-06T04:45:58.378636+0000","last_fullsized":"2023-10-06T04:45:58.378636+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:57.005759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366918+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376514+0000","last_change":"2023-10-06T04:45:58.376514+0000","last_active":"2023-10-06T04:45:58.376514+0000","last_peered":"2023-10-06T04:45:58.376514+0000","last_clean":"2023-10-06T04:45:58.376514+0000","last_became_active":"2023-10-06T04:45:58.376268+0000","last_became_peered":"2023-10-06T04:45:58.376268+0000","last_unstale":"2023-10-06T04:45:58.376514+0000","last_undegraded":"2023-10-06T04:45:58.376514+0000","last_fullsized":"2023-10-06T04:45:58.376514+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:27.755364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361447+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.383472+0000","last_change":"2023-10-06T04:45:58.383472+0000","last_active":"2023-10-06T04:45:58.383472+0000","last_peered":"2023-10-06T04:45:58.383472+0000","last_clean":"2023-10-06T04:45:58.383472+0000","last_became_active":"2023-10-06T04:45:58.383157+0000","last_became_peered":"2023-10-06T04:45:58.383157+0000","last_unstale":"2023-10-06T04:45:58.383472+0000","last_undegraded":"2023-10-06T04:45:58.383472+0000","last_fullsized":"2023-10-06T04:45:58.383472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:07.547228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371157+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:02:47.648706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.387194+0000","last_change":"2023-10-06T04:45:58.387194+0000","last_active":"2023-10-06T04:45:58.387194+0000","last_peered":"2023-10-06T04:45:58.387194+0000","last_clean":"2023-10-06T04:45:58.387194+0000","last_became_active":"2023-10-06T04:45:58.386895+0000","last_became_peered":"2023-10-06T04:45:58.386895+0000","last_unstale":"2023-10-06T04:45:58.387194+0000","last_undegraded":"2023-10-06T04:45:58.387194+0000","last_fullsized":"2023-10-06T04:45:58.387194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.409964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368398+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379458+0000","last_change":"2023-10-06T04:45:58.379458+0000","last_active":"2023-10-06T04:45:58.379458+0000","last_peered":"2023-10-06T04:45:58.379458+0000","last_clean":"2023-10-06T04:45:58.379458+0000","last_became_active":"2023-10-06T04:45:58.379126+0000","last_became_peered":"2023-10-06T04:45:58.379126+0000","last_unstale":"2023-10-06T04:45:58.379458+0000","last_undegraded":"2023-10-06T04:45:58.379458+0000","last_fullsized":"2023-10-06T04:45:58.379458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:04.264347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371752+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:52.019869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.373073+0000","last_change":"2023-10-06T04:45:58.373073+0000","last_active":"2023-10-06T04:45:58.373073+0000","last_peered":"2023-10-06T04:45:58.373073+0000","last_clean":"2023-10-06T04:45:58.373073+0000","last_became_active":"2023-10-06T04:45:58.372806+0000","last_became_peered":"2023-10-06T04:45:58.372806+0000","last_unstale":"2023-10-06T04:45:58.373073+0000","last_undegraded":"2023-10-06T04:45:58.373073+0000","last_fullsized":"2023-10-06T04:45:58.373073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:20.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.370917+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:42.035682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386284+0000","last_change":"2023-10-06T04:45:58.386284+0000","last_active":"2023-10-06T04:45:58.386284+0000","last_peered":"2023-10-06T04:45:58.386284+0000","last_clean":"2023-10-06T04:45:58.386284+0000","last_became_active":"2023-10-06T04:45:58.385929+0000","last_became_peered":"2023-10-06T04:45:58.385929+0000","last_unstale":"2023-10-06T04:45:58.386284+0000","last_undegraded":"2023-10-06T04:45:58.386284+0000","last_fullsized":"2023-10-06T04:45:58.386284+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:21.483289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362124+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:51.096604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.371421+0000","last_change":"2023-10-06T04:45:58.371421+0000","last_active":"2023-10-06T04:45:58.371421+0000","last_peered":"2023-10-06T04:45:58.371421+0000","last_clean":"2023-10-06T04:45:58.371421+0000","last_became_active":"2023-10-06T04:45:58.371149+0000","last_became_peered":"2023-10-06T04:45:58.371149+0000","last_unstale":"2023-10-06T04:45:58.371421+0000","last_undegraded":"2023-10-06T04:45:58.371421+0000","last_fullsized":"2023-10-06T04:45:58.371421+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:48.703741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368327+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.377285+0000","last_change":"2023-10-06T04:45:58.377285+0000","last_active":"2023-10-06T04:45:58.377285+0000","last_peered":"2023-10-06T04:45:58.377285+0000","last_clean":"2023-10-06T04:45:58.377285+0000","last_became_active":"2023-10-06T04:45:58.376985+0000","last_became_peered":"2023-10-06T04:45:58.376985+0000","last_unstale":"2023-10-06T04:45:58.377285+0000","last_undegraded":"2023-10-06T04:45:58.377285+0000","last_fullsized":"2023-10-06T04:45:58.377285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:40.662514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362393+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:25.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.384543+0000","last_change":"2023-10-06T04:45:58.384543+0000","last_active":"2023-10-06T04:45:58.384543+0000","last_peered":"2023-10-06T04:45:58.384543+0000","last_clean":"2023-10-06T04:45:58.384543+0000","last_became_active":"2023-10-06T04:45:58.384231+0000","last_became_peered":"2023-10-06T04:45:58.384231+0000","last_unstale":"2023-10-06T04:45:58.384543+0000","last_undegraded":"2023-10-06T04:45:58.384543+0000","last_fullsized":"2023-10-06T04:45:58.384543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:12.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360333+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:21.379661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.367446+0000","last_change":"2023-10-06T04:45:58.367446+0000","last_active":"2023-10-06T04:45:58.367446+0000","last_peered":"2023-10-06T04:45:58.367446+0000","last_clean":"2023-10-06T04:45:58.367446+0000","last_became_active":"2023-10-06T04:45:58.367205+0000","last_became_peered":"2023-10-06T04:45:58.367205+0000","last_unstale":"2023-10-06T04:45:58.367446+0000","last_undegraded":"2023-10-06T04:45:58.367446+0000","last_fullsized":"2023-10-06T04:45:58.367446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:57.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368698+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:26.322862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374574+0000","last_change":"2023-10-06T04:45:58.374574+0000","last_active":"2023-10-06T04:45:58.374574+0000","last_peered":"2023-10-06T04:45:58.374574+0000","last_clean":"2023-10-06T04:45:58.374574+0000","last_became_active":"2023-10-06T04:45:58.374324+0000","last_became_peered":"2023-10-06T04:45:58.374324+0000","last_unstale":"2023-10-06T04:45:58.374574+0000","last_undegraded":"2023-10-06T04:45:58.374574+0000","last_fullsized":"2023-10-06T04:45:58.374574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:34.789813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368972+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:35.027796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386145+0000","last_change":"2023-10-06T04:45:58.386145+0000","last_active":"2023-10-06T04:45:58.386145+0000","last_peered":"2023-10-06T04:45:58.386145+0000","last_clean":"2023-10-06T04:45:58.386145+0000","last_became_active":"2023-10-06T04:45:58.385854+0000","last_became_peered":"2023-10-06T04:45:58.385854+0000","last_unstale":"2023-10-06T04:45:58.386145+0000","last_undegraded":"2023-10-06T04:45:58.386145+0000","last_fullsized":"2023-10-06T04:45:58.386145+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:17.470610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362204+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:34.684364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374747+0000","last_change":"2023-10-06T04:45:58.374747+0000","last_active":"2023-10-06T04:45:58.374747+0000","last_peered":"2023-10-06T04:45:58.374747+0000","last_clean":"2023-10-06T04:45:58.374747+0000","last_became_active":"2023-10-06T04:45:58.374335+0000","last_became_peered":"2023-10-06T04:45:58.374335+0000","last_unstale":"2023-10-06T04:45:58.374747+0000","last_undegraded":"2023-10-06T04:45:58.374747+0000","last_fullsized":"2023-10-06T04:45:58.374747+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:24.483593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368231+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:14.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.377103+0000","last_change":"2023-10-06T04:45:58.377103+0000","last_active":"2023-10-06T04:45:58.377103+0000","last_peered":"2023-10-06T04:45:58.377103+0000","last_clean":"2023-10-06T04:45:58.377103+0000","last_became_active":"2023-10-06T04:45:58.376840+0000","last_became_peered":"2023-10-06T04:45:58.376840+0000","last_unstale":"2023-10-06T04:45:58.377103+0000","last_undegraded":"2023-10-06T04:45:58.377103+0000","last_fullsized":"2023-10-06T04:45:58.377103+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:42.023055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.359421+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:45:57.359421+0000","last_peered":"2023-10-06T04:45:57.359421+0000","last_clean":"2023-10-06T04:45:57.359421+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:45:57.359421+0000","last_undegraded":"2023-10-06T04:45:57.359421+0000","last_fullsized":"2023-10-06T04:45:57.359421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360331+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:05.341198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.378021+0000","last_change":"2023-10-06T04:45:58.378021+0000","last_active":"2023-10-06T04:45:58.378021+0000","last_peered":"2023-10-06T04:45:58.378021+0000","last_clean":"2023-10-06T04:45:58.378021+0000","last_became_active":"2023-10-06T04:45:58.377772+0000","last_became_peered":"2023-10-06T04:45:58.377772+0000","last_unstale":"2023-10-06T04:45:58.378021+0000","last_undegraded":"2023-10-06T04:45:58.378021+0000","last_fullsized":"2023-10-06T04:45:58.378021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:33.935139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.350807+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:45:57.350807+0000","last_peered":"2023-10-06T04:45:57.350807+0000","last_clean":"2023-10-06T04:45:57.350807+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:45:57.350807+0000","last_undegraded":"2023-10-06T04:45:57.350807+0000","last_fullsized":"2023-10-06T04:45:57.350807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362012+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:04.481543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382369+0000","last_change":"2023-10-06T04:45:58.382369+0000","last_active":"2023-10-06T04:45:58.382369+0000","last_peered":"2023-10-06T04:45:58.382369+0000","last_clean":"2023-10-06T04:45:58.382369+0000","last_became_active":"2023-10-06T04:45:58.382110+0000","last_became_peered":"2023-10-06T04:45:58.382110+0000","last_unstale":"2023-10-06T04:45:58.382369+0000","last_undegraded":"2023-10-06T04:45:58.382369+0000","last_fullsized":"2023-10-06T04:45:58.382369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:03.339842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356286+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:45:57.356286+0000","last_peered":"2023-10-06T04:45:57.356286+0000","last_clean":"2023-10-06T04:45:57.356286+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:45:57.356286+0000","last_undegraded":"2023-10-06T04:45:57.356286+0000","last_fullsized":"2023-10-06T04:45:57.356286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353195+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:45:57.353195+0000","last_peered":"2023-10-06T04:45:57.353195+0000","last_clean":"2023-10-06T04:45:57.353195+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:45:57.353195+0000","last_undegraded":"2023-10-06T04:45:57.353195+0000","last_fullsized":"2023-10-06T04:45:57.353195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371377+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:07.505833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382973+0000","last_change":"2023-10-06T04:45:58.382973+0000","last_active":"2023-10-06T04:45:58.382973+0000","last_peered":"2023-10-06T04:45:58.382973+0000","last_clean":"2023-10-06T04:45:58.382973+0000","last_became_active":"2023-10-06T04:45:58.382252+0000","last_became_peered":"2023-10-06T04:45:58.382252+0000","last_unstale":"2023-10-06T04:45:58.382973+0000","last_undegraded":"2023-10-06T04:45:58.382973+0000","last_fullsized":"2023-10-06T04:45:58.382973+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.222034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353374+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:45:57.353374+0000","last_peered":"2023-10-06T04:45:57.353374+0000","last_clean":"2023-10-06T04:45:57.353374+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:45:57.353374+0000","last_undegraded":"2023-10-06T04:45:57.353374+0000","last_fullsized":"2023-10-06T04:45:57.353374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367254+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:29.918962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382870+0000","last_change":"2023-10-06T04:45:58.382870+0000","last_active":"2023-10-06T04:45:58.382870+0000","last_peered":"2023-10-06T04:45:58.382870+0000","last_clean":"2023-10-06T04:45:58.382870+0000","last_became_active":"2023-10-06T04:45:58.382617+0000","last_became_peered":"2023-10-06T04:45:58.382617+0000","last_unstale":"2023-10-06T04:45:58.382870+0000","last_undegraded":"2023-10-06T04:45:58.382870+0000","last_fullsized":"2023-10-06T04:45:58.382870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:16.905907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353103+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:45:57.353103+0000","last_peered":"2023-10-06T04:45:57.353103+0000","last_clean":"2023-10-06T04:45:57.353103+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:45:57.353103+0000","last_undegraded":"2023-10-06T04:45:57.353103+0000","last_fullsized":"2023-10-06T04:45:57.353103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360331+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:43.030244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.383128+0000","last_change":"2023-10-06T04:45:58.383128+0000","last_active":"2023-10-06T04:45:58.383128+0000","last_peered":"2023-10-06T04:45:58.383128+0000","last_clean":"2023-10-06T04:45:58.383128+0000","last_became_active":"2023-10-06T04:45:58.382791+0000","last_became_peered":"2023-10-06T04:45:58.382791+0000","last_unstale":"2023-10-06T04:45:58.383128+0000","last_undegraded":"2023-10-06T04:45:58.383128+0000","last_fullsized":"2023-10-06T04:45:58.383128+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:42.436503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353293+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:45:57.353293+0000","last_peered":"2023-10-06T04:45:57.353293+0000","last_clean":"2023-10-06T04:45:57.353293+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:45:57.353293+0000","last_undegraded":"2023-10-06T04:45:57.353293+0000","last_fullsized":"2023-10-06T04:45:57.353293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369320+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:13.933274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374674+0000","last_change":"2023-10-06T04:45:58.374674+0000","last_active":"2023-10-06T04:45:58.374674+0000","last_peered":"2023-10-06T04:45:58.374674+0000","last_clean":"2023-10-06T04:45:58.374674+0000","last_became_active":"2023-10-06T04:45:58.374405+0000","last_became_peered":"2023-10-06T04:45:58.374405+0000","last_unstale":"2023-10-06T04:45:58.374674+0000","last_undegraded":"2023-10-06T04:45:58.374674+0000","last_fullsized":"2023-10-06T04:45:58.374674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:21.225714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356554+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:45:57.356554+0000","last_peered":"2023-10-06T04:45:57.356554+0000","last_clean":"2023-10-06T04:45:57.356554+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:45:57.356554+0000","last_undegraded":"2023-10-06T04:45:57.356554+0000","last_fullsized":"2023-10-06T04:45:57.356554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369495+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:04.457930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.384839+0000","last_change":"2023-10-06T04:45:58.384839+0000","last_active":"2023-10-06T04:45:58.384839+0000","last_peered":"2023-10-06T04:45:58.384839+0000","last_clean":"2023-10-06T04:45:58.384839+0000","last_became_active":"2023-10-06T04:45:58.384520+0000","last_became_peered":"2023-10-06T04:45:58.384520+0000","last_unstale":"2023-10-06T04:45:58.384839+0000","last_undegraded":"2023-10-06T04:45:58.384839+0000","last_fullsized":"2023-10-06T04:45:58.384839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:20.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356665+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:45:57.356665+0000","last_peered":"2023-10-06T04:45:57.356665+0000","last_clean":"2023-10-06T04:45:57.356665+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:45:57.356665+0000","last_undegraded":"2023-10-06T04:45:57.356665+0000","last_fullsized":"2023-10-06T04:45:57.356665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":797945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.3070000000000004,"5min":9.3070000000000004,"15min":9.3070000000000004},"last":0.501},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.2129999999999992,"5min":9.2129999999999992,"15min":9.2129999999999992},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.626},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":9.0850000000000009,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":9.0969999999999995},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.748}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67300000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.81200000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":797945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.2509999999999994,"5min":9.2509999999999994,"15min":9.2509999999999994},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":6.4000000000000004,"5min":6.4000000000000004,"15min":6.4000000000000004},"last":0.497},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.4450000000000003,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.81499999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.97099999999999997},{"interface":"front","average":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":19.992999999999999,"5min":19.992999999999999,"15min":19.992999999999999},"last":0.86699999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":6.476,"5min":6.476,"15min":6.476},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.9050000000000002,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.93799999999999994}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":2.056,"5min":2.056,"15min":2.056},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":19.960999999999999,"5min":19.960999999999999,"15min":19.960999999999999},"last":0.82099999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.70999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":11.241,"5min":11.241,"15min":11.241},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.442},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.273,"5min":11.273,"15min":11.273},"last":0.5}]},{"osd":3,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":11.125999999999999,"5min":11.125999999999999,"15min":11.125999999999999},"last":0.97099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":11.208,"5min":11.208,"15min":11.208},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":5.327,"5min":5.327,"15min":5.327},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.755}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.504},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65700000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.749}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.873}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.752},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.626},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:46:03.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:46:03.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.934+0000 7f4b4fbff700 1 Processor -- start 2023-10-06T04:46:03.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.934+0000 7f4b4fbff700 1 -- start start 2023-10-06T04:46:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.935+0000 7f4b4fbff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b480cae80 0x7f4b480cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.935+0000 7f4b4fbff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b480c1d10 con 0x7f4b480ccec0 2023-10-06T04:46:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.935+0000 7f4b4fbff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b480688a0 con 0x7f4b481598e0 2023-10-06T04:46:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.935+0000 7f4b4fbff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b480cd430 con 0x7f4b480cae80 2023-10-06T04:46:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.935+0000 7f4b4d99b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b480cae80 0x7f4b480cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.935+0000 7f4b4d19a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f4b480ccec0 0x7f4b481591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53480/0 (socket says 172.21.15.124:53480) 2023-10-06T04:46:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.936+0000 7f4b4d19a700 1 -- 172.21.15.124:0/114367368 learned_addr learned my addr 172.21.15.124:0/114367368 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:46:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.936+0000 7f4b4d99b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b480cae80 0x7f4b480cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60744/0 (socket says 172.21.15.124:60744) 2023-10-06T04:46:03.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.936+0000 7f4b4d99b700 1 -- 172.21.15.124:0/114367368 >> v1:172.21.15.158:6789/0 conn(0x7f4b481598e0 legacy=0x7f4b480afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.936+0000 7f4b4d99b700 1 -- 172.21.15.124:0/114367368 >> v1:172.21.15.124:6789/0 conn(0x7f4b480ccec0 legacy=0x7f4b481591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.936+0000 7f4b4d99b700 1 -- 172.21.15.124:0/114367368 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b48068b80 con 0x7f4b480cae80 2023-10-06T04:46:03.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.936+0000 7f4b4c999700 1 -- 172.21.15.124:0/114367368 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40461368 0 0) 0x7f4b480c1d10 con 0x7f4b480ccec0 2023-10-06T04:46:03.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.936+0000 7f4b4d99b700 1 --2- 172.21.15.124:0/114367368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 0x7f4b480cc980 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b440098e0 tx=0x7f4b440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391b5fd083f221a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:03.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.936+0000 7f4b4c999700 1 -- 172.21.15.124:0/114367368 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44009e80 con 0x7f4b480cae80 2023-10-06T04:46:03.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.936+0000 7f4b4c999700 1 -- 172.21.15.124:0/114367368 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4400b860 con 0x7f4b480cae80 2023-10-06T04:46:03.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.936+0000 7f4b4c999700 1 -- 172.21.15.124:0/114367368 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400bbe0 con 0x7f4b480cae80 2023-10-06T04:46:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.937+0000 7f4b4fbff700 1 -- 172.21.15.124:0/114367368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 msgr2=0x7f4b480cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.937+0000 7f4b4fbff700 1 --2- 172.21.15.124:0/114367368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 0x7f4b480cc980 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b440098e0 tx=0x7f4b440091a0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.937+0000 7f4b4fbff700 1 -- 172.21.15.124:0/114367368 shutdown_connections 2023-10-06T04:46:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.937+0000 7f4b4fbff700 1 --2- 172.21.15.124:0/114367368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 0x7f4b480cc980 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.937+0000 7f4b4fbff700 1 -- 172.21.15.124:0/114367368 >> 172.21.15.124:0/114367368 conn(0x7f4b480974f0 msgr2=0x7f4b480639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.937+0000 7f4b4fbff700 1 -- 172.21.15.124:0/114367368 shutdown_connections 2023-10-06T04:46:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.937+0000 7f4b4fbff700 1 -- 172.21.15.124:0/114367368 wait complete. 2023-10-06T04:46:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.938+0000 7f4b4fbff700 1 Processor -- start 2023-10-06T04:46:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.939+0000 7f4b4fbff700 1 -- start start 2023-10-06T04:46:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.939+0000 7f4b4fbff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 0x7f4b4806ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.939+0000 7f4b4fbff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b480ccec0 0x7f4b4806cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.939+0000 7f4b4fbff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b481598e0 0x7f4b480c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.939+0000 7f4b4fbff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480c8170 con 0x7f4b480cae80 2023-10-06T04:46:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.939+0000 7f4b4fbff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480c7560 con 0x7f4b481598e0 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.939+0000 7f4b4fbff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480c7840 con 0x7f4b480ccec0 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d99b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 0x7f4b4806ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d99b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 0x7f4b4806ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60752/0 (socket says 172.21.15.124:60752) 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d99b700 1 -- 172.21.15.124:0/886064640 learned_addr learned my addr 172.21.15.124:0/886064640 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d19a700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b480ccec0 0x7f4b4806cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4e19c700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b481598e0 0x7f4b480c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d99b700 1 -- 172.21.15.124:0/886064640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b480ccec0 msgr2=0x7f4b4806cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d99b700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b480ccec0 0x7f4b4806cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d99b700 1 -- 172.21.15.124:0/886064640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b481598e0 msgr2=0x7f4b480c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d99b700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b481598e0 0x7f4b480c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d99b700 1 -- 172.21.15.124:0/886064640 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44009420 con 0x7f4b480cae80 2023-10-06T04:46:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d19a700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b480ccec0 0x7f4b4806cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4e19c700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b481598e0 0x7f4b480c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.940+0000 7f4b4d99b700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 0x7f4b4806ca20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4b480641d0 tx=0x7f4b44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.941+0000 7f4b3dffb700 1 -- 172.21.15.124:0/886064640 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4401f070 con 0x7f4b480cae80 2023-10-06T04:46:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.941+0000 7f4b3dffb700 1 -- 172.21.15.124:0/886064640 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44011420 con 0x7f4b480cae80 2023-10-06T04:46:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.941+0000 7f4b3dffb700 1 -- 172.21.15.124:0/886064640 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400bbe0 con 0x7f4b480cae80 2023-10-06T04:46:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.941+0000 7f4b4fbff700 1 -- 172.21.15.124:0/886064640 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b480c7b20 con 0x7f4b480cae80 2023-10-06T04:46:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.941+0000 7f4b4fbff700 1 -- 172.21.15.124:0/886064640 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b48158840 con 0x7f4b480cae80 2023-10-06T04:46:03.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.942+0000 7f4b4fbff700 1 -- 172.21.15.124:0/886064640 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b480717a0 con 0x7f4b480cae80 2023-10-06T04:46:03.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.943+0000 7f4b3dffb700 1 -- 172.21.15.124:0/886064640 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b44011a50 con 0x7f4b480cae80 2023-10-06T04:46:03.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.943+0000 7f4b3dffb700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4b2c066f30 0x7f4b2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:03.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.943+0000 7f4b3dffb700 1 -- 172.21.15.124:0/886064640 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4b44085d60 con 0x7f4b480cae80 2023-10-06T04:46:03.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.944+0000 7f4b4d19a700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4b2c066f30 0x7f4b2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:03.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.944+0000 7f4b4d19a700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4b2c066f30 0x7f4b2c0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4b480b1d10 tx=0x7f4b38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:03.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:03.947+0000 7f4b3dffb700 1 -- 172.21.15.124:0/886064640 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b44052dd0 con 0x7f4b480cae80 2023-10-06T04:46:04.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.131+0000 7f4b4fbff700 1 -- 172.21.15.124:0/886064640 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b480c82b0 con 0x7f4b2c066f30 2023-10-06T04:46:04.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.140+0000 7f4b3dffb700 1 -- 172.21.15.124:0/886064640 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308330 (secure 0 0 0) 0x7f4b38001d70 con 0x7f4b2c066f30 2023-10-06T04:46:04.145 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:46:04.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.144+0000 7f4b4fbff700 1 -- 172.21.15.124:0/886064640 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4b2c066f30 msgr2=0x7f4b2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.144+0000 7f4b4fbff700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4b2c066f30 0x7f4b2c0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4b480b1d10 tx=0x7f4b38009040 comp rx=0 tx=0).stop 2023-10-06T04:46:04.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.144+0000 7f4b4fbff700 1 -- 172.21.15.124:0/886064640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 msgr2=0x7f4b4806ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.144+0000 7f4b4fbff700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 0x7f4b4806ca20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4b480641d0 tx=0x7f4b44017000 comp rx=0 tx=0).stop 2023-10-06T04:46:04.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.144+0000 7f4b4fbff700 1 -- 172.21.15.124:0/886064640 shutdown_connections 2023-10-06T04:46:04.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.144+0000 7f4b4fbff700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b481598e0 0x7f4b480c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.144+0000 7f4b4fbff700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480cae80 0x7f4b4806ca20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.144+0000 7f4b4fbff700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4b2c066f30 0x7f4b2c0693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.144+0000 7f4b4fbff700 1 --2- 172.21.15.124:0/886064640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b480ccec0 0x7f4b4806cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.144+0000 7f4b4fbff700 1 -- 172.21.15.124:0/886064640 >> 172.21.15.124:0/886064640 conn(0x7f4b480974f0 msgr2=0x7f4b4806ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:04.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.145+0000 7f4b4fbff700 1 -- 172.21.15.124:0/886064640 shutdown_connections 2023-10-06T04:46:04.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.145+0000 7f4b4fbff700 1 -- 172.21.15.124:0/886064640 wait complete. 2023-10-06T04:46:04.149 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:46:04.163 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-10-06T04:46:03.924729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383332,"kb_used_data":5028,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591388,"statfs":{"total":773094113280,"available":770653581312,"internally_reserved":0,"allocated":5148672,"data_stored":2821504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001188"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365902+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:18.477799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364925+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:05.341198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.376689+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:58.073785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363691+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:22.232903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367500+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364087+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:25.603030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377258+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:25.669595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.372203+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:29.243247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369766+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:05.791456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362889+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:39.627784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367835+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:10.969828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368171+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365107+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:07.136795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377017+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:43.829007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363667+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:06.672386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365492+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:11.474480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377205+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:44.696218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364256+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:21.379661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.375224+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:50.429560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369047+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:48.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366996+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:00.063314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.370855+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368251+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:56.746843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371723+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:46.147015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.376055+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:51.081341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368877+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362478+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:30.092271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367940+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:45.556503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371516+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:02.855835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364276+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:34.942328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.375743+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:57.112135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361046+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363741+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376757+0000","last_change":"2023-10-06T04:45:58.376757+0000","last_active":"2023-10-06T04:45:58.376757+0000","last_peered":"2023-10-06T04:45:58.376757+0000","last_clean":"2023-10-06T04:45:58.376757+0000","last_became_active":"2023-10-06T04:45:58.376419+0000","last_became_peered":"2023-10-06T04:45:58.376419+0000","last_unstale":"2023-10-06T04:45:58.376757+0000","last_undegraded":"2023-10-06T04:45:58.376757+0000","last_fullsized":"2023-10-06T04:45:58.376757+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:02.868440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360346+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:34.942328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379050+0000","last_change":"2023-10-06T04:45:58.379050+0000","last_active":"2023-10-06T04:45:58.379050+0000","last_peered":"2023-10-06T04:45:58.379050+0000","last_clean":"2023-10-06T04:45:58.379050+0000","last_became_active":"2023-10-06T04:45:58.378772+0000","last_became_peered":"2023-10-06T04:45:58.378772+0000","last_unstale":"2023-10-06T04:45:58.379050+0000","last_undegraded":"2023-10-06T04:45:58.379050+0000","last_fullsized":"2023-10-06T04:45:58.379050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:08.306889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369542+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:27.358669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.373937+0000","last_change":"2023-10-06T04:45:58.373937+0000","last_active":"2023-10-06T04:45:58.373937+0000","last_peered":"2023-10-06T04:45:58.373937+0000","last_clean":"2023-10-06T04:45:58.373937+0000","last_became_active":"2023-10-06T04:45:58.373648+0000","last_became_peered":"2023-10-06T04:45:58.373648+0000","last_unstale":"2023-10-06T04:45:58.373937+0000","last_undegraded":"2023-10-06T04:45:58.373937+0000","last_fullsized":"2023-10-06T04:45:58.373937+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:57.993530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371882+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:42.683982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379222+0000","last_change":"2023-10-06T04:45:58.379222+0000","last_active":"2023-10-06T04:45:58.379222+0000","last_peered":"2023-10-06T04:45:58.379222+0000","last_clean":"2023-10-06T04:45:58.379222+0000","last_became_active":"2023-10-06T04:45:58.378814+0000","last_became_peered":"2023-10-06T04:45:58.378814+0000","last_unstale":"2023-10-06T04:45:58.379222+0000","last_undegraded":"2023-10-06T04:45:58.379222+0000","last_fullsized":"2023-10-06T04:45:58.379222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:50.379050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366974+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386102+0000","last_change":"2023-10-06T04:45:58.386102+0000","last_active":"2023-10-06T04:45:58.386102+0000","last_peered":"2023-10-06T04:45:58.386102+0000","last_clean":"2023-10-06T04:45:58.386102+0000","last_became_active":"2023-10-06T04:45:58.385833+0000","last_became_peered":"2023-10-06T04:45:58.385833+0000","last_unstale":"2023-10-06T04:45:58.386102+0000","last_undegraded":"2023-10-06T04:45:58.386102+0000","last_fullsized":"2023-10-06T04:45:58.386102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:21.167993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363799+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:35.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376488+0000","last_change":"2023-10-06T04:45:58.376488+0000","last_active":"2023-10-06T04:45:58.376488+0000","last_peered":"2023-10-06T04:45:58.376488+0000","last_clean":"2023-10-06T04:45:58.376488+0000","last_became_active":"2023-10-06T04:45:58.376235+0000","last_became_peered":"2023-10-06T04:45:58.376235+0000","last_unstale":"2023-10-06T04:45:58.376488+0000","last_undegraded":"2023-10-06T04:45:58.376488+0000","last_fullsized":"2023-10-06T04:45:58.376488+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:42.023055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367820+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376414+0000","last_change":"2023-10-06T04:45:58.376414+0000","last_active":"2023-10-06T04:45:58.376414+0000","last_peered":"2023-10-06T04:45:58.376414+0000","last_clean":"2023-10-06T04:45:58.376414+0000","last_became_active":"2023-10-06T04:45:58.376107+0000","last_became_peered":"2023-10-06T04:45:58.376107+0000","last_unstale":"2023-10-06T04:45:58.376414+0000","last_undegraded":"2023-10-06T04:45:58.376414+0000","last_fullsized":"2023-10-06T04:45:58.376414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:25:56.264481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363935+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:43.030244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382839+0000","last_change":"2023-10-06T04:45:58.382839+0000","last_active":"2023-10-06T04:45:58.382839+0000","last_peered":"2023-10-06T04:45:58.382839+0000","last_clean":"2023-10-06T04:45:58.382839+0000","last_became_active":"2023-10-06T04:45:58.382554+0000","last_became_peered":"2023-10-06T04:45:58.382554+0000","last_unstale":"2023-10-06T04:45:58.382839+0000","last_undegraded":"2023-10-06T04:45:58.382839+0000","last_fullsized":"2023-10-06T04:45:58.382839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:10.467291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.373345+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379403+0000","last_change":"2023-10-06T04:45:58.379403+0000","last_active":"2023-10-06T04:45:58.379403+0000","last_peered":"2023-10-06T04:45:58.379403+0000","last_clean":"2023-10-06T04:45:58.379403+0000","last_became_active":"2023-10-06T04:45:58.379136+0000","last_became_peered":"2023-10-06T04:45:58.379136+0000","last_unstale":"2023-10-06T04:45:58.379403+0000","last_undegraded":"2023-10-06T04:45:58.379403+0000","last_fullsized":"2023-10-06T04:45:58.379403+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:33.707670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361359+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.387517+0000","last_change":"2023-10-06T04:45:58.387517+0000","last_active":"2023-10-06T04:45:58.387517+0000","last_peered":"2023-10-06T04:45:58.387517+0000","last_clean":"2023-10-06T04:45:58.387517+0000","last_became_active":"2023-10-06T04:45:58.387130+0000","last_became_peered":"2023-10-06T04:45:58.387130+0000","last_unstale":"2023-10-06T04:45:58.387517+0000","last_undegraded":"2023-10-06T04:45:58.387517+0000","last_fullsized":"2023-10-06T04:45:58.387517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:33.935139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368375+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:28.724681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.378636+0000","last_change":"2023-10-06T04:45:58.378636+0000","last_active":"2023-10-06T04:45:58.378636+0000","last_peered":"2023-10-06T04:45:58.378636+0000","last_clean":"2023-10-06T04:45:58.378636+0000","last_became_active":"2023-10-06T04:45:58.378361+0000","last_became_peered":"2023-10-06T04:45:58.378361+0000","last_unstale":"2023-10-06T04:45:58.378636+0000","last_undegraded":"2023-10-06T04:45:58.378636+0000","last_fullsized":"2023-10-06T04:45:58.378636+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:57.005759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366918+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376514+0000","last_change":"2023-10-06T04:45:58.376514+0000","last_active":"2023-10-06T04:45:58.376514+0000","last_peered":"2023-10-06T04:45:58.376514+0000","last_clean":"2023-10-06T04:45:58.376514+0000","last_became_active":"2023-10-06T04:45:58.376268+0000","last_became_peered":"2023-10-06T04:45:58.376268+0000","last_unstale":"2023-10-06T04:45:58.376514+0000","last_undegraded":"2023-10-06T04:45:58.376514+0000","last_fullsized":"2023-10-06T04:45:58.376514+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:27.755364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361447+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.383472+0000","last_change":"2023-10-06T04:45:58.383472+0000","last_active":"2023-10-06T04:45:58.383472+0000","last_peered":"2023-10-06T04:45:58.383472+0000","last_clean":"2023-10-06T04:45:58.383472+0000","last_became_active":"2023-10-06T04:45:58.383157+0000","last_became_peered":"2023-10-06T04:45:58.383157+0000","last_unstale":"2023-10-06T04:45:58.383472+0000","last_undegraded":"2023-10-06T04:45:58.383472+0000","last_fullsized":"2023-10-06T04:45:58.383472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:07.547228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371157+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:02:47.648706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.387194+0000","last_change":"2023-10-06T04:45:58.387194+0000","last_active":"2023-10-06T04:45:58.387194+0000","last_peered":"2023-10-06T04:45:58.387194+0000","last_clean":"2023-10-06T04:45:58.387194+0000","last_became_active":"2023-10-06T04:45:58.386895+0000","last_became_peered":"2023-10-06T04:45:58.386895+0000","last_unstale":"2023-10-06T04:45:58.387194+0000","last_undegraded":"2023-10-06T04:45:58.387194+0000","last_fullsized":"2023-10-06T04:45:58.387194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.409964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368398+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379458+0000","last_change":"2023-10-06T04:45:58.379458+0000","last_active":"2023-10-06T04:45:58.379458+0000","last_peered":"2023-10-06T04:45:58.379458+0000","last_clean":"2023-10-06T04:45:58.379458+0000","last_became_active":"2023-10-06T04:45:58.379126+0000","last_became_peered":"2023-10-06T04:45:58.379126+0000","last_unstale":"2023-10-06T04:45:58.379458+0000","last_undegraded":"2023-10-06T04:45:58.379458+0000","last_fullsized":"2023-10-06T04:45:58.379458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:04.264347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371752+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:52.019869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.373073+0000","last_change":"2023-10-06T04:45:58.373073+0000","last_active":"2023-10-06T04:45:58.373073+0000","last_peered":"2023-10-06T04:45:58.373073+0000","last_clean":"2023-10-06T04:45:58.373073+0000","last_became_active":"2023-10-06T04:45:58.372806+0000","last_became_peered":"2023-10-06T04:45:58.372806+0000","last_unstale":"2023-10-06T04:45:58.373073+0000","last_undegraded":"2023-10-06T04:45:58.373073+0000","last_fullsized":"2023-10-06T04:45:58.373073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:20.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.370917+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:42.035682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386284+0000","last_change":"2023-10-06T04:45:58.386284+0000","last_active":"2023-10-06T04:45:58.386284+0000","last_peered":"2023-10-06T04:45:58.386284+0000","last_clean":"2023-10-06T04:45:58.386284+0000","last_became_active":"2023-10-06T04:45:58.385929+0000","last_became_peered":"2023-10-06T04:45:58.385929+0000","last_unstale":"2023-10-06T04:45:58.386284+0000","last_undegraded":"2023-10-06T04:45:58.386284+0000","last_fullsized":"2023-10-06T04:45:58.386284+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:21.483289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362124+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:51.096604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.371421+0000","last_change":"2023-10-06T04:45:58.371421+0000","last_active":"2023-10-06T04:45:58.371421+0000","last_peered":"2023-10-06T04:45:58.371421+0000","last_clean":"2023-10-06T04:45:58.371421+0000","last_became_active":"2023-10-06T04:45:58.371149+0000","last_became_peered":"2023-10-06T04:45:58.371149+0000","last_unstale":"2023-10-06T04:45:58.371421+0000","last_undegraded":"2023-10-06T04:45:58.371421+0000","last_fullsized":"2023-10-06T04:45:58.371421+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:48.703741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368327+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.377285+0000","last_change":"2023-10-06T04:45:58.377285+0000","last_active":"2023-10-06T04:45:58.377285+0000","last_peered":"2023-10-06T04:45:58.377285+0000","last_clean":"2023-10-06T04:45:58.377285+0000","last_became_active":"2023-10-06T04:45:58.376985+0000","last_became_peered":"2023-10-06T04:45:58.376985+0000","last_unstale":"2023-10-06T04:45:58.377285+0000","last_undegraded":"2023-10-06T04:45:58.377285+0000","last_fullsized":"2023-10-06T04:45:58.377285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:40.662514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362393+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:25.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.384543+0000","last_change":"2023-10-06T04:45:58.384543+0000","last_active":"2023-10-06T04:45:58.384543+0000","last_peered":"2023-10-06T04:45:58.384543+0000","last_clean":"2023-10-06T04:45:58.384543+0000","last_became_active":"2023-10-06T04:45:58.384231+0000","last_became_peered":"2023-10-06T04:45:58.384231+0000","last_unstale":"2023-10-06T04:45:58.384543+0000","last_undegraded":"2023-10-06T04:45:58.384543+0000","last_fullsized":"2023-10-06T04:45:58.384543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:12.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360333+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:21.379661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.367446+0000","last_change":"2023-10-06T04:45:58.367446+0000","last_active":"2023-10-06T04:45:58.367446+0000","last_peered":"2023-10-06T04:45:58.367446+0000","last_clean":"2023-10-06T04:45:58.367446+0000","last_became_active":"2023-10-06T04:45:58.367205+0000","last_became_peered":"2023-10-06T04:45:58.367205+0000","last_unstale":"2023-10-06T04:45:58.367446+0000","last_undegraded":"2023-10-06T04:45:58.367446+0000","last_fullsized":"2023-10-06T04:45:58.367446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:57.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368698+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:26.322862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374574+0000","last_change":"2023-10-06T04:45:58.374574+0000","last_active":"2023-10-06T04:45:58.374574+0000","last_peered":"2023-10-06T04:45:58.374574+0000","last_clean":"2023-10-06T04:45:58.374574+0000","last_became_active":"2023-10-06T04:45:58.374324+0000","last_became_peered":"2023-10-06T04:45:58.374324+0000","last_unstale":"2023-10-06T04:45:58.374574+0000","last_undegraded":"2023-10-06T04:45:58.374574+0000","last_fullsized":"2023-10-06T04:45:58.374574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:34.789813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368972+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:35.027796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386145+0000","last_change":"2023-10-06T04:45:58.386145+0000","last_active":"2023-10-06T04:45:58.386145+0000","last_peered":"2023-10-06T04:45:58.386145+0000","last_clean":"2023-10-06T04:45:58.386145+0000","last_became_active":"2023-10-06T04:45:58.385854+0000","last_became_peered":"2023-10-06T04:45:58.385854+0000","last_unstale":"2023-10-06T04:45:58.386145+0000","last_undegraded":"2023-10-06T04:45:58.386145+0000","last_fullsized":"2023-10-06T04:45:58.386145+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:17.470610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362204+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:34.684364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374747+0000","last_change":"2023-10-06T04:45:58.374747+0000","last_active":"2023-10-06T04:45:58.374747+0000","last_peered":"2023-10-06T04:45:58.374747+0000","last_clean":"2023-10-06T04:45:58.374747+0000","last_became_active":"2023-10-06T04:45:58.374335+0000","last_became_peered":"2023-10-06T04:45:58.374335+0000","last_unstale":"2023-10-06T04:45:58.374747+0000","last_undegraded":"2023-10-06T04:45:58.374747+0000","last_fullsized":"2023-10-06T04:45:58.374747+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:24.483593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368231+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:14.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.377103+0000","last_change":"2023-10-06T04:45:58.377103+0000","last_active":"2023-10-06T04:45:58.377103+0000","last_peered":"2023-10-06T04:45:58.377103+0000","last_clean":"2023-10-06T04:45:58.377103+0000","last_became_active":"2023-10-06T04:45:58.376840+0000","last_became_peered":"2023-10-06T04:45:58.376840+0000","last_unstale":"2023-10-06T04:45:58.377103+0000","last_undegraded":"2023-10-06T04:45:58.377103+0000","last_fullsized":"2023-10-06T04:45:58.377103+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:42.023055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.359421+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:45:57.359421+0000","last_peered":"2023-10-06T04:45:57.359421+0000","last_clean":"2023-10-06T04:45:57.359421+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:45:57.359421+0000","last_undegraded":"2023-10-06T04:45:57.359421+0000","last_fullsized":"2023-10-06T04:45:57.359421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360331+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:05.341198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.378021+0000","last_change":"2023-10-06T04:45:58.378021+0000","last_active":"2023-10-06T04:45:58.378021+0000","last_peered":"2023-10-06T04:45:58.378021+0000","last_clean":"2023-10-06T04:45:58.378021+0000","last_became_active":"2023-10-06T04:45:58.377772+0000","last_became_peered":"2023-10-06T04:45:58.377772+0000","last_unstale":"2023-10-06T04:45:58.378021+0000","last_undegraded":"2023-10-06T04:45:58.378021+0000","last_fullsized":"2023-10-06T04:45:58.378021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:33.935139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.350807+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:45:57.350807+0000","last_peered":"2023-10-06T04:45:57.350807+0000","last_clean":"2023-10-06T04:45:57.350807+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:45:57.350807+0000","last_undegraded":"2023-10-06T04:45:57.350807+0000","last_fullsized":"2023-10-06T04:45:57.350807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362012+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:04.481543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382369+0000","last_change":"2023-10-06T04:45:58.382369+0000","last_active":"2023-10-06T04:45:58.382369+0000","last_peered":"2023-10-06T04:45:58.382369+0000","last_clean":"2023-10-06T04:45:58.382369+0000","last_became_active":"2023-10-06T04:45:58.382110+0000","last_became_peered":"2023-10-06T04:45:58.382110+0000","last_unstale":"2023-10-06T04:45:58.382369+0000","last_undegraded":"2023-10-06T04:45:58.382369+0000","last_fullsized":"2023-10-06T04:45:58.382369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:03.339842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356286+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:45:57.356286+0000","last_peered":"2023-10-06T04:45:57.356286+0000","last_clean":"2023-10-06T04:45:57.356286+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:45:57.356286+0000","last_undegraded":"2023-10-06T04:45:57.356286+0000","last_fullsized":"2023-10-06T04:45:57.356286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353195+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:45:57.353195+0000","last_peered":"2023-10-06T04:45:57.353195+0000","last_clean":"2023-10-06T04:45:57.353195+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:45:57.353195+0000","last_undegraded":"2023-10-06T04:45:57.353195+0000","last_fullsized":"2023-10-06T04:45:57.353195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371377+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:07.505833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382973+0000","last_change":"2023-10-06T04:45:58.382973+0000","last_active":"2023-10-06T04:45:58.382973+0000","last_peered":"2023-10-06T04:45:58.382973+0000","last_clean":"2023-10-06T04:45:58.382973+0000","last_became_active":"2023-10-06T04:45:58.382252+0000","last_became_peered":"2023-10-06T04:45:58.382252+0000","last_unstale":"2023-10-06T04:45:58.382973+0000","last_undegraded":"2023-10-06T04:45:58.382973+0000","last_fullsized":"2023-10-06T04:45:58.382973+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.222034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353374+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:45:57.353374+0000","last_peered":"2023-10-06T04:45:57.353374+0000","last_clean":"2023-10-06T04:45:57.353374+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:45:57.353374+0000","last_undegraded":"2023-10-06T04:45:57.353374+0000","last_fullsized":"2023-10-06T04:45:57.353374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367254+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:29.918962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382870+0000","last_change":"2023-10-06T04:45:58.382870+0000","last_active":"2023-10-06T04:45:58.382870+0000","last_peered":"2023-10-06T04:45:58.382870+0000","last_clean":"2023-10-06T04:45:58.382870+0000","last_became_active":"2023-10-06T04:45:58.382617+0000","last_became_peered":"2023-10-06T04:45:58.382617+0000","last_unstale":"2023-10-06T04:45:58.382870+0000","last_undegraded":"2023-10-06T04:45:58.382870+0000","last_fullsized":"2023-10-06T04:45:58.382870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:16.905907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353103+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:45:57.353103+0000","last_peered":"2023-10-06T04:45:57.353103+0000","last_clean":"2023-10-06T04:45:57.353103+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:45:57.353103+0000","last_undegraded":"2023-10-06T04:45:57.353103+0000","last_fullsized":"2023-10-06T04:45:57.353103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360331+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:43.030244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.383128+0000","last_change":"2023-10-06T04:45:58.383128+0000","last_active":"2023-10-06T04:45:58.383128+0000","last_peered":"2023-10-06T04:45:58.383128+0000","last_clean":"2023-10-06T04:45:58.383128+0000","last_became_active":"2023-10-06T04:45:58.382791+0000","last_became_peered":"2023-10-06T04:45:58.382791+0000","last_unstale":"2023-10-06T04:45:58.383128+0000","last_undegraded":"2023-10-06T04:45:58.383128+0000","last_fullsized":"2023-10-06T04:45:58.383128+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:42.436503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353293+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:45:57.353293+0000","last_peered":"2023-10-06T04:45:57.353293+0000","last_clean":"2023-10-06T04:45:57.353293+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:45:57.353293+0000","last_undegraded":"2023-10-06T04:45:57.353293+0000","last_fullsized":"2023-10-06T04:45:57.353293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369320+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:13.933274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374674+0000","last_change":"2023-10-06T04:45:58.374674+0000","last_active":"2023-10-06T04:45:58.374674+0000","last_peered":"2023-10-06T04:45:58.374674+0000","last_clean":"2023-10-06T04:45:58.374674+0000","last_became_active":"2023-10-06T04:45:58.374405+0000","last_became_peered":"2023-10-06T04:45:58.374405+0000","last_unstale":"2023-10-06T04:45:58.374674+0000","last_undegraded":"2023-10-06T04:45:58.374674+0000","last_fullsized":"2023-10-06T04:45:58.374674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:21.225714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356554+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:45:57.356554+0000","last_peered":"2023-10-06T04:45:57.356554+0000","last_clean":"2023-10-06T04:45:57.356554+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:45:57.356554+0000","last_undegraded":"2023-10-06T04:45:57.356554+0000","last_fullsized":"2023-10-06T04:45:57.356554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369495+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:04.457930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.384839+0000","last_change":"2023-10-06T04:45:58.384839+0000","last_active":"2023-10-06T04:45:58.384839+0000","last_peered":"2023-10-06T04:45:58.384839+0000","last_clean":"2023-10-06T04:45:58.384839+0000","last_became_active":"2023-10-06T04:45:58.384520+0000","last_became_peered":"2023-10-06T04:45:58.384520+0000","last_unstale":"2023-10-06T04:45:58.384839+0000","last_undegraded":"2023-10-06T04:45:58.384839+0000","last_fullsized":"2023-10-06T04:45:58.384839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:20.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356665+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:45:57.356665+0000","last_peered":"2023-10-06T04:45:57.356665+0000","last_clean":"2023-10-06T04:45:57.356665+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:45:57.356665+0000","last_undegraded":"2023-10-06T04:45:57.356665+0000","last_fullsized":"2023-10-06T04:45:57.356665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":797945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.3070000000000004,"5min":9.3070000000000004,"15min":9.3070000000000004},"last":0.501},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.2129999999999992,"5min":9.2129999999999992,"15min":9.2129999999999992},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.626},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":9.0850000000000009,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":9.0969999999999995},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.748}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67300000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.81200000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":797945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.2509999999999994,"5min":9.2509999999999994,"15min":9.2509999999999994},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":6.4000000000000004,"5min":6.4000000000000004,"15min":6.4000000000000004},"last":0.497},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.4450000000000003,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.81499999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.97099999999999997},{"interface":"front","average":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":19.992999999999999,"5min":19.992999999999999,"15min":19.992999999999999},"last":0.86699999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":6.476,"5min":6.476,"15min":6.476},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.9050000000000002,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.93799999999999994}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":2.056,"5min":2.056,"15min":2.056},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":19.960999999999999,"5min":19.960999999999999,"15min":19.960999999999999},"last":0.82099999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.70999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":11.241,"5min":11.241,"15min":11.241},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.442},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.273,"5min":11.273,"15min":11.273},"last":0.5}]},{"osd":3,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":11.125999999999999,"5min":11.125999999999999,"15min":11.125999999999999},"last":0.97099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":11.208,"5min":11.208,"15min":11.208},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":5.327,"5min":5.327,"15min":5.327},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.755}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.504},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65700000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.749}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.873}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.752},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.626},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:46:04.171 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:46:04.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.392+0000 7fe2763ff700 1 Processor -- start 2023-10-06T04:46:04.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.393+0000 7fe2763ff700 1 -- start start 2023-10-06T04:46:04.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.394+0000 7fe2763ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe2700cae80 0x7fe2700cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.394+0000 7fe2763ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe2701598e0 0x7fe2700afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.394+0000 7fe2763ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2700c1d10 con 0x7fe2700ccec0 2023-10-06T04:46:04.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.394+0000 7fe2763ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700cd430 con 0x7fe2700cae80 2023-10-06T04:46:04.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.394+0000 7fe2763ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700688a0 con 0x7fe2701598e0 2023-10-06T04:46:04.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.394+0000 7fe26ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe2700cae80 0x7fe2700cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.394+0000 7fe26ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe2700cae80 0x7fe2700cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60756/0 (socket says 172.21.15.124:60756) 2023-10-06T04:46:04.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.394+0000 7fe26ffff700 1 -- 172.21.15.124:0/1708086647 learned_addr learned my addr 172.21.15.124:0/1708086647 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:04.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.394+0000 7fe27499c700 1 --2- 172.21.15.124:0/1708086647 >> v2:172.21.15.158:3300/0 conn(0x7fe2701598e0 0x7fe2700afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.395+0000 7fe26ffff700 1 -- 172.21.15.124:0/1708086647 >> v2:172.21.15.158:3300/0 conn(0x7fe2701598e0 msgr2=0x7fe2700afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:04.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.395+0000 7fe26ffff700 1 --2- 172.21.15.124:0/1708086647 >> v2:172.21.15.158:3300/0 conn(0x7fe2701598e0 0x7fe2700afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.395+0000 7fe26ffff700 1 -- 172.21.15.124:0/1708086647 >> v1:172.21.15.158:6789/0 conn(0x7fe2700ccec0 legacy=0x7fe2701591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.395+0000 7fe26ffff700 1 -- 172.21.15.124:0/1708086647 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270068b80 con 0x7fe2700cae80 2023-10-06T04:46:04.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.395+0000 7fe26ffff700 1 --2- 172.21.15.124:0/1708086647 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 0x7fe2700cc980 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe2700c1ca0 tx=0x7fe260009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7376036cc3df8330 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:04.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.395+0000 7fe26f7fe700 1 -- 172.21.15.124:0/1708086647 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260009e70 con 0x7fe2700cae80 2023-10-06T04:46:04.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.395+0000 7fe26f7fe700 1 -- 172.21.15.124:0/1708086647 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26000b860 con 0x7fe2700cae80 2023-10-06T04:46:04.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.395+0000 7fe26f7fe700 1 -- 172.21.15.124:0/1708086647 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26000bc00 con 0x7fe2700cae80 2023-10-06T04:46:04.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.396+0000 7fe2763ff700 1 -- 172.21.15.124:0/1708086647 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 msgr2=0x7fe2700cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.396+0000 7fe2763ff700 1 --2- 172.21.15.124:0/1708086647 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 0x7fe2700cc980 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe2700c1ca0 tx=0x7fe260009250 comp rx=0 tx=0).stop 2023-10-06T04:46:04.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.396+0000 7fe2763ff700 1 -- 172.21.15.124:0/1708086647 shutdown_connections 2023-10-06T04:46:04.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.396+0000 7fe2763ff700 1 --2- 172.21.15.124:0/1708086647 >> v2:172.21.15.158:3300/0 conn(0x7fe2701598e0 0x7fe2700afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.396+0000 7fe2763ff700 1 --2- 172.21.15.124:0/1708086647 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 0x7fe2700cc980 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.396+0000 7fe2763ff700 1 -- 172.21.15.124:0/1708086647 >> 172.21.15.124:0/1708086647 conn(0x7fe2700974f0 msgr2=0x7fe2700639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:04.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.396+0000 7fe2763ff700 1 -- 172.21.15.124:0/1708086647 shutdown_connections 2023-10-06T04:46:04.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.396+0000 7fe2763ff700 1 -- 172.21.15.124:0/1708086647 wait complete. 2023-10-06T04:46:04.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.398+0000 7fe2763ff700 1 Processor -- start 2023-10-06T04:46:04.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.398+0000 7fe2763ff700 1 -- start start 2023-10-06T04:46:04.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe2763ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 0x7fe270069e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe2763ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2700ccec0 0x7fe2700c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe2763ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2701598e0 0x7fe2700c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe2763ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700c8070 con 0x7fe2700cae80 2023-10-06T04:46:04.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe2763ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700c73f0 con 0x7fe2700ccec0 2023-10-06T04:46:04.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe2763ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700c76d0 con 0x7fe2701598e0 2023-10-06T04:46:04.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe26ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 0x7fe270069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe26ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 0x7fe270069e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60766/0 (socket says 172.21.15.124:60766) 2023-10-06T04:46:04.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe26ffff700 1 -- 172.21.15.124:0/4196680689 learned_addr learned my addr 172.21.15.124:0/4196680689 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:04.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe267fff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2700ccec0 0x7fe2700c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe27499c700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2701598e0 0x7fe2700c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe26ffff700 1 -- 172.21.15.124:0/4196680689 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2701598e0 msgr2=0x7fe2700c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe26ffff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2701598e0 0x7fe2700c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe26ffff700 1 -- 172.21.15.124:0/4196680689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2700ccec0 msgr2=0x7fe2700c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe26ffff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2700ccec0 0x7fe2700c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe26ffff700 1 -- 172.21.15.124:0/4196680689 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600094f0 con 0x7fe2700cae80 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe27499c700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2701598e0 0x7fe2700c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.399+0000 7fe26ffff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 0x7fe270069e60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe2700641d0 tx=0x7fe260017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.400+0000 7fe26cff9700 1 -- 172.21.15.124:0/4196680689 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011420 con 0x7fe2700cae80 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.400+0000 7fe26cff9700 1 -- 172.21.15.124:0/4196680689 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe260011580 con 0x7fe2700cae80 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.400+0000 7fe2763ff700 1 -- 172.21.15.124:0/4196680689 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2700c79b0 con 0x7fe2700cae80 2023-10-06T04:46:04.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.400+0000 7fe26cff9700 1 -- 172.21.15.124:0/4196680689 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011940 con 0x7fe2700cae80 2023-10-06T04:46:04.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.400+0000 7fe2763ff700 1 -- 172.21.15.124:0/4196680689 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2700c7100 con 0x7fe2700cae80 2023-10-06T04:46:04.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.401+0000 7fe2763ff700 1 -- 172.21.15.124:0/4196680689 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2700717a0 con 0x7fe2700cae80 2023-10-06T04:46:04.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.402+0000 7fe26cff9700 1 -- 172.21.15.124:0/4196680689 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe26002c3b0 con 0x7fe2700cae80 2023-10-06T04:46:04.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.402+0000 7fe26cff9700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe250066f30 0x7fe2500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.403+0000 7fe26cff9700 1 -- 172.21.15.124:0/4196680689 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe260085cc0 con 0x7fe2700cae80 2023-10-06T04:46:04.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.403+0000 7fe267fff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe250066f30 0x7fe2500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.403+0000 7fe267fff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe250066f30 0x7fe2500693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe27006a8c0 tx=0x7fe258009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:04.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.407+0000 7fe26cff9700 1 -- 172.21.15.124:0/4196680689 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe26008c080 con 0x7fe2700cae80 2023-10-06T04:46:04.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.593+0000 7fe2763ff700 1 -- 172.21.15.124:0/4196680689 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2700c7e50 con 0x7fe250066f30 2023-10-06T04:46:04.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.602+0000 7fe26cff9700 1 -- 172.21.15.124:0/4196680689 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308330 (secure 0 0 0) 0x7fe258003d00 con 0x7fe250066f30 2023-10-06T04:46:04.607 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:46:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.606+0000 7fe2763ff700 1 -- 172.21.15.124:0/4196680689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe250066f30 msgr2=0x7fe2500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.606+0000 7fe2763ff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe250066f30 0x7fe2500693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe27006a8c0 tx=0x7fe258009040 comp rx=0 tx=0).stop 2023-10-06T04:46:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.606+0000 7fe2763ff700 1 -- 172.21.15.124:0/4196680689 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 msgr2=0x7fe270069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.606+0000 7fe2763ff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 0x7fe270069e60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe2700641d0 tx=0x7fe260017000 comp rx=0 tx=0).stop 2023-10-06T04:46:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.606+0000 7fe2763ff700 1 -- 172.21.15.124:0/4196680689 shutdown_connections 2023-10-06T04:46:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.606+0000 7fe2763ff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe250066f30 0x7fe2500693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.606+0000 7fe2763ff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2701598e0 0x7fe2700c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.606+0000 7fe2763ff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2700cae80 0x7fe270069e60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.606+0000 7fe2763ff700 1 --2- 172.21.15.124:0/4196680689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2700ccec0 0x7fe2700c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.606+0000 7fe2763ff700 1 -- 172.21.15.124:0/4196680689 >> 172.21.15.124:0/4196680689 conn(0x7fe2700974f0 msgr2=0x7fe27006cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.607+0000 7fe2763ff700 1 -- 172.21.15.124:0/4196680689 shutdown_connections 2023-10-06T04:46:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.607+0000 7fe2763ff700 1 -- 172.21.15.124:0/4196680689 wait complete. 2023-10-06T04:46:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:46:04.626 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-10-06T04:46:03.924729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383332,"kb_used_data":5028,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591388,"statfs":{"total":773094113280,"available":770653581312,"internally_reserved":0,"allocated":5148672,"data_stored":2821504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001188"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365902+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:18.477799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364925+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:05.341198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.376689+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:58.073785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363691+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:22.232903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367500+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364087+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:25.603030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377258+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:25.669595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.372203+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:29.243247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369766+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:05.791456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362889+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:39.627784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367835+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:10.969828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368171+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365107+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:07.136795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377017+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:43.829007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363667+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:06.672386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365492+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:11.474480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377205+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:44.696218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364256+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:21.379661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.375224+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:50.429560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369047+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:48.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366996+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:00.063314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.370855+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368251+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:56.746843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371723+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:46.147015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.376055+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:51.081341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368877+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362478+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:30.092271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367940+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:45.556503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371516+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:02.855835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364276+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:34.942328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.375743+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:57.112135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361046+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363741+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376757+0000","last_change":"2023-10-06T04:45:58.376757+0000","last_active":"2023-10-06T04:45:58.376757+0000","last_peered":"2023-10-06T04:45:58.376757+0000","last_clean":"2023-10-06T04:45:58.376757+0000","last_became_active":"2023-10-06T04:45:58.376419+0000","last_became_peered":"2023-10-06T04:45:58.376419+0000","last_unstale":"2023-10-06T04:45:58.376757+0000","last_undegraded":"2023-10-06T04:45:58.376757+0000","last_fullsized":"2023-10-06T04:45:58.376757+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:02.868440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360346+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:34.942328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379050+0000","last_change":"2023-10-06T04:45:58.379050+0000","last_active":"2023-10-06T04:45:58.379050+0000","last_peered":"2023-10-06T04:45:58.379050+0000","last_clean":"2023-10-06T04:45:58.379050+0000","last_became_active":"2023-10-06T04:45:58.378772+0000","last_became_peered":"2023-10-06T04:45:58.378772+0000","last_unstale":"2023-10-06T04:45:58.379050+0000","last_undegraded":"2023-10-06T04:45:58.379050+0000","last_fullsized":"2023-10-06T04:45:58.379050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:08.306889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369542+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:27.358669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.373937+0000","last_change":"2023-10-06T04:45:58.373937+0000","last_active":"2023-10-06T04:45:58.373937+0000","last_peered":"2023-10-06T04:45:58.373937+0000","last_clean":"2023-10-06T04:45:58.373937+0000","last_became_active":"2023-10-06T04:45:58.373648+0000","last_became_peered":"2023-10-06T04:45:58.373648+0000","last_unstale":"2023-10-06T04:45:58.373937+0000","last_undegraded":"2023-10-06T04:45:58.373937+0000","last_fullsized":"2023-10-06T04:45:58.373937+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:57.993530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371882+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:42.683982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379222+0000","last_change":"2023-10-06T04:45:58.379222+0000","last_active":"2023-10-06T04:45:58.379222+0000","last_peered":"2023-10-06T04:45:58.379222+0000","last_clean":"2023-10-06T04:45:58.379222+0000","last_became_active":"2023-10-06T04:45:58.378814+0000","last_became_peered":"2023-10-06T04:45:58.378814+0000","last_unstale":"2023-10-06T04:45:58.379222+0000","last_undegraded":"2023-10-06T04:45:58.379222+0000","last_fullsized":"2023-10-06T04:45:58.379222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:50.379050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366974+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386102+0000","last_change":"2023-10-06T04:45:58.386102+0000","last_active":"2023-10-06T04:45:58.386102+0000","last_peered":"2023-10-06T04:45:58.386102+0000","last_clean":"2023-10-06T04:45:58.386102+0000","last_became_active":"2023-10-06T04:45:58.385833+0000","last_became_peered":"2023-10-06T04:45:58.385833+0000","last_unstale":"2023-10-06T04:45:58.386102+0000","last_undegraded":"2023-10-06T04:45:58.386102+0000","last_fullsized":"2023-10-06T04:45:58.386102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:21.167993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363799+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:35.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376488+0000","last_change":"2023-10-06T04:45:58.376488+0000","last_active":"2023-10-06T04:45:58.376488+0000","last_peered":"2023-10-06T04:45:58.376488+0000","last_clean":"2023-10-06T04:45:58.376488+0000","last_became_active":"2023-10-06T04:45:58.376235+0000","last_became_peered":"2023-10-06T04:45:58.376235+0000","last_unstale":"2023-10-06T04:45:58.376488+0000","last_undegraded":"2023-10-06T04:45:58.376488+0000","last_fullsized":"2023-10-06T04:45:58.376488+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:42.023055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367820+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376414+0000","last_change":"2023-10-06T04:45:58.376414+0000","last_active":"2023-10-06T04:45:58.376414+0000","last_peered":"2023-10-06T04:45:58.376414+0000","last_clean":"2023-10-06T04:45:58.376414+0000","last_became_active":"2023-10-06T04:45:58.376107+0000","last_became_peered":"2023-10-06T04:45:58.376107+0000","last_unstale":"2023-10-06T04:45:58.376414+0000","last_undegraded":"2023-10-06T04:45:58.376414+0000","last_fullsized":"2023-10-06T04:45:58.376414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:25:56.264481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363935+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:43.030244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382839+0000","last_change":"2023-10-06T04:45:58.382839+0000","last_active":"2023-10-06T04:45:58.382839+0000","last_peered":"2023-10-06T04:45:58.382839+0000","last_clean":"2023-10-06T04:45:58.382839+0000","last_became_active":"2023-10-06T04:45:58.382554+0000","last_became_peered":"2023-10-06T04:45:58.382554+0000","last_unstale":"2023-10-06T04:45:58.382839+0000","last_undegraded":"2023-10-06T04:45:58.382839+0000","last_fullsized":"2023-10-06T04:45:58.382839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:10.467291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.373345+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379403+0000","last_change":"2023-10-06T04:45:58.379403+0000","last_active":"2023-10-06T04:45:58.379403+0000","last_peered":"2023-10-06T04:45:58.379403+0000","last_clean":"2023-10-06T04:45:58.379403+0000","last_became_active":"2023-10-06T04:45:58.379136+0000","last_became_peered":"2023-10-06T04:45:58.379136+0000","last_unstale":"2023-10-06T04:45:58.379403+0000","last_undegraded":"2023-10-06T04:45:58.379403+0000","last_fullsized":"2023-10-06T04:45:58.379403+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:33.707670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361359+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.387517+0000","last_change":"2023-10-06T04:45:58.387517+0000","last_active":"2023-10-06T04:45:58.387517+0000","last_peered":"2023-10-06T04:45:58.387517+0000","last_clean":"2023-10-06T04:45:58.387517+0000","last_became_active":"2023-10-06T04:45:58.387130+0000","last_became_peered":"2023-10-06T04:45:58.387130+0000","last_unstale":"2023-10-06T04:45:58.387517+0000","last_undegraded":"2023-10-06T04:45:58.387517+0000","last_fullsized":"2023-10-06T04:45:58.387517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:33.935139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368375+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:28.724681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.378636+0000","last_change":"2023-10-06T04:45:58.378636+0000","last_active":"2023-10-06T04:45:58.378636+0000","last_peered":"2023-10-06T04:45:58.378636+0000","last_clean":"2023-10-06T04:45:58.378636+0000","last_became_active":"2023-10-06T04:45:58.378361+0000","last_became_peered":"2023-10-06T04:45:58.378361+0000","last_unstale":"2023-10-06T04:45:58.378636+0000","last_undegraded":"2023-10-06T04:45:58.378636+0000","last_fullsized":"2023-10-06T04:45:58.378636+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:57.005759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366918+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376514+0000","last_change":"2023-10-06T04:45:58.376514+0000","last_active":"2023-10-06T04:45:58.376514+0000","last_peered":"2023-10-06T04:45:58.376514+0000","last_clean":"2023-10-06T04:45:58.376514+0000","last_became_active":"2023-10-06T04:45:58.376268+0000","last_became_peered":"2023-10-06T04:45:58.376268+0000","last_unstale":"2023-10-06T04:45:58.376514+0000","last_undegraded":"2023-10-06T04:45:58.376514+0000","last_fullsized":"2023-10-06T04:45:58.376514+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:27.755364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361447+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.383472+0000","last_change":"2023-10-06T04:45:58.383472+0000","last_active":"2023-10-06T04:45:58.383472+0000","last_peered":"2023-10-06T04:45:58.383472+0000","last_clean":"2023-10-06T04:45:58.383472+0000","last_became_active":"2023-10-06T04:45:58.383157+0000","last_became_peered":"2023-10-06T04:45:58.383157+0000","last_unstale":"2023-10-06T04:45:58.383472+0000","last_undegraded":"2023-10-06T04:45:58.383472+0000","last_fullsized":"2023-10-06T04:45:58.383472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:07.547228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371157+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:02:47.648706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.387194+0000","last_change":"2023-10-06T04:45:58.387194+0000","last_active":"2023-10-06T04:45:58.387194+0000","last_peered":"2023-10-06T04:45:58.387194+0000","last_clean":"2023-10-06T04:45:58.387194+0000","last_became_active":"2023-10-06T04:45:58.386895+0000","last_became_peered":"2023-10-06T04:45:58.386895+0000","last_unstale":"2023-10-06T04:45:58.387194+0000","last_undegraded":"2023-10-06T04:45:58.387194+0000","last_fullsized":"2023-10-06T04:45:58.387194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.409964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368398+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379458+0000","last_change":"2023-10-06T04:45:58.379458+0000","last_active":"2023-10-06T04:45:58.379458+0000","last_peered":"2023-10-06T04:45:58.379458+0000","last_clean":"2023-10-06T04:45:58.379458+0000","last_became_active":"2023-10-06T04:45:58.379126+0000","last_became_peered":"2023-10-06T04:45:58.379126+0000","last_unstale":"2023-10-06T04:45:58.379458+0000","last_undegraded":"2023-10-06T04:45:58.379458+0000","last_fullsized":"2023-10-06T04:45:58.379458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:04.264347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371752+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:52.019869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.373073+0000","last_change":"2023-10-06T04:45:58.373073+0000","last_active":"2023-10-06T04:45:58.373073+0000","last_peered":"2023-10-06T04:45:58.373073+0000","last_clean":"2023-10-06T04:45:58.373073+0000","last_became_active":"2023-10-06T04:45:58.372806+0000","last_became_peered":"2023-10-06T04:45:58.372806+0000","last_unstale":"2023-10-06T04:45:58.373073+0000","last_undegraded":"2023-10-06T04:45:58.373073+0000","last_fullsized":"2023-10-06T04:45:58.373073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:20.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.370917+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:42.035682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386284+0000","last_change":"2023-10-06T04:45:58.386284+0000","last_active":"2023-10-06T04:45:58.386284+0000","last_peered":"2023-10-06T04:45:58.386284+0000","last_clean":"2023-10-06T04:45:58.386284+0000","last_became_active":"2023-10-06T04:45:58.385929+0000","last_became_peered":"2023-10-06T04:45:58.385929+0000","last_unstale":"2023-10-06T04:45:58.386284+0000","last_undegraded":"2023-10-06T04:45:58.386284+0000","last_fullsized":"2023-10-06T04:45:58.386284+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:21.483289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362124+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:51.096604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.371421+0000","last_change":"2023-10-06T04:45:58.371421+0000","last_active":"2023-10-06T04:45:58.371421+0000","last_peered":"2023-10-06T04:45:58.371421+0000","last_clean":"2023-10-06T04:45:58.371421+0000","last_became_active":"2023-10-06T04:45:58.371149+0000","last_became_peered":"2023-10-06T04:45:58.371149+0000","last_unstale":"2023-10-06T04:45:58.371421+0000","last_undegraded":"2023-10-06T04:45:58.371421+0000","last_fullsized":"2023-10-06T04:45:58.371421+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:48.703741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368327+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.377285+0000","last_change":"2023-10-06T04:45:58.377285+0000","last_active":"2023-10-06T04:45:58.377285+0000","last_peered":"2023-10-06T04:45:58.377285+0000","last_clean":"2023-10-06T04:45:58.377285+0000","last_became_active":"2023-10-06T04:45:58.376985+0000","last_became_peered":"2023-10-06T04:45:58.376985+0000","last_unstale":"2023-10-06T04:45:58.377285+0000","last_undegraded":"2023-10-06T04:45:58.377285+0000","last_fullsized":"2023-10-06T04:45:58.377285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:40.662514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362393+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:25.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.384543+0000","last_change":"2023-10-06T04:45:58.384543+0000","last_active":"2023-10-06T04:45:58.384543+0000","last_peered":"2023-10-06T04:45:58.384543+0000","last_clean":"2023-10-06T04:45:58.384543+0000","last_became_active":"2023-10-06T04:45:58.384231+0000","last_became_peered":"2023-10-06T04:45:58.384231+0000","last_unstale":"2023-10-06T04:45:58.384543+0000","last_undegraded":"2023-10-06T04:45:58.384543+0000","last_fullsized":"2023-10-06T04:45:58.384543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:12.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360333+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:21.379661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.367446+0000","last_change":"2023-10-06T04:45:58.367446+0000","last_active":"2023-10-06T04:45:58.367446+0000","last_peered":"2023-10-06T04:45:58.367446+0000","last_clean":"2023-10-06T04:45:58.367446+0000","last_became_active":"2023-10-06T04:45:58.367205+0000","last_became_peered":"2023-10-06T04:45:58.367205+0000","last_unstale":"2023-10-06T04:45:58.367446+0000","last_undegraded":"2023-10-06T04:45:58.367446+0000","last_fullsized":"2023-10-06T04:45:58.367446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:57.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368698+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:26.322862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374574+0000","last_change":"2023-10-06T04:45:58.374574+0000","last_active":"2023-10-06T04:45:58.374574+0000","last_peered":"2023-10-06T04:45:58.374574+0000","last_clean":"2023-10-06T04:45:58.374574+0000","last_became_active":"2023-10-06T04:45:58.374324+0000","last_became_peered":"2023-10-06T04:45:58.374324+0000","last_unstale":"2023-10-06T04:45:58.374574+0000","last_undegraded":"2023-10-06T04:45:58.374574+0000","last_fullsized":"2023-10-06T04:45:58.374574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:34.789813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368972+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:35.027796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386145+0000","last_change":"2023-10-06T04:45:58.386145+0000","last_active":"2023-10-06T04:45:58.386145+0000","last_peered":"2023-10-06T04:45:58.386145+0000","last_clean":"2023-10-06T04:45:58.386145+0000","last_became_active":"2023-10-06T04:45:58.385854+0000","last_became_peered":"2023-10-06T04:45:58.385854+0000","last_unstale":"2023-10-06T04:45:58.386145+0000","last_undegraded":"2023-10-06T04:45:58.386145+0000","last_fullsized":"2023-10-06T04:45:58.386145+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:17.470610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362204+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:34.684364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374747+0000","last_change":"2023-10-06T04:45:58.374747+0000","last_active":"2023-10-06T04:45:58.374747+0000","last_peered":"2023-10-06T04:45:58.374747+0000","last_clean":"2023-10-06T04:45:58.374747+0000","last_became_active":"2023-10-06T04:45:58.374335+0000","last_became_peered":"2023-10-06T04:45:58.374335+0000","last_unstale":"2023-10-06T04:45:58.374747+0000","last_undegraded":"2023-10-06T04:45:58.374747+0000","last_fullsized":"2023-10-06T04:45:58.374747+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:24.483593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368231+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:14.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.377103+0000","last_change":"2023-10-06T04:45:58.377103+0000","last_active":"2023-10-06T04:45:58.377103+0000","last_peered":"2023-10-06T04:45:58.377103+0000","last_clean":"2023-10-06T04:45:58.377103+0000","last_became_active":"2023-10-06T04:45:58.376840+0000","last_became_peered":"2023-10-06T04:45:58.376840+0000","last_unstale":"2023-10-06T04:45:58.377103+0000","last_undegraded":"2023-10-06T04:45:58.377103+0000","last_fullsized":"2023-10-06T04:45:58.377103+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:42.023055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.359421+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:45:57.359421+0000","last_peered":"2023-10-06T04:45:57.359421+0000","last_clean":"2023-10-06T04:45:57.359421+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:45:57.359421+0000","last_undegraded":"2023-10-06T04:45:57.359421+0000","last_fullsized":"2023-10-06T04:45:57.359421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360331+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:05.341198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.378021+0000","last_change":"2023-10-06T04:45:58.378021+0000","last_active":"2023-10-06T04:45:58.378021+0000","last_peered":"2023-10-06T04:45:58.378021+0000","last_clean":"2023-10-06T04:45:58.378021+0000","last_became_active":"2023-10-06T04:45:58.377772+0000","last_became_peered":"2023-10-06T04:45:58.377772+0000","last_unstale":"2023-10-06T04:45:58.378021+0000","last_undegraded":"2023-10-06T04:45:58.378021+0000","last_fullsized":"2023-10-06T04:45:58.378021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:33.935139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.350807+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:45:57.350807+0000","last_peered":"2023-10-06T04:45:57.350807+0000","last_clean":"2023-10-06T04:45:57.350807+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:45:57.350807+0000","last_undegraded":"2023-10-06T04:45:57.350807+0000","last_fullsized":"2023-10-06T04:45:57.350807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362012+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:04.481543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382369+0000","last_change":"2023-10-06T04:45:58.382369+0000","last_active":"2023-10-06T04:45:58.382369+0000","last_peered":"2023-10-06T04:45:58.382369+0000","last_clean":"2023-10-06T04:45:58.382369+0000","last_became_active":"2023-10-06T04:45:58.382110+0000","last_became_peered":"2023-10-06T04:45:58.382110+0000","last_unstale":"2023-10-06T04:45:58.382369+0000","last_undegraded":"2023-10-06T04:45:58.382369+0000","last_fullsized":"2023-10-06T04:45:58.382369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:03.339842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356286+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:45:57.356286+0000","last_peered":"2023-10-06T04:45:57.356286+0000","last_clean":"2023-10-06T04:45:57.356286+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:45:57.356286+0000","last_undegraded":"2023-10-06T04:45:57.356286+0000","last_fullsized":"2023-10-06T04:45:57.356286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353195+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:45:57.353195+0000","last_peered":"2023-10-06T04:45:57.353195+0000","last_clean":"2023-10-06T04:45:57.353195+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:45:57.353195+0000","last_undegraded":"2023-10-06T04:45:57.353195+0000","last_fullsized":"2023-10-06T04:45:57.353195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371377+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:07.505833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382973+0000","last_change":"2023-10-06T04:45:58.382973+0000","last_active":"2023-10-06T04:45:58.382973+0000","last_peered":"2023-10-06T04:45:58.382973+0000","last_clean":"2023-10-06T04:45:58.382973+0000","last_became_active":"2023-10-06T04:45:58.382252+0000","last_became_peered":"2023-10-06T04:45:58.382252+0000","last_unstale":"2023-10-06T04:45:58.382973+0000","last_undegraded":"2023-10-06T04:45:58.382973+0000","last_fullsized":"2023-10-06T04:45:58.382973+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.222034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353374+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:45:57.353374+0000","last_peered":"2023-10-06T04:45:57.353374+0000","last_clean":"2023-10-06T04:45:57.353374+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:45:57.353374+0000","last_undegraded":"2023-10-06T04:45:57.353374+0000","last_fullsized":"2023-10-06T04:45:57.353374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367254+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:29.918962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382870+0000","last_change":"2023-10-06T04:45:58.382870+0000","last_active":"2023-10-06T04:45:58.382870+0000","last_peered":"2023-10-06T04:45:58.382870+0000","last_clean":"2023-10-06T04:45:58.382870+0000","last_became_active":"2023-10-06T04:45:58.382617+0000","last_became_peered":"2023-10-06T04:45:58.382617+0000","last_unstale":"2023-10-06T04:45:58.382870+0000","last_undegraded":"2023-10-06T04:45:58.382870+0000","last_fullsized":"2023-10-06T04:45:58.382870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:16.905907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353103+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:45:57.353103+0000","last_peered":"2023-10-06T04:45:57.353103+0000","last_clean":"2023-10-06T04:45:57.353103+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:45:57.353103+0000","last_undegraded":"2023-10-06T04:45:57.353103+0000","last_fullsized":"2023-10-06T04:45:57.353103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360331+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:43.030244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.383128+0000","last_change":"2023-10-06T04:45:58.383128+0000","last_active":"2023-10-06T04:45:58.383128+0000","last_peered":"2023-10-06T04:45:58.383128+0000","last_clean":"2023-10-06T04:45:58.383128+0000","last_became_active":"2023-10-06T04:45:58.382791+0000","last_became_peered":"2023-10-06T04:45:58.382791+0000","last_unstale":"2023-10-06T04:45:58.383128+0000","last_undegraded":"2023-10-06T04:45:58.383128+0000","last_fullsized":"2023-10-06T04:45:58.383128+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:42.436503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353293+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:45:57.353293+0000","last_peered":"2023-10-06T04:45:57.353293+0000","last_clean":"2023-10-06T04:45:57.353293+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:45:57.353293+0000","last_undegraded":"2023-10-06T04:45:57.353293+0000","last_fullsized":"2023-10-06T04:45:57.353293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369320+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:13.933274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374674+0000","last_change":"2023-10-06T04:45:58.374674+0000","last_active":"2023-10-06T04:45:58.374674+0000","last_peered":"2023-10-06T04:45:58.374674+0000","last_clean":"2023-10-06T04:45:58.374674+0000","last_became_active":"2023-10-06T04:45:58.374405+0000","last_became_peered":"2023-10-06T04:45:58.374405+0000","last_unstale":"2023-10-06T04:45:58.374674+0000","last_undegraded":"2023-10-06T04:45:58.374674+0000","last_fullsized":"2023-10-06T04:45:58.374674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:21.225714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356554+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:45:57.356554+0000","last_peered":"2023-10-06T04:45:57.356554+0000","last_clean":"2023-10-06T04:45:57.356554+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:45:57.356554+0000","last_undegraded":"2023-10-06T04:45:57.356554+0000","last_fullsized":"2023-10-06T04:45:57.356554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369495+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:04.457930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.384839+0000","last_change":"2023-10-06T04:45:58.384839+0000","last_active":"2023-10-06T04:45:58.384839+0000","last_peered":"2023-10-06T04:45:58.384839+0000","last_clean":"2023-10-06T04:45:58.384839+0000","last_became_active":"2023-10-06T04:45:58.384520+0000","last_became_peered":"2023-10-06T04:45:58.384520+0000","last_unstale":"2023-10-06T04:45:58.384839+0000","last_undegraded":"2023-10-06T04:45:58.384839+0000","last_fullsized":"2023-10-06T04:45:58.384839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:20.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356665+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:45:57.356665+0000","last_peered":"2023-10-06T04:45:57.356665+0000","last_clean":"2023-10-06T04:45:57.356665+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:45:57.356665+0000","last_undegraded":"2023-10-06T04:45:57.356665+0000","last_fullsized":"2023-10-06T04:45:57.356665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":797945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.3070000000000004,"5min":9.3070000000000004,"15min":9.3070000000000004},"last":0.501},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.2129999999999992,"5min":9.2129999999999992,"15min":9.2129999999999992},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.626},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":9.0850000000000009,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":9.0969999999999995},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.748}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67300000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.81200000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":797945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.2509999999999994,"5min":9.2509999999999994,"15min":9.2509999999999994},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":6.4000000000000004,"5min":6.4000000000000004,"15min":6.4000000000000004},"last":0.497},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.4450000000000003,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.81499999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.97099999999999997},{"interface":"front","average":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":19.992999999999999,"5min":19.992999999999999,"15min":19.992999999999999},"last":0.86699999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":6.476,"5min":6.476,"15min":6.476},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.9050000000000002,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.93799999999999994}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":2.056,"5min":2.056,"15min":2.056},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":19.960999999999999,"5min":19.960999999999999,"15min":19.960999999999999},"last":0.82099999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.70999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":11.241,"5min":11.241,"15min":11.241},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.442},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.273,"5min":11.273,"15min":11.273},"last":0.5}]},{"osd":3,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":11.125999999999999,"5min":11.125999999999999,"15min":11.125999999999999},"last":0.97099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":11.208,"5min":11.208,"15min":11.208},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":5.327,"5min":5.327,"15min":5.327},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.755}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.504},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65700000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.749}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.873}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.752},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.626},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:46:04.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-10-06T04:46:04.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.365902+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:43:18.477799+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:46:04.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-10-06T04:46:04.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.364925+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:59:05.341198+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:46:04.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-10-06T04:46:04.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.376689+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:46:58.073785+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-10-06T04:46:04.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.363691+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:19:22.232903+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:46:04.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-10-06T04:46:04.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.367500+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:46:04.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-10-06T04:46:04.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.364087+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:13:25.603030+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:46:04.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-10-06T04:46:04.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.377258+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:31:25.669595+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-10-06T04:46:04.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.372203+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:18:29.243247+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-10-06T04:46:04.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.369766+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:54:05.791456+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-10-06T04:46:04.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.362889+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:06:39.627784+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:46:04.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-10-06T04:46:04.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.367835+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:54:10.969828+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T04:46:04.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-10-06T04:46:04.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.368171+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-10-06T04:46:04.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.365107+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:32:07.136795+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:46:04.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-10-06T04:46:04.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.377017+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:56:43.829007+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-10-06T04:46:04.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.363667+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:00:06.672386+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:46:04.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-10-06T04:46:04.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.365492+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:49:11.474480+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:46:04.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-10-06T04:46:04.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.377205+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:54:44.696218+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-10-06T04:46:04.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.364256+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:36:21.379661+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:46:04.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-10-06T04:46:04.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.375224+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:09:50.429560+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-10-06T04:46:04.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.369047+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:29:48.346853+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:46:04.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-10-06T04:46:04.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.366996+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:18:00.063314+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:46:04.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-10-06T04:46:04.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.370855+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-10-06T04:46:04.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.368251+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:03:56.746843+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T04:46:04.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-10-06T04:46:04.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.371723+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:33:46.147015+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-10-06T04:46:04.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.376055+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:42:51.081341+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-10-06T04:46:04.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.368877+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-10-06T04:46:04.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.362478+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:48:30.092271+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:46:04.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-10-06T04:46:04.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.367940+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:35:45.556503+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:46:04.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-10-06T04:46:04.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.371516+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:48:02.855835+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-10-06T04:46:04.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.364276+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:53:34.942328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:46:04.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-10-06T04:46:04.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.375743+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:59:57.112135+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-10-06T04:46:04.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.361046+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:46:04.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-10-06T04:46:04.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.363741+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:36:28.762553+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:46:04.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-10-06T04:46:04.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.360346+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:53:34.942328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:46:04.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-10-06T04:46:04.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.369542+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:07:27.358669+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:46:04.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-10-06T04:46:04.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.371882+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:46:42.683982+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-10-06T04:46:04.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.366974+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:46:04.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-10-06T04:46:04.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.363799+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:28:35.797002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:46:04.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-10-06T04:46:04.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.367820+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-10-06T04:46:04.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.363935+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:45:43.030244+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:46:04.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-10-06T04:46:04.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.373345+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:46:04.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-10-06T04:46:04.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.361359+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:46:04.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-10-06T04:46:04.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.368375+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:17:28.724681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-10-06T04:46:04.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.366918+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:46:04.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-10-06T04:46:04.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.361447+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:46:04.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-10-06T04:46:04.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.371157+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:02:47.648706+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-10-06T04:46:04.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.368398+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-10-06T04:46:04.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.371752+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:08:52.019869+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-10-06T04:46:04.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.370917+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:28:42.035682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-10-06T04:46:04.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.362124+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:59:51.096604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:46:04.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-10-06T04:46:04.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.368327+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:46:04.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-10-06T04:46:04.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.362393+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:30:25.944748+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:46:04.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-10-06T04:46:04.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.360333+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:36:21.379661+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:46:04.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-10-06T04:46:04.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.368698+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:49:26.322862+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:46:04.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-10-06T04:46:04.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.368972+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:54:35.027796+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-10-06T04:46:04.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.362204+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:56:34.684364+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:46:04.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-10-06T04:46:04.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.368231+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:39:14.566346+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-10-06T04:46:04.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.360331+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:59:05.341198+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:46:04.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-10-06T04:46:04.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.362012+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:52:04.481543+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:46:04.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-10-06T04:46:04.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.371377+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:26:07.505833+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-10-06T04:46:04.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.367254+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:48:29.918962+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:46:04.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-10-06T04:46:04.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.360331+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:45:43.030244+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:46:04.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-10-06T04:46:04.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.369320+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:57:13.933274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:46:04.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-10-06T04:46:04.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:45:58.348938+0000', 'last_change': '2023-10-06T04:45:58.369495+0000', 'last_active': '2023-10-06T04:45:58.348938+0000', 'last_peered': '2023-10-06T04:45:58.348938+0000', 'last_clean': '2023-10-06T04:45:58.348938+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:45:58.348938+0000', 'last_undegraded': '2023-10-06T04:45:58.348938+0000', 'last_fullsized': '2023-10-06T04:45:58.348938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'last_clean_scrub_stamp': '2023-10-06T04:45:58.348938+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:30:04.457930+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:46:04.670 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T04:46:04.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.858+0000 7f6d8bbff700 1 Processor -- start 2023-10-06T04:46:04.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.858+0000 7f6d8bbff700 1 -- start start 2023-10-06T04:46:04.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.859+0000 7f6d8bbff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6d840690b0 0x7f6d84099610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.859+0000 7f6d8bbff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d840acc40 con 0x7f6d840abb60 2023-10-06T04:46:04.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.859+0000 7f6d8bbff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d840ad0d0 con 0x7f6d840ccd30 2023-10-06T04:46:04.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.859+0000 7f6d8bbff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8406ae30 con 0x7f6d840690b0 2023-10-06T04:46:04.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.859+0000 7f6d8999b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6d840abb60 0x7f6d84098f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53494/0 (socket says 172.21.15.124:53494) 2023-10-06T04:46:04.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.859+0000 7f6d8999b700 1 -- 172.21.15.124:0/2732849931 learned_addr learned my addr 172.21.15.124:0/2732849931 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:46:04.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d8a19c700 1 --2- 172.21.15.124:0/2732849931 >> v2:172.21.15.158:3300/0 conn(0x7f6d840690b0 0x7f6d84099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519684085 0 0) 0x7f6d840acc40 con 0x7f6d840abb60 2023-10-06T04:46:04.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d70003570 con 0x7f6d840abb60 2023-10-06T04:46:04.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3102835368 0 0) 0x7f6d70003570 con 0x7f6d840abb60 2023-10-06T04:46:04.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 >> v2:172.21.15.158:3300/0 conn(0x7f6d840690b0 msgr2=0x7f6d84099610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:04.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 --2- 172.21.15.124:0/2732849931 >> v2:172.21.15.158:3300/0 conn(0x7f6d840690b0 0x7f6d84099610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 >> v1:172.21.15.158:6789/0 conn(0x7f6d840ccd30 legacy=0x7f6d84096a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d840ac5f0 con 0x7f6d840abb60 2023-10-06T04:46:04.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f6d80001470 con 0x7f6d840abb60 2023-10-06T04:46:04.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 >> v1:172.21.15.124:6789/0 conn(0x7f6d840abb60 legacy=0x7f6d84098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d70003a60 0x7f6d70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d70004810 0x7f6d70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8406ae30 con 0x7f6d700051c0 2023-10-06T04:46:04.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7000c160 con 0x7f6d70004810 2023-10-06T04:46:04.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7000c320 con 0x7f6d70003a60 2023-10-06T04:46:04.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.860+0000 7f6d8a19c700 1 --2- 172.21.15.124:0/2732849931 >> v2:172.21.15.158:3300/0 conn(0x7f6d840690b0 0x7f6d84099610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:46:04.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d8a19c700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d8999b700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d70003a60 0x7f6d70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d8919a700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d70004810 0x7f6d70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d8a19c700 1 -- 172.21.15.124:0/2732849931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d70003a60 msgr2=0x7f6d70003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:04.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d8a19c700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d70003a60 0x7f6d70003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d8a19c700 1 -- 172.21.15.124:0/2732849931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d70004810 msgr2=0x7f6d70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:04.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d8a19c700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d70004810 0x7f6d70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d8a19c700 1 -- 172.21.15.124:0/2732849931 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70003570 con 0x7f6d700051c0 2023-10-06T04:46:04.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d8a19c700 1 -- 172.21.15.124:0/2732849931 reap_dead start 2023-10-06T04:46:04.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d8a19c700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d7000ba60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e3c0 tx=0x7f6d7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97f68f1b18aa55c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:04.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c009c50 con 0x7f6d700051c0 2023-10-06T04:46:04.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c00f040 con 0x7f6d700051c0 2023-10-06T04:46:04.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.861+0000 7f6d88999700 1 -- 172.21.15.124:0/2732849931 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00eea0 con 0x7f6d700051c0 2023-10-06T04:46:04.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.862+0000 7f6d8bbff700 1 -- 172.21.15.124:0/2732849931 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 msgr2=0x7f6d7000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.862+0000 7f6d8bbff700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d7000ba60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e3c0 tx=0x7f6d7c00b040 comp rx=0 tx=0).stop 2023-10-06T04:46:04.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.862+0000 7f6d8bbff700 1 -- 172.21.15.124:0/2732849931 shutdown_connections 2023-10-06T04:46:04.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.862+0000 7f6d8bbff700 1 --2- 172.21.15.124:0/2732849931 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d7000ba60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.862+0000 7f6d8bbff700 1 -- 172.21.15.124:0/2732849931 >> 172.21.15.124:0/2732849931 conn(0x7f6d840cc050 msgr2=0x7f6d840cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:04.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.862+0000 7f6d8bbff700 1 -- 172.21.15.124:0/2732849931 shutdown_connections 2023-10-06T04:46:04.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.862+0000 7f6d8bbff700 1 -- 172.21.15.124:0/2732849931 wait complete. 2023-10-06T04:46:04.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.863+0000 7f6d8bbff700 1 Processor -- start 2023-10-06T04:46:04.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.864+0000 7f6d8bbff700 1 -- start start 2023-10-06T04:46:04.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.864+0000 7f6d8bbff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d8415a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8bbff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d840af420 0x7f6d840c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8bbff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d840c64d0 0x7f6d8416d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8bbff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840b0c60 con 0x7f6d700051c0 2023-10-06T04:46:04.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8bbff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840c6940 con 0x7f6d840af420 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8bbff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8415adb0 con 0x7f6d840c64d0 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8999b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d8415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8999b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d8415a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60782/0 (socket says 172.21.15.124:60782) 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8999b700 1 -- 172.21.15.124:0/1243579331 learned_addr learned my addr 172.21.15.124:0/1243579331 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8919a700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d840af420 0x7f6d840c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8a19c700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d840c64d0 0x7f6d8416d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8999b700 1 -- 172.21.15.124:0/1243579331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d840c64d0 msgr2=0x7f6d8416d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8999b700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d840c64d0 0x7f6d8416d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8999b700 1 -- 172.21.15.124:0/1243579331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d840af420 msgr2=0x7f6d840c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8999b700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d840af420 0x7f6d840c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:04.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8999b700 1 -- 172.21.15.124:0/1243579331 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d840afd00 con 0x7f6d700051c0 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8919a700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d840af420 0x7f6d840c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.865+0000 7f6d8999b700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d8415a870 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6d80007390 tx=0x7f6d80001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.866+0000 7f6d79ffb700 1 -- 172.21.15.124:0/1243579331 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80018030 con 0x7f6d700051c0 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.866+0000 7f6d79ffb700 1 -- 172.21.15.124:0/1243579331 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000f8d0 con 0x7f6d700051c0 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.866+0000 7f6d8bbff700 1 -- 172.21.15.124:0/1243579331 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d840affe0 con 0x7f6d700051c0 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.866+0000 7f6d79ffb700 1 -- 172.21.15.124:0/1243579331 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000fcb0 con 0x7f6d700051c0 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.866+0000 7f6d8bbff700 1 -- 172.21.15.124:0/1243579331 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d840b05a0 con 0x7f6d700051c0 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.867+0000 7f6d8bbff700 1 -- 172.21.15.124:0/1243579331 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d840717a0 con 0x7f6d700051c0 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.868+0000 7f6d79ffb700 1 -- 172.21.15.124:0/1243579331 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d8001b070 con 0x7f6d700051c0 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.868+0000 7f6d79ffb700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6d68066f30 0x7f6d680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.869+0000 7f6d79ffb700 1 -- 172.21.15.124:0/1243579331 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6d80019070 con 0x7f6d700051c0 2023-10-06T04:46:04.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.869+0000 7f6d8919a700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6d68066f30 0x7f6d680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:04.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.869+0000 7f6d8919a700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6d68066f30 0x7f6d680693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6d74007e40 tx=0x7f6d74009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:04.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:04.872+0000 7f6d79ffb700 1 -- 172.21.15.124:0/1243579331 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d800517a0 con 0x7f6d700051c0 2023-10-06T04:46:05.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.138+0000 7f6d8bbff700 1 -- 172.21.15.124:0/1243579331 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6d840ae020 con 0x7f6d700051c0 2023-10-06T04:46:05.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.138+0000 7f6d79ffb700 1 -- 172.21.15.124:0/1243579331 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1585 (secure 0 0 0) 0x7f6d80054dc0 con 0x7f6d700051c0 2023-10-06T04:46:05.140 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:46:05.140 INFO:teuthology.orchestra.run.smithi124.stdout:{"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":117,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1696567458,"num_in_osds":8,"osd_in_since":1696567450,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2440531968,"bytes_avail":770653581312,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5376}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-10-06T04:45:19.916902+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T04:46:05.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 -- 172.21.15.124:0/1243579331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6d68066f30 msgr2=0x7f6d680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:05.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6d68066f30 0x7f6d680693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6d74007e40 tx=0x7f6d74009040 comp rx=0 tx=0).stop 2023-10-06T04:46:05.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 -- 172.21.15.124:0/1243579331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 msgr2=0x7f6d8415a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:05.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d8415a870 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6d80007390 tx=0x7f6d80001e50 comp rx=0 tx=0).stop 2023-10-06T04:46:05.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 -- 172.21.15.124:0/1243579331 shutdown_connections 2023-10-06T04:46:05.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6d68066f30 0x7f6d680693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d840c64d0 0x7f6d8416d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d700051c0 0x7f6d8415a870 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 --2- 172.21.15.124:0/1243579331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d840af420 0x7f6d840c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 -- 172.21.15.124:0/1243579331 >> 172.21.15.124:0/1243579331 conn(0x7f6d840cc050 msgr2=0x7f6d8415c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:05.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 -- 172.21.15.124:0/1243579331 shutdown_connections 2023-10-06T04:46:05.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.141+0000 7f6d8bbff700 1 -- 172.21.15.124:0/1243579331 wait complete. 2023-10-06T04:46:05.160 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T04:46:05.160 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:46:05.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.348+0000 7f32095ff700 1 Processor -- start 2023-10-06T04:46:05.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.348+0000 7f32095ff700 1 -- start start 2023-10-06T04:46:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.349+0000 7f32095ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 0x7f32040cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.349+0000 7f32095ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040cf6b0 con 0x7f32040ce450 2023-10-06T04:46:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.349+0000 7f32095ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040ceaa0 con 0x7f32040cdfe0 2023-10-06T04:46:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.349+0000 7f32095ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32040ced80 con 0x7f32040ccbb0 2023-10-06T04:46:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.350+0000 7f32037fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f32040ce450 0x7f32040ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53498/0 (socket says 172.21.15.124:53498) 2023-10-06T04:46:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.350+0000 7f32037fe700 1 -- 172.21.15.124:0/4100363982 learned_addr learned my addr 172.21.15.124:0/4100363982 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:46:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.350+0000 7f3202ffd700 1 --2- 172.21.15.124:0/4100363982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 0x7f32040cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:05.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.350+0000 7f3201ffb700 1 -- 172.21.15.124:0/4100363982 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635751606 0 0) 0x7f32040cf6b0 con 0x7f32040ce450 2023-10-06T04:46:05.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.350+0000 7f3201ffb700 1 -- 172.21.15.124:0/4100363982 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ec003570 con 0x7f32040ce450 2023-10-06T04:46:05.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.350+0000 7f3201ffb700 1 -- 172.21.15.124:0/4100363982 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111863951 0 0) 0x7f32040ceaa0 con 0x7f32040cdfe0 2023-10-06T04:46:05.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.350+0000 7f3201ffb700 1 -- 172.21.15.124:0/4100363982 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32040cf6b0 con 0x7f32040cdfe0 2023-10-06T04:46:05.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.350+0000 7f3202ffd700 1 -- 172.21.15.124:0/4100363982 >> v1:172.21.15.158:6789/0 conn(0x7f32040cdfe0 legacy=0x7f32040ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:05.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.350+0000 7f3202ffd700 1 -- 172.21.15.124:0/4100363982 >> v1:172.21.15.124:6789/0 conn(0x7f32040ce450 legacy=0x7f32040ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:05.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.350+0000 7f3202ffd700 1 -- 172.21.15.124:0/4100363982 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040cf060 con 0x7f32040ccbb0 2023-10-06T04:46:05.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.351+0000 7f3202ffd700 1 --2- 172.21.15.124:0/4100363982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 0x7f32040cfb40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009910 tx=0x7f31f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77b9635a796fcab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:05.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.351+0000 7f3201ffb700 1 -- 172.21.15.124:0/4100363982 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4011630 con 0x7f32040ccbb0 2023-10-06T04:46:05.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.351+0000 7f3201ffb700 1 -- 172.21.15.124:0/4100363982 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4011790 con 0x7f32040ccbb0 2023-10-06T04:46:05.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.351+0000 7f3201ffb700 1 -- 172.21.15.124:0/4100363982 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4011b30 con 0x7f32040ccbb0 2023-10-06T04:46:05.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.351+0000 7f32095ff700 1 -- 172.21.15.124:0/4100363982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 msgr2=0x7f32040cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:05.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.351+0000 7f32095ff700 1 --2- 172.21.15.124:0/4100363982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 0x7f32040cfb40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009910 tx=0x7f31f40091a0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.351+0000 7f32095ff700 1 -- 172.21.15.124:0/4100363982 shutdown_connections 2023-10-06T04:46:05.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.351+0000 7f32095ff700 1 --2- 172.21.15.124:0/4100363982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 0x7f32040cfb40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.351+0000 7f32095ff700 1 -- 172.21.15.124:0/4100363982 >> 172.21.15.124:0/4100363982 conn(0x7f3204099710 msgr2=0x7f320406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:05.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.352+0000 7f32095ff700 1 -- 172.21.15.124:0/4100363982 shutdown_connections 2023-10-06T04:46:05.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.352+0000 7f32095ff700 1 -- 172.21.15.124:0/4100363982 wait complete. 2023-10-06T04:46:05.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.353+0000 7f32095ff700 1 Processor -- start 2023-10-06T04:46:05.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.353+0000 7f32095ff700 1 -- start start 2023-10-06T04:46:05.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f32095ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 0x7f32040b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:05.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f32095ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f32040cdfe0 0x7f320415ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:05.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f32095ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32040ce450 0x7f320415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:05.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f32095ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320416d100 con 0x7f32040ce450 2023-10-06T04:46:05.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f32095ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320416d3e0 con 0x7f32040cdfe0 2023-10-06T04:46:05.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f32095ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320416d6c0 con 0x7f32040ccbb0 2023-10-06T04:46:05.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f3202ffd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 0x7f32040b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:05.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f32037fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32040ce450 0x7f320415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:05.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f32037fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32040ce450 0x7f320415f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60790/0 (socket says 172.21.15.124:60790) 2023-10-06T04:46:05.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f3202ffd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 0x7f32040b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:51594/0 (socket says 172.21.15.124:51594) 2023-10-06T04:46:05.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f32027fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f32040cdfe0 0x7f320415ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:05.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.354+0000 7f32037fe700 1 -- 172.21.15.124:0/3010642361 learned_addr learned my addr 172.21.15.124:0/3010642361 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:05.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f32037fe700 1 -- 172.21.15.124:0/3010642361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 msgr2=0x7f32040b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:05.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f32037fe700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 0x7f32040b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f32037fe700 1 -- 172.21.15.124:0/3010642361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f32040cdfe0 msgr2=0x7f320415ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:05.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f32037fe700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f32040cdfe0 0x7f320415ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f32037fe700 1 -- 172.21.15.124:0/3010642361 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4009420 con 0x7f32040ce450 2023-10-06T04:46:05.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f32037fe700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32040ce450 0x7f320415f380 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00cbc0 tx=0x7f31fc001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:05.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f31eaffd700 1 -- 172.21.15.124:0/3010642361 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00a7e0 con 0x7f32040ce450 2023-10-06T04:46:05.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f31eaffd700 1 -- 172.21.15.124:0/3010642361 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc00a940 con 0x7f32040ce450 2023-10-06T04:46:05.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f32095ff700 1 -- 172.21.15.124:0/3010642361 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320416d9a0 con 0x7f32040ce450 2023-10-06T04:46:05.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f31eaffd700 1 -- 172.21.15.124:0/3010642361 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00ad00 con 0x7f32040ce450 2023-10-06T04:46:05.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.355+0000 7f32095ff700 1 -- 172.21.15.124:0/3010642361 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32040b0e10 con 0x7f32040ce450 2023-10-06T04:46:05.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.357+0000 7f32095ff700 1 -- 172.21.15.124:0/3010642361 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320416dec0 con 0x7f32040ce450 2023-10-06T04:46:05.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.357+0000 7f31eaffd700 1 -- 172.21.15.124:0/3010642361 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31fc007300 con 0x7f32040ce450 2023-10-06T04:46:05.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.358+0000 7f31eaffd700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f31f0066f30 0x7f31f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:05.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.358+0000 7f31eaffd700 1 -- 172.21.15.124:0/3010642361 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f31fc0849d0 con 0x7f32040ce450 2023-10-06T04:46:05.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.358+0000 7f3202ffd700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f31f0066f30 0x7f31f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:05.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.359+0000 7f3202ffd700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f31f0066f30 0x7f31f00693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f31f40091e0 tx=0x7f31f4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:05.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.362+0000 7f31eaffd700 1 -- 172.21.15.124:0/3010642361 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f320416dec0 con 0x7f32040ce450 2023-10-06T04:46:05.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.551+0000 7f32095ff700 1 -- 172.21.15.124:0/3010642361 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f320416dec0 con 0x7f31f0066f30 2023-10-06T04:46:05.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.560+0000 7f31eaffd700 1 -- 172.21.15.124:0/3010642361 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308330 (secure 0 0 0) 0x7f320416dec0 con 0x7f31f0066f30 2023-10-06T04:46:05.566 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:46:05.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.564+0000 7f32095ff700 1 -- 172.21.15.124:0/3010642361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f31f0066f30 msgr2=0x7f31f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:05.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.564+0000 7f32095ff700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f31f0066f30 0x7f31f00693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f31f40091e0 tx=0x7f31f4017000 comp rx=0 tx=0).stop 2023-10-06T04:46:05.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.564+0000 7f32095ff700 1 -- 172.21.15.124:0/3010642361 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32040ce450 msgr2=0x7f320415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:05.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.564+0000 7f32095ff700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32040ce450 0x7f320415f380 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00cbc0 tx=0x7f31fc001a20 comp rx=0 tx=0).stop 2023-10-06T04:46:05.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.564+0000 7f32095ff700 1 -- 172.21.15.124:0/3010642361 shutdown_connections 2023-10-06T04:46:05.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.564+0000 7f32095ff700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32040ce450 0x7f320415f380 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.564+0000 7f32095ff700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f31f0066f30 0x7f31f00693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.564+0000 7f32095ff700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32040ccbb0 0x7f32040b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.564+0000 7f32095ff700 1 --2- 172.21.15.124:0/3010642361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f32040cdfe0 0x7f320415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:05.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.564+0000 7f32095ff700 1 -- 172.21.15.124:0/3010642361 >> 172.21.15.124:0/3010642361 conn(0x7f3204099710 msgr2=0x7f3204151880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:05.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.565+0000 7f32095ff700 1 -- 172.21.15.124:0/3010642361 shutdown_connections 2023-10-06T04:46:05.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:05.565+0000 7f32095ff700 1 -- 172.21.15.124:0/3010642361 wait complete. 2023-10-06T04:46:05.569 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:46:05.583 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-10-06T04:46:03.924729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383332,"kb_used_data":5028,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591388,"statfs":{"total":773094113280,"available":770653581312,"internally_reserved":0,"allocated":5148672,"data_stored":2821504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001188"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365902+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:18.477799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364925+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:05.341198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.376689+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:58.073785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363691+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:22.232903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367500+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364087+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:25.603030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377258+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:25.669595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.372203+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:29.243247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369766+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:05.791456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362889+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:39.627784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367835+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:10.969828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368171+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365107+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:07.136795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377017+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:43.829007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363667+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:06.672386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.365492+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:11.474480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.377205+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:44.696218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364256+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:21.379661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.375224+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:50.429560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369047+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:48.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366996+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:00.063314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.370855+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368251+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:56.746843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371723+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:46.147015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.376055+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:51.081341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368877+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362478+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:30.092271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367940+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:45.556503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371516+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:02.855835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.364276+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:34.942328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.375743+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:57.112135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361046+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363741+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376757+0000","last_change":"2023-10-06T04:45:58.376757+0000","last_active":"2023-10-06T04:45:58.376757+0000","last_peered":"2023-10-06T04:45:58.376757+0000","last_clean":"2023-10-06T04:45:58.376757+0000","last_became_active":"2023-10-06T04:45:58.376419+0000","last_became_peered":"2023-10-06T04:45:58.376419+0000","last_unstale":"2023-10-06T04:45:58.376757+0000","last_undegraded":"2023-10-06T04:45:58.376757+0000","last_fullsized":"2023-10-06T04:45:58.376757+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:02.868440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360346+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:34.942328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379050+0000","last_change":"2023-10-06T04:45:58.379050+0000","last_active":"2023-10-06T04:45:58.379050+0000","last_peered":"2023-10-06T04:45:58.379050+0000","last_clean":"2023-10-06T04:45:58.379050+0000","last_became_active":"2023-10-06T04:45:58.378772+0000","last_became_peered":"2023-10-06T04:45:58.378772+0000","last_unstale":"2023-10-06T04:45:58.379050+0000","last_undegraded":"2023-10-06T04:45:58.379050+0000","last_fullsized":"2023-10-06T04:45:58.379050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:08.306889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369542+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:27.358669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.373937+0000","last_change":"2023-10-06T04:45:58.373937+0000","last_active":"2023-10-06T04:45:58.373937+0000","last_peered":"2023-10-06T04:45:58.373937+0000","last_clean":"2023-10-06T04:45:58.373937+0000","last_became_active":"2023-10-06T04:45:58.373648+0000","last_became_peered":"2023-10-06T04:45:58.373648+0000","last_unstale":"2023-10-06T04:45:58.373937+0000","last_undegraded":"2023-10-06T04:45:58.373937+0000","last_fullsized":"2023-10-06T04:45:58.373937+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:57.993530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371882+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:42.683982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379222+0000","last_change":"2023-10-06T04:45:58.379222+0000","last_active":"2023-10-06T04:45:58.379222+0000","last_peered":"2023-10-06T04:45:58.379222+0000","last_clean":"2023-10-06T04:45:58.379222+0000","last_became_active":"2023-10-06T04:45:58.378814+0000","last_became_peered":"2023-10-06T04:45:58.378814+0000","last_unstale":"2023-10-06T04:45:58.379222+0000","last_undegraded":"2023-10-06T04:45:58.379222+0000","last_fullsized":"2023-10-06T04:45:58.379222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:50.379050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366974+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386102+0000","last_change":"2023-10-06T04:45:58.386102+0000","last_active":"2023-10-06T04:45:58.386102+0000","last_peered":"2023-10-06T04:45:58.386102+0000","last_clean":"2023-10-06T04:45:58.386102+0000","last_became_active":"2023-10-06T04:45:58.385833+0000","last_became_peered":"2023-10-06T04:45:58.385833+0000","last_unstale":"2023-10-06T04:45:58.386102+0000","last_undegraded":"2023-10-06T04:45:58.386102+0000","last_fullsized":"2023-10-06T04:45:58.386102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:21.167993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363799+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:35.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376488+0000","last_change":"2023-10-06T04:45:58.376488+0000","last_active":"2023-10-06T04:45:58.376488+0000","last_peered":"2023-10-06T04:45:58.376488+0000","last_clean":"2023-10-06T04:45:58.376488+0000","last_became_active":"2023-10-06T04:45:58.376235+0000","last_became_peered":"2023-10-06T04:45:58.376235+0000","last_unstale":"2023-10-06T04:45:58.376488+0000","last_undegraded":"2023-10-06T04:45:58.376488+0000","last_fullsized":"2023-10-06T04:45:58.376488+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:42.023055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367820+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376414+0000","last_change":"2023-10-06T04:45:58.376414+0000","last_active":"2023-10-06T04:45:58.376414+0000","last_peered":"2023-10-06T04:45:58.376414+0000","last_clean":"2023-10-06T04:45:58.376414+0000","last_became_active":"2023-10-06T04:45:58.376107+0000","last_became_peered":"2023-10-06T04:45:58.376107+0000","last_unstale":"2023-10-06T04:45:58.376414+0000","last_undegraded":"2023-10-06T04:45:58.376414+0000","last_fullsized":"2023-10-06T04:45:58.376414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:25:56.264481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.363935+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:43.030244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382839+0000","last_change":"2023-10-06T04:45:58.382839+0000","last_active":"2023-10-06T04:45:58.382839+0000","last_peered":"2023-10-06T04:45:58.382839+0000","last_clean":"2023-10-06T04:45:58.382839+0000","last_became_active":"2023-10-06T04:45:58.382554+0000","last_became_peered":"2023-10-06T04:45:58.382554+0000","last_unstale":"2023-10-06T04:45:58.382839+0000","last_undegraded":"2023-10-06T04:45:58.382839+0000","last_fullsized":"2023-10-06T04:45:58.382839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:10.467291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.373345+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379403+0000","last_change":"2023-10-06T04:45:58.379403+0000","last_active":"2023-10-06T04:45:58.379403+0000","last_peered":"2023-10-06T04:45:58.379403+0000","last_clean":"2023-10-06T04:45:58.379403+0000","last_became_active":"2023-10-06T04:45:58.379136+0000","last_became_peered":"2023-10-06T04:45:58.379136+0000","last_unstale":"2023-10-06T04:45:58.379403+0000","last_undegraded":"2023-10-06T04:45:58.379403+0000","last_fullsized":"2023-10-06T04:45:58.379403+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:33.707670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361359+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.387517+0000","last_change":"2023-10-06T04:45:58.387517+0000","last_active":"2023-10-06T04:45:58.387517+0000","last_peered":"2023-10-06T04:45:58.387517+0000","last_clean":"2023-10-06T04:45:58.387517+0000","last_became_active":"2023-10-06T04:45:58.387130+0000","last_became_peered":"2023-10-06T04:45:58.387130+0000","last_unstale":"2023-10-06T04:45:58.387517+0000","last_undegraded":"2023-10-06T04:45:58.387517+0000","last_fullsized":"2023-10-06T04:45:58.387517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:33.935139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368375+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:28.724681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.378636+0000","last_change":"2023-10-06T04:45:58.378636+0000","last_active":"2023-10-06T04:45:58.378636+0000","last_peered":"2023-10-06T04:45:58.378636+0000","last_clean":"2023-10-06T04:45:58.378636+0000","last_became_active":"2023-10-06T04:45:58.378361+0000","last_became_peered":"2023-10-06T04:45:58.378361+0000","last_unstale":"2023-10-06T04:45:58.378636+0000","last_undegraded":"2023-10-06T04:45:58.378636+0000","last_fullsized":"2023-10-06T04:45:58.378636+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:57.005759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.366918+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.376514+0000","last_change":"2023-10-06T04:45:58.376514+0000","last_active":"2023-10-06T04:45:58.376514+0000","last_peered":"2023-10-06T04:45:58.376514+0000","last_clean":"2023-10-06T04:45:58.376514+0000","last_became_active":"2023-10-06T04:45:58.376268+0000","last_became_peered":"2023-10-06T04:45:58.376268+0000","last_unstale":"2023-10-06T04:45:58.376514+0000","last_undegraded":"2023-10-06T04:45:58.376514+0000","last_fullsized":"2023-10-06T04:45:58.376514+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:27.755364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.361447+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.383472+0000","last_change":"2023-10-06T04:45:58.383472+0000","last_active":"2023-10-06T04:45:58.383472+0000","last_peered":"2023-10-06T04:45:58.383472+0000","last_clean":"2023-10-06T04:45:58.383472+0000","last_became_active":"2023-10-06T04:45:58.383157+0000","last_became_peered":"2023-10-06T04:45:58.383157+0000","last_unstale":"2023-10-06T04:45:58.383472+0000","last_undegraded":"2023-10-06T04:45:58.383472+0000","last_fullsized":"2023-10-06T04:45:58.383472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:07.547228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371157+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:02:47.648706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.387194+0000","last_change":"2023-10-06T04:45:58.387194+0000","last_active":"2023-10-06T04:45:58.387194+0000","last_peered":"2023-10-06T04:45:58.387194+0000","last_clean":"2023-10-06T04:45:58.387194+0000","last_became_active":"2023-10-06T04:45:58.386895+0000","last_became_peered":"2023-10-06T04:45:58.386895+0000","last_unstale":"2023-10-06T04:45:58.387194+0000","last_undegraded":"2023-10-06T04:45:58.387194+0000","last_fullsized":"2023-10-06T04:45:58.387194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.409964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368398+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.379458+0000","last_change":"2023-10-06T04:45:58.379458+0000","last_active":"2023-10-06T04:45:58.379458+0000","last_peered":"2023-10-06T04:45:58.379458+0000","last_clean":"2023-10-06T04:45:58.379458+0000","last_became_active":"2023-10-06T04:45:58.379126+0000","last_became_peered":"2023-10-06T04:45:58.379126+0000","last_unstale":"2023-10-06T04:45:58.379458+0000","last_undegraded":"2023-10-06T04:45:58.379458+0000","last_fullsized":"2023-10-06T04:45:58.379458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:04.264347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371752+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:52.019869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.373073+0000","last_change":"2023-10-06T04:45:58.373073+0000","last_active":"2023-10-06T04:45:58.373073+0000","last_peered":"2023-10-06T04:45:58.373073+0000","last_clean":"2023-10-06T04:45:58.373073+0000","last_became_active":"2023-10-06T04:45:58.372806+0000","last_became_peered":"2023-10-06T04:45:58.372806+0000","last_unstale":"2023-10-06T04:45:58.373073+0000","last_undegraded":"2023-10-06T04:45:58.373073+0000","last_fullsized":"2023-10-06T04:45:58.373073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:20.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.370917+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:42.035682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386284+0000","last_change":"2023-10-06T04:45:58.386284+0000","last_active":"2023-10-06T04:45:58.386284+0000","last_peered":"2023-10-06T04:45:58.386284+0000","last_clean":"2023-10-06T04:45:58.386284+0000","last_became_active":"2023-10-06T04:45:58.385929+0000","last_became_peered":"2023-10-06T04:45:58.385929+0000","last_unstale":"2023-10-06T04:45:58.386284+0000","last_undegraded":"2023-10-06T04:45:58.386284+0000","last_fullsized":"2023-10-06T04:45:58.386284+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:21.483289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362124+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:51.096604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.371421+0000","last_change":"2023-10-06T04:45:58.371421+0000","last_active":"2023-10-06T04:45:58.371421+0000","last_peered":"2023-10-06T04:45:58.371421+0000","last_clean":"2023-10-06T04:45:58.371421+0000","last_became_active":"2023-10-06T04:45:58.371149+0000","last_became_peered":"2023-10-06T04:45:58.371149+0000","last_unstale":"2023-10-06T04:45:58.371421+0000","last_undegraded":"2023-10-06T04:45:58.371421+0000","last_fullsized":"2023-10-06T04:45:58.371421+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:48.703741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368327+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.377285+0000","last_change":"2023-10-06T04:45:58.377285+0000","last_active":"2023-10-06T04:45:58.377285+0000","last_peered":"2023-10-06T04:45:58.377285+0000","last_clean":"2023-10-06T04:45:58.377285+0000","last_became_active":"2023-10-06T04:45:58.376985+0000","last_became_peered":"2023-10-06T04:45:58.376985+0000","last_unstale":"2023-10-06T04:45:58.377285+0000","last_undegraded":"2023-10-06T04:45:58.377285+0000","last_fullsized":"2023-10-06T04:45:58.377285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:40.662514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362393+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:25.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.384543+0000","last_change":"2023-10-06T04:45:58.384543+0000","last_active":"2023-10-06T04:45:58.384543+0000","last_peered":"2023-10-06T04:45:58.384543+0000","last_clean":"2023-10-06T04:45:58.384543+0000","last_became_active":"2023-10-06T04:45:58.384231+0000","last_became_peered":"2023-10-06T04:45:58.384231+0000","last_unstale":"2023-10-06T04:45:58.384543+0000","last_undegraded":"2023-10-06T04:45:58.384543+0000","last_fullsized":"2023-10-06T04:45:58.384543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:12.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360333+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:21.379661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.367446+0000","last_change":"2023-10-06T04:45:58.367446+0000","last_active":"2023-10-06T04:45:58.367446+0000","last_peered":"2023-10-06T04:45:58.367446+0000","last_clean":"2023-10-06T04:45:58.367446+0000","last_became_active":"2023-10-06T04:45:58.367205+0000","last_became_peered":"2023-10-06T04:45:58.367205+0000","last_unstale":"2023-10-06T04:45:58.367446+0000","last_undegraded":"2023-10-06T04:45:58.367446+0000","last_fullsized":"2023-10-06T04:45:58.367446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:57.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368698+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:26.322862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374574+0000","last_change":"2023-10-06T04:45:58.374574+0000","last_active":"2023-10-06T04:45:58.374574+0000","last_peered":"2023-10-06T04:45:58.374574+0000","last_clean":"2023-10-06T04:45:58.374574+0000","last_became_active":"2023-10-06T04:45:58.374324+0000","last_became_peered":"2023-10-06T04:45:58.374324+0000","last_unstale":"2023-10-06T04:45:58.374574+0000","last_undegraded":"2023-10-06T04:45:58.374574+0000","last_fullsized":"2023-10-06T04:45:58.374574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:34.789813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368972+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:35.027796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.386145+0000","last_change":"2023-10-06T04:45:58.386145+0000","last_active":"2023-10-06T04:45:58.386145+0000","last_peered":"2023-10-06T04:45:58.386145+0000","last_clean":"2023-10-06T04:45:58.386145+0000","last_became_active":"2023-10-06T04:45:58.385854+0000","last_became_peered":"2023-10-06T04:45:58.385854+0000","last_unstale":"2023-10-06T04:45:58.386145+0000","last_undegraded":"2023-10-06T04:45:58.386145+0000","last_fullsized":"2023-10-06T04:45:58.386145+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:17.470610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362204+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:34.684364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374747+0000","last_change":"2023-10-06T04:45:58.374747+0000","last_active":"2023-10-06T04:45:58.374747+0000","last_peered":"2023-10-06T04:45:58.374747+0000","last_clean":"2023-10-06T04:45:58.374747+0000","last_became_active":"2023-10-06T04:45:58.374335+0000","last_became_peered":"2023-10-06T04:45:58.374335+0000","last_unstale":"2023-10-06T04:45:58.374747+0000","last_undegraded":"2023-10-06T04:45:58.374747+0000","last_fullsized":"2023-10-06T04:45:58.374747+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:24.483593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.368231+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:14.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.377103+0000","last_change":"2023-10-06T04:45:58.377103+0000","last_active":"2023-10-06T04:45:58.377103+0000","last_peered":"2023-10-06T04:45:58.377103+0000","last_clean":"2023-10-06T04:45:58.377103+0000","last_became_active":"2023-10-06T04:45:58.376840+0000","last_became_peered":"2023-10-06T04:45:58.376840+0000","last_unstale":"2023-10-06T04:45:58.377103+0000","last_undegraded":"2023-10-06T04:45:58.377103+0000","last_fullsized":"2023-10-06T04:45:58.377103+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:42.023055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.359421+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:45:57.359421+0000","last_peered":"2023-10-06T04:45:57.359421+0000","last_clean":"2023-10-06T04:45:57.359421+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:45:57.359421+0000","last_undegraded":"2023-10-06T04:45:57.359421+0000","last_fullsized":"2023-10-06T04:45:57.359421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360331+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:05.341198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.378021+0000","last_change":"2023-10-06T04:45:58.378021+0000","last_active":"2023-10-06T04:45:58.378021+0000","last_peered":"2023-10-06T04:45:58.378021+0000","last_clean":"2023-10-06T04:45:58.378021+0000","last_became_active":"2023-10-06T04:45:58.377772+0000","last_became_peered":"2023-10-06T04:45:58.377772+0000","last_unstale":"2023-10-06T04:45:58.378021+0000","last_undegraded":"2023-10-06T04:45:58.378021+0000","last_fullsized":"2023-10-06T04:45:58.378021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:33.935139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.350807+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:45:57.350807+0000","last_peered":"2023-10-06T04:45:57.350807+0000","last_clean":"2023-10-06T04:45:57.350807+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:45:57.350807+0000","last_undegraded":"2023-10-06T04:45:57.350807+0000","last_fullsized":"2023-10-06T04:45:57.350807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.362012+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:04.481543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382369+0000","last_change":"2023-10-06T04:45:58.382369+0000","last_active":"2023-10-06T04:45:58.382369+0000","last_peered":"2023-10-06T04:45:58.382369+0000","last_clean":"2023-10-06T04:45:58.382369+0000","last_became_active":"2023-10-06T04:45:58.382110+0000","last_became_peered":"2023-10-06T04:45:58.382110+0000","last_unstale":"2023-10-06T04:45:58.382369+0000","last_undegraded":"2023-10-06T04:45:58.382369+0000","last_fullsized":"2023-10-06T04:45:58.382369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:03.339842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356286+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:45:57.356286+0000","last_peered":"2023-10-06T04:45:57.356286+0000","last_clean":"2023-10-06T04:45:57.356286+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:45:57.356286+0000","last_undegraded":"2023-10-06T04:45:57.356286+0000","last_fullsized":"2023-10-06T04:45:57.356286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353195+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:45:57.353195+0000","last_peered":"2023-10-06T04:45:57.353195+0000","last_clean":"2023-10-06T04:45:57.353195+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:45:57.353195+0000","last_undegraded":"2023-10-06T04:45:57.353195+0000","last_fullsized":"2023-10-06T04:45:57.353195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.371377+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:07.505833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382973+0000","last_change":"2023-10-06T04:45:58.382973+0000","last_active":"2023-10-06T04:45:58.382973+0000","last_peered":"2023-10-06T04:45:58.382973+0000","last_clean":"2023-10-06T04:45:58.382973+0000","last_became_active":"2023-10-06T04:45:58.382252+0000","last_became_peered":"2023-10-06T04:45:58.382252+0000","last_unstale":"2023-10-06T04:45:58.382973+0000","last_undegraded":"2023-10-06T04:45:58.382973+0000","last_fullsized":"2023-10-06T04:45:58.382973+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.222034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353374+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:45:57.353374+0000","last_peered":"2023-10-06T04:45:57.353374+0000","last_clean":"2023-10-06T04:45:57.353374+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:45:57.353374+0000","last_undegraded":"2023-10-06T04:45:57.353374+0000","last_fullsized":"2023-10-06T04:45:57.353374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.367254+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:29.918962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.382870+0000","last_change":"2023-10-06T04:45:58.382870+0000","last_active":"2023-10-06T04:45:58.382870+0000","last_peered":"2023-10-06T04:45:58.382870+0000","last_clean":"2023-10-06T04:45:58.382870+0000","last_became_active":"2023-10-06T04:45:58.382617+0000","last_became_peered":"2023-10-06T04:45:58.382617+0000","last_unstale":"2023-10-06T04:45:58.382870+0000","last_undegraded":"2023-10-06T04:45:58.382870+0000","last_fullsized":"2023-10-06T04:45:58.382870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:16.905907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353103+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:45:57.353103+0000","last_peered":"2023-10-06T04:45:57.353103+0000","last_clean":"2023-10-06T04:45:57.353103+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:45:57.353103+0000","last_undegraded":"2023-10-06T04:45:57.353103+0000","last_fullsized":"2023-10-06T04:45:57.353103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.360331+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:43.030244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.383128+0000","last_change":"2023-10-06T04:45:58.383128+0000","last_active":"2023-10-06T04:45:58.383128+0000","last_peered":"2023-10-06T04:45:58.383128+0000","last_clean":"2023-10-06T04:45:58.383128+0000","last_became_active":"2023-10-06T04:45:58.382791+0000","last_became_peered":"2023-10-06T04:45:58.382791+0000","last_unstale":"2023-10-06T04:45:58.383128+0000","last_undegraded":"2023-10-06T04:45:58.383128+0000","last_fullsized":"2023-10-06T04:45:58.383128+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:42.436503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.353293+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:45:57.353293+0000","last_peered":"2023-10-06T04:45:57.353293+0000","last_clean":"2023-10-06T04:45:57.353293+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:45:57.353293+0000","last_undegraded":"2023-10-06T04:45:57.353293+0000","last_fullsized":"2023-10-06T04:45:57.353293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369320+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:13.933274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.374674+0000","last_change":"2023-10-06T04:45:58.374674+0000","last_active":"2023-10-06T04:45:58.374674+0000","last_peered":"2023-10-06T04:45:58.374674+0000","last_clean":"2023-10-06T04:45:58.374674+0000","last_became_active":"2023-10-06T04:45:58.374405+0000","last_became_peered":"2023-10-06T04:45:58.374405+0000","last_unstale":"2023-10-06T04:45:58.374674+0000","last_undegraded":"2023-10-06T04:45:58.374674+0000","last_fullsized":"2023-10-06T04:45:58.374674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:21.225714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356554+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:45:57.356554+0000","last_peered":"2023-10-06T04:45:57.356554+0000","last_clean":"2023-10-06T04:45:57.356554+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:45:57.356554+0000","last_undegraded":"2023-10-06T04:45:57.356554+0000","last_fullsized":"2023-10-06T04:45:57.356554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:45:58.348938+0000","last_change":"2023-10-06T04:45:58.369495+0000","last_active":"2023-10-06T04:45:58.348938+0000","last_peered":"2023-10-06T04:45:58.348938+0000","last_clean":"2023-10-06T04:45:58.348938+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:45:58.348938+0000","last_undegraded":"2023-10-06T04:45:58.348938+0000","last_fullsized":"2023-10-06T04:45:58.348938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:04.457930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:45:58.384839+0000","last_change":"2023-10-06T04:45:58.384839+0000","last_active":"2023-10-06T04:45:58.384839+0000","last_peered":"2023-10-06T04:45:58.384839+0000","last_clean":"2023-10-06T04:45:58.384839+0000","last_became_active":"2023-10-06T04:45:58.384520+0000","last_became_peered":"2023-10-06T04:45:58.384520+0000","last_unstale":"2023-10-06T04:45:58.384839+0000","last_undegraded":"2023-10-06T04:45:58.384839+0000","last_fullsized":"2023-10-06T04:45:58.384839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:20.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T04:45:57.356665+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:45:57.356665+0000","last_peered":"2023-10-06T04:45:57.356665+0000","last_clean":"2023-10-06T04:45:57.356665+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:45:57.356665+0000","last_undegraded":"2023-10-06T04:45:57.356665+0000","last_fullsized":"2023-10-06T04:45:57.356665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":797945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.3070000000000004,"5min":9.3070000000000004,"15min":9.3070000000000004},"last":0.501},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.2129999999999992,"5min":9.2129999999999992,"15min":9.2129999999999992},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.626},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":9.0850000000000009,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":9.0969999999999995},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.748}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67300000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.81200000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":797945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.2509999999999994,"5min":9.2509999999999994,"15min":9.2509999999999994},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":6.4000000000000004,"5min":6.4000000000000004,"15min":6.4000000000000004},"last":0.497},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.4450000000000003,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.81499999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.97099999999999997},{"interface":"front","average":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":19.992999999999999,"5min":19.992999999999999,"15min":19.992999999999999},"last":0.86699999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":6.476,"5min":6.476,"15min":6.476},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.9050000000000002,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.93799999999999994}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":2.056,"5min":2.056,"15min":2.056},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":19.960999999999999,"5min":19.960999999999999,"15min":19.960999999999999},"last":0.82099999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.70999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":11.241,"5min":11.241,"15min":11.241},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.442},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.273,"5min":11.273,"15min":11.273},"last":0.5}]},{"osd":3,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":11.125999999999999,"5min":11.125999999999999,"15min":11.125999999999999},"last":0.97099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":11.208,"5min":11.208,"15min":11.208},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":5.327,"5min":5.327,"15min":5.327},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.755}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.504},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65700000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.749}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.873}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":200961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.752},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.626},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:46:08.591 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:46:08.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.788+0000 7f2a68fff700 1 Processor -- start 2023-10-06T04:46:08.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.789+0000 7f2a68fff700 1 -- start start 2023-10-06T04:46:08.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.790+0000 7f2a68fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a641573e0 0x7f2a641577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:08.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.790+0000 7f2a68fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2a640ad770 0x7f2a640adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:08.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.790+0000 7f2a68fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a640ab910 con 0x7f2a640a6c60 2023-10-06T04:46:08.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.790+0000 7f2a68fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a640abbf0 con 0x7f2a640ad770 2023-10-06T04:46:08.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.790+0000 7f2a68fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640ae130 con 0x7f2a641573e0 2023-10-06T04:46:08.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.790+0000 7f2a62d9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2a640ad770 0x7f2a640adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:08.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.790+0000 7f2a62d9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2a640ad770 0x7f2a640adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60792/0 (socket says 172.21.15.124:60792) 2023-10-06T04:46:08.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.790+0000 7f2a62d9d700 1 -- 172.21.15.124:0/3977310295 learned_addr learned my addr 172.21.15.124:0/3977310295 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:08.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.790+0000 7f2a61d9b700 1 --1- 172.21.15.124:0/3977310295 >> v1:172.21.15.124:6789/0 conn(0x7f2a640a6c60 0x7f2a64069a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53508/0 (socket says 172.21.15.124:53508) 2023-10-06T04:46:08.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.790+0000 7f2a6259c700 1 --2- 172.21.15.124:0/3977310295 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a641573e0 0x7f2a641577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:08.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.791+0000 7f2a62d9d700 1 -- 172.21.15.124:0/3977310295 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a641573e0 msgr2=0x7f2a641577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:08.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.791+0000 7f2a62d9d700 1 --2- 172.21.15.124:0/3977310295 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a641573e0 0x7f2a641577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:08.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.791+0000 7f2a62d9d700 1 -- 172.21.15.124:0/3977310295 >> v1:172.21.15.124:6789/0 conn(0x7f2a640a6c60 legacy=0x7f2a64069a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:08.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.791+0000 7f2a62d9d700 1 -- 172.21.15.124:0/3977310295 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6406a4a0 con 0x7f2a640ad770 2023-10-06T04:46:08.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.791+0000 7f2a62d9d700 1 --2- 172.21.15.124:0/3977310295 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 0x7f2a640adbf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009f20 tx=0x7f2a5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b085abb76d854bcd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:08.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.791+0000 7f2a6159a700 1 -- 172.21.15.124:0/3977310295 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c00e070 con 0x7f2a640ad770 2023-10-06T04:46:08.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.791+0000 7f2a6159a700 1 -- 172.21.15.124:0/3977310295 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c00ba80 con 0x7f2a640ad770 2023-10-06T04:46:08.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.791+0000 7f2a6159a700 1 -- 172.21.15.124:0/3977310295 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0092e0 con 0x7f2a640ad770 2023-10-06T04:46:08.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.792+0000 7f2a68fff700 1 -- 172.21.15.124:0/3977310295 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 msgr2=0x7f2a640adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:08.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.792+0000 7f2a68fff700 1 --2- 172.21.15.124:0/3977310295 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 0x7f2a640adbf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009f20 tx=0x7f2a5c009840 comp rx=0 tx=0).stop 2023-10-06T04:46:08.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.792+0000 7f2a68fff700 1 -- 172.21.15.124:0/3977310295 shutdown_connections 2023-10-06T04:46:08.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.792+0000 7f2a68fff700 1 --2- 172.21.15.124:0/3977310295 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 0x7f2a640adbf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:08.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.792+0000 7f2a68fff700 1 --2- 172.21.15.124:0/3977310295 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a641573e0 0x7f2a641577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:08.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.792+0000 7f2a68fff700 1 -- 172.21.15.124:0/3977310295 >> 172.21.15.124:0/3977310295 conn(0x7f2a640cc050 msgr2=0x7f2a640cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:08.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.792+0000 7f2a68fff700 1 -- 172.21.15.124:0/3977310295 shutdown_connections 2023-10-06T04:46:08.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.792+0000 7f2a68fff700 1 -- 172.21.15.124:0/3977310295 wait complete. 2023-10-06T04:46:08.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.793+0000 7f2a68fff700 1 Processor -- start 2023-10-06T04:46:08.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.793+0000 7f2a68fff700 1 -- start start 2023-10-06T04:46:08.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.794+0000 7f2a68fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 0x7f2a6416c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:08.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.794+0000 7f2a68fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a641573e0 0x7f2a64155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:08.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.794+0000 7f2a68fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a6415c350 0x7f2a64098b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:08.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.794+0000 7f2a68fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640a8a30 con 0x7f2a640ad770 2023-10-06T04:46:08.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.794+0000 7f2a68fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6415c810 con 0x7f2a6415c350 2023-10-06T04:46:08.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.794+0000 7f2a68fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640a8100 con 0x7f2a641573e0 2023-10-06T04:46:08.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a6259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 0x7f2a6416c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:08.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a6259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 0x7f2a6416c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60804/0 (socket says 172.21.15.124:60804) 2023-10-06T04:46:08.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a6259c700 1 -- 172.21.15.124:0/3460539139 learned_addr learned my addr 172.21.15.124:0/3460539139 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:08.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a62d9d700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a6415c350 0x7f2a64098b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:08.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a61d9b700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a641573e0 0x7f2a64155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:08.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a6259c700 1 -- 172.21.15.124:0/3460539139 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a641573e0 msgr2=0x7f2a64155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:08.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a6259c700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a641573e0 0x7f2a64155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:08.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a6259c700 1 -- 172.21.15.124:0/3460539139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a6415c350 msgr2=0x7f2a64098b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:08.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a6259c700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a6415c350 0x7f2a64098b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:08.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a6259c700 1 -- 172.21.15.124:0/3460539139 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c009ae0 con 0x7f2a640ad770 2023-10-06T04:46:08.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.795+0000 7f2a6259c700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 0x7f2a6416c6b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400d860 tx=0x7f2a54008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:08.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.796+0000 7f2a527fc700 1 -- 172.21.15.124:0/3460539139 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540125f0 con 0x7f2a640ad770 2023-10-06T04:46:08.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.796+0000 7f2a527fc700 1 -- 172.21.15.124:0/3460539139 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a54012750 con 0x7f2a640ad770 2023-10-06T04:46:08.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.796+0000 7f2a68fff700 1 -- 172.21.15.124:0/3460539139 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a640a83e0 con 0x7f2a640ad770 2023-10-06T04:46:08.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.796+0000 7f2a527fc700 1 -- 172.21.15.124:0/3460539139 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54012b10 con 0x7f2a640ad770 2023-10-06T04:46:08.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.796+0000 7f2a68fff700 1 -- 172.21.15.124:0/3460539139 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a641565c0 con 0x7f2a640ad770 2023-10-06T04:46:08.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.797+0000 7f2a68fff700 1 -- 172.21.15.124:0/3460539139 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a640717a0 con 0x7f2a640ad770 2023-10-06T04:46:08.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.797+0000 7f2a527fc700 1 -- 172.21.15.124:0/3460539139 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a5401e460 con 0x7f2a640ad770 2023-10-06T04:46:08.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.799+0000 7f2a527fc700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a44066f30 0x7f2a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:08.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.799+0000 7f2a527fc700 1 -- 172.21.15.124:0/3460539139 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2a54084c20 con 0x7f2a640ad770 2023-10-06T04:46:08.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.799+0000 7f2a61d9b700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a44066f30 0x7f2a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:08.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.799+0000 7f2a61d9b700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a44066f30 0x7f2a440693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2a640a6c30 tx=0x7f2a58007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:08.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.803+0000 7f2a527fc700 1 -- 172.21.15.124:0/3460539139 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a54051c90 con 0x7f2a640ad770 2023-10-06T04:46:08.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:08.992+0000 7f2a68fff700 1 -- 172.21.15.124:0/3460539139 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a640a8b70 con 0x7f2a44066f30 2023-10-06T04:46:09.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.001+0000 7f2a527fc700 1 -- 172.21.15.124:0/3460539139 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311186 (secure 0 0 0) 0x7f2a58004c60 con 0x7f2a44066f30 2023-10-06T04:46:09.006 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:46:09.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.005+0000 7f2a68fff700 1 -- 172.21.15.124:0/3460539139 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a44066f30 msgr2=0x7f2a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.005+0000 7f2a68fff700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a44066f30 0x7f2a440693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2a640a6c30 tx=0x7f2a58007eb0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.005+0000 7f2a68fff700 1 -- 172.21.15.124:0/3460539139 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 msgr2=0x7f2a6416c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.005+0000 7f2a68fff700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 0x7f2a6416c6b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400d860 tx=0x7f2a54008040 comp rx=0 tx=0).stop 2023-10-06T04:46:09.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.006+0000 7f2a68fff700 1 -- 172.21.15.124:0/3460539139 shutdown_connections 2023-10-06T04:46:09.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.006+0000 7f2a68fff700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a6415c350 0x7f2a64098b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.006+0000 7f2a68fff700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a640ad770 0x7f2a6416c6b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.006+0000 7f2a68fff700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2a44066f30 0x7f2a440693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.006+0000 7f2a68fff700 1 --2- 172.21.15.124:0/3460539139 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2a641573e0 0x7f2a64155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.006+0000 7f2a68fff700 1 -- 172.21.15.124:0/3460539139 >> 172.21.15.124:0/3460539139 conn(0x7f2a640cc050 msgr2=0x7f2a640cb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:09.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.006+0000 7f2a68fff700 1 -- 172.21.15.124:0/3460539139 shutdown_connections 2023-10-06T04:46:09.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.006+0000 7f2a68fff700 1 -- 172.21.15.124:0/3460539139 wait complete. 2023-10-06T04:46:09.010 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:46:09.025 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-10-06T04:46:07.925673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383624,"kb_used_data":5320,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591096,"statfs":{"total":773094113280,"available":770653282304,"internally_reserved":0,"allocated":5447680,"data_stored":2956020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.565858"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.393784+0000","last_change":"2023-10-06T04:45:59.387962+0000","last_active":"2023-10-06T04:45:59.393784+0000","last_peered":"2023-10-06T04:45:59.393784+0000","last_clean":"2023-10-06T04:45:59.393784+0000","last_became_active":"2023-10-06T04:45:59.387707+0000","last_became_peered":"2023-10-06T04:45:59.387707+0000","last_unstale":"2023-10-06T04:45:59.393784+0000","last_undegraded":"2023-10-06T04:45:59.393784+0000","last_fullsized":"2023-10-06T04:45:59.393784+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:22.175182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.395855+0000","last_change":"2023-10-06T04:45:59.393051+0000","last_active":"2023-10-06T04:45:59.395855+0000","last_peered":"2023-10-06T04:45:59.395855+0000","last_clean":"2023-10-06T04:45:59.395855+0000","last_became_active":"2023-10-06T04:45:59.392403+0000","last_became_peered":"2023-10-06T04:45:59.392403+0000","last_unstale":"2023-10-06T04:45:59.395855+0000","last_undegraded":"2023-10-06T04:45:59.395855+0000","last_fullsized":"2023-10-06T04:45:59.395855+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:13.933274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.378837+0000","last_change":"2023-10-06T04:45:59.376111+0000","last_active":"2023-10-06T04:45:59.378837+0000","last_peered":"2023-10-06T04:45:59.378837+0000","last_clean":"2023-10-06T04:45:59.378837+0000","last_became_active":"2023-10-06T04:45:59.375806+0000","last_became_peered":"2023-10-06T04:45:59.375806+0000","last_unstale":"2023-10-06T04:45:59.378837+0000","last_undegraded":"2023-10-06T04:45:59.378837+0000","last_fullsized":"2023-10-06T04:45:59.378837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:22.490987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.393394+0000","last_change":"2023-10-06T04:45:59.390411+0000","last_active":"2023-10-06T04:45:59.393394+0000","last_peered":"2023-10-06T04:45:59.393394+0000","last_clean":"2023-10-06T04:45:59.393394+0000","last_became_active":"2023-10-06T04:45:59.390026+0000","last_became_peered":"2023-10-06T04:45:59.390026+0000","last_unstale":"2023-10-06T04:45:59.393394+0000","last_undegraded":"2023-10-06T04:45:59.393394+0000","last_fullsized":"2023-10-06T04:45:59.393394+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:05.791456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.384041+0000","last_change":"2023-10-06T04:45:59.381371+0000","last_active":"2023-10-06T04:45:59.384041+0000","last_peered":"2023-10-06T04:45:59.384041+0000","last_clean":"2023-10-06T04:45:59.384041+0000","last_became_active":"2023-10-06T04:45:59.380740+0000","last_became_peered":"2023-10-06T04:45:59.380740+0000","last_unstale":"2023-10-06T04:45:59.384041+0000","last_undegraded":"2023-10-06T04:45:59.384041+0000","last_fullsized":"2023-10-06T04:45:59.384041+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:05.791456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.393881+0000","last_change":"2023-10-06T04:45:59.383817+0000","last_active":"2023-10-06T04:45:59.393881+0000","last_peered":"2023-10-06T04:45:59.393881+0000","last_clean":"2023-10-06T04:45:59.393881+0000","last_became_active":"2023-10-06T04:45:59.383521+0000","last_became_peered":"2023-10-06T04:45:59.383521+0000","last_unstale":"2023-10-06T04:45:59.393881+0000","last_undegraded":"2023-10-06T04:45:59.393881+0000","last_fullsized":"2023-10-06T04:45:59.393881+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:08.554417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.379627+0000","last_change":"2023-10-06T04:45:59.376229+0000","last_active":"2023-10-06T04:45:59.379627+0000","last_peered":"2023-10-06T04:45:59.379627+0000","last_clean":"2023-10-06T04:45:59.379627+0000","last_became_active":"2023-10-06T04:45:59.375633+0000","last_became_peered":"2023-10-06T04:45:59.375633+0000","last_unstale":"2023-10-06T04:45:59.379627+0000","last_undegraded":"2023-10-06T04:45:59.379627+0000","last_fullsized":"2023-10-06T04:45:59.379627+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:25.445980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.387979+0000","last_change":"2023-10-06T04:45:59.380313+0000","last_active":"2023-10-06T04:45:59.387979+0000","last_peered":"2023-10-06T04:45:59.387979+0000","last_clean":"2023-10-06T04:45:59.387979+0000","last_became_active":"2023-10-06T04:45:59.380048+0000","last_became_peered":"2023-10-06T04:45:59.380048+0000","last_unstale":"2023-10-06T04:45:59.387979+0000","last_undegraded":"2023-10-06T04:45:59.387979+0000","last_fullsized":"2023-10-06T04:45:59.387979+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:38.648337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396613+0000","last_change":"2023-10-06T04:45:59.392340+0000","last_active":"2023-10-06T04:45:59.396613+0000","last_peered":"2023-10-06T04:45:59.396613+0000","last_clean":"2023-10-06T04:45:59.396613+0000","last_became_active":"2023-10-06T04:45:59.391214+0000","last_became_peered":"2023-10-06T04:45:59.391214+0000","last_unstale":"2023-10-06T04:45:59.396613+0000","last_undegraded":"2023-10-06T04:45:59.396613+0000","last_fullsized":"2023-10-06T04:45:59.396613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:58.902507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.393596+0000","last_change":"2023-10-06T04:45:59.384429+0000","last_active":"2023-10-06T04:45:59.393596+0000","last_peered":"2023-10-06T04:45:59.393596+0000","last_clean":"2023-10-06T04:45:59.393596+0000","last_became_active":"2023-10-06T04:45:59.384161+0000","last_became_peered":"2023-10-06T04:45:59.384161+0000","last_unstale":"2023-10-06T04:45:59.393596+0000","last_undegraded":"2023-10-06T04:45:59.393596+0000","last_fullsized":"2023-10-06T04:45:59.393596+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:43.665824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.386491+0000","last_change":"2023-10-06T04:45:59.376908+0000","last_active":"2023-10-06T04:45:59.386491+0000","last_peered":"2023-10-06T04:45:59.386491+0000","last_clean":"2023-10-06T04:45:59.386491+0000","last_became_active":"2023-10-06T04:45:59.376669+0000","last_became_peered":"2023-10-06T04:45:59.376669+0000","last_unstale":"2023-10-06T04:45:59.386491+0000","last_undegraded":"2023-10-06T04:45:59.386491+0000","last_fullsized":"2023-10-06T04:45:59.386491+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:55.352047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.386414+0000","last_change":"2023-10-06T04:45:59.381611+0000","last_active":"2023-10-06T04:45:59.386414+0000","last_peered":"2023-10-06T04:45:59.386414+0000","last_clean":"2023-10-06T04:45:59.386414+0000","last_became_active":"2023-10-06T04:45:59.380776+0000","last_became_peered":"2023-10-06T04:45:59.380776+0000","last_unstale":"2023-10-06T04:45:59.386414+0000","last_undegraded":"2023-10-06T04:45:59.386414+0000","last_fullsized":"2023-10-06T04:45:59.386414+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:32.681897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.394277+0000","last_change":"2023-10-06T04:45:59.385158+0000","last_active":"2023-10-06T04:45:59.394277+0000","last_peered":"2023-10-06T04:45:59.394277+0000","last_clean":"2023-10-06T04:45:59.394277+0000","last_became_active":"2023-10-06T04:45:59.384904+0000","last_became_peered":"2023-10-06T04:45:59.384904+0000","last_unstale":"2023-10-06T04:45:59.394277+0000","last_undegraded":"2023-10-06T04:45:59.394277+0000","last_fullsized":"2023-10-06T04:45:59.394277+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:14.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.383079+0000","last_change":"2023-10-06T04:45:59.380429+0000","last_active":"2023-10-06T04:45:59.383079+0000","last_peered":"2023-10-06T04:45:59.383079+0000","last_clean":"2023-10-06T04:45:59.383079+0000","last_became_active":"2023-10-06T04:45:59.380116+0000","last_became_peered":"2023-10-06T04:45:59.380116+0000","last_unstale":"2023-10-06T04:45:59.383079+0000","last_undegraded":"2023-10-06T04:45:59.383079+0000","last_fullsized":"2023-10-06T04:45:59.383079+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:58.664763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.389521+0000","last_change":"2023-10-06T04:45:59.384390+0000","last_active":"2023-10-06T04:45:59.389521+0000","last_peered":"2023-10-06T04:45:59.389521+0000","last_clean":"2023-10-06T04:45:59.389521+0000","last_became_active":"2023-10-06T04:45:59.384109+0000","last_became_peered":"2023-10-06T04:45:59.384109+0000","last_unstale":"2023-10-06T04:45:59.389521+0000","last_undegraded":"2023-10-06T04:45:59.389521+0000","last_fullsized":"2023-10-06T04:45:59.389521+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:42.035682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.393719+0000","last_change":"2023-10-06T04:45:59.385117+0000","last_active":"2023-10-06T04:45:59.393719+0000","last_peered":"2023-10-06T04:45:59.393719+0000","last_clean":"2023-10-06T04:45:59.393719+0000","last_became_active":"2023-10-06T04:45:59.384843+0000","last_became_peered":"2023-10-06T04:45:59.384843+0000","last_unstale":"2023-10-06T04:45:59.393719+0000","last_undegraded":"2023-10-06T04:45:59.393719+0000","last_fullsized":"2023-10-06T04:45:59.393719+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:28.724681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.390180+0000","last_change":"2023-10-06T04:45:59.384353+0000","last_active":"2023-10-06T04:45:59.390180+0000","last_peered":"2023-10-06T04:45:59.390180+0000","last_clean":"2023-10-06T04:45:59.390180+0000","last_became_active":"2023-10-06T04:45:59.383702+0000","last_became_peered":"2023-10-06T04:45:59.383702+0000","last_unstale":"2023-10-06T04:45:59.390180+0000","last_undegraded":"2023-10-06T04:45:59.390180+0000","last_fullsized":"2023-10-06T04:45:59.390180+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.395873+0000","last_change":"2023-10-06T04:45:59.393234+0000","last_active":"2023-10-06T04:45:59.395873+0000","last_peered":"2023-10-06T04:45:59.395873+0000","last_clean":"2023-10-06T04:45:59.395873+0000","last_became_active":"2023-10-06T04:45:59.392787+0000","last_became_peered":"2023-10-06T04:45:59.392787+0000","last_unstale":"2023-10-06T04:45:59.395873+0000","last_undegraded":"2023-10-06T04:45:59.395873+0000","last_fullsized":"2023-10-06T04:45:59.395873+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:33.865059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.398617+0000","last_change":"2023-10-06T04:45:59.389718+0000","last_active":"2023-10-06T04:45:59.398617+0000","last_peered":"2023-10-06T04:45:59.398617+0000","last_clean":"2023-10-06T04:45:59.398617+0000","last_became_active":"2023-10-06T04:45:59.389445+0000","last_became_peered":"2023-10-06T04:45:59.389445+0000","last_unstale":"2023-10-06T04:45:59.398617+0000","last_undegraded":"2023-10-06T04:45:59.398617+0000","last_fullsized":"2023-10-06T04:45:59.398617+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:58:52.923687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.388572+0000","last_change":"2023-10-06T04:45:59.385811+0000","last_active":"2023-10-06T04:45:59.388572+0000","last_peered":"2023-10-06T04:45:59.388572+0000","last_clean":"2023-10-06T04:45:59.388572+0000","last_became_active":"2023-10-06T04:45:59.385502+0000","last_became_peered":"2023-10-06T04:45:59.385502+0000","last_unstale":"2023-10-06T04:45:59.388572+0000","last_undegraded":"2023-10-06T04:45:59.388572+0000","last_fullsized":"2023-10-06T04:45:59.388572+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.821700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.383640+0000","last_change":"2023-10-06T04:45:59.381462+0000","last_active":"2023-10-06T04:45:59.383640+0000","last_peered":"2023-10-06T04:45:59.383640+0000","last_clean":"2023-10-06T04:45:59.383640+0000","last_became_active":"2023-10-06T04:45:59.380968+0000","last_became_peered":"2023-10-06T04:45:59.380968+0000","last_unstale":"2023-10-06T04:45:59.383640+0000","last_undegraded":"2023-10-06T04:45:59.383640+0000","last_fullsized":"2023-10-06T04:45:59.383640+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:34.714859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396382+0000","last_change":"2023-10-06T04:45:59.388786+0000","last_active":"2023-10-06T04:45:59.396382+0000","last_peered":"2023-10-06T04:45:59.396382+0000","last_clean":"2023-10-06T04:45:59.396382+0000","last_became_active":"2023-10-06T04:45:59.388536+0000","last_became_peered":"2023-10-06T04:45:59.388536+0000","last_unstale":"2023-10-06T04:45:59.396382+0000","last_undegraded":"2023-10-06T04:45:59.396382+0000","last_fullsized":"2023-10-06T04:45:59.396382+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:12.614269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.386491+0000","last_change":"2023-10-06T04:45:59.376898+0000","last_active":"2023-10-06T04:45:59.386491+0000","last_peered":"2023-10-06T04:45:59.386491+0000","last_clean":"2023-10-06T04:45:59.386491+0000","last_became_active":"2023-10-06T04:45:59.376616+0000","last_became_peered":"2023-10-06T04:45:59.376616+0000","last_unstale":"2023-10-06T04:45:59.386491+0000","last_undegraded":"2023-10-06T04:45:59.386491+0000","last_fullsized":"2023-10-06T04:45:59.386491+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:02.720121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.376779+0000","last_change":"2023-10-06T04:45:59.371784+0000","last_active":"2023-10-06T04:45:59.376779+0000","last_peered":"2023-10-06T04:45:59.376779+0000","last_clean":"2023-10-06T04:45:59.376779+0000","last_became_active":"2023-10-06T04:45:59.371511+0000","last_became_peered":"2023-10-06T04:45:59.371511+0000","last_unstale":"2023-10-06T04:45:59.376779+0000","last_undegraded":"2023-10-06T04:45:59.376779+0000","last_fullsized":"2023-10-06T04:45:59.376779+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:40.427966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.398621+0000","last_change":"2023-10-06T04:45:59.390303+0000","last_active":"2023-10-06T04:45:59.398621+0000","last_peered":"2023-10-06T04:45:59.398621+0000","last_clean":"2023-10-06T04:45:59.398621+0000","last_became_active":"2023-10-06T04:45:59.390019+0000","last_became_peered":"2023-10-06T04:45:59.390019+0000","last_unstale":"2023-10-06T04:45:59.398621+0000","last_undegraded":"2023-10-06T04:45:59.398621+0000","last_fullsized":"2023-10-06T04:45:59.398621+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:34.565696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396527+0000","last_change":"2023-10-06T04:45:59.387949+0000","last_active":"2023-10-06T04:45:59.396527+0000","last_peered":"2023-10-06T04:45:59.396527+0000","last_clean":"2023-10-06T04:45:59.396527+0000","last_became_active":"2023-10-06T04:45:59.387321+0000","last_became_peered":"2023-10-06T04:45:59.387321+0000","last_unstale":"2023-10-06T04:45:59.396527+0000","last_undegraded":"2023-10-06T04:45:59.396527+0000","last_fullsized":"2023-10-06T04:45:59.396527+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:58.252978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.394596+0000","last_change":"2023-10-06T04:45:59.381929+0000","last_active":"2023-10-06T04:45:59.394596+0000","last_peered":"2023-10-06T04:45:59.394596+0000","last_clean":"2023-10-06T04:45:59.394596+0000","last_became_active":"2023-10-06T04:45:59.381530+0000","last_became_peered":"2023-10-06T04:45:59.381530+0000","last_unstale":"2023-10-06T04:45:59.394596+0000","last_undegraded":"2023-10-06T04:45:59.394596+0000","last_fullsized":"2023-10-06T04:45:59.394596+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:01.582857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.380360+0000","last_change":"2023-10-06T04:45:59.377865+0000","last_active":"2023-10-06T04:45:59.380360+0000","last_peered":"2023-10-06T04:45:59.380360+0000","last_clean":"2023-10-06T04:45:59.380360+0000","last_became_active":"2023-10-06T04:45:59.377544+0000","last_became_peered":"2023-10-06T04:45:59.377544+0000","last_unstale":"2023-10-06T04:45:59.380360+0000","last_undegraded":"2023-10-06T04:45:59.380360+0000","last_fullsized":"2023-10-06T04:45:59.380360+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:45.741777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.398593+0000","last_change":"2023-10-06T04:45:59.389338+0000","last_active":"2023-10-06T04:45:59.398593+0000","last_peered":"2023-10-06T04:45:59.398593+0000","last_clean":"2023-10-06T04:45:59.398593+0000","last_became_active":"2023-10-06T04:45:59.389061+0000","last_became_peered":"2023-10-06T04:45:59.389061+0000","last_unstale":"2023-10-06T04:45:59.398593+0000","last_undegraded":"2023-10-06T04:45:59.398593+0000","last_fullsized":"2023-10-06T04:45:59.398593+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:15.572360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.390372+0000","last_change":"2023-10-06T04:45:59.385846+0000","last_active":"2023-10-06T04:45:59.390372+0000","last_peered":"2023-10-06T04:45:59.390372+0000","last_clean":"2023-10-06T04:45:59.390372+0000","last_became_active":"2023-10-06T04:45:59.385578+0000","last_became_peered":"2023-10-06T04:45:59.385578+0000","last_unstale":"2023-10-06T04:45:59.390372+0000","last_undegraded":"2023-10-06T04:45:59.390372+0000","last_fullsized":"2023-10-06T04:45:59.390372+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:20.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.379646+0000","last_change":"2023-10-06T04:45:59.376339+0000","last_active":"2023-10-06T04:45:59.379646+0000","last_peered":"2023-10-06T04:45:59.379646+0000","last_clean":"2023-10-06T04:45:59.379646+0000","last_became_active":"2023-10-06T04:45:59.375971+0000","last_became_peered":"2023-10-06T04:45:59.375971+0000","last_unstale":"2023-10-06T04:45:59.379646+0000","last_undegraded":"2023-10-06T04:45:59.379646+0000","last_fullsized":"2023-10-06T04:45:59.379646+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:37.194067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.392863+0000","last_change":"2023-10-06T04:45:59.390906+0000","last_active":"2023-10-06T04:45:59.392863+0000","last_peered":"2023-10-06T04:45:59.392863+0000","last_clean":"2023-10-06T04:45:59.392863+0000","last_became_active":"2023-10-06T04:45:59.390623+0000","last_became_peered":"2023-10-06T04:45:59.390623+0000","last_unstale":"2023-10-06T04:45:59.392863+0000","last_undegraded":"2023-10-06T04:45:59.392863+0000","last_fullsized":"2023-10-06T04:45:59.392863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:05.791456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396545+0000","last_change":"2023-10-06T04:45:59.394998+0000","last_active":"2023-10-06T04:45:59.396545+0000","last_peered":"2023-10-06T04:45:59.396545+0000","last_clean":"2023-10-06T04:45:59.396545+0000","last_became_active":"2023-10-06T04:45:59.394654+0000","last_became_peered":"2023-10-06T04:45:59.394654+0000","last_unstale":"2023-10-06T04:45:59.396545+0000","last_undegraded":"2023-10-06T04:45:59.396545+0000","last_fullsized":"2023-10-06T04:45:59.396545+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:22.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"44'4","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.385921+0000","last_change":"2023-10-06T04:45:58.376757+0000","last_active":"2023-10-06T04:45:59.385921+0000","last_peered":"2023-10-06T04:45:59.385921+0000","last_clean":"2023-10-06T04:45:59.385921+0000","last_became_active":"2023-10-06T04:45:58.376419+0000","last_became_peered":"2023-10-06T04:45:58.376419+0000","last_unstale":"2023-10-06T04:45:59.385921+0000","last_undegraded":"2023-10-06T04:45:59.385921+0000","last_fullsized":"2023-10-06T04:45:59.385921+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:02.868440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.389697+0000","last_change":"2023-10-06T04:45:59.385480+0000","last_active":"2023-10-06T04:45:59.389697+0000","last_peered":"2023-10-06T04:45:59.389697+0000","last_clean":"2023-10-06T04:45:59.389697+0000","last_became_active":"2023-10-06T04:45:59.382846+0000","last_became_peered":"2023-10-06T04:45:59.382846+0000","last_unstale":"2023-10-06T04:45:59.389697+0000","last_undegraded":"2023-10-06T04:45:59.389697+0000","last_fullsized":"2023-10-06T04:45:59.389697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.393399+0000","last_change":"2023-10-06T04:45:58.379050+0000","last_active":"2023-10-06T04:45:59.393399+0000","last_peered":"2023-10-06T04:45:59.393399+0000","last_clean":"2023-10-06T04:45:59.393399+0000","last_became_active":"2023-10-06T04:45:58.378772+0000","last_became_peered":"2023-10-06T04:45:58.378772+0000","last_unstale":"2023-10-06T04:45:59.393399+0000","last_undegraded":"2023-10-06T04:45:59.393399+0000","last_fullsized":"2023-10-06T04:45:59.393399+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:08.306889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.383399+0000","last_change":"2023-10-06T04:45:59.380978+0000","last_active":"2023-10-06T04:45:59.383399+0000","last_peered":"2023-10-06T04:45:59.383399+0000","last_clean":"2023-10-06T04:45:59.383399+0000","last_became_active":"2023-10-06T04:45:59.380714+0000","last_became_peered":"2023-10-06T04:45:59.380714+0000","last_unstale":"2023-10-06T04:45:59.383399+0000","last_undegraded":"2023-10-06T04:45:59.383399+0000","last_fullsized":"2023-10-06T04:45:59.383399+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:05.271535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.394738+0000","last_change":"2023-10-06T04:45:58.373937+0000","last_active":"2023-10-06T04:45:59.394738+0000","last_peered":"2023-10-06T04:45:59.394738+0000","last_clean":"2023-10-06T04:45:59.394738+0000","last_became_active":"2023-10-06T04:45:58.373648+0000","last_became_peered":"2023-10-06T04:45:58.373648+0000","last_unstale":"2023-10-06T04:45:59.394738+0000","last_undegraded":"2023-10-06T04:45:59.394738+0000","last_fullsized":"2023-10-06T04:45:59.394738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:57.993530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.398790+0000","last_change":"2023-10-06T04:45:59.394533+0000","last_active":"2023-10-06T04:45:59.398790+0000","last_peered":"2023-10-06T04:45:59.398790+0000","last_clean":"2023-10-06T04:45:59.398790+0000","last_became_active":"2023-10-06T04:45:59.394274+0000","last_became_peered":"2023-10-06T04:45:59.394274+0000","last_unstale":"2023-10-06T04:45:59.398790+0000","last_undegraded":"2023-10-06T04:45:59.398790+0000","last_fullsized":"2023-10-06T04:45:59.398790+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:07.981308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.387818+0000","last_change":"2023-10-06T04:45:58.379222+0000","last_active":"2023-10-06T04:45:59.387818+0000","last_peered":"2023-10-06T04:45:59.387818+0000","last_clean":"2023-10-06T04:45:59.387818+0000","last_became_active":"2023-10-06T04:45:58.378814+0000","last_became_peered":"2023-10-06T04:45:58.378814+0000","last_unstale":"2023-10-06T04:45:59.387818+0000","last_undegraded":"2023-10-06T04:45:59.387818+0000","last_fullsized":"2023-10-06T04:45:59.387818+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:50.379050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.383149+0000","last_change":"2023-10-06T04:45:59.379649+0000","last_active":"2023-10-06T04:45:59.383149+0000","last_peered":"2023-10-06T04:45:59.383149+0000","last_clean":"2023-10-06T04:45:59.383149+0000","last_became_active":"2023-10-06T04:45:59.379293+0000","last_became_peered":"2023-10-06T04:45:59.379293+0000","last_unstale":"2023-10-06T04:45:59.383149+0000","last_undegraded":"2023-10-06T04:45:59.383149+0000","last_fullsized":"2023-10-06T04:45:59.383149+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:07.505833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396545+0000","last_change":"2023-10-06T04:45:58.386102+0000","last_active":"2023-10-06T04:45:59.396545+0000","last_peered":"2023-10-06T04:45:59.396545+0000","last_clean":"2023-10-06T04:45:59.396545+0000","last_became_active":"2023-10-06T04:45:58.385833+0000","last_became_peered":"2023-10-06T04:45:58.385833+0000","last_unstale":"2023-10-06T04:45:59.396545+0000","last_undegraded":"2023-10-06T04:45:59.396545+0000","last_fullsized":"2023-10-06T04:45:59.396545+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:21.167993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.389472+0000","last_change":"2023-10-06T04:45:59.383422+0000","last_active":"2023-10-06T04:45:59.389472+0000","last_peered":"2023-10-06T04:45:59.389472+0000","last_clean":"2023-10-06T04:45:59.389472+0000","last_became_active":"2023-10-06T04:45:59.383147+0000","last_became_peered":"2023-10-06T04:45:59.383147+0000","last_unstale":"2023-10-06T04:45:59.389472+0000","last_undegraded":"2023-10-06T04:45:59.389472+0000","last_fullsized":"2023-10-06T04:45:59.389472+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:27.793234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.381446+0000","last_change":"2023-10-06T04:45:58.376488+0000","last_active":"2023-10-06T04:45:59.381446+0000","last_peered":"2023-10-06T04:45:59.381446+0000","last_clean":"2023-10-06T04:45:59.381446+0000","last_became_active":"2023-10-06T04:45:58.376235+0000","last_became_peered":"2023-10-06T04:45:58.376235+0000","last_unstale":"2023-10-06T04:45:59.381446+0000","last_undegraded":"2023-10-06T04:45:59.381446+0000","last_fullsized":"2023-10-06T04:45:59.381446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:42.023055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396507+0000","last_change":"2023-10-06T04:45:59.387716+0000","last_active":"2023-10-06T04:45:59.396507+0000","last_peered":"2023-10-06T04:45:59.396507+0000","last_clean":"2023-10-06T04:45:59.396507+0000","last_became_active":"2023-10-06T04:45:59.387383+0000","last_became_peered":"2023-10-06T04:45:59.387383+0000","last_unstale":"2023-10-06T04:45:59.396507+0000","last_undegraded":"2023-10-06T04:45:59.396507+0000","last_fullsized":"2023-10-06T04:45:59.396507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:35.479757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.371399+0000","last_change":"2023-10-06T04:45:58.376414+0000","last_active":"2023-10-06T04:45:59.371399+0000","last_peered":"2023-10-06T04:45:59.371399+0000","last_clean":"2023-10-06T04:45:59.371399+0000","last_became_active":"2023-10-06T04:45:58.376107+0000","last_became_peered":"2023-10-06T04:45:58.376107+0000","last_unstale":"2023-10-06T04:45:59.371399+0000","last_undegraded":"2023-10-06T04:45:59.371399+0000","last_fullsized":"2023-10-06T04:45:59.371399+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:25:56.264481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.391029+0000","last_change":"2023-10-06T04:45:59.386490+0000","last_active":"2023-10-06T04:45:59.391029+0000","last_peered":"2023-10-06T04:45:59.391029+0000","last_clean":"2023-10-06T04:45:59.391029+0000","last_became_active":"2023-10-06T04:45:59.386234+0000","last_became_peered":"2023-10-06T04:45:59.386234+0000","last_unstale":"2023-10-06T04:45:59.391029+0000","last_undegraded":"2023-10-06T04:45:59.391029+0000","last_fullsized":"2023-10-06T04:45:59.391029+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.364819+0000","last_change":"2023-10-06T04:45:58.382839+0000","last_active":"2023-10-06T04:45:59.364819+0000","last_peered":"2023-10-06T04:45:59.364819+0000","last_clean":"2023-10-06T04:45:59.364819+0000","last_became_active":"2023-10-06T04:45:58.382554+0000","last_became_peered":"2023-10-06T04:45:58.382554+0000","last_unstale":"2023-10-06T04:45:59.364819+0000","last_undegraded":"2023-10-06T04:45:59.364819+0000","last_fullsized":"2023-10-06T04:45:59.364819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:10.467291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.395699+0000","last_change":"2023-10-06T04:45:59.393789+0000","last_active":"2023-10-06T04:45:59.395699+0000","last_peered":"2023-10-06T04:45:59.395699+0000","last_clean":"2023-10-06T04:45:59.395699+0000","last_became_active":"2023-10-06T04:45:59.393478+0000","last_became_peered":"2023-10-06T04:45:59.393478+0000","last_unstale":"2023-10-06T04:45:59.395699+0000","last_undegraded":"2023-10-06T04:45:59.395699+0000","last_fullsized":"2023-10-06T04:45:59.395699+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:42.035682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.372026+0000","last_change":"2023-10-06T04:45:58.379403+0000","last_active":"2023-10-06T04:45:59.372026+0000","last_peered":"2023-10-06T04:45:59.372026+0000","last_clean":"2023-10-06T04:45:59.372026+0000","last_became_active":"2023-10-06T04:45:58.379136+0000","last_became_peered":"2023-10-06T04:45:58.379136+0000","last_unstale":"2023-10-06T04:45:59.372026+0000","last_undegraded":"2023-10-06T04:45:59.372026+0000","last_fullsized":"2023-10-06T04:45:59.372026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:33.707670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.389679+0000","last_change":"2023-10-06T04:45:59.383010+0000","last_active":"2023-10-06T04:45:59.389679+0000","last_peered":"2023-10-06T04:45:59.389679+0000","last_clean":"2023-10-06T04:45:59.389679+0000","last_became_active":"2023-10-06T04:45:59.382644+0000","last_became_peered":"2023-10-06T04:45:59.382644+0000","last_unstale":"2023-10-06T04:45:59.389679+0000","last_undegraded":"2023-10-06T04:45:59.389679+0000","last_fullsized":"2023-10-06T04:45:59.389679+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:42.683982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.365346+0000","last_change":"2023-10-06T04:45:58.387517+0000","last_active":"2023-10-06T04:45:59.365346+0000","last_peered":"2023-10-06T04:45:59.365346+0000","last_clean":"2023-10-06T04:45:59.365346+0000","last_became_active":"2023-10-06T04:45:58.387130+0000","last_became_peered":"2023-10-06T04:45:58.387130+0000","last_unstale":"2023-10-06T04:45:59.365346+0000","last_undegraded":"2023-10-06T04:45:59.365346+0000","last_fullsized":"2023-10-06T04:45:59.365346+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:33.935139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.397946+0000","last_change":"2023-10-06T04:45:59.389178+0000","last_active":"2023-10-06T04:45:59.397946+0000","last_peered":"2023-10-06T04:45:59.397946+0000","last_clean":"2023-10-06T04:45:59.397946+0000","last_became_active":"2023-10-06T04:45:59.388922+0000","last_became_peered":"2023-10-06T04:45:59.388922+0000","last_unstale":"2023-10-06T04:45:59.397946+0000","last_undegraded":"2023-10-06T04:45:59.397946+0000","last_fullsized":"2023-10-06T04:45:59.397946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:44:08.360812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"44'3","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.395020+0000","last_change":"2023-10-06T04:45:58.378636+0000","last_active":"2023-10-06T04:45:59.395020+0000","last_peered":"2023-10-06T04:45:59.395020+0000","last_clean":"2023-10-06T04:45:59.395020+0000","last_became_active":"2023-10-06T04:45:58.378361+0000","last_became_peered":"2023-10-06T04:45:58.378361+0000","last_unstale":"2023-10-06T04:45:59.395020+0000","last_undegraded":"2023-10-06T04:45:59.395020+0000","last_fullsized":"2023-10-06T04:45:59.395020+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:57.005759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.384060+0000","last_change":"2023-10-06T04:45:59.381679+0000","last_active":"2023-10-06T04:45:59.384060+0000","last_peered":"2023-10-06T04:45:59.384060+0000","last_clean":"2023-10-06T04:45:59.384060+0000","last_became_active":"2023-10-06T04:45:59.381120+0000","last_became_peered":"2023-10-06T04:45:59.381120+0000","last_unstale":"2023-10-06T04:45:59.384060+0000","last_undegraded":"2023-10-06T04:45:59.384060+0000","last_fullsized":"2023-10-06T04:45:59.384060+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:13.933274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"44'6","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.400347+0000","last_change":"2023-10-06T04:45:58.376514+0000","last_active":"2023-10-06T04:45:59.400347+0000","last_peered":"2023-10-06T04:45:59.400347+0000","last_clean":"2023-10-06T04:45:59.400347+0000","last_became_active":"2023-10-06T04:45:58.376268+0000","last_became_peered":"2023-10-06T04:45:58.376268+0000","last_unstale":"2023-10-06T04:45:59.400347+0000","last_undegraded":"2023-10-06T04:45:59.400347+0000","last_fullsized":"2023-10-06T04:45:59.400347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:27.755364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.387742+0000","last_change":"2023-10-06T04:45:59.382180+0000","last_active":"2023-10-06T04:45:59.387742+0000","last_peered":"2023-10-06T04:45:59.387742+0000","last_clean":"2023-10-06T04:45:59.387742+0000","last_became_active":"2023-10-06T04:45:59.381862+0000","last_became_peered":"2023-10-06T04:45:59.381862+0000","last_unstale":"2023-10-06T04:45:59.387742+0000","last_undegraded":"2023-10-06T04:45:59.387742+0000","last_fullsized":"2023-10-06T04:45:59.387742+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:42.035682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396704+0000","last_change":"2023-10-06T04:45:58.383472+0000","last_active":"2023-10-06T04:45:59.396704+0000","last_peered":"2023-10-06T04:45:59.396704+0000","last_clean":"2023-10-06T04:45:59.396704+0000","last_became_active":"2023-10-06T04:45:58.383157+0000","last_became_peered":"2023-10-06T04:45:58.383157+0000","last_unstale":"2023-10-06T04:45:59.396704+0000","last_undegraded":"2023-10-06T04:45:59.396704+0000","last_fullsized":"2023-10-06T04:45:59.396704+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:07.547228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.395461+0000","last_change":"2023-10-06T04:45:59.385603+0000","last_active":"2023-10-06T04:45:59.395461+0000","last_peered":"2023-10-06T04:45:59.395461+0000","last_clean":"2023-10-06T04:45:59.395461+0000","last_became_active":"2023-10-06T04:45:59.385266+0000","last_became_peered":"2023-10-06T04:45:59.385266+0000","last_unstale":"2023-10-06T04:45:59.395461+0000","last_undegraded":"2023-10-06T04:45:59.395461+0000","last_fullsized":"2023-10-06T04:45:59.395461+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:51.941200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.368875+0000","last_change":"2023-10-06T04:45:58.387194+0000","last_active":"2023-10-06T04:45:59.368875+0000","last_peered":"2023-10-06T04:45:59.368875+0000","last_clean":"2023-10-06T04:45:59.368875+0000","last_became_active":"2023-10-06T04:45:58.386895+0000","last_became_peered":"2023-10-06T04:45:58.386895+0000","last_unstale":"2023-10-06T04:45:59.368875+0000","last_undegraded":"2023-10-06T04:45:59.368875+0000","last_fullsized":"2023-10-06T04:45:59.368875+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.409964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396544+0000","last_change":"2023-10-06T04:45:59.389697+0000","last_active":"2023-10-06T04:45:59.396544+0000","last_peered":"2023-10-06T04:45:59.396544+0000","last_clean":"2023-10-06T04:45:59.396544+0000","last_became_active":"2023-10-06T04:45:59.389424+0000","last_became_peered":"2023-10-06T04:45:59.389424+0000","last_unstale":"2023-10-06T04:45:59.396544+0000","last_undegraded":"2023-10-06T04:45:59.396544+0000","last_fullsized":"2023-10-06T04:45:59.396544+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:22.872575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.373131+0000","last_change":"2023-10-06T04:45:58.379458+0000","last_active":"2023-10-06T04:45:59.373131+0000","last_peered":"2023-10-06T04:45:59.373131+0000","last_clean":"2023-10-06T04:45:59.373131+0000","last_became_active":"2023-10-06T04:45:58.379126+0000","last_became_peered":"2023-10-06T04:45:58.379126+0000","last_unstale":"2023-10-06T04:45:59.373131+0000","last_undegraded":"2023-10-06T04:45:59.373131+0000","last_fullsized":"2023-10-06T04:45:59.373131+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:04.264347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.390199+0000","last_change":"2023-10-06T04:45:59.384516+0000","last_active":"2023-10-06T04:45:59.390199+0000","last_peered":"2023-10-06T04:45:59.390199+0000","last_clean":"2023-10-06T04:45:59.390199+0000","last_became_active":"2023-10-06T04:45:59.384059+0000","last_became_peered":"2023-10-06T04:45:59.384059+0000","last_unstale":"2023-10-06T04:45:59.390199+0000","last_undegraded":"2023-10-06T04:45:59.390199+0000","last_fullsized":"2023-10-06T04:45:59.390199+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:24.360217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"44'8","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396834+0000","last_change":"2023-10-06T04:45:58.373073+0000","last_active":"2023-10-06T04:45:59.396834+0000","last_peered":"2023-10-06T04:45:59.396834+0000","last_clean":"2023-10-06T04:45:59.396834+0000","last_became_active":"2023-10-06T04:45:58.372806+0000","last_became_peered":"2023-10-06T04:45:58.372806+0000","last_unstale":"2023-10-06T04:45:59.396834+0000","last_undegraded":"2023-10-06T04:45:59.396834+0000","last_fullsized":"2023-10-06T04:45:59.396834+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:20.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396905+0000","last_change":"2023-10-06T04:45:59.387735+0000","last_active":"2023-10-06T04:45:59.396905+0000","last_peered":"2023-10-06T04:45:59.396905+0000","last_clean":"2023-10-06T04:45:59.396905+0000","last_became_active":"2023-10-06T04:45:59.387058+0000","last_became_peered":"2023-10-06T04:45:59.387058+0000","last_unstale":"2023-10-06T04:45:59.396905+0000","last_undegraded":"2023-10-06T04:45:59.396905+0000","last_fullsized":"2023-10-06T04:45:59.396905+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:53:59.238496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.397096+0000","last_change":"2023-10-06T04:45:58.386284+0000","last_active":"2023-10-06T04:45:59.397096+0000","last_peered":"2023-10-06T04:45:59.397096+0000","last_clean":"2023-10-06T04:45:59.397096+0000","last_became_active":"2023-10-06T04:45:58.385929+0000","last_became_peered":"2023-10-06T04:45:58.385929+0000","last_unstale":"2023-10-06T04:45:59.397096+0000","last_undegraded":"2023-10-06T04:45:59.397096+0000","last_fullsized":"2023-10-06T04:45:59.397096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:21.483289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.393692+0000","last_change":"2023-10-06T04:45:59.381388+0000","last_active":"2023-10-06T04:45:59.393692+0000","last_peered":"2023-10-06T04:45:59.393692+0000","last_clean":"2023-10-06T04:45:59.393692+0000","last_became_active":"2023-10-06T04:45:59.381111+0000","last_became_peered":"2023-10-06T04:45:59.381111+0000","last_unstale":"2023-10-06T04:45:59.393692+0000","last_undegraded":"2023-10-06T04:45:59.393692+0000","last_fullsized":"2023-10-06T04:45:59.393692+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:35.027796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.394225+0000","last_change":"2023-10-06T04:45:58.371421+0000","last_active":"2023-10-06T04:45:59.394225+0000","last_peered":"2023-10-06T04:45:59.394225+0000","last_clean":"2023-10-06T04:45:59.394225+0000","last_became_active":"2023-10-06T04:45:58.371149+0000","last_became_peered":"2023-10-06T04:45:58.371149+0000","last_unstale":"2023-10-06T04:45:59.394225+0000","last_undegraded":"2023-10-06T04:45:59.394225+0000","last_fullsized":"2023-10-06T04:45:59.394225+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:48.703741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.394981+0000","last_change":"2023-10-06T04:45:59.393643+0000","last_active":"2023-10-06T04:45:59.394981+0000","last_peered":"2023-10-06T04:45:59.394981+0000","last_clean":"2023-10-06T04:45:59.394981+0000","last_became_active":"2023-10-06T04:45:59.393256+0000","last_became_peered":"2023-10-06T04:45:59.393256+0000","last_unstale":"2023-10-06T04:45:59.394981+0000","last_undegraded":"2023-10-06T04:45:59.394981+0000","last_fullsized":"2023-10-06T04:45:59.394981+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:42.683982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.395037+0000","last_change":"2023-10-06T04:45:58.377285+0000","last_active":"2023-10-06T04:45:59.395037+0000","last_peered":"2023-10-06T04:45:59.395037+0000","last_clean":"2023-10-06T04:45:59.395037+0000","last_became_active":"2023-10-06T04:45:58.376985+0000","last_became_peered":"2023-10-06T04:45:58.376985+0000","last_unstale":"2023-10-06T04:45:59.395037+0000","last_undegraded":"2023-10-06T04:45:59.395037+0000","last_fullsized":"2023-10-06T04:45:59.395037+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:40.662514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.397091+0000","last_change":"2023-10-06T04:45:59.394199+0000","last_active":"2023-10-06T04:45:59.397091+0000","last_peered":"2023-10-06T04:45:59.397091+0000","last_clean":"2023-10-06T04:45:59.397091+0000","last_became_active":"2023-10-06T04:45:59.393882+0000","last_became_peered":"2023-10-06T04:45:59.393882+0000","last_unstale":"2023-10-06T04:45:59.397091+0000","last_undegraded":"2023-10-06T04:45:59.397091+0000","last_fullsized":"2023-10-06T04:45:59.397091+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:17.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.370171+0000","last_change":"2023-10-06T04:45:58.384543+0000","last_active":"2023-10-06T04:45:59.370171+0000","last_peered":"2023-10-06T04:45:59.370171+0000","last_clean":"2023-10-06T04:45:59.370171+0000","last_became_active":"2023-10-06T04:45:58.384231+0000","last_became_peered":"2023-10-06T04:45:58.384231+0000","last_unstale":"2023-10-06T04:45:59.370171+0000","last_undegraded":"2023-10-06T04:45:59.370171+0000","last_fullsized":"2023-10-06T04:45:59.370171+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:12.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.387763+0000","last_change":"2023-10-06T04:45:59.382202+0000","last_active":"2023-10-06T04:45:59.387763+0000","last_peered":"2023-10-06T04:45:59.387763+0000","last_clean":"2023-10-06T04:45:59.387763+0000","last_became_active":"2023-10-06T04:45:59.381885+0000","last_became_peered":"2023-10-06T04:45:59.381885+0000","last_unstale":"2023-10-06T04:45:59.387763+0000","last_undegraded":"2023-10-06T04:45:59.387763+0000","last_fullsized":"2023-10-06T04:45:59.387763+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:07.505833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.394207+0000","last_change":"2023-10-06T04:45:58.367446+0000","last_active":"2023-10-06T04:45:59.394207+0000","last_peered":"2023-10-06T04:45:59.394207+0000","last_clean":"2023-10-06T04:45:59.394207+0000","last_became_active":"2023-10-06T04:45:58.367205+0000","last_became_peered":"2023-10-06T04:45:58.367205+0000","last_unstale":"2023-10-06T04:45:59.394207+0000","last_undegraded":"2023-10-06T04:45:59.394207+0000","last_fullsized":"2023-10-06T04:45:59.394207+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:57.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.391654+0000","last_change":"2023-10-06T04:45:59.387900+0000","last_active":"2023-10-06T04:45:59.391654+0000","last_peered":"2023-10-06T04:45:59.391654+0000","last_clean":"2023-10-06T04:45:59.391654+0000","last_became_active":"2023-10-06T04:45:59.387575+0000","last_became_peered":"2023-10-06T04:45:59.387575+0000","last_unstale":"2023-10-06T04:45:59.391654+0000","last_undegraded":"2023-10-06T04:45:59.391654+0000","last_fullsized":"2023-10-06T04:45:59.391654+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:32.283196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.370583+0000","last_change":"2023-10-06T04:45:58.374574+0000","last_active":"2023-10-06T04:45:59.370583+0000","last_peered":"2023-10-06T04:45:59.370583+0000","last_clean":"2023-10-06T04:45:59.370583+0000","last_became_active":"2023-10-06T04:45:58.374324+0000","last_became_peered":"2023-10-06T04:45:58.374324+0000","last_unstale":"2023-10-06T04:45:59.370583+0000","last_undegraded":"2023-10-06T04:45:59.370583+0000","last_fullsized":"2023-10-06T04:45:59.370583+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:34.789813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.397937+0000","last_change":"2023-10-06T04:45:59.388488+0000","last_active":"2023-10-06T04:45:59.397937+0000","last_peered":"2023-10-06T04:45:59.397937+0000","last_clean":"2023-10-06T04:45:59.397937+0000","last_became_active":"2023-10-06T04:45:59.387911+0000","last_became_peered":"2023-10-06T04:45:59.387911+0000","last_unstale":"2023-10-06T04:45:59.397937+0000","last_undegraded":"2023-10-06T04:45:59.397937+0000","last_fullsized":"2023-10-06T04:45:59.397937+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:49.143907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.366665+0000","last_change":"2023-10-06T04:45:58.386145+0000","last_active":"2023-10-06T04:45:59.366665+0000","last_peered":"2023-10-06T04:45:59.366665+0000","last_clean":"2023-10-06T04:45:59.366665+0000","last_became_active":"2023-10-06T04:45:58.385854+0000","last_became_peered":"2023-10-06T04:45:58.385854+0000","last_unstale":"2023-10-06T04:45:59.366665+0000","last_undegraded":"2023-10-06T04:45:59.366665+0000","last_fullsized":"2023-10-06T04:45:59.366665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:17.470610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.393981+0000","last_change":"2023-10-06T04:45:59.392852+0000","last_active":"2023-10-06T04:45:59.393981+0000","last_peered":"2023-10-06T04:45:59.393981+0000","last_clean":"2023-10-06T04:45:59.393981+0000","last_became_active":"2023-10-06T04:45:59.392542+0000","last_became_peered":"2023-10-06T04:45:59.392542+0000","last_unstale":"2023-10-06T04:45:59.393981+0000","last_undegraded":"2023-10-06T04:45:59.393981+0000","last_fullsized":"2023-10-06T04:45:59.393981+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:22.490478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.361169+0000","last_change":"2023-10-06T04:45:58.374747+0000","last_active":"2023-10-06T04:45:59.361169+0000","last_peered":"2023-10-06T04:45:59.361169+0000","last_clean":"2023-10-06T04:45:59.361169+0000","last_became_active":"2023-10-06T04:45:58.374335+0000","last_became_peered":"2023-10-06T04:45:58.374335+0000","last_unstale":"2023-10-06T04:45:59.361169+0000","last_undegraded":"2023-10-06T04:45:59.361169+0000","last_fullsized":"2023-10-06T04:45:59.361169+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:24.483593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.377482+0000","last_change":"2023-10-06T04:45:59.372977+0000","last_active":"2023-10-06T04:45:59.377482+0000","last_peered":"2023-10-06T04:45:59.377482+0000","last_clean":"2023-10-06T04:45:59.377482+0000","last_became_active":"2023-10-06T04:45:59.372694+0000","last_became_peered":"2023-10-06T04:45:59.372694+0000","last_unstale":"2023-10-06T04:45:59.377482+0000","last_undegraded":"2023-10-06T04:45:59.377482+0000","last_fullsized":"2023-10-06T04:45:59.377482+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:25.975063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.365728+0000","last_change":"2023-10-06T04:45:58.377103+0000","last_active":"2023-10-06T04:45:59.365728+0000","last_peered":"2023-10-06T04:45:59.365728+0000","last_clean":"2023-10-06T04:45:59.365728+0000","last_became_active":"2023-10-06T04:45:58.376840+0000","last_became_peered":"2023-10-06T04:45:58.376840+0000","last_unstale":"2023-10-06T04:45:59.365728+0000","last_undegraded":"2023-10-06T04:45:59.365728+0000","last_fullsized":"2023-10-06T04:45:59.365728+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:42.023055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.364572+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:45:59.364572+0000","last_peered":"2023-10-06T04:45:59.364572+0000","last_clean":"2023-10-06T04:45:59.364572+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:45:59.364572+0000","last_undegraded":"2023-10-06T04:45:59.364572+0000","last_fullsized":"2023-10-06T04:45:59.364572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.387813+0000","last_change":"2023-10-06T04:45:59.384607+0000","last_active":"2023-10-06T04:45:59.387813+0000","last_peered":"2023-10-06T04:45:59.387813+0000","last_clean":"2023-10-06T04:45:59.387813+0000","last_became_active":"2023-10-06T04:45:59.384334+0000","last_became_peered":"2023-10-06T04:45:59.384334+0000","last_unstale":"2023-10-06T04:45:59.387813+0000","last_undegraded":"2023-10-06T04:45:59.387813+0000","last_fullsized":"2023-10-06T04:45:59.387813+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:11.113979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.370580+0000","last_change":"2023-10-06T04:45:58.378021+0000","last_active":"2023-10-06T04:45:59.370580+0000","last_peered":"2023-10-06T04:45:59.370580+0000","last_clean":"2023-10-06T04:45:59.370580+0000","last_became_active":"2023-10-06T04:45:58.377772+0000","last_became_peered":"2023-10-06T04:45:58.377772+0000","last_unstale":"2023-10-06T04:45:59.370580+0000","last_undegraded":"2023-10-06T04:45:59.370580+0000","last_fullsized":"2023-10-06T04:45:59.370580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:33.935139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.367633+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:45:59.367633+0000","last_peered":"2023-10-06T04:45:59.367633+0000","last_clean":"2023-10-06T04:45:59.367633+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:45:59.367633+0000","last_undegraded":"2023-10-06T04:45:59.367633+0000","last_fullsized":"2023-10-06T04:45:59.367633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.399007+0000","last_change":"2023-10-06T04:45:59.397816+0000","last_active":"2023-10-06T04:45:59.399007+0000","last_peered":"2023-10-06T04:45:59.399007+0000","last_clean":"2023-10-06T04:45:59.399007+0000","last_became_active":"2023-10-06T04:45:59.397472+0000","last_became_peered":"2023-10-06T04:45:59.397472+0000","last_unstale":"2023-10-06T04:45:59.399007+0000","last_undegraded":"2023-10-06T04:45:59.399007+0000","last_fullsized":"2023-10-06T04:45:59.399007+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:49.229223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.372290+0000","last_change":"2023-10-06T04:45:58.382369+0000","last_active":"2023-10-06T04:45:59.372290+0000","last_peered":"2023-10-06T04:45:59.372290+0000","last_clean":"2023-10-06T04:45:59.372290+0000","last_became_active":"2023-10-06T04:45:58.382110+0000","last_became_peered":"2023-10-06T04:45:58.382110+0000","last_unstale":"2023-10-06T04:45:59.372290+0000","last_undegraded":"2023-10-06T04:45:59.372290+0000","last_fullsized":"2023-10-06T04:45:59.372290+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:03.339842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.374941+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:45:59.374941+0000","last_peered":"2023-10-06T04:45:59.374941+0000","last_clean":"2023-10-06T04:45:59.374941+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:45:59.374941+0000","last_undegraded":"2023-10-06T04:45:59.374941+0000","last_fullsized":"2023-10-06T04:45:59.374941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":183,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.370245+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:45:59.370245+0000","last_peered":"2023-10-06T04:45:59.370245+0000","last_clean":"2023-10-06T04:45:59.370245+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:45:59.370245+0000","last_undegraded":"2023-10-06T04:45:59.370245+0000","last_fullsized":"2023-10-06T04:45:59.370245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396019+0000","last_change":"2023-10-06T04:45:59.382922+0000","last_active":"2023-10-06T04:45:59.396019+0000","last_peered":"2023-10-06T04:45:59.396019+0000","last_clean":"2023-10-06T04:45:59.396019+0000","last_became_active":"2023-10-06T04:45:59.382626+0000","last_became_peered":"2023-10-06T04:45:59.382626+0000","last_unstale":"2023-10-06T04:45:59.396019+0000","last_undegraded":"2023-10-06T04:45:59.396019+0000","last_fullsized":"2023-10-06T04:45:59.396019+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:31.725740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.366970+0000","last_change":"2023-10-06T04:45:58.382973+0000","last_active":"2023-10-06T04:45:59.366970+0000","last_peered":"2023-10-06T04:45:59.366970+0000","last_clean":"2023-10-06T04:45:59.366970+0000","last_became_active":"2023-10-06T04:45:58.382252+0000","last_became_peered":"2023-10-06T04:45:58.382252+0000","last_unstale":"2023-10-06T04:45:59.366970+0000","last_undegraded":"2023-10-06T04:45:59.366970+0000","last_fullsized":"2023-10-06T04:45:59.366970+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.222034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.370948+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:45:59.370948+0000","last_peered":"2023-10-06T04:45:59.370948+0000","last_clean":"2023-10-06T04:45:59.370948+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:45:59.370948+0000","last_undegraded":"2023-10-06T04:45:59.370948+0000","last_fullsized":"2023-10-06T04:45:59.370948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.387347+0000","last_change":"2023-10-06T04:45:59.383899+0000","last_active":"2023-10-06T04:45:59.387347+0000","last_peered":"2023-10-06T04:45:59.387347+0000","last_clean":"2023-10-06T04:45:59.387347+0000","last_became_active":"2023-10-06T04:45:59.383645+0000","last_became_peered":"2023-10-06T04:45:59.383645+0000","last_unstale":"2023-10-06T04:45:59.387347+0000","last_undegraded":"2023-10-06T04:45:59.387347+0000","last_fullsized":"2023-10-06T04:45:59.387347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:04.347031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:46:00.960735+0000","last_change":"2023-10-06T04:45:58.382870+0000","last_active":"2023-10-06T04:46:00.960735+0000","last_peered":"2023-10-06T04:46:00.960735+0000","last_clean":"2023-10-06T04:46:00.960735+0000","last_became_active":"2023-10-06T04:45:58.382617+0000","last_became_peered":"2023-10-06T04:45:58.382617+0000","last_unstale":"2023-10-06T04:46:00.960735+0000","last_undegraded":"2023-10-06T04:46:00.960735+0000","last_fullsized":"2023-10-06T04:46:00.960735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:16.905907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.370146+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:45:59.370146+0000","last_peered":"2023-10-06T04:45:59.370146+0000","last_clean":"2023-10-06T04:45:59.370146+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:45:59.370146+0000","last_undegraded":"2023-10-06T04:45:59.370146+0000","last_fullsized":"2023-10-06T04:45:59.370146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.390495+0000","last_change":"2023-10-06T04:45:59.389073+0000","last_active":"2023-10-06T04:45:59.390495+0000","last_peered":"2023-10-06T04:45:59.390495+0000","last_clean":"2023-10-06T04:45:59.390495+0000","last_became_active":"2023-10-06T04:45:59.388719+0000","last_became_peered":"2023-10-06T04:45:59.388719+0000","last_unstale":"2023-10-06T04:45:59.390495+0000","last_undegraded":"2023-10-06T04:45:59.390495+0000","last_fullsized":"2023-10-06T04:45:59.390495+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:13.933274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.379607+0000","last_change":"2023-10-06T04:45:58.383128+0000","last_active":"2023-10-06T04:45:59.379607+0000","last_peered":"2023-10-06T04:45:59.379607+0000","last_clean":"2023-10-06T04:45:59.379607+0000","last_became_active":"2023-10-06T04:45:58.382791+0000","last_became_peered":"2023-10-06T04:45:58.382791+0000","last_unstale":"2023-10-06T04:45:59.379607+0000","last_undegraded":"2023-10-06T04:45:59.379607+0000","last_fullsized":"2023-10-06T04:45:59.379607+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:42.436503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.365974+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:45:59.365974+0000","last_peered":"2023-10-06T04:45:59.365974+0000","last_clean":"2023-10-06T04:45:59.365974+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:45:59.365974+0000","last_undegraded":"2023-10-06T04:45:59.365974+0000","last_fullsized":"2023-10-06T04:45:59.365974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.396592+0000","last_change":"2023-10-06T04:45:59.387778+0000","last_active":"2023-10-06T04:45:59.396592+0000","last_peered":"2023-10-06T04:45:59.396592+0000","last_clean":"2023-10-06T04:45:59.396592+0000","last_became_active":"2023-10-06T04:45:59.387451+0000","last_became_peered":"2023-10-06T04:45:59.387451+0000","last_unstale":"2023-10-06T04:45:59.396592+0000","last_undegraded":"2023-10-06T04:45:59.396592+0000","last_fullsized":"2023-10-06T04:45:59.396592+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:06.616155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.365431+0000","last_change":"2023-10-06T04:45:58.374674+0000","last_active":"2023-10-06T04:45:59.365431+0000","last_peered":"2023-10-06T04:45:59.365431+0000","last_clean":"2023-10-06T04:45:59.365431+0000","last_became_active":"2023-10-06T04:45:58.374405+0000","last_became_peered":"2023-10-06T04:45:58.374405+0000","last_unstale":"2023-10-06T04:45:59.365431+0000","last_undegraded":"2023-10-06T04:45:59.365431+0000","last_fullsized":"2023-10-06T04:45:59.365431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:21.225714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.368268+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:45:59.368268+0000","last_peered":"2023-10-06T04:45:59.368268+0000","last_clean":"2023-10-06T04:45:59.368268+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:45:59.368268+0000","last_undegraded":"2023-10-06T04:45:59.368268+0000","last_fullsized":"2023-10-06T04:45:59.368268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.397914+0000","last_change":"2023-10-06T04:45:59.388287+0000","last_active":"2023-10-06T04:45:59.397914+0000","last_peered":"2023-10-06T04:45:59.397914+0000","last_clean":"2023-10-06T04:45:59.397914+0000","last_became_active":"2023-10-06T04:45:59.387539+0000","last_became_peered":"2023-10-06T04:45:59.387539+0000","last_unstale":"2023-10-06T04:45:59.397914+0000","last_undegraded":"2023-10-06T04:45:59.397914+0000","last_fullsized":"2023-10-06T04:45:59.397914+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:58.348938+0000","last_clean_scrub_stamp":"2023-10-06T04:45:58.348938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:13.052548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.365211+0000","last_change":"2023-10-06T04:45:58.384839+0000","last_active":"2023-10-06T04:45:59.365211+0000","last_peered":"2023-10-06T04:45:59.365211+0000","last_clean":"2023-10-06T04:45:59.365211+0000","last_became_active":"2023-10-06T04:45:58.384520+0000","last_became_peered":"2023-10-06T04:45:58.384520+0000","last_unstale":"2023-10-06T04:45:59.365211+0000","last_undegraded":"2023-10-06T04:45:59.365211+0000","last_fullsized":"2023-10-06T04:45:59.365211+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:45:57.341749+0000","last_clean_scrub_stamp":"2023-10-06T04:45:57.341749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:20.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:45:59.368998+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:45:59.368998+0000","last_peered":"2023-10-06T04:45:59.368998+0000","last_clean":"2023-10-06T04:45:59.368998+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:45:59.368998+0000","last_undegraded":"2023-10-06T04:45:59.368998+0000","last_fullsized":"2023-10-06T04:45:59.368998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298388,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073452,"statfs":{"total":96636764160,"available":96331214848,"internally_reserved":0,"allocated":1126400,"data_stored":811826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.3070000000000004,"5min":9.3070000000000004,"15min":9.3070000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.2129999999999992,"5min":9.2129999999999992,"15min":9.2129999999999992},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":9.0850000000000009,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":9.0969999999999995},"last":0.746}]},{"osd":4,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":221958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.78600000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90100000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.64900000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298388,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073452,"statfs":{"total":96636764160,"available":96331214848,"internally_reserved":0,"allocated":1126400,"data_stored":811862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.2509999999999994,"5min":9.2509999999999994,"15min":9.2509999999999994},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":6.4000000000000004,"5min":6.4000000000000004,"15min":6.4000000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.4450000000000003,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.84899999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.69099999999999995},{"interface":"front","average":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":19.992999999999999,"5min":19.992999999999999,"15min":19.992999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":6.476,"5min":6.476,"15min":6.476},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.9050000000000002,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":2.056,"5min":2.056,"15min":2.056},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":19.960999999999999,"5min":19.960999999999999,"15min":19.960999999999999},"last":0.753}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":221390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.63},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.749}]},{"osd":5,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81999999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.83199999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297812,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074028,"statfs":{"total":96636764160,"available":96331804672,"internally_reserved":0,"allocated":536576,"data_stored":222870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.28299999999999997},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":11.241,"5min":11.241,"15min":11.241},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.44},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.273,"5min":11.273,"15min":11.273},"last":0.34799999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.502}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":11.125999999999999,"5min":11.125999999999999,"15min":11.125999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":11.208,"5min":11.208,"15min":11.208},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":5.327,"5min":5.327,"15min":5.327},"last":0.745}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.68200000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297816,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074024,"statfs":{"total":96636764160,"available":96331800576,"internally_reserved":0,"allocated":540672,"data_stored":222892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.435}]},{"osd":1,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.372},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45000000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.85899999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.75}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":221888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.503},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.78200000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.628}]},{"osd":6,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81699999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.749},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.73499999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297800,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074040,"statfs":{"total":96636764160,"available":96331816960,"internally_reserved":0,"allocated":524288,"data_stored":221334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.751},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48699999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.80800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:46:09.031 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:46:09.031 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T04:46:09.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.260+0000 7f731b7ff700 1 Processor -- start 2023-10-06T04:46:09.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.260+0000 7f731b7ff700 1 -- start start 2023-10-06T04:46:09.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.261+0000 7f731b7ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f731415dce0 0x7f731406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.261+0000 7f731b7ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f731406d5a0 0x7f7314069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.261+0000 7f731b7ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7314068700 con 0x7f7314159480 2023-10-06T04:46:09.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.261+0000 7f731b7ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731406d9e0 con 0x7f731406d5a0 2023-10-06T04:46:09.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.261+0000 7f731b7ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73140c9030 con 0x7f731415dce0 2023-10-06T04:46:09.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f7319d9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f731406d5a0 0x7f7314069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f7319d9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f731406d5a0 0x7f7314069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60814/0 (socket says 172.21.15.124:60814) 2023-10-06T04:46:09.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f731959b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f7314159480 0x7f73140c8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53514/0 (socket says 172.21.15.124:53514) 2023-10-06T04:46:09.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f7319d9c700 1 -- 172.21.15.124:0/2169742073 learned_addr learned my addr 172.21.15.124:0/2169742073 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:09.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f7318d9a700 1 --2- 172.21.15.124:0/2169742073 >> v2:172.21.15.158:3300/0 conn(0x7f731415dce0 0x7f731406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f7319d9c700 1 -- 172.21.15.124:0/2169742073 >> v2:172.21.15.158:3300/0 conn(0x7f731415dce0 msgr2=0x7f731406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:09.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f7319d9c700 1 --2- 172.21.15.124:0/2169742073 >> v2:172.21.15.158:3300/0 conn(0x7f731415dce0 0x7f731406d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f7319d9c700 1 -- 172.21.15.124:0/2169742073 >> v1:172.21.15.124:6789/0 conn(0x7f7314159480 legacy=0x7f73140c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f7319d9c700 1 -- 172.21.15.124:0/2169742073 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314068950 con 0x7f731406d5a0 2023-10-06T04:46:09.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f7318d9a700 1 --2- 172.21.15.124:0/2169742073 >> v2:172.21.15.158:3300/0 conn(0x7f731415dce0 0x7f731406d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:09.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f730bfff700 1 -- 172.21.15.124:0/2169742073 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123863741 0 0) 0x7f7314068700 con 0x7f7314159480 2023-10-06T04:46:09.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f7319d9c700 1 --2- 172.21.15.124:0/2169742073 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 0x7f7314069430 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f73141433d0 tx=0x7f730c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cd3818d3080bb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:09.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.262+0000 7f730bfff700 1 -- 172.21.15.124:0/2169742073 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c00e070 con 0x7f731406d5a0 2023-10-06T04:46:09.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.263+0000 7f730bfff700 1 -- 172.21.15.124:0/2169742073 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c00ba50 con 0x7f731406d5a0 2023-10-06T04:46:09.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.263+0000 7f730bfff700 1 -- 172.21.15.124:0/2169742073 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c0092e0 con 0x7f731406d5a0 2023-10-06T04:46:09.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.263+0000 7f731b7ff700 1 -- 172.21.15.124:0/2169742073 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 msgr2=0x7f7314069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.263+0000 7f731b7ff700 1 --2- 172.21.15.124:0/2169742073 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 0x7f7314069430 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f73141433d0 tx=0x7f730c009840 comp rx=0 tx=0).stop 2023-10-06T04:46:09.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.263+0000 7f731b7ff700 1 -- 172.21.15.124:0/2169742073 shutdown_connections 2023-10-06T04:46:09.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.263+0000 7f731b7ff700 1 --2- 172.21.15.124:0/2169742073 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 0x7f7314069430 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.263+0000 7f731b7ff700 1 --2- 172.21.15.124:0/2169742073 >> v2:172.21.15.158:3300/0 conn(0x7f731415dce0 0x7f731406d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.263+0000 7f731b7ff700 1 -- 172.21.15.124:0/2169742073 >> 172.21.15.124:0/2169742073 conn(0x7f7314063cc0 msgr2=0x7f73140ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:09.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.263+0000 7f731b7ff700 1 -- 172.21.15.124:0/2169742073 shutdown_connections 2023-10-06T04:46:09.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.263+0000 7f731b7ff700 1 -- 172.21.15.124:0/2169742073 wait complete. 2023-10-06T04:46:09.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.265+0000 7f731b7ff700 1 Processor -- start 2023-10-06T04:46:09.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.265+0000 7f731b7ff700 1 -- start start 2023-10-06T04:46:09.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f731b7ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 0x7f7314159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f731b7ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7314159480 0x7f7314169bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f731b7ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f731415dce0 0x7f731416a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f731b7ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140c2fb0 con 0x7f731406d5a0 2023-10-06T04:46:09.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f731b7ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140c2cd0 con 0x7f731415dce0 2023-10-06T04:46:09.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f731b7ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7314159d90 con 0x7f7314159480 2023-10-06T04:46:09.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f731959b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 0x7f7314159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f731959b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 0x7f7314159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60822/0 (socket says 172.21.15.124:60822) 2023-10-06T04:46:09.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f731959b700 1 -- 172.21.15.124:0/3469587053 learned_addr learned my addr 172.21.15.124:0/3469587053 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:09.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f7319d9c700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f731415dce0 0x7f731416a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.266+0000 7f7318d9a700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7314159480 0x7f7314169bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f731959b700 1 -- 172.21.15.124:0/3469587053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7314159480 msgr2=0x7f7314169bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f731959b700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7314159480 0x7f7314169bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f731959b700 1 -- 172.21.15.124:0/3469587053 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f731415dce0 msgr2=0x7f731416a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f731959b700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f731415dce0 0x7f731416a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f731959b700 1 -- 172.21.15.124:0/3469587053 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c009ae0 con 0x7f731406d5a0 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f7318d9a700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7314159480 0x7f7314169bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f731959b700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 0x7f7314159850 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f731000c5b0 tx=0x7f7310001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f73097fa700 1 -- 172.21.15.124:0/3469587053 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310005a70 con 0x7f731406d5a0 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f73097fa700 1 -- 172.21.15.124:0/3469587053 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7310005bd0 con 0x7f731406d5a0 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f73097fa700 1 -- 172.21.15.124:0/3469587053 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73100070d0 con 0x7f731406d5a0 2023-10-06T04:46:09.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f731b7ff700 1 -- 172.21.15.124:0/3469587053 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731415c110 con 0x7f731406d5a0 2023-10-06T04:46:09.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.267+0000 7f731b7ff700 1 -- 172.21.15.124:0/3469587053 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731415c6d0 con 0x7f731406d5a0 2023-10-06T04:46:09.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.268+0000 7f731b7ff700 1 -- 172.21.15.124:0/3469587053 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731404c380 con 0x7f731406d5a0 2023-10-06T04:46:09.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.269+0000 7f73097fa700 1 -- 172.21.15.124:0/3469587053 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73100074c0 con 0x7f731406d5a0 2023-10-06T04:46:09.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.270+0000 7f73097fa700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.270+0000 7f73097fa700 1 -- 172.21.15.124:0/3469587053 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7310083bd0 con 0x7f731406d5a0 2023-10-06T04:46:09.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.270+0000 7f7318d9a700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.271+0000 7f7318d9a700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f72f8066f30 0x7f72f80693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f73140b0cd0 tx=0x7f7304008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:09.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.274+0000 7f73097fa700 1 -- 172.21.15.124:0/3469587053 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7310050c40 con 0x7f731406d5a0 2023-10-06T04:46:09.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.537+0000 7f731b7ff700 1 -- 172.21.15.124:0/3469587053 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7314068c30 con 0x7f731406d5a0 2023-10-06T04:46:09.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.541+0000 7f73097fa700 1 -- 172.21.15.124:0/3469587053 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7310017020 con 0x7f731406d5a0 2023-10-06T04:46:09.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 -- 172.21.15.124:0/3469587053 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f72f8066f30 msgr2=0x7f72f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f72f8066f30 0x7f72f80693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f73140b0cd0 tx=0x7f7304008040 comp rx=0 tx=0).stop 2023-10-06T04:46:09.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 -- 172.21.15.124:0/3469587053 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 msgr2=0x7f7314159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 0x7f7314159850 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f731000c5b0 tx=0x7f7310001040 comp rx=0 tx=0).stop 2023-10-06T04:46:09.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 -- 172.21.15.124:0/3469587053 shutdown_connections 2023-10-06T04:46:09.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f731415dce0 0x7f731416a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f731406d5a0 0x7f7314159850 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 --2- 172.21.15.124:0/3469587053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7314159480 0x7f7314169bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 -- 172.21.15.124:0/3469587053 >> 172.21.15.124:0/3469587053 conn(0x7f7314063cc0 msgr2=0x7f73140692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:09.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 -- 172.21.15.124:0/3469587053 shutdown_connections 2023-10-06T04:46:09.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.543+0000 7f731b7ff700 1 -- 172.21.15.124:0/3469587053 wait complete. 2023-10-06T04:46:09.546 INFO:teuthology.orchestra.run.smithi124.stderr:updated caps for client.0 2023-10-06T04:46:09.563 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:46:09.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.756+0000 7f6df4dff700 1 Processor -- start 2023-10-06T04:46:09.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.757+0000 7f6df4dff700 1 -- start start 2023-10-06T04:46:09.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6df4dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6df00cae80 0x7f6df00cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6df4dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6df01598e0 0x7f6df00afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6df4dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df00c1d10 con 0x7f6df00ccec0 2023-10-06T04:46:09.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6df4dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df00cd430 con 0x7f6df01598e0 2023-10-06T04:46:09.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6df4dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00688a0 con 0x7f6df00cae80 2023-10-06T04:46:09.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6dedd9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6df00ccec0 0x7f6df01591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53530/0 (socket says 172.21.15.124:53530) 2023-10-06T04:46:09.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6dedd9b700 1 -- 172.21.15.124:0/2279870919 learned_addr learned my addr 172.21.15.124:0/2279870919 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:46:09.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6dee59c700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6df00cae80 0x7f6df00cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6deed9d700 1 --2- 172.21.15.124:0/2279870919 >> v2:172.21.15.158:3300/0 conn(0x7f6df01598e0 0x7f6df00afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204994531 0 0) 0x7f6df00c1d10 con 0x7f6df00ccec0 2023-10-06T04:46:09.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.758+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd8003570 con 0x7f6df00ccec0 2023-10-06T04:46:09.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3097244324 0 0) 0x7f6dd8003570 con 0x7f6df00ccec0 2023-10-06T04:46:09.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6df00cae80 msgr2=0x7f6df00cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:09.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6df00cae80 0x7f6df00cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 >> v2:172.21.15.158:3300/0 conn(0x7f6df01598e0 msgr2=0x7f6df00afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:09.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 --2- 172.21.15.124:0/2279870919 >> v2:172.21.15.158:3300/0 conn(0x7f6df01598e0 0x7f6df00afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df0068b80 con 0x7f6df00ccec0 2023-10-06T04:46:09.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f6de4001470 con 0x7f6df00ccec0 2023-10-06T04:46:09.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 >> v1:172.21.15.124:6789/0 conn(0x7f6df00ccec0 legacy=0x7f6df01591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6dd8003a60 0x7f6dd8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6df00cae80 0x7f6dd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6dd8004d50 0x7f6dd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00cd430 con 0x7f6dd8004d50 2023-10-06T04:46:09.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00688a0 con 0x7f6dd8003a60 2023-10-06T04:46:09.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd800ba60 con 0x7f6df00cae80 2023-10-06T04:46:09.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6deed9d700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6dd8004d50 0x7f6dd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6dee59c700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6dd8003a60 0x7f6dd8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.759+0000 7f6dedd9b700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6df00cae80 0x7f6dd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.760+0000 7f6deed9d700 1 -- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6df00cae80 msgr2=0x7f6dd8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:09.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.760+0000 7f6deed9d700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6df00cae80 0x7f6dd8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.760+0000 7f6deed9d700 1 -- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6dd8003a60 msgr2=0x7f6dd8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:09.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.760+0000 7f6deed9d700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6dd8003a60 0x7f6dd8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.760+0000 7f6deed9d700 1 -- 172.21.15.124:0/2279870919 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8003570 con 0x7f6dd8004d50 2023-10-06T04:46:09.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.760+0000 7f6deed9d700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6dd8004d50 0x7f6dd80051c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6de800e210 tx=0x7f6de800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5f9969a926e97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:09.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.760+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800ea60 con 0x7f6dd8004d50 2023-10-06T04:46:09.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.760+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de800f040 con 0x7f6dd8004d50 2023-10-06T04:46:09.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.760+0000 7f6ded59a700 1 -- 172.21.15.124:0/2279870919 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800ee10 con 0x7f6dd8004d50 2023-10-06T04:46:09.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.761+0000 7f6df4dff700 1 -- 172.21.15.124:0/2279870919 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6dd8004d50 msgr2=0x7f6dd80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.761+0000 7f6df4dff700 1 --2- 172.21.15.124:0/2279870919 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6dd8004d50 0x7f6dd80051c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6de800e210 tx=0x7f6de800b040 comp rx=0 tx=0).stop 2023-10-06T04:46:09.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.761+0000 7f6deed9d700 1 -- 172.21.15.124:0/2279870919 reap_dead start 2023-10-06T04:46:09.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.761+0000 7f6df4dff700 1 -- 172.21.15.124:0/2279870919 shutdown_connections 2023-10-06T04:46:09.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.761+0000 7f6df4dff700 1 -- 172.21.15.124:0/2279870919 >> 172.21.15.124:0/2279870919 conn(0x7f6df00974f0 msgr2=0x7f6df00639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:09.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.761+0000 7f6df4dff700 1 -- 172.21.15.124:0/2279870919 shutdown_connections 2023-10-06T04:46:09.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.761+0000 7f6df4dff700 1 -- 172.21.15.124:0/2279870919 wait complete. 2023-10-06T04:46:09.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.762+0000 7f6df4dff700 1 Processor -- start 2023-10-06T04:46:09.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.762+0000 7f6df4dff700 1 -- start start 2023-10-06T04:46:09.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.763+0000 7f6df4dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dd8004d50 0x7f6df0159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.763+0000 7f6df4dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6df01589f0 0x7f6df00c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.763+0000 7f6df4dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6df00c8ef0 0x7f6df00c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.763+0000 7f6df4dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00c98a0 con 0x7f6df00c8ef0 2023-10-06T04:46:09.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.763+0000 7f6df4dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df015af90 con 0x7f6df01589f0 2023-10-06T04:46:09.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.763+0000 7f6df4dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00c73b0 con 0x7f6dd8004d50 2023-10-06T04:46:09.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6deed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6df00c8ef0 0x7f6df00c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6deed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6df00c8ef0 0x7f6df00c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60844/0 (socket says 172.21.15.124:60844) 2023-10-06T04:46:09.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6deed9d700 1 -- 172.21.15.124:0/101501972 learned_addr learned my addr 172.21.15.124:0/101501972 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:09.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6dee59c700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dd8004d50 0x7f6df0159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6dedd9b700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6df01589f0 0x7f6df00c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6deed9d700 1 -- 172.21.15.124:0/101501972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dd8004d50 msgr2=0x7f6df0159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6deed9d700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dd8004d50 0x7f6df0159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6deed9d700 1 -- 172.21.15.124:0/101501972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6df01589f0 msgr2=0x7f6df00c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:09.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6deed9d700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6df01589f0 0x7f6df00c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:09.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6deed9d700 1 -- 172.21.15.124:0/101501972 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df015a380 con 0x7f6df00c8ef0 2023-10-06T04:46:09.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.764+0000 7f6deed9d700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6df00c8ef0 0x7f6df00c9360 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6de8016000 tx=0x7f6de801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:09.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.765+0000 7f6dde7fc700 1 -- 172.21.15.124:0/101501972 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800ee60 con 0x7f6df00c8ef0 2023-10-06T04:46:09.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.765+0000 7f6dde7fc700 1 -- 172.21.15.124:0/101501972 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8022070 con 0x7f6df00c8ef0 2023-10-06T04:46:09.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.765+0000 7f6dde7fc700 1 -- 172.21.15.124:0/101501972 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de801e890 con 0x7f6df00c8ef0 2023-10-06T04:46:09.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.765+0000 7f6df4dff700 1 -- 172.21.15.124:0/101501972 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df015a660 con 0x7f6df00c8ef0 2023-10-06T04:46:09.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.765+0000 7f6df4dff700 1 -- 172.21.15.124:0/101501972 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df015ac20 con 0x7f6df00c8ef0 2023-10-06T04:46:09.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.766+0000 7f6df4dff700 1 -- 172.21.15.124:0/101501972 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df0158dc0 con 0x7f6df00c8ef0 2023-10-06T04:46:09.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.767+0000 7f6dde7fc700 1 -- 172.21.15.124:0/101501972 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6de801ec40 con 0x7f6df00c8ef0 2023-10-06T04:46:09.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.768+0000 7f6dde7fc700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6dd0066f30 0x7f6dd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:09.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.768+0000 7f6dde7fc700 1 -- 172.21.15.124:0/101501972 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6de8024070 con 0x7f6df00c8ef0 2023-10-06T04:46:09.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.768+0000 7f6dee59c700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6dd0066f30 0x7f6dd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:09.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.769+0000 7f6dee59c700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6dd0066f30 0x7f6dd00693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6de0006f00 tx=0x7f6de00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:09.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:09.772+0000 7f6dde7fc700 1 -- 172.21.15.124:0/101501972 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6de80533c0 con 0x7f6df00c8ef0 2023-10-06T04:46:10.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.007+0000 7f6df4dff700 1 -- 172.21.15.124:0/101501972 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6df00717a0 con 0x7f6df00c8ef0 2023-10-06T04:46:10.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.008+0000 7f6dde7fc700 1 -- 172.21.15.124:0/101501972 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f6de80569e0 con 0x7f6df00c8ef0 2023-10-06T04:46:10.010 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:46:10.010 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/267826992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":267826992},{"type":"v1","addr":"172.21.15.158:6835","nonce":267826992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/361532770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":361532770},{"type":"v1","addr":"172.21.15.124:6835","nonce":361532770}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1150240645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6836","nonce":1150240645},{"type":"v1","addr":"172.21.15.124:6837","nonce":1150240645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:58.847255+0000","modified":"2023-10-06T04:46:02.379103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6834/1553392288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1553392288},{"type":"v1","addr":"172.21.15.158:6834","nonce":1553392288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:46:10.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.010+0000 7f6df4dff700 1 -- 172.21.15.124:0/101501972 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6dd0066f30 msgr2=0x7f6dd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6dd0066f30 0x7f6dd00693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6de0006f00 tx=0x7f6de00091a0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 -- 172.21.15.124:0/101501972 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6df00c8ef0 msgr2=0x7f6df00c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6df00c8ef0 0x7f6df00c9360 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6de8016000 tx=0x7f6de801a000 comp rx=0 tx=0).stop 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 -- 172.21.15.124:0/101501972 shutdown_connections 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6df00c8ef0 0x7f6df00c9360 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6dd0066f30 0x7f6dd00693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dd8004d50 0x7f6df0159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 --2- 172.21.15.124:0/101501972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6df01589f0 0x7f6df00c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 -- 172.21.15.124:0/101501972 >> 172.21.15.124:0/101501972 conn(0x7f6df00974f0 msgr2=0x7f6df00c3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 -- 172.21.15.124:0/101501972 shutdown_connections 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.011+0000 7f6df4dff700 1 -- 172.21.15.124:0/101501972 wait complete. 2023-10-06T04:46:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 25 2023-10-06T04:46:10.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:45:58.847255+0000', 'modified': '2023-10-06T04:46:02.379103+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5376}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5376': {'gid': 5376, 'name': 'b', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.158:6834/1553392288', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6832', 'nonce': 1553392288}, {'type': 'v1', 'addr': '172.21.15.158:6834', 'nonce': 1553392288}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:46:10.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:46:10.433 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T04:46:10.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.630+0000 7fea373ff700 1 Processor -- start 2023-10-06T04:46:10.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.630+0000 7fea373ff700 1 -- start start 2023-10-06T04:46:10.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.631+0000 7fea373ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fea301594b0 0x7fea300b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.631+0000 7fea373ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea300b1ea0 0x7fea300b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.631+0000 7fea373ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea300b27e0 con 0x7fea3015a580 2023-10-06T04:46:10.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.631+0000 7fea373ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea300b4410 con 0x7fea301594b0 2023-10-06T04:46:10.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.631+0000 7fea373ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea300b46f0 con 0x7fea300b1ea0 2023-10-06T04:46:10.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.632+0000 7fea3519b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fea301594b0 0x7fea300b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.632+0000 7fea3519b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fea301594b0 0x7fea300b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60856/0 (socket says 172.21.15.124:60856) 2023-10-06T04:46:10.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.632+0000 7fea3519b700 1 -- 172.21.15.124:0/2414834781 learned_addr learned my addr 172.21.15.124:0/2414834781 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:10.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.632+0000 7fea3599c700 1 --2- 172.21.15.124:0/2414834781 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea300b1ea0 0x7fea300b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.632+0000 7fea3519b700 1 -- 172.21.15.124:0/2414834781 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea300b1ea0 msgr2=0x7fea300b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:10.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.632+0000 7fea3519b700 1 --2- 172.21.15.124:0/2414834781 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea300b1ea0 0x7fea300b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.632+0000 7fea3519b700 1 -- 172.21.15.124:0/2414834781 >> v1:172.21.15.124:6789/0 conn(0x7fea3015a580 legacy=0x7fea300b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.632+0000 7fea3519b700 1 -- 172.21.15.124:0/2414834781 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea300b49d0 con 0x7fea301594b0 2023-10-06T04:46:10.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.632+0000 7fea27fff700 1 -- 172.21.15.124:0/2414834781 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596726299 0 0) 0x7fea300b27e0 con 0x7fea3015a580 2023-10-06T04:46:10.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.632+0000 7fea3519b700 1 --2- 172.21.15.124:0/2414834781 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 0x7fea300b3d30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0099b0 tx=0x7fea2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da14609cf757b491 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:10.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea27fff700 1 -- 172.21.15.124:0/2414834781 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00b860 con 0x7fea301594b0 2023-10-06T04:46:10.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea27fff700 1 -- 172.21.15.124:0/2414834781 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c00b9c0 con 0x7fea301594b0 2023-10-06T04:46:10.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea27fff700 1 -- 172.21.15.124:0/2414834781 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00bd60 con 0x7fea301594b0 2023-10-06T04:46:10.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea373ff700 1 -- 172.21.15.124:0/2414834781 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 msgr2=0x7fea300b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea373ff700 1 --2- 172.21.15.124:0/2414834781 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 0x7fea300b3d30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0099b0 tx=0x7fea2c009250 comp rx=0 tx=0).stop 2023-10-06T04:46:10.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea373ff700 1 -- 172.21.15.124:0/2414834781 shutdown_connections 2023-10-06T04:46:10.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea373ff700 1 --2- 172.21.15.124:0/2414834781 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea300b1ea0 0x7fea300b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea373ff700 1 --2- 172.21.15.124:0/2414834781 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 0x7fea300b3d30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea373ff700 1 -- 172.21.15.124:0/2414834781 >> 172.21.15.124:0/2414834781 conn(0x7fea3006ed20 msgr2=0x7fea3006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:10.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea373ff700 1 -- 172.21.15.124:0/2414834781 shutdown_connections 2023-10-06T04:46:10.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.633+0000 7fea373ff700 1 -- 172.21.15.124:0/2414834781 wait complete. 2023-10-06T04:46:10.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.635+0000 7fea373ff700 1 Processor -- start 2023-10-06T04:46:10.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.635+0000 7fea373ff700 1 -- start start 2023-10-06T04:46:10.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea373ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea300b1ea0 0x7fea3014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea373ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 0x7fea30150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea373ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea3015a580 0x7fea301525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea373ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea300aea10 con 0x7fea301594b0 2023-10-06T04:46:10.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea373ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea30152140 con 0x7fea3015a580 2023-10-06T04:46:10.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea373ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea30151530 con 0x7fea300b1ea0 2023-10-06T04:46:10.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3499a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 0x7fea30150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3499a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 0x7fea30150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60862/0 (socket says 172.21.15.124:60862) 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3499a700 1 -- 172.21.15.124:0/3174971987 learned_addr learned my addr 172.21.15.124:0/3174971987 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3519b700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea300b1ea0 0x7fea3014d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3599c700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea3015a580 0x7fea301525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3499a700 1 -- 172.21.15.124:0/3174971987 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea300b1ea0 msgr2=0x7fea3014d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3499a700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea300b1ea0 0x7fea3014d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3499a700 1 -- 172.21.15.124:0/3174971987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea3015a580 msgr2=0x7fea301525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3499a700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea3015a580 0x7fea301525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3499a700 1 -- 172.21.15.124:0/3174971987 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c0094f0 con 0x7fea301594b0 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.636+0000 7fea3599c700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea3015a580 0x7fea301525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.637+0000 7fea3499a700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 0x7fea30150730 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fea2000c530 tx=0x7fea2000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.637+0000 7fea257fa700 1 -- 172.21.15.124:0/3174971987 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20011590 con 0x7fea301594b0 2023-10-06T04:46:10.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.637+0000 7fea257fa700 1 -- 172.21.15.124:0/3174971987 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea20011710 con 0x7fea301594b0 2023-10-06T04:46:10.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.637+0000 7fea257fa700 1 -- 172.21.15.124:0/3174971987 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20011ad0 con 0x7fea301594b0 2023-10-06T04:46:10.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.637+0000 7fea373ff700 1 -- 172.21.15.124:0/3174971987 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea30151810 con 0x7fea301594b0 2023-10-06T04:46:10.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.637+0000 7fea373ff700 1 -- 172.21.15.124:0/3174971987 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea30151dd0 con 0x7fea301594b0 2023-10-06T04:46:10.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.639+0000 7fea257fa700 1 -- 172.21.15.124:0/3174971987 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea2001b3b0 con 0x7fea301594b0 2023-10-06T04:46:10.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.640+0000 7fea257fa700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fea14066f30 0x7fea140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.640+0000 7fea257fa700 1 -- 172.21.15.124:0/3174971987 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea20083c10 con 0x7fea301594b0 2023-10-06T04:46:10.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.640+0000 7fea3519b700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fea14066f30 0x7fea140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.641+0000 7fea3519b700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fea14066f30 0x7fea140693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0099b0 tx=0x7fea2c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:10.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.642+0000 7fea45bc3b80 1 Processor -- start 2023-10-06T04:46:10.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.642+0000 7fea45bc3b80 1 -- start start 2023-10-06T04:46:10.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.643+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a74f450 0x557b1a74f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.643+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a757f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.643+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a7584d0 0x557b1a758940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.643+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a622310 con 0x557b1a734f40 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.643+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a65f130 con 0x557b1a74f450 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.643+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b1a65caf0 con 0x557b1a7584d0 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.643+0000 7fea3499a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a757f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.643+0000 7fea3499a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a757f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60872/0 (socket says 172.21.15.124:60872) 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.643+0000 7fea3499a700 1 -- 172.21.15.124:0/57570833 learned_addr learned my addr 172.21.15.124:0/57570833 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea3519b700 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a74f450 0x557b1a74f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea3499a700 1 -- 172.21.15.124:0/57570833 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a7584d0 msgr2=0x557b1a758940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:10.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea3599c700 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a7584d0 0x557b1a758940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea3499a700 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a7584d0 0x557b1a758940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea3499a700 1 -- 172.21.15.124:0/57570833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a74f450 msgr2=0x557b1a74f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:10.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea3499a700 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a74f450 0x557b1a74f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea3499a700 1 -- 172.21.15.124:0/57570833 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1a45e790 con 0x557b1a734f40 2023-10-06T04:46:10.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea3519b700 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a74f450 0x557b1a74f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:10.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea3599c700 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a7584d0 0x557b1a758940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:10.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea3499a700 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a757f90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fea20050e40 tx=0x7fea20081e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2831f7d534e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:10.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea1a7fc700 1 -- 172.21.15.124:0/57570833 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20054940 con 0x557b1a734f40 2023-10-06T04:46:10.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea1a7fc700 1 -- 172.21.15.124:0/57570833 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea20057b90 con 0x557b1a734f40 2023-10-06T04:46:10.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.644+0000 7fea1a7fc700 1 -- 172.21.15.124:0/57570833 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2005b8e0 con 0x557b1a734f40 2023-10-06T04:46:10.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.645+0000 7fea45bc3b80 1 -- 172.21.15.124:0/57570833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 msgr2=0x557b1a757f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.645+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a757f90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fea20050e40 tx=0x7fea20081e90 comp rx=0 tx=0).stop 2023-10-06T04:46:10.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.645+0000 7fea45bc3b80 1 -- 172.21.15.124:0/57570833 shutdown_connections 2023-10-06T04:46:10.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.645+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a7584d0 0x557b1a758940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.645+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a74f450 0x557b1a74f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.645+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/57570833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a757f90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.645+0000 7fea45bc3b80 1 -- 172.21.15.124:0/57570833 >> 172.21.15.124:0/57570833 conn(0x557b1a752880 msgr2=0x557b1a752c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.645+0000 7fea45bc3b80 1 -- 172.21.15.124:0/57570833 shutdown_connections 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.645+0000 7fea45bc3b80 1 -- 172.21.15.124:0/57570833 wait complete. 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.646+0000 7fea45bc3b80 1 -- start start 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.646+0000 7fea45bc3b80 1 Processor -- start 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a735350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a74f450 0x557b1a72f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a7584d0 0x557b1a709fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a6588e0 con 0x557b1a734f40 2023-10-06T04:46:10.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a604980 con 0x557b1a7584d0 2023-10-06T04:46:10.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b1a604620 con 0x557b1a74f450 2023-10-06T04:46:10.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea45bc3b80 10 client.0 _ll_register_callbacks cb 0x557b1a467a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:46:10.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea3519b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a735350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea3519b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a735350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60878/0 (socket says 172.21.15.124:60878) 2023-10-06T04:46:10.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea3519b700 1 -- 172.21.15.124:0/4284513916 learned_addr learned my addr 172.21.15.124:0/4284513916 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:10.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea3519b700 1 -- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a74f450 msgr2=0x557b1a72f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:10.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea3499a700 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a74f450 0x557b1a72f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea3519b700 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a74f450 0x557b1a72f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea3599c700 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a7584d0 0x557b1a709fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea3519b700 1 -- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a7584d0 msgr2=0x557b1a709fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:10.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.648+0000 7fea3519b700 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a7584d0 0x557b1a709fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea3519b700 1 -- 172.21.15.124:0/4284513916 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea30151dd0 con 0x557b1a734f40 2023-10-06T04:46:10.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea3519b700 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a735350 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00bf00 tx=0x7fea2c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd0c88aa8fc5e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea0f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea0f7fe700 1 -- 172.21.15.124:0/4284513916 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c021070 con 0x557b1a734f40 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea0f7fe700 1 -- 172.21.15.124:0/4284513916 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea2c01a630 con 0x557b1a734f40 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4284513916 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b1a6fcd60 con 0x557b1a734f40 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea0f7fe700 1 -- 172.21.15.124:0/4284513916 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea2c01aa00 con 0x557b1a734f40 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea45bc3b80 10 client.5544 fetch_fsmap learned FSMap version 25 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4284513916 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x557b1a54b0a0 con 0x557b1a734f40 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea0f7fe700 1 -- 172.21.15.124:0/4284513916 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b1a6fcd60 con 0x557b1a734f40 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.649+0000 7fea0f7fe700 1 -- 172.21.15.124:0/4284513916 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fea2c030070 con 0x557b1a734f40 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.650+0000 7fea45bc3b80 10 client.5544 fetch_fsmap finished waiting for FSMap version 25 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.650+0000 7fea45bc3b80 10 client.5544 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T04:46:10.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.650+0000 7fea45bc3b80 20 client.5544 populate_metadata read hostname 'smithi124' 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.650+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:6832/1553392288,v1:172.21.15.158:6834/1553392288] conn(0x557b1a72e450 0x557b1a70a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.650+0000 7fea45bc3b80 4 client.5544 mds_command: new command op to 5376 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.650+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4284513916 --> [v2:172.21.15.158:6832/1553392288,v1:172.21.15.158:6834/1553392288] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b1a6d9b30 con 0x557b1a72e450 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.650+0000 7fea3499a700 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:6832/1553392288,v1:172.21.15.158:6834/1553392288] conn(0x557b1a72e450 0x557b1a70a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.651+0000 7fea3499a700 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:6832/1553392288,v1:172.21.15.158:6834/1553392288] conn(0x557b1a72e450 0x557b1a70a500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82bf63b6bb5b87e9 server_cookie=b32f2bd16f11a40c in_seq=0 out_seq=0 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.651+0000 7fea0f7fe700 10 client.5544 ms_handle_connect on v2:172.21.15.158:6832/1553392288 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea0f7fe700 1 -- 172.21.15.124:0/4284513916 <== mds.0 v2:172.21.15.158:6832/1553392288 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557b1a6d9b30 con 0x557b1a72e450 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea0f7fe700 10 client.5544 handle_command_reply: tid=0 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 client.5544 shutdown 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4284513916 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 msgr2=0x557b1a735350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a735350 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00bf00 tx=0x7fea2c021000 comp rx=0 tx=0).stop 2023-10-06T04:46:10.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4284513916 shutdown_connections 2023-10-06T04:46:10.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:6832/1553392288,v1:172.21.15.158:6834/1553392288] conn(0x557b1a72e450 0x557b1a70a500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a7584d0 0x557b1a709fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a734f40 0x557b1a735350 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/4284513916 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a74f450 0x557b1a72f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea0f7fe700 0 client.5544 ms_handle_reset on v2:172.21.15.158:6832/1553392288 2023-10-06T04:46:10.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4284513916 >> 172.21.15.124:0/4284513916 conn(0x557b1a752880 msgr2=0x557b1a704970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:10.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4284513916 shutdown_connections 2023-10-06T04:46:10.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4284513916 wait complete. 2023-10-06T04:46:10.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.652+0000 7fea45bc3b80 20 client.5544 trim_cache size 0 max 16384 2023-10-06T04:46:10.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.669+0000 7fea45bc3b80 1 Processor -- start 2023-10-06T04:46:10.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.670+0000 7fea45bc3b80 1 -- start start 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.670+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a734f40 0x557b1a6ff160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.670+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a74f450 0x557b1a74ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.670+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a7584d0 0x557b1a737c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.670+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a4f01e0 con 0x557b1a7584d0 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.670+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a72db00 con 0x557b1a74f450 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.670+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b1a707040 con 0x557b1a734f40 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea3599c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a7584d0 0x557b1a737c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea3599c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a7584d0 0x557b1a737c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60882/0 (socket says 172.21.15.124:60882) 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea3599c700 1 -- 172.21.15.124:0/4087608321 learned_addr learned my addr 172.21.15.124:0/4087608321 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea3599c700 1 -- 172.21.15.124:0/4087608321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a734f40 msgr2=0x557b1a6ff160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea3599c700 1 --2- 172.21.15.124:0/4087608321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a734f40 0x557b1a6ff160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea3599c700 1 -- 172.21.15.124:0/4087608321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a74f450 msgr2=0x557b1a74ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:10.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea3599c700 1 --2- 172.21.15.124:0/4087608321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a74f450 0x557b1a74ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea3599c700 1 -- 172.21.15.124:0/4087608321 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1a6273c0 con 0x557b1a7584d0 2023-10-06T04:46:10.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea3599c700 1 --2- 172.21.15.124:0/4087608321 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a7584d0 0x557b1a737c40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fea28009ed0 tx=0x7fea2800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109508b38e88b10c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:10.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea1affd700 1 -- 172.21.15.124:0/4087608321 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28007e80 con 0x557b1a7584d0 2023-10-06T04:46:10.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea1affd700 1 -- 172.21.15.124:0/4087608321 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2800f070 con 0x557b1a7584d0 2023-10-06T04:46:10.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.671+0000 7fea1affd700 1 -- 172.21.15.124:0/4087608321 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea280166a0 con 0x557b1a7584d0 2023-10-06T04:46:10.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.672+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4087608321 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a7584d0 msgr2=0x557b1a737c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.672+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/4087608321 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a7584d0 0x557b1a737c40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fea28009ed0 tx=0x7fea2800b040 comp rx=0 tx=0).stop 2023-10-06T04:46:10.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.672+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4087608321 shutdown_connections 2023-10-06T04:46:10.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.672+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/4087608321 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a7584d0 0x557b1a737c40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.672+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/4087608321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a734f40 0x557b1a6ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.672+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/4087608321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a74f450 0x557b1a74ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.672+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4087608321 >> 172.21.15.124:0/4087608321 conn(0x557b1a752880 msgr2=0x557b1a7057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:10.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.672+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4087608321 shutdown_connections 2023-10-06T04:46:10.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.672+0000 7fea45bc3b80 1 -- 172.21.15.124:0/4087608321 wait complete. 2023-10-06T04:46:10.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.673+0000 7fea45bc3b80 1 -- start start 2023-10-06T04:46:10.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.673+0000 7fea45bc3b80 1 Processor -- start 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a734f40 0x557b1a751290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a74f450 0x557b1a729fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea45bc3b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a7584d0 0x557b1a757490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a7b5160 con 0x557b1a74f450 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a72b490 con 0x557b1a7584d0 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea45bc3b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b1a750e00 con 0x557b1a734f40 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea45bc3b80 10 client.0 _ll_register_callbacks cb 0x557b1a467a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea3499a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a74f450 0x557b1a729fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea3499a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a74f450 0x557b1a729fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60886/0 (socket says 172.21.15.124:60886) 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea3499a700 1 -- 172.21.15.124:0/229923672 learned_addr learned my addr 172.21.15.124:0/229923672 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:10.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea3519b700 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a734f40 0x557b1a751290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.674+0000 7fea3599c700 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a7584d0 0x557b1a757490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea3499a700 1 -- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a734f40 msgr2=0x557b1a751290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea3499a700 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a734f40 0x557b1a751290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea3499a700 1 -- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a7584d0 msgr2=0x557b1a757490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea3499a700 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a7584d0 0x557b1a757490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea3499a700 1 -- 172.21.15.124:0/229923672 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea28009c00 con 0x557b1a74f450 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea3499a700 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a74f450 0x557b1a729fd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fea20001290 tx=0x7fea2007f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8b0827395e5bf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea0f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea0f7fe700 1 -- 172.21.15.124:0/229923672 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20011c30 con 0x557b1a74f450 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea45bc3b80 1 -- 172.21.15.124:0/229923672 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea20057b90 con 0x557b1a74f450 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea0f7fe700 1 -- 172.21.15.124:0/229923672 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea20068070 con 0x557b1a74f450 2023-10-06T04:46:10.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea0f7fe700 1 -- 172.21.15.124:0/229923672 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea20054040 con 0x557b1a74f450 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea45bc3b80 10 client.5550 fetch_fsmap learned FSMap version 25 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea45bc3b80 1 -- 172.21.15.124:0/229923672 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x557b1a4bf1d0 con 0x557b1a74f450 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea0f7fe700 1 -- 172.21.15.124:0/229923672 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea20057b90 con 0x557b1a74f450 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea0f7fe700 1 -- 172.21.15.124:0/229923672 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fea2005b450 con 0x557b1a74f450 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea45bc3b80 10 client.5550 fetch_fsmap finished waiting for FSMap version 25 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea45bc3b80 10 client.5550 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.675+0000 7fea45bc3b80 20 client.5550 populate_metadata read hostname 'smithi124' 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.676+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:6832/1553392288,v1:172.21.15.158:6834/1553392288] conn(0x557b1a7b4300 0x557b1a7b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.676+0000 7fea45bc3b80 4 client.5550 mds_command: new command op to 5376 tid=0[{"prefix": "status"}] 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.676+0000 7fea45bc3b80 1 -- 172.21.15.124:0/229923672 --> [v2:172.21.15.158:6832/1553392288,v1:172.21.15.158:6834/1553392288] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557b1a5fb8d0 con 0x557b1a7b4300 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.676+0000 7fea3519b700 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:6832/1553392288,v1:172.21.15.158:6834/1553392288] conn(0x557b1a7b4300 0x557b1a7b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.676+0000 7fea0f7fe700 10 client.5550 ms_handle_connect on v2:172.21.15.158:6832/1553392288 2023-10-06T04:46:10.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.676+0000 7fea3519b700 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:6832/1553392288,v1:172.21.15.158:6834/1553392288] conn(0x557b1a7b4300 0x557b1a7b46d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4889ffd815d0cd71 server_cookie=2f9e0926225dcb20 in_seq=0 out_seq=0 2023-10-06T04:46:10.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea0f7fe700 1 -- 172.21.15.124:0/229923672 <== mds.0 v2:172.21.15.158:6832/1553392288 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557b1a5fb8d0 con 0x557b1a7b4300 2023-10-06T04:46:10.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea0f7fe700 10 client.5550 handle_command_reply: tid=0 2023-10-06T04:46:10.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 client.5550 shutdown 2023-10-06T04:46:10.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 -- 172.21.15.124:0/229923672 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a74f450 msgr2=0x557b1a729fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a74f450 0x557b1a729fd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fea20001290 tx=0x7fea2007f040 comp rx=0 tx=0).stop 2023-10-06T04:46:10.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 -- 172.21.15.124:0/229923672 shutdown_connections 2023-10-06T04:46:10.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:6832/1553392288,v1:172.21.15.158:6834/1553392288] conn(0x557b1a7b4300 0x557b1a7b46d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557b1a7584d0 0x557b1a757490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x557b1a734f40 0x557b1a751290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 --2- 172.21.15.124:0/229923672 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x557b1a74f450 0x557b1a729fd0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea0f7fe700 0 client.5550 ms_handle_reset on v2:172.21.15.158:6832/1553392288 2023-10-06T04:46:10.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 -- 172.21.15.124:0/229923672 >> 172.21.15.124:0/229923672 conn(0x557b1a752880 msgr2=0x557b1a752c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:10.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 -- 172.21.15.124:0/229923672 shutdown_connections 2023-10-06T04:46:10.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 1 -- 172.21.15.124:0/229923672 wait complete. 2023-10-06T04:46:10.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.677+0000 7fea45bc3b80 20 client.5550 trim_cache size 0 max 16384 2023-10-06T04:46:10.684 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:46:10.684 INFO:teuthology.orchestra.run.smithi124.stdout: "cluster_fsid": "8703c690-5fd4-410f-8b5d-95264116cbcb", 2023-10-06T04:46:10.684 INFO:teuthology.orchestra.run.smithi124.stdout: "whoami": 0, 2023-10-06T04:46:10.684 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 5376, 2023-10-06T04:46:10.685 INFO:teuthology.orchestra.run.smithi124.stdout: "want_state": "up:active", 2023-10-06T04:46:10.685 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "up:active", 2023-10-06T04:46:10.685 INFO:teuthology.orchestra.run.smithi124.stdout: "fs_name": "cephfs", 2023-10-06T04:46:10.685 INFO:teuthology.orchestra.run.smithi124.stdout: "rank_uptime": 11.318524359, 2023-10-06T04:46:10.685 INFO:teuthology.orchestra.run.smithi124.stdout: "mdsmap_epoch": 25, 2023-10-06T04:46:10.685 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch": 45, 2023-10-06T04:46:10.685 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch_barrier": 45, 2023-10-06T04:46:10.685 INFO:teuthology.orchestra.run.smithi124.stdout: "uptime": 18.016189915999998 2023-10-06T04:46:10.685 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:46:10.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 -- 172.21.15.124:0/3174971987 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fea14066f30 msgr2=0x7fea140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fea14066f30 0x7fea140693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0099b0 tx=0x7fea2c017000 comp rx=0 tx=0).stop 2023-10-06T04:46:10.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 -- 172.21.15.124:0/3174971987 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 msgr2=0x7fea30150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 0x7fea30150730 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fea2000c530 tx=0x7fea2000c840 comp rx=0 tx=0).stop 2023-10-06T04:46:10.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 -- 172.21.15.124:0/3174971987 shutdown_connections 2023-10-06T04:46:10.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea3015a580 0x7fea301525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fea14066f30 0x7fea140693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea300b1ea0 0x7fea3014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 --2- 172.21.15.124:0/3174971987 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea301594b0 0x7fea30150730 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 -- 172.21.15.124:0/3174971987 >> 172.21.15.124:0/3174971987 conn(0x7fea3006ed20 msgr2=0x7fea30159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:10.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 -- 172.21.15.124:0/3174971987 shutdown_connections 2023-10-06T04:46:10.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.678+0000 7fea373ff700 1 -- 172.21.15.124:0/3174971987 wait complete. 2023-10-06T04:46:10.696 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:46:10.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.884+0000 7f2017fff700 1 Processor -- start 2023-10-06T04:46:10.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.885+0000 7f2017fff700 1 -- start start 2023-10-06T04:46:10.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f2017fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f20100ac3d0 0x7f20100aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f2017fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f201006a850 0x7f201006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f2017fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201006e870 con 0x7f20100af350 2023-10-06T04:46:10.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f2017fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2010069cb0 con 0x7f20100ac3d0 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f2017fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2010156110 con 0x7f201006a850 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f2015d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f20100ac3d0 0x7f20100aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f201559a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f20100af350 0x7f201006a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:53546/0 (socket says 172.21.15.124:53546) 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f2015d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f20100ac3d0 0x7f20100aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60896/0 (socket says 172.21.15.124:60896) 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f201559a700 1 -- 172.21.15.124:0/18393833 learned_addr learned my addr 172.21.15.124:0/18393833 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f201659c700 1 --2- 172.21.15.124:0/18393833 >> v2:172.21.15.158:3300/0 conn(0x7f201006a850 0x7f201006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f2015d9b700 1 -- 172.21.15.124:0/18393833 >> v2:172.21.15.158:3300/0 conn(0x7f201006a850 msgr2=0x7f201006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.886+0000 7f2015d9b700 1 --2- 172.21.15.124:0/18393833 >> v2:172.21.15.158:3300/0 conn(0x7f201006a850 0x7f201006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.887+0000 7f2015d9b700 1 -- 172.21.15.124:0/18393833 >> v1:172.21.15.124:6789/0 conn(0x7f20100af350 legacy=0x7f201006a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.887+0000 7f2015d9b700 1 -- 172.21.15.124:0/18393833 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201006eaa0 con 0x7f20100ac3d0 2023-10-06T04:46:10.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.887+0000 7f2014d99700 1 -- 172.21.15.124:0/18393833 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473814558 0 0) 0x7f201006e870 con 0x7f20100af350 2023-10-06T04:46:10.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.887+0000 7f2015d9b700 1 --2- 172.21.15.124:0/18393833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20100ac3d0 0x7f20100aee10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f201006b1a0 tx=0x7f200c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a7a2282070a495 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:10.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.887+0000 7f2014d99700 1 -- 172.21.15.124:0/18393833 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00b740 con 0x7f20100ac3d0 2023-10-06T04:46:10.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.887+0000 7f2014d99700 1 -- 172.21.15.124:0/18393833 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c00b8a0 con 0x7f20100ac3d0 2023-10-06T04:46:10.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.887+0000 7f2014d99700 1 -- 172.21.15.124:0/18393833 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00bc40 con 0x7f20100ac3d0 2023-10-06T04:46:10.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.887+0000 7f2017fff700 1 -- 172.21.15.124:0/18393833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20100ac3d0 msgr2=0x7f20100aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.887+0000 7f2017fff700 1 --2- 172.21.15.124:0/18393833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20100ac3d0 0x7f20100aee10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f201006b1a0 tx=0x7f200c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.888+0000 7f2017fff700 1 -- 172.21.15.124:0/18393833 shutdown_connections 2023-10-06T04:46:10.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.888+0000 7f2017fff700 1 --2- 172.21.15.124:0/18393833 >> v2:172.21.15.158:3300/0 conn(0x7f201006a850 0x7f201006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.888+0000 7f2017fff700 1 --2- 172.21.15.124:0/18393833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20100ac3d0 0x7f20100aee10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.888+0000 7f2017fff700 1 -- 172.21.15.124:0/18393833 >> 172.21.15.124:0/18393833 conn(0x7f20100cc050 msgr2=0x7f20100cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:10.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.888+0000 7f2017fff700 1 -- 172.21.15.124:0/18393833 shutdown_connections 2023-10-06T04:46:10.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.888+0000 7f2017fff700 1 -- 172.21.15.124:0/18393833 wait complete. 2023-10-06T04:46:10.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.889+0000 7f2017fff700 1 Processor -- start 2023-10-06T04:46:10.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.889+0000 7f2017fff700 1 -- start start 2023-10-06T04:46:10.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.890+0000 7f2017fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201006a850 0x7f2010168180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.890+0000 7f2017fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20100ac3d0 0x7f2010157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.890+0000 7f2017fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20100af350 0x7f20100c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.890+0000 7f2017fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2010158fc0 con 0x7f201006a850 2023-10-06T04:46:10.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.890+0000 7f2017fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2010158440 con 0x7f20100ac3d0 2023-10-06T04:46:10.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.890+0000 7f2017fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2010158720 con 0x7f20100af350 2023-10-06T04:46:10.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.890+0000 7f2015d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201006a850 0x7f2010168180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.890+0000 7f2015d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201006a850 0x7f2010168180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60910/0 (socket says 172.21.15.124:60910) 2023-10-06T04:46:10.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.890+0000 7f2015d9b700 1 -- 172.21.15.124:0/713694773 learned_addr learned my addr 172.21.15.124:0/713694773 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:46:10.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f2015d9b700 1 -- 172.21.15.124:0/713694773 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20100af350 msgr2=0x7f20100c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f2015d9b700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20100af350 0x7f20100c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f201559a700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20100ac3d0 0x7f2010157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f2015d9b700 1 -- 172.21.15.124:0/713694773 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20100ac3d0 msgr2=0x7f2010157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f2015d9b700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20100ac3d0 0x7f2010157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f2015d9b700 1 -- 172.21.15.124:0/713694773 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c009420 con 0x7f201006a850 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f201559a700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20100ac3d0 0x7f2010157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f2015d9b700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201006a850 0x7f2010168180 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f201006c840 tx=0x7f200c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f2005ffb700 1 -- 172.21.15.124:0/713694773 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00bc20 con 0x7f201006a850 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f2005ffb700 1 -- 172.21.15.124:0/713694773 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c011420 con 0x7f201006a850 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f2005ffb700 1 -- 172.21.15.124:0/713694773 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0117e0 con 0x7f201006a850 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.891+0000 7f2017fff700 1 -- 172.21.15.124:0/713694773 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2010158a00 con 0x7f201006a850 2023-10-06T04:46:10.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.892+0000 7f2017fff700 1 -- 172.21.15.124:0/713694773 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2010157f80 con 0x7f201006a850 2023-10-06T04:46:10.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.893+0000 7f2017fff700 1 -- 172.21.15.124:0/713694773 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20101581a0 con 0x7f201006a850 2023-10-06T04:46:10.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.893+0000 7f2005ffb700 1 -- 172.21.15.124:0/713694773 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f200c011b50 con 0x7f201006a850 2023-10-06T04:46:10.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.894+0000 7f2005ffb700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1ff4066f30 0x7f1ff40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:46:10.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.894+0000 7f2005ffb700 1 -- 172.21.15.124:0/713694773 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f200c085ca0 con 0x7f201006a850 2023-10-06T04:46:10.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.894+0000 7f201559a700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1ff4066f30 0x7f1ff40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:46:10.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.895+0000 7f201559a700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1ff4066f30 0x7f1ff40693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2010143f40 tx=0x7f2000009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:46:10.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:10.898+0000 7f2005ffb700 1 -- 172.21.15.124:0/713694773 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f200c052d10 con 0x7f201006a850 2023-10-06T04:46:11.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.132+0000 7f2017fff700 1 -- 172.21.15.124:0/713694773 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f20100717a0 con 0x7f201006a850 2023-10-06T04:46:11.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.133+0000 7f2005ffb700 1 -- 172.21.15.124:0/713694773 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f200c015070 con 0x7f201006a850 2023-10-06T04:46:11.134 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:46:11.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 -- 172.21.15.124:0/713694773 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1ff4066f30 msgr2=0x7f1ff40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:11.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1ff4066f30 0x7f1ff40693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2010143f40 tx=0x7f2000009040 comp rx=0 tx=0).stop 2023-10-06T04:46:11.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 -- 172.21.15.124:0/713694773 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201006a850 msgr2=0x7f2010168180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:46:11.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201006a850 0x7f2010168180 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f201006c840 tx=0x7f200c017000 comp rx=0 tx=0).stop 2023-10-06T04:46:11.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 -- 172.21.15.124:0/713694773 shutdown_connections 2023-10-06T04:46:11.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f1ff4066f30 0x7f1ff40693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:11.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20100af350 0x7f20100c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:11.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f201006a850 0x7f2010168180 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:11.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 --2- 172.21.15.124:0/713694773 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20100ac3d0 0x7f2010157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:46:11.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 -- 172.21.15.124:0/713694773 >> 172.21.15.124:0/713694773 conn(0x7f20100cc050 msgr2=0x7f20100afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:46:11.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 -- 172.21.15.124:0/713694773 shutdown_connections 2023-10-06T04:46:11.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:46:11.135+0000 7f2017fff700 1 -- 172.21.15.124:0/713694773 wait complete. 2023-10-06T04:46:11.154 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:46:11.154 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:46:11.154 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2023-10-06T04:46:11.154 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:46:11.154 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:46:11.155 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:46:11.155 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T04:46:11.155 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:46:11.155 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:46:11.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:46:11.155 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2023-10-06T04:46:11.203 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:46:11.203 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:46:11.203 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:46:11.203 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:46:11.203 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-06T04:46:11.203 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:46:11.203 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:46:11.203 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f0 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f1 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42187sec preferred_lft 42187sec 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::ec4:7aff:fe8f:d5c5/64 scope link 2023-10-06T04:46:11.204 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 4e:9e:1a:d5:9e:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::c4a5:a6ff:fe18:bdf9/64 scope link 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 4e:9e:1a:d5:9e:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::4c9e:1aff:fed5:9e13/64 scope link 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether ca:1e:a5:85:3d:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:46:11.205 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::c81e:a5ff:fe85:3d1a/64 scope link 2023-10-06T04:46:11.206 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:46:11.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:46:11.207 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:46:11.274 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-06T04:46:11.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:46:11.277 DEBUG:teuthology.orchestra.run.smithi124:> route 2023-10-06T04:46:11.328 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2023-10-06T04:46:11.328 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:46:11.328 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:46:11.328 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:46:11.329 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:46:11.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:46:11.329 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T04:46:11.329 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T04:46:11.329 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:46:11.330 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:46:11.330 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:46:11.330 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T04:46:11.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:46:11.500 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T04:46:11.547 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:46:11.547 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:46:11.548 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:46:11.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:46:11.548 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.0 up 2023-10-06T04:46:11.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:46:11.658 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:46:11.703 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:46:11.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:46:11.704 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:46:11.790 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T04:46:11.790 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:46:11.790 DEBUG:teuthology.orchestra.run.smithi124:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:46:11.929 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:46:11.929 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:46:11.957 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:46:11.958 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:46:11.958 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-06T04:46:11.958 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 0@8703c690-5fd4-410f-8b5d-95264116cbcb.cephfs=/ 2023-10-06T04:46:11.958 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.124:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-06T04:46:11.962 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:46:11.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:46:11.962 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:46:12.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:46:12.033 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://github.com/ceph/ceph-qa-suite) 2023-10-06T04:46:12.089 INFO:teuthology.orchestra.run.smithi124.stderr:Cloning into 'ceph-qa-suite'... 2023-10-06T04:46:20.095 INFO:teuthology.orchestra.run.smithi124.stderr:Updating files: 47% (665/1396) Updating files: 48% (671/1396) Updating files: 49% (685/1396) Updating files: 50% (698/1396) Updating files: 51% (712/1396) Updating files: 52% (726/1396) Updating files: 53% (740/1396) Updating files: 54% (754/1396) Updating files: 55% (768/1396) Updating files: 56% (782/1396) Updating files: 57% (796/1396) Updating files: 58% (810/1396) Updating files: 59% (824/1396) Updating files: 60% (838/1396) Updating files: 61% (852/1396) Updating files: 62% (866/1396) Updating files: 63% (880/1396) Updating files: 64% (894/1396) Updating files: 65% (908/1396) Updating files: 66% (922/1396) Updating files: 67% (936/1396) Updating files: 68% (950/1396) Updating files: 69% (964/1396) Updating files: 70% (978/1396) Updating files: 71% (992/1396) Updating files: 72% (1006/1396) Updating files: 73% (1020/1396) Updating files: 74% (1034/1396) Updating files: 75% (1047/1396) Updating files: 76% (1061/1396) Updating files: 77% (1075/1396) Updating files: 77% (1085/1396) Updating files: 78% (1089/1396) Updating files: 79% (1103/1396) Updating files: 80% (1117/1396) Updating files: 81% (1131/1396) Updating files: 82% (1145/1396) Updating files: 83% (1159/1396) Updating files: 84% (1173/1396) Updating files: 85% (1187/1396) Updating files: 86% (1201/1396) Updating files: 87% (1215/1396) Updating files: 88% (1229/1396) Updating files: 89% (1243/1396) Updating files: 90% (1257/1396) Updating files: 91% (1271/1396) Updating files: 92% (1285/1396) Updating files: 93% (1299/1396) Updating files: 94% (1313/1396) Updating files: 95% (1327/1396) Updating files: 96% (1341/1396) Updating files: 97% (1355/1396) Updating files: 98% (1369/1396) Updating files: 99% (1383/1396) Updating files: 100% (1396/1396) Updating files: 100% (1396/1396), done. 2023-10-06T04:46:20.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:46:20.104 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T04:46:20.366 INFO:teuthology.orchestra.run.smithi124.stdout:./ 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=3-m=1.yaml 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=isa-k=2-m=1.yaml 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=2-m=1.yaml 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=shec-k=4-m=3-c=2.yaml 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code/ec-feature-plugins-v3.yaml 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code/ec-rados-default.yaml 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code/ec-rados-sequential.yaml 2023-10-06T04:46:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code/ec-rados-parallel.yaml 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/erasure-code/ec-feature-plugins-v2.yaml 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/releases 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/releases/jewel.yaml 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/releases/kraken.yaml 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/releases/infernalis.yaml 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tox.ini 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/ceph-deploy-overrides 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/ceph-deploy-overrides/enable_dmcrypt_diff_journal_disk.yaml 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/ceph-deploy-overrides/ceph_deploy_dmcrypt.yaml 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/ceph-deploy-overrides/enable_diff_journal_disk.yaml 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/ceph-deploy-overrides/disable_diff_journal_disk.yaml 2023-10-06T04:46:20.368 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/nightlies 2023-10-06T04:46:20.369 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/nightlies/cron_wrapper 2023-10-06T04:46:20.369 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/overrides 2023-10-06T04:46:20.369 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/overrides/3-size-2-min-size.yaml 2023-10-06T04:46:20.369 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.369 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/overrides/2-size-2-min-size.yaml 2023-10-06T04:46:20.369 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/overrides/2-size-1-min-size.yaml 2023-10-06T04:46:20.369 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/overrides/short_pg_log.yaml 2023-10-06T04:46:20.369 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/packages 2023-10-06T04:46:20.369 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/packages/packages.yaml 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/clusters 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/clusters/extra-client.yaml 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/clusters/fixed-2.yaml 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/clusters/fixed-3.yaml 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/clusters/fixed-3-cephfs.yaml 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/clusters/fixed-4.yaml 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/clusters/fixed-1.yaml 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/overrides 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/overrides/debug.yaml 2023-10-06T04:46:20.370 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/overrides/fuse 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm/yes.yaml 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm/no.yaml 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm/% 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/overrides/frag_enable.yaml 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/clusters 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/clusters/9-mds.yaml 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/clusters/3-mds.yaml 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/clusters/fixed-2-ucephfs.yaml 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/mount 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/mount/kclient.yaml 2023-10-06T04:46:20.371 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/mount/fuse.yaml 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/begin.yaml 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/tasks 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/tasks/libcephfs_interface_tests.yaml 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_trivial_sync.yaml 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_ffsb.yaml 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_blogbench.yaml 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_dbench.yaml 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/objectstore 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/objectstore/bluestore.yaml 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/objectstore/filestore.yaml 2023-10-06T04:46:20.372 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/config 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/config/rados.yaml 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/archs 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/archs/armv7.yaml 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/archs/i686.yaml 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/archs/aarch64.yaml 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/archs/x86_64.yaml 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/fs 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/fs/btrfs.yaml 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/fs/xfs.yaml 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/fs/ext4.yaml 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/rgw_pool_type 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/rgw_pool_type/ec-profile.yaml 2023-10-06T04:46:20.373 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/rgw_pool_type/ec.yaml 2023-10-06T04:46:20.374 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/rgw_pool_type/ec-cache.yaml 2023-10-06T04:46:20.374 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/rgw_pool_type/replicated.yaml 2023-10-06T04:46:20.374 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git 2023-10-06T04:46:20.374 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/HEAD 2023-10-06T04:46:20.374 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/description 2023-10-06T04:46:20.374 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/index 2023-10-06T04:46:20.374 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/objects 2023-10-06T04:46:20.374 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/objects/info 2023-10-06T04:46:20.374 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/objects/pack 2023-10-06T04:46:20.374 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.idx 2023-10-06T04:46:20.375 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.pack 2023-10-06T04:46:20.375 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks 2023-10-06T04:46:20.375 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/pre-merge-commit.sample 2023-10-06T04:46:20.390 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/pre-commit.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/fsmonitor-watchman.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/commit-msg.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/pre-rebase.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/pre-receive.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/prepare-commit-msg.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/update.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/pre-push.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/pre-applypatch.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/push-to-checkout.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/post-update.sample 2023-10-06T04:46:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/hooks/applypatch-msg.sample 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/logs 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/logs/HEAD 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/logs/refs 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/logs/refs/heads 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/logs/refs/heads/master 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/logs/refs/remotes 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/logs/refs/remotes/origin 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/logs/refs/remotes/origin/HEAD 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/packed-refs 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/config 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/info 2023-10-06T04:46:20.392 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/info/exclude 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/refs 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/refs/tags 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/refs/heads 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/refs/heads/master 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/refs/remotes 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/refs/remotes/origin 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/refs/remotes/origin/HEAD 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.git/branches 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/config_options 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/config_options/cephdeploy_conf.yaml 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/a-supported-distro.yaml 2023-10-06T04:46:20.393 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/supported 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/supported/ubuntu_16.04.yaml 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/supported/centos_7.2.yaml 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/supported/ubuntu_14.04.yaml 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/fedora_17.yaml 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/centos_6.4.yaml 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/debian_7.0.yaml 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/debian_6.0.yaml 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/fedora_19.yaml 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/ubuntu_16.04.yaml 2023-10-06T04:46:20.394 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/opensuse_13.2.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/opensuse_12.2.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/rhel_6.3.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/sles_11-sp2.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/centos_7.2.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/rhel_6.4.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/centos_7.0.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/ubuntu_14.04_i686.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/opensuse_42.1.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/debian_8.0.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/fedora_18.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/rhel_7.0.yaml 2023-10-06T04:46:20.395 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/ubuntu_14.04.yaml 2023-10-06T04:46:20.396 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/centos_7.1.yaml 2023-10-06T04:46:20.396 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/ubuntu_12.10.yaml 2023-10-06T04:46:20.396 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/ubuntu_12.04.yaml 2023-10-06T04:46:20.396 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/centos_6.3.yaml 2023-10-06T04:46:20.396 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/rhel_6.5.yaml 2023-10-06T04:46:20.396 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/ubuntu_14.04_aarch64.yaml 2023-10-06T04:46:20.396 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/distros/all/centos_6.5.yaml 2023-10-06T04:46:20.397 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites 2023-10-06T04:46:20.397 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress 2023-10-06T04:46:20.397 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/bench 2023-10-06T04:46:20.397 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/bench/clusters 2023-10-06T04:46:20.397 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/bench/clusters/fixed-3-cephfs.yaml 2023-10-06T04:46:20.397 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/bench/% 2023-10-06T04:46:20.397 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/bench/tasks 2023-10-06T04:46:20.397 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/bench/tasks/kclient_workunit_suites_fsx.yaml 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/bench/tasks/cfuse_workunit_snaps.yaml 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/clusters 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/clusters/16-osd.yaml 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/clusters/3-osd-1-machine.yaml 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/clusters/8-osd.yaml 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/fs 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/fs/none.yaml 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/fs/btrfs.yaml 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/fs/xfs.yaml 2023-10-06T04:46:20.398 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/workloads 2023-10-06T04:46:20.399 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/readwrite.yaml 2023-10-06T04:46:20.399 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/radosbench.yaml 2023-10-06T04:46:20.399 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/iozone_cfuse.yaml 2023-10-06T04:46:20.399 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/bonnie_cfuse.yaml 2023-10-06T04:46:20.399 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/% 2023-10-06T04:46:20.399 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers 2023-10-06T04:46:20.429 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers/default.yaml 2023-10-06T04:46:20.429 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers/more-down.yaml 2023-10-06T04:46:20.429 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers/fast.yaml 2023-10-06T04:46:20.430 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr 2023-10-06T04:46:20.430 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr/basic 2023-10-06T04:46:20.430 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr/basic/clusters 2023-10-06T04:46:20.430 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr/basic/clusters/2-node-mgr.yaml 2023-10-06T04:46:20.430 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr/basic/fs 2023-10-06T04:46:20.430 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr/basic/fs/xfs.yaml 2023-10-06T04:46:20.430 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr/basic/% 2023-10-06T04:46:20.430 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr/basic/tasks 2023-10-06T04:46:20.430 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr/basic/tasks/failover.yaml 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr/basic/debug 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mgr/basic/debug/mgr.yaml 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/powercycle 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/powercycle/default.yaml 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/clusters 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/clusters/3osd-1per-target.yaml 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/objectstore 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/fs 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/fs/btrfs.yaml 2023-10-06T04:46:20.431 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/fs/xfs.yaml 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/% 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/readwrite.yaml 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsync.yaml 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/radosbench.yaml 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_pjd.yaml 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_ffsb.yaml 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsx.yaml 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-few-objects.yaml 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_misc.yaml 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/admin_socket_objecter_requests.yaml 2023-10-06T04:46:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_truncate_delay.yaml 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-many-objects.yaml 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_kernel_untar_build.yaml 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/rados_api_tests.yaml 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/features 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/features/defaults.yaml 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/features/journaling.yaml 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/features/layering.yaml 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/features/format-1.yaml 2023-10-06T04:46:20.433 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/base 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/base/install.yaml 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/pool 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/pool/small-cache-pool.yaml 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/pool/replicated-data-pool.yaml 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/pool/ec-data-pool.yaml 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/pool/none.yaml 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/clusters 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/msgr-failures 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/msgr-failures/many.yaml 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/msgr-failures/few.yaml 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/objectstore 2023-10-06T04:46:20.434 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/fs 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/workloads 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_import_export.yaml 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_copy.yaml 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/cli/% 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/base 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/base/install.yaml 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters/openstack.yaml 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters/+ 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters/fixed-3.yaml 2023-10-06T04:46:20.435 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/objectstore 2023-10-06T04:46:20.436 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/workloads 2023-10-06T04:46:20.436 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/workloads/dynamic_features.yaml 2023-10-06T04:46:20.436 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/workloads/rebuild_object_map.yaml 2023-10-06T04:46:20.436 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/% 2023-10-06T04:46:20.436 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/xfs.yaml 2023-10-06T04:46:20.436 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/qemu 2023-10-06T04:46:20.446 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/maintenance/qemu/xfstests.yaml 2023-10-06T04:46:20.446 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/openstack.yaml 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/objectstore 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/% 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/rbd-vs-unmanaged-snaps.yaml 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/rbd_mirror.yaml 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/verify_pool.yaml 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/formatted-output.yaml 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/rbdmap_RBDMAPFILE.yaml 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writeback.yaml 2023-10-06T04:46:20.447 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writeback.yaml 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/permissions.yaml 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/read-flags-no-cache.yaml 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-no-cache.yaml 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writethrough.yaml 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writethrough.yaml 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/admin_socket.yaml 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/singleton/all/merge_diff.yaml 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/base 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/base/install.yaml 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/cachepool 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/cachepool/none.yaml 2023-10-06T04:46:20.448 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/cachepool/small.yaml 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/clusters 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/clusters/openstack.yaml 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/clusters/+ 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/clusters/fixed-1.yaml 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/msgr-failures 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/msgr-failures/many.yaml 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/msgr-failures/few.yaml 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/objectstore 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/fs 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/fs/xfs.yaml 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/% 2023-10-06T04:46:20.449 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/tasks 2023-10-06T04:46:20.450 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_lock_and_fence.yaml 2023-10-06T04:46:20.450 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cli_tests.yaml 2023-10-06T04:46:20.450 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_api_tests_old_format.yaml 2023-10-06T04:46:20.450 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cls_tests.yaml 2023-10-06T04:46:20.450 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_python_api_tests_old_format.yaml 2023-10-06T04:46:20.450 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd 2023-10-06T04:46:20.450 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/pool 2023-10-06T04:46:20.450 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/small-cache-pool.yaml 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/replicated-data-pool.yaml 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/ec-data-pool.yaml 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/none.yaml 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters/openstack.yaml 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters/+ 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters/fixed-3.yaml 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/msgr-failures 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/msgr-failures/few.yaml 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/objectstore 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/config 2023-10-06T04:46:20.451 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/config/skip-partial-discard.yaml 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/config/none.yaml 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/config/copy-on-read.yaml 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/fs 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests.yaml 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/rbd_fio.yaml 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_defaults.yaml 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests.yaml 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/fsx.yaml 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_journaling.yaml 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_journaling.yaml 2023-10-06T04:46:20.452 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_defaults.yaml 2023-10-06T04:46:20.453 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/cache 2023-10-06T04:46:20.453 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/cache/writeback.yaml 2023-10-06T04:46:20.453 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/cache/writethrough.yaml 2023-10-06T04:46:20.453 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/cache/none.yaml 2023-10-06T04:46:20.453 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/librbd/% 2023-10-06T04:46:20.453 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind 2023-10-06T04:46:20.469 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/base 2023-10-06T04:46:20.469 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/base/install.yaml 2023-10-06T04:46:20.469 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/clusters 2023-10-06T04:46:20.469 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/objectstore 2023-10-06T04:46:20.469 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/fs 2023-10-06T04:46:20.469 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads 2023-10-06T04:46:20.469 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/rbd_mirror.yaml 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests.yaml 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_defaults.yaml 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests.yaml 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/fsx.yaml 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_journaling.yaml 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_journaling.yaml 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_defaults.yaml 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/validator 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/validator/memcheck.yaml 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/valgrind/% 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd 2023-10-06T04:46:20.470 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/base 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster/openstack.yaml 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster/+ 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster/fixed-3.yaml 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/msgr-failures 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/objectstore 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/fs 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/workloads 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_nbd.yaml 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_fsx_nbd.yaml 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/% 2023-10-06T04:46:20.471 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/nbd/thrashers 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/base 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/base/install.yaml 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters/openstack.yaml 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters/fixed-2.yaml 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters/+ 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/msgr-failures 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/msgr-failures/few.yaml 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/objectstore 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/fs 2023-10-06T04:46:20.472 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/fs/xfs.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writeback.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_copy_on_read.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_journal.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_journaling.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_nocache.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/journal.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_copy_on_read.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_no_locking.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writethrough.yaml 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/% 2023-10-06T04:46:20.473 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/thrashers 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/thrashers/default.yaml 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/thrash/thrashers/cache.yaml 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/base 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/base/install.yaml 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster/openstack.yaml 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster/2-node.yaml 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster/+ 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/msgr-failures 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/objectstore 2023-10-06T04:46:20.474 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/fs 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/workloads 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-stress-workunit.yaml 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-workunit.yaml 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/% 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/rbd-mirror 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/mirror/rbd-mirror/one-per-cluster.yaml 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/features 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/features/defaults.yaml 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/features/journaling.yaml 2023-10-06T04:46:20.475 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/pool 2023-10-06T04:46:20.492 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/small-cache-pool.yaml 2023-10-06T04:46:20.492 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/replicated-data-pool.yaml 2023-10-06T04:46:20.492 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/ec-cache-pool.yaml 2023-10-06T04:46:20.492 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/ec-data-pool.yaml 2023-10-06T04:46:20.492 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/none.yaml 2023-10-06T04:46:20.492 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters 2023-10-06T04:46:20.492 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters/openstack.yaml 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters/+ 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters/fixed-3.yaml 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/msgr-failures 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/msgr-failures/few.yaml 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/objectstore 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/fs 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_iozone.yaml.disabled 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/#qemu_xfstests.yaml# 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_xfstests.yaml 2023-10-06T04:46:20.493 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_fsstress.yaml 2023-10-06T04:46:20.494 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_bonnie.yaml 2023-10-06T04:46:20.494 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/cache 2023-10-06T04:46:20.494 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/cache/writeback.yaml 2023-10-06T04:46:20.494 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/cache/writethrough.yaml 2023-10-06T04:46:20.494 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/cache/none.yaml 2023-10-06T04:46:20.494 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rbd/qemu/% 2023-10-06T04:46:20.494 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rest 2023-10-06T04:46:20.494 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rest/basic 2023-10-06T04:46:20.494 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rest/basic/tasks 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rest/basic/tasks/rest_test.yaml 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/clusters 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/clusters/fixed-2.yaml 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/objectstore 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/fs 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/fs/xfs.yaml 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/rgw_pool_type 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/frontend 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/frontend/apache.yaml 2023-10-06T04:46:20.495 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/frontend/civetweb.yaml 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/overrides.yaml 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/% 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_roundtrip.yaml 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_multipart_upload.yaml 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_user_quota.yaml 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_readwrite.yaml 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_swift.yaml 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_s3tests.yaml 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_bucket_quota.yaml 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton 2023-10-06T04:46:20.496 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/objectstore 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/fs 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/fs/xfs.yaml 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/rgw_pool_type 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/frontend 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/frontend/apache.yaml 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/frontend/civetweb.yaml 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/overrides.yaml 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/% 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/xfs.yaml 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/all 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-multi-region.yaml 2023-10-06T04:46:20.497 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin.yaml 2023-10-06T04:46:20.498 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-data-sync.yaml 2023-10-06T04:46:20.498 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-convert-to-region.yaml 2023-10-06T04:46:20.498 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify 2023-10-06T04:46:20.498 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/validater 2023-10-06T04:46:20.498 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/validater/valgrind.yaml 2023-10-06T04:46:20.498 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/validater/lockdep.yaml 2023-10-06T04:46:20.498 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/clusters 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/clusters/fixed-2.yaml 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/msgr-failures 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/msgr-failures/few.yaml 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/objectstore 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/fs 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/fs/xfs.yaml 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/rgw_pool_type 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/frontend 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/frontend/apache.yaml 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/frontend/civetweb.yaml 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/overrides.yaml 2023-10-06T04:46:20.499 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/% 2023-10-06T04:46:20.518 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/tasks 2023-10-06T04:46:20.518 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests_multiregion.yaml 2023-10-06T04:46:20.518 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/tasks/rgw_swift.yaml 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests.yaml 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy/basic 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/ceph-deploy-overrides 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/python_versions 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_3.yaml 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_2.yaml 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/config_options 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/distros 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/% 2023-10-06T04:46:20.519 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/tasks 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/tasks/ceph-admin-commands.yaml 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/clusters 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/clusters/fixed-3.yaml 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/msgr-failures 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/msgr-failures/many.yaml 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/msgr-failures/few.yaml 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/fs 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/fs/btrfs.yaml 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/% 2023-10-06T04:46:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/iozone-sync.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/dbench-short.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/blogbench.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/ffsb.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/pjd.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fsync-tester.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/iogen.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fsx.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/bonnie.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fio.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/iozone.yaml 2023-10-06T04:46:20.521 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/dbench.yaml 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fsstress.yaml 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/install 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/install/install.yaml 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/clusters 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/clusters/samba-basic.yaml 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/workload 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/workload/cifs-kernel-build.yaml.disabled 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/workload/cifs-fsstress.yaml 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/workload/smbtorture.yaml 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/workload/cifs-dbench.yaml 2023-10-06T04:46:20.522 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/fs 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/fs/xfs.yaml 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/mount 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/mount/noceph.yaml 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/mount/kclient.yaml 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/mount/fuse.yaml 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/mount/native.yaml 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/samba/% 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests 2023-10-06T04:46:20.523 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/cls.yaml 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_cli_tests.yaml.disabled 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_import_export.yaml 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/ceph-admin-commands.yaml 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/1-distros 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/single_mon_osd.yaml 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/3-node.yaml 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning/vm_friendly.yaml 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source/upstream_stable.yaml 2023-10-06T04:46:20.524 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/% 2023-10-06T04:46:20.525 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/% 2023-10-06T04:46:20.525 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd 2023-10-06T04:46:20.525 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal 2023-10-06T04:46:20.525 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal/collocated.yaml 2023-10-06T04:46:20.525 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/% 2023-10-06T04:46:20.547 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices 2023-10-06T04:46:20.547 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/osd_auto_discovery.yaml 2023-10-06T04:46:20.547 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/from_teuthology.yaml 2023-10-06T04:46:20.547 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup 2023-10-06T04:46:20.547 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup/ceph_ansible.yaml 2023-10-06T04:46:20.547 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big 2023-10-06T04:46:20.547 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters/medium.yaml 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters/big.yaml 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters/small.yaml 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/fs 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/fs/btrfs.yaml 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/fs/xfs.yaml 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/workloads 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/workloads/snaps-few-objects.yaml 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/ceph 2023-10-06T04:46:20.548 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/ceph/ceph.yaml 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/% 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/thrashers 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/big/rados-thrash/thrashers/default.yaml 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mixed-clients 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mixed-clients/basic 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mixed-clients/basic/clusters 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mixed-clients/basic/clusters/fixed-3.yaml 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mixed-clients/basic/fs 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mixed-clients/basic/fs/btrfs.yaml 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mixed-clients/basic/tasks 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml 2023-10-06T04:46:20.549 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_dbench_iozone.yaml 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/traceless 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/traceless/50pc.yaml 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/overrides 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/debug.yaml 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/+ 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/frag_enable.yaml 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/clusters 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/clusters/fixed-2-ucephfs.yaml 2023-10-06T04:46:20.550 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/objectstore 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/fs 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/fs/xfs.yaml 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/mount 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/mount/fuse.yaml 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/begin.yaml 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/% 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/tasks 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_ffsb.yaml 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_blogbench.yaml 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_dbench.yaml 2023-10-06T04:46:20.551 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/overrides 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/mon-debug.yaml 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/debug.yaml 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/+ 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/frag_enable.yaml 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/clusters 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/clusters/2-remote-clients.yaml 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/objectstore 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/fs 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/fs/xfs.yaml 2023-10-06T04:46:20.552 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/mount 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/mount/fuse.yaml 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/begin.yaml 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/% 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/tasks 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multifs/tasks/failover.yaml 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/overrides 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/debug.yaml 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/+ 2023-10-06T04:46:20.553 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/frag_enable.yaml 2023-10-06T04:46:20.561 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/clusters 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/clusters/fixed-2-ucephfs.yaml 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/objectstore 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/fs 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/fs/xfs.yaml 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/mount 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/mount/fuse.yaml 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/begin.yaml 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/% 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/tasks 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/snaps/tasks/snaptests.yaml 2023-10-06T04:46:20.562 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/overrides 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/overrides/debug.yaml 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/overrides/+ 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/overrides/frag_enable.yaml 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/clusters 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/clusters/fixed-2-ucephfs.yaml 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/objectstore 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/fs 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/fs/xfs.yaml 2023-10-06T04:46:20.563 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/mount 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/mount/fuse.yaml 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/inline 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/inline/yes.yaml 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/inline/no.yaml 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/begin.yaml 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/% 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsync.yaml 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_interface_tests.yaml 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_pjd.yaml 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_norstats.yaml 2023-10-06T04:46:20.564 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_trivial_sync.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_ffsb.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsx.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_java.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc_test_o_trunc.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/mds_creation_retry.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/asok_dump_tree.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_quota.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_truncate_delay.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_kernel_untar_build.yaml 2023-10-06T04:46:20.565 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_blogbench.yaml 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_python.yaml 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cephfs_scrub_tests.yaml 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iogen.yaml 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_dbench.yaml 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iozone.yaml 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/overrides 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/fuse-unmounted.yaml 2023-10-06T04:46:20.566 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/debug.yaml 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/+ 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/frag_enable.yaml 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/clusters 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/clusters/4-remote-clients.yaml 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/objectstore 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/fs 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/fs/xfs.yaml 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/mount 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/mount/fuse.yaml 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/begin.yaml 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/% 2023-10-06T04:46:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks 2023-10-06T04:46:20.568 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/backtrace.yaml 2023-10-06T04:46:20.568 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/forward-scrub.yaml 2023-10-06T04:46:20.568 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/client-readahad.yaml 2023-10-06T04:46:20.568 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/volume-client.yaml 2023-10-06T04:46:20.568 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/config-commands.yaml 2023-10-06T04:46:20.568 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/mds-full.yaml 2023-10-06T04:46:20.584 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/sessionmap.yaml 2023-10-06T04:46:20.584 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/data-scan.yaml 2023-10-06T04:46:20.584 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/cap-flush.yaml 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/mds-flush.yaml 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/auto-repair.yaml 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/damage.yaml 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/client-recovery.yaml 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/journal-repair.yaml 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/client-limits.yaml 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/strays.yaml 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/fragment.yaml 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/pool-perm.yaml 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/overrides 2023-10-06T04:46:20.585 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.586 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/overrides/debug.yaml 2023-10-06T04:46:20.586 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/overrides/+ 2023-10-06T04:46:20.586 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/overrides/frag_enable.yaml 2023-10-06T04:46:20.586 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/clusters 2023-10-06T04:46:20.586 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/clusters/fixed-2-ucephfs.yaml 2023-10-06T04:46:20.586 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/objectstore 2023-10-06T04:46:20.586 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/fs 2023-10-06T04:46:20.586 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/fs/xfs.yaml 2023-10-06T04:46:20.587 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/mount 2023-10-06T04:46:20.587 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/mount/fuse.yaml 2023-10-06T04:46:20.587 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/begin.yaml 2023-10-06T04:46:20.587 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/% 2023-10-06T04:46:20.587 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/tasks 2023-10-06T04:46:20.588 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_suites_pjd.yaml 2023-10-06T04:46:20.588 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_misc.yaml 2023-10-06T04:46:20.588 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay 2023-10-06T04:46:20.588 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides 2023-10-06T04:46:20.588 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.588 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/debug.yaml 2023-10-06T04:46:20.589 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/+ 2023-10-06T04:46:20.589 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/frag_enable.yaml 2023-10-06T04:46:20.589 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/clusters 2023-10-06T04:46:20.589 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/clusters/standby-replay.yaml 2023-10-06T04:46:20.589 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/objectstore 2023-10-06T04:46:20.590 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/fs 2023-10-06T04:46:20.590 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/fs/xfs.yaml 2023-10-06T04:46:20.590 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/mount 2023-10-06T04:46:20.590 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/mount/fuse.yaml 2023-10-06T04:46:20.590 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/begin.yaml 2023-10-06T04:46:20.591 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/% 2023-10-06T04:46:20.591 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/tasks 2023-10-06T04:46:20.591 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/standbyreplay/tasks/migration.yaml 2023-10-06T04:46:20.591 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits 2023-10-06T04:46:20.591 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/overrides 2023-10-06T04:46:20.591 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.592 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/debug.yaml 2023-10-06T04:46:20.592 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/+ 2023-10-06T04:46:20.592 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/faked-ino.yaml 2023-10-06T04:46:20.592 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/frag_enable.yaml 2023-10-06T04:46:20.592 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/clusters 2023-10-06T04:46:20.593 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/clusters/fixed-2-ucephfs.yaml 2023-10-06T04:46:20.593 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/objectstore 2023-10-06T04:46:20.593 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/fs 2023-10-06T04:46:20.593 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/fs/xfs.yaml 2023-10-06T04:46:20.593 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/mount 2023-10-06T04:46:20.593 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/mount/fuse.yaml 2023-10-06T04:46:20.594 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/begin.yaml 2023-10-06T04:46:20.594 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/% 2023-10-06T04:46:20.594 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/tasks 2023-10-06T04:46:20.594 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_pjd.yaml 2023-10-06T04:46:20.594 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.595 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash 2023-10-06T04:46:20.595 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/ceph-thrash 2023-10-06T04:46:20.595 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/ceph-thrash/default.yaml 2023-10-06T04:46:20.595 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/overrides 2023-10-06T04:46:20.595 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.595 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/debug.yaml 2023-10-06T04:46:20.595 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/+ 2023-10-06T04:46:20.596 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/frag_enable.yaml 2023-10-06T04:46:20.596 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/clusters 2023-10-06T04:46:20.596 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/clusters/mds-1active-1standby.yaml 2023-10-06T04:46:20.596 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/msgr-failures 2023-10-06T04:46:20.609 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/msgr-failures/osd-mds-delay.yaml 2023-10-06T04:46:20.610 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/msgr-failures/none.yaml 2023-10-06T04:46:20.610 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/objectstore 2023-10-06T04:46:20.610 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/fs 2023-10-06T04:46:20.610 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/fs/xfs.yaml 2023-10-06T04:46:20.610 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/mount 2023-10-06T04:46:20.610 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/mount/fuse.yaml 2023-10-06T04:46:20.610 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/begin.yaml 2023-10-06T04:46:20.610 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/% 2023-10-06T04:46:20.610 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/tasks 2023-10-06T04:46:20.610 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_pjd.yaml 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_trivial_sync.yaml 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_snaptests.yaml 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/validater 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/validater/lockdep.yaml 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/overrides 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/overrides/mon-debug.yaml 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/overrides/debug.yaml 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/overrides/+ 2023-10-06T04:46:20.611 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/overrides/frag_enable.yaml 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/clusters 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/clusters/fixed-2-ucephfs.yaml 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/objectstore 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/fs 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/fs/xfs.yaml 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/mount 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/mount/fuse.yaml 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/begin.yaml 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/% 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/tasks 2023-10-06T04:46:20.612 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/tasks/libcephfs_interface_tests.yaml 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_dbench.yaml 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/whitelist_wrongly_marked_down.yaml 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/debug.yaml 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/+ 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/frag_enable.yaml 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/clusters 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/clusters/three_clients.yaml 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/clusters/two_clients.yaml 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/objectstore 2023-10-06T04:46:20.613 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/fs 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/fs/xfs.yaml 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/mount 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/mount/fuse.yaml 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/mount/kclient.yaml.disabled 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/begin.yaml 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/% 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/fsx-mpi.yaml.disabled 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/ior-shared-file.yaml 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/cephfs_misc_tests.yaml 2023-10-06T04:46:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/mdtest.yaml 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-disk 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-disk/basic 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-disk/basic/distros 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-disk/basic/% 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-disk/basic/tasks 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/ceph-disk/basic/tasks/ceph-disk.yaml 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/clusters 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/clusters/separate-client.yaml 2023-10-06T04:46:20.615 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/ceph 2023-10-06T04:46:20.617 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/ceph/ceph.yaml 2023-10-06T04:46:20.617 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels 2023-10-06T04:46:20.617 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels/pre-single-major.yaml 2023-10-06T04:46:20.618 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-on.yaml 2023-10-06T04:46:20.618 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-off.yaml 2023-10-06T04:46:20.618 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/conf.yaml 2023-10-06T04:46:20.618 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/% 2023-10-06T04:46:20.618 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/xfs.yaml 2023-10-06T04:46:20.618 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/tasks 2023-10-06T04:46:20.618 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/unmap/tasks/unmap.yaml 2023-10-06T04:46:20.618 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd 2023-10-06T04:46:20.629 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/clusters 2023-10-06T04:46:20.629 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/clusters/fixed-3.yaml 2023-10-06T04:46:20.629 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/msgr-failures 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/msgr-failures/many.yaml 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/msgr-failures/few.yaml 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/fs 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/fs/btrfs.yaml 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/conf.yaml 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/% 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_fio.yaml 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_ffsb.yaml 2023-10-06T04:46:20.630 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_ext4.yaml 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_iozone.yaml 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_dbench.yaml 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_kernel_untar_build.yaml 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_trivial_sync.yaml 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_btrfs.yaml 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsx.yaml 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/singleton 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/singleton/msgr-failures 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/singleton/msgr-failures/many.yaml 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/singleton/msgr-failures/few.yaml 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/singleton/fs 2023-10-06T04:46:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/singleton/fs/btrfs.yaml 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/singleton/conf.yaml 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/singleton/% 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/singleton/tasks 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/singleton/tasks/rbd_xfstests.yaml 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/install 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/install/ceph.yaml 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/clusters 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/clusters/fixed-3.yaml 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/many.yaml 2023-10-06T04:46:20.632 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/few.yaml 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/fs 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/fs/btrfs.yaml 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/conf.yaml 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/% 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_unmap.yaml 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kfsx.yaml 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_image_read.yaml 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_simple_big.yaml 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_concurrent.yaml 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_snapshot_io.yaml 2023-10-06T04:46:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_huge_tickets.yaml 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kernel.yaml 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/clusters 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/clusters/fixed-3.yaml 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/fs 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/fs/btrfs.yaml 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_fio.yaml 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_ffsb.yaml 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_iozone.yaml.disabled 2023-10-06T04:46:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/conf.yaml 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/% 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/thrashers 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/thrashers/default.yaml 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/krbd/thrash/thrashers/mon-thrasher.yaml 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages/tests 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages/tests/distros 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages/tests/% 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages/tests/tasks 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages/tests/tasks/release.yaml 2023-10-06T04:46:20.635 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages/any 2023-10-06T04:46:20.636 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages/any/distros 2023-10-06T04:46:20.636 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages/any/% 2023-10-06T04:46:20.636 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages/any/tasks 2023-10-06T04:46:20.636 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/buildpackages/any/tasks/release.yaml 2023-10-06T04:46:20.642 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados 2023-10-06T04:46:20.642 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/objectstore 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent-aio-journal.yaml 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/objectstore/ceph_objectstore_tool.yaml 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/objectstore/fusestore.yaml 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/objectstore/keyvaluedb.yaml 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/objectstore/objectstore.yaml 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/objectstore/alloc-hint.yaml 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/objectstore/filejournal.yaml 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/objectstore/objectcacher-stress.yaml 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent.yaml 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton 2023-10-06T04:46:20.643 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/msgr 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/msgr-failures 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/msgr-failures/many.yaml 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/msgr-failures/few.yaml 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/objectstore 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/fs 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/fs/xfs.yaml 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/% 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/divergent_priors.yaml 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/watch-notify-same-primary.yaml 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/ec-lost-unfound.yaml 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/rest-api.yaml 2023-10-06T04:46:20.644 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/mon-config-keys.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/mon-thrasher.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/osd-recovery-incomplete.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/osd-recovery.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/admin-socket.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/reg11184.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/mon-seesaw.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/radostool.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/thrash_cache_writeback_proxy_none.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/dump-stuck.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/resolve_stuck_peering.yaml 2023-10-06T04:46:20.645 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/osd-backfill.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/divergent_priors2.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/peer.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/test_envlibrados_for_rocksdb.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/thrash-rados.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/lost-unfound.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/cephtool.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/pg-removal-interruption.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/rebuild-mondb.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/all/lost-unfound-delete.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton/rados.yaml 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic 2023-10-06T04:46:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/msgr 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/msgr/async.yaml 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/msgr/simple.yaml 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/msgr/random.yaml 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/clusters 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/clusters/openstack.yaml 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/clusters/fixed-2.yaml 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/clusters/+ 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/msgr-failures 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/msgr-failures/many.yaml 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/msgr-failures/few.yaml 2023-10-06T04:46:20.647 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/objectstore 2023-10-06T04:46:20.648 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/fs 2023-10-06T04:46:20.648 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/fs/btrfs.yaml 2023-10-06T04:46:20.648 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/fs/xfs.yaml 2023-10-06T04:46:20.648 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/% 2023-10-06T04:46:20.648 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/mon_kv_backend 2023-10-06T04:46:20.648 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks 2023-10-06T04:46:20.648 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/readwrite.yaml 2023-10-06T04:46:20.648 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_cls_all.yaml 2023-10-06T04:46:20.648 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mostlyread.yaml 2023-10-06T04:46:20.648 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_stress_watch.yaml 2023-10-06T04:46:20.649 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_big.yaml 2023-10-06T04:46:20.649 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/scrub_test.yaml 2023-10-06T04:46:20.653 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mix.yaml 2023-10-06T04:46:20.653 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_python.yaml 2023-10-06T04:46:20.653 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/repair_test.yaml 2023-10-06T04:46:20.653 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_api_tests.yaml 2023-10-06T04:46:20.653 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rgw_snaps.yaml 2023-10-06T04:46:20.653 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_striper.yaml 2023-10-06T04:46:20.653 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/basic/rados.yaml 2023-10-06T04:46:20.653 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/leveldb.yaml 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/openstack.yaml 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/+ 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/fixed-4.yaml 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/msgr-failures 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/objectstore 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs/xfs.yaml 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads 2023-10-06T04:46:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/% 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers/default.yaml 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/rados.yaml 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fast 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/normal.yaml 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/fast.yaml 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/leveldb.yaml 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/clusters 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/msgr-failures 2023-10-06T04:46:20.655 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/objectstore 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fs 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read-overwrites.yaml 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-overwrites.yaml 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-snaps-few-objects-overwrites.yaml 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-radosbench.yaml 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects.yaml 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read.yaml 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-pool-snaps-few-objects-overwrites.yaml 2023-10-06T04:46:20.656 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/% 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/default.yaml 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/fastread.yaml 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/morepggrow.yaml 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/pggrow.yaml 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/mapgap.yaml 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/rados.yaml 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/% 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/multi-backfill-reject.yaml 2023-10-06T04:46:20.657 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/full-tiering.yaml 2023-10-06T04:46:20.658 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/cache-fs-trunc.yaml 2023-10-06T04:46:20.658 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/msgr.yaml 2023-10-06T04:46:20.658 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/ceph-post-file.yaml 2023-10-06T04:46:20.658 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/export-after-evict.yaml 2023-10-06T04:46:20.658 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/valgrind-leaks.yaml 2023-10-06T04:46:20.671 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/rados.yaml 2023-10-06T04:46:20.671 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade 2023-10-06T04:46:20.671 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon/monb.yaml 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon/monc.yaml 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install/jewel.yaml 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/readwrite.yaml 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/snaps-few-objects.yaml 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-cls.yaml 2023-10-06T04:46:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-import-export.yaml 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/+ 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon/mona.yaml 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/% 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rbd-python.yaml 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rgw-swift.yaml 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/snaps-many-objects.yaml 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/+ 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade/firsthalf.yaml 2023-10-06T04:46:20.673 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash/default.yaml 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/radosbench.yaml 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/rbd_api.yaml 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/+ 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/openstack.yaml 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/+ 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/start.yaml 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash 2023-10-06T04:46:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr 2023-10-06T04:46:20.675 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/clusters 2023-10-06T04:46:20.675 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/clusters/3-mons.yaml 2023-10-06T04:46:20.675 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/clusters/9-mons.yaml 2023-10-06T04:46:20.675 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr-failures 2023-10-06T04:46:20.675 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr-failures/mon-delay.yaml 2023-10-06T04:46:20.675 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr-failures/few.yaml 2023-10-06T04:46:20.675 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/objectstore 2023-10-06T04:46:20.675 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/fs 2023-10-06T04:46:20.675 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/fs/xfs.yaml 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/pool-create-delete.yaml 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/snaps-few-objects.yaml 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/rados_mon_workunits.yaml 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/rados_5925.yaml 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/rados_api_tests.yaml 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/ceph 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/ceph/ceph.yaml 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/% 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/mon_kv_backend 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers 2023-10-06T04:46:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/many.yaml 2023-10-06T04:46:20.677 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/one.yaml 2023-10-06T04:46:20.677 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/sync.yaml 2023-10-06T04:46:20.677 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/sync-many.yaml 2023-10-06T04:46:20.677 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/force-sync-many.yaml 2023-10-06T04:46:20.677 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/monthrash/rados.yaml 2023-10-06T04:46:20.688 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash 2023-10-06T04:46:20.688 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/msgr 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/clusters 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/clusters/openstack.yaml 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/clusters/fixed-2.yaml 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/clusters/+ 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/normal_pg_log.yaml 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/short_pg_log.yaml 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures/few.yaml 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures/fastclose.yaml 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures/osd-delay.yaml 2023-10-06T04:46:20.689 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/3-size-2-min-size.yaml 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-2-min-size.yaml 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-1-min-size.yaml 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/objectstore 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/fs 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/fs/btrfs.yaml 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/fs/xfs.yaml 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/radosbench.yaml 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-big.yaml 2023-10-06T04:46:20.690 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-small.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/snaps-few-objects.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/write_fadvise_dontneed.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/admin_socket_objecter_requests.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps-readproxy.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-snaps.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/pool-snaps-few-objects.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/rados_api_tests.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/small-objects.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/hobj-sort.yaml 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/% 2023-10-06T04:46:20.691 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/default.yaml 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/morepggrow.yaml 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/pggrow.yaml 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/mapgap.yaml 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/rocksdb.yaml 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash/rados.yaml 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/msgr 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/validater 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/validater/valgrind.yaml 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/validater/lockdep.yaml 2023-10-06T04:46:20.692 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/clusters 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/clusters/openstack.yaml 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/clusters/fixed-2.yaml 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/clusters/+ 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/msgr-failures 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/msgr-failures/few.yaml 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/objectstore 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/fs 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/fs/btrfs.yaml 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/1thrash 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/1thrash/default.yaml 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/1thrash/none.yaml 2023-10-06T04:46:20.693 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/% 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/mon_kv_backend 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/tasks 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/tasks/rados_cls_all.yaml 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/tasks/mon_recovery.yaml 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/tasks/rados_api_tests.yaml 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/verify/rados.yaml 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/msgr 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/clusters 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/21.yaml 2023-10-06T04:46:20.694 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/9.yaml 2023-10-06T04:46:20.703 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/3.yaml 2023-10-06T04:46:20.703 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/6.yaml 2023-10-06T04:46:20.703 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/msgr-failures 2023-10-06T04:46:20.703 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/msgr-failures/many.yaml 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/msgr-failures/few.yaml 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/objectstore 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/fs 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/fs/xfs.yaml 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/% 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/mon_kv_backend 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/tasks 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_with_skews.yaml 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/tasks/mon_recovery.yaml 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_no_skews.yaml 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/multimon/rados.yaml 2023-10-06T04:46:20.704 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/leveldb.yaml 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/clusters 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/msgr-failures 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/objectstore 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/supported 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/fs 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads/ec-rados-plugin=isa-k=2-m=1.yaml 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch/x86_64.yaml 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/% 2023-10-06T04:46:20.705 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/thrashers 2023-10-06T04:46:20.706 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/rados.yaml 2023-10-06T04:46:20.706 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big 2023-10-06T04:46:20.706 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster 2023-10-06T04:46:20.706 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/openstack.yaml 2023-10-06T04:46:20.706 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/12-osds.yaml 2023-10-06T04:46:20.706 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/+ 2023-10-06T04:46:20.706 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/leveldb.yaml 2023-10-06T04:46:20.706 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/msgr-failures 2023-10-06T04:46:20.706 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/objectstore 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/fs 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/% 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/default.yaml 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/fastread.yaml 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/morepggrow.yaml 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/pggrow.yaml 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/mapgap.yaml 2023-10-06T04:46:20.707 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/rados.yaml 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/clusters 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/clusters/extra-client.yaml 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/fs 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/fs/xfs.yaml 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/mount 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/mount/v4.yaml 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/mount/v3.yaml 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/ceph 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/ceph/base.yaml 2023-10-06T04:46:20.708 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/% 2023-10-06T04:46:20.709 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/tasks 2023-10-06T04:46:20.709 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_dbench.yaml 2023-10-06T04:46:20.709 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs-workunit-kernel-untar-build.yaml 2023-10-06T04:46:20.709 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_ffsb.yaml 2023-10-06T04:46:20.709 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_blogbench.yaml 2023-10-06T04:46:20.709 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_misc.yaml 2023-10-06T04:46:20.709 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.709 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_iozone.yaml 2023-10-06T04:46:20.709 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/experimental 2023-10-06T04:46:20.729 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/experimental/multimds 2023-10-06T04:46:20.730 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/experimental/multimds/clusters 2023-10-06T04:46:20.730 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/experimental/multimds/clusters/7-multimds.yaml 2023-10-06T04:46:20.730 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/experimental/multimds/% 2023-10-06T04:46:20.730 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/experimental/multimds/tasks 2023-10-06T04:46:20.730 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/experimental/multimds/tasks/fsstress_thrash_subtrees.yaml 2023-10-06T04:46:20.730 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal 2023-10-06T04:46:20.730 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/fs-misc 2023-10-06T04:46:20.730 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/fs-misc/clusters 2023-10-06T04:46:20.730 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/fs-misc/clusters/two_clients.yaml 2023-10-06T04:46:20.730 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/fs-misc/fs 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/fs-misc/fs/btrfs.yaml 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/fs-misc/% 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/fs-misc/tasks 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/fs-misc/tasks/locktest.yaml 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/basic 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/basic/clusters 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/basic/clusters/fixed-3.yaml 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/basic/fs 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/basic/fs/btrfs.yaml 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/basic/% 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/basic/tasks 2023-10-06T04:46:20.731 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_blogbench.yaml 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_fsx.yaml 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/mds_restart 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/mds_restart/clusters 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/mds_restart/clusters/one_mds.yaml 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/mds_restart/% 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/mds_restart/tasks 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/mds_restart/tasks/restart-workunit-backtraces.yaml 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/clusters 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-3-mds.yaml 2023-10-06T04:46:20.732 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-9-mds.yaml 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/fs 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/fs/btrfs.yaml 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/% 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/mounts 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/mounts/ceph-fuse.yaml 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/mounts/kclient.yaml 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_pjd.yaml 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsstress.yaml 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_truncate_delay.yaml 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_misc.yaml 2023-10-06T04:46:20.733 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_blogbench.yaml 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsync.yaml 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_dbench.yaml 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/thrash 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/thrash/normal.yaml 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/marginal/multimds/thrash/exports.yaml 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/clusters 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/clusters/fixed-3-cephfs.yaml 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/fs 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/fs/xfs.yaml 2023-10-06T04:46:20.734 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/inline 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/inline/yes.yaml 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/inline/no.yaml 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/conf.yaml 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/% 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_misc.yaml 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_trivial_sync.yaml 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_snaps.yaml 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_direct_io.yaml 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsx.yaml 2023-10-06T04:46:20.735 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_kernel_untar_build.yaml 2023-10-06T04:46:20.736 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_ffsb.yaml 2023-10-06T04:46:20.748 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_dbench.yaml 2023-10-06T04:46:20.748 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsync.yaml 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_pjd.yaml 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_iozone.yaml 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_o_trunc.yaml 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters/2-clients.yaml 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/fs 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/fs/xfs.yaml 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/conf.yaml 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/% 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks 2023-10-06T04:46:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_dbench_iozone.yaml 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/dirfrag 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/dirfrag/frag_enable.yaml 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/clusters 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/clusters/4-remote-clients.yaml 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/% 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/mounts 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/mounts/kmounts.yaml 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/xfs.yaml 2023-10-06T04:46:20.750 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks 2023-10-06T04:46:20.751 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/backtrace.yaml 2023-10-06T04:46:20.751 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/forward-scrub.yaml 2023-10-06T04:46:20.751 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/volume-client.yaml 2023-10-06T04:46:20.751 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/config-commands.yaml 2023-10-06T04:46:20.751 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/sessionmap.yaml 2023-10-06T04:46:20.751 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/failover.yaml.disabled 2023-10-06T04:46:20.751 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/data-scan.yaml 2023-10-06T04:46:20.751 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/mds-flush.yaml 2023-10-06T04:46:20.751 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/auto-repair.yaml 2023-10-06T04:46:20.751 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/damage.yaml 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-recovery.yaml 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/journal-repair.yaml 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-limits.yaml 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/strays.yaml.disabled 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/pool-perm.yaml 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/debug 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/recovery/debug/mds_client.yaml 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/clusters 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/clusters/fixed-3-cephfs.yaml 2023-10-06T04:46:20.752 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/fs 2023-10-06T04:46:20.753 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/fs/xfs.yaml 2023-10-06T04:46:20.753 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/workloads 2023-10-06T04:46:20.753 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_ffsb.yaml 2023-10-06T04:46:20.753 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_iozone.yaml 2023-10-06T04:46:20.753 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/conf.yaml 2023-10-06T04:46:20.753 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/% 2023-10-06T04:46:20.753 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers 2023-10-06T04:46:20.753 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers/default.yaml 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mon.yaml 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mds.yaml 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/point-to-point-upgrade.yaml 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/centos_7.2.yaml 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/ubuntu_14.04.yaml 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/% 2023-10-06T04:46:20.754 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel 2023-10-06T04:46:20.755 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/kraken.yaml 2023-10-06T04:46:20.755 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install 2023-10-06T04:46:20.755 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install/jewel.yaml 2023-10-06T04:46:20.764 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/4-kraken.yaml 2023-10-06T04:46:20.764 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence 2023-10-06T04:46:20.764 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml 2023-10-06T04:46:20.764 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-mon-osd-mds.yaml 2023-10-06T04:46:20.764 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/distros 2023-10-06T04:46:20.764 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/% 2023-10-06T04:46:20.764 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload 2023-10-06T04:46:20.764 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_python.yaml 2023-10-06T04:46:20.764 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/blogbench.yaml 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_api.yaml 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_loadgenbig.yaml 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/ec-rados-default.yaml 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/+ 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_api.yaml 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/openstack.yaml 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/+ 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/start.yaml 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/blogbench.yaml 2023-10-06T04:46:20.765 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados-snaps-few-objects.yaml 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/+ 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_loadgenmix.yaml 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_cls.yaml 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_mon_thrash.yaml 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rgw_swift.yaml 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_import_export.yaml 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon/monb.yaml 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon 2023-10-06T04:46:20.766 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon/monc.yaml 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install/jewel.yaml 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/readwrite.yaml 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/snaps-few-objects.yaml 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-cls.yaml 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-import-export.yaml 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/+ 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon/mona.yaml 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/distros 2023-10-06T04:46:20.767 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/% 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rbd-python.yaml 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rgw-swift.yaml 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/snaps-many-objects.yaml 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/+ 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade/firsthalf.yaml 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash/default.yaml 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/radosbench.yaml 2023-10-06T04:46:20.768 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/rbd_api.yaml 2023-10-06T04:46:20.769 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/+ 2023-10-06T04:46:20.780 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster 2023-10-06T04:46:20.780 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/openstack.yaml 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/+ 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/start.yaml 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/6-next-mon 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/8-next-mon 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/1-jewel-install 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload/ec-rados-default.yaml 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/4-mon 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/% 2023-10-06T04:46:20.781 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-x86_64.yaml 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/2-partial-upgrade 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash/default.yaml 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-cluster 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/6-next-mon 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/8-next-mon 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/1-jewel-install 2023-10-06T04:46:20.782 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload/ec-rados-default.yaml 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/4-mon 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/distros 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/% 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/2-partial-upgrade 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash/default.yaml 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/0-cluster 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x 2023-10-06T04:46:20.783 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/8-kraken.yaml 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install/hammer-jewel.yaml 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/4-jewel.yaml 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3.5-finish.yaml 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-osd-mds-mon.yaml 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-by-daemon.yaml 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-all.yaml 2023-10-06T04:46:20.784 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros 2023-10-06T04:46:20.785 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/centos_7.2.yaml 2023-10-06T04:46:20.785 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/ubuntu_14.04.yaml 2023-10-06T04:46:20.785 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/% 2023-10-06T04:46:20.785 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload 2023-10-06T04:46:20.794 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados-snaps-few-objects.yaml 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/+ 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_loadgenmix.yaml 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_cls.yaml 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_mon_thrash.yaml 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_import_export.yaml 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rgw_s3tests.yaml 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_python.yaml 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_api.yaml 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_loadgenbig.yaml 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/ec-rados-default.yaml 2023-10-06T04:46:20.795 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/+ 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_api.yaml 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_python.yaml 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_api.yaml 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_loadgenbig.yaml 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/ec-rados-default.yaml 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/+ 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_api.yaml 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade/hammer-jewel-x.yaml 2023-10-06T04:46:20.796 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster/start.yaml 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/6-next-mon 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/8-next-mon 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/5-workload 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/4-mon 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/centos_7.2.yaml 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/ubuntu_14.04.yaml 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/% 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/9-workload 2023-10-06T04:46:20.797 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel/hammer-to-jewel.yaml 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/2-partial-upgrade 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/3-thrash 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/7-workload 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/0-cluster 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install/hammer-client-x.yaml 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/% 2023-10-06T04:46:20.798 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload 2023-10-06T04:46:20.799 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload/rbd_notification_tests.yaml 2023-10-06T04:46:20.799 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster 2023-10-06T04:46:20.799 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster/start.yaml 2023-10-06T04:46:20.799 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic 2023-10-06T04:46:20.826 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install/hammer-client-x.yaml 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/% 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_cli_import_export.yaml 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_api_tests.yaml 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster/start.yaml 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install 2023-10-06T04:46:20.827 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install/jewel-client-x.yaml 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/% 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload/rbd_notification_tests.yaml 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster/start.yaml 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install/jewel-client-x.yaml 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/% 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_cli_import_export.yaml 2023-10-06T04:46:20.828 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_api_tests.yaml 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster/start.yaml 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/dummy 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/dummy/% 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/dummy/all 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/dummy/all/nop.yaml 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/hadoop 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/hadoop/basic 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/hadoop/basic/clusters 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/hadoop/basic/clusters/fixed-3.yaml 2023-10-06T04:46:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/hadoop/basic/% 2023-10-06T04:46:20.830 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/hadoop/basic/xfs.yaml 2023-10-06T04:46:20.830 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks 2023-10-06T04:46:20.830 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks/wordcount.yaml 2023-10-06T04:46:20.830 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks/repl.yaml 2023-10-06T04:46:20.830 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks/terasort.yaml 2023-10-06T04:46:20.830 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology 2023-10-06T04:46:20.830 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/integration.yaml 2023-10-06T04:46:20.830 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/nop 2023-10-06T04:46:20.831 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/nop/% 2023-10-06T04:46:20.831 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/nop/all 2023-10-06T04:46:20.831 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/nop/all/nop.yaml 2023-10-06T04:46:20.831 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/rgw 2023-10-06T04:46:20.831 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/rgw/distros 2023-10-06T04:46:20.831 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/rgw/% 2023-10-06T04:46:20.831 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks 2023-10-06T04:46:20.831 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fastcgi.yaml 2023-10-06T04:46:20.831 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fcgi.yaml 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-civetweb.yaml 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/no-ceph 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/clusters 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/clusters/single.yaml 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/% 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/tasks 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/tasks/teuthology.yaml 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/ceph 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/ceph/clusters 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/ceph/clusters/single.yaml 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/ceph/distros 2023-10-06T04:46:20.832 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/ceph/% 2023-10-06T04:46:20.833 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/ceph/tasks 2023-10-06T04:46:20.833 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/ceph/tasks/teuthology.yaml 2023-10-06T04:46:20.833 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/buildpackages 2023-10-06T04:46:20.848 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/distros 2023-10-06T04:46:20.848 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/% 2023-10-06T04:46:20.848 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks 2023-10-06T04:46:20.848 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks/default.yaml 2023-10-06T04:46:20.848 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks/tag.yaml 2023-10-06T04:46:20.849 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks/branch.yaml 2023-10-06T04:46:20.849 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster 2023-10-06T04:46:20.849 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/fs 2023-10-06T04:46:20.849 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/fs/xfs.yaml 2023-10-06T04:46:20.849 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/% 2023-10-06T04:46:20.849 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all 2023-10-06T04:46:20.849 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/thrashosds.yaml 2023-10-06T04:46:20.849 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/ceph.yaml 2023-10-06T04:46:20.849 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/upgrade.yaml 2023-10-06T04:46:20.849 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/workunit.yaml 2023-10-06T04:46:20.850 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/workunits 2023-10-06T04:46:20.850 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/teuthology/workunits/yes.yaml 2023-10-06T04:46:20.850 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds 2023-10-06T04:46:20.850 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic 2023-10-06T04:46:20.850 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/overrides 2023-10-06T04:46:20.850 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/overrides/fuse-default-perm-no.yaml 2023-10-06T04:46:20.850 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/overrides/basic 2023-10-06T04:46:20.850 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/overrides/% 2023-10-06T04:46:20.850 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/clusters 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/clusters/9-mds.yaml 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/clusters/3-mds.yaml 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/fs 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/mount 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/mount/kclient.yaml 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/mount/fuse.yaml 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/inline 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/begin.yaml 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/% 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/basic/tasks 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify 2023-10-06T04:46:20.851 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/validater 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/overrides 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/overrides/fuse-default-perm-no.yaml 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/overrides/% 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/overrides/verify 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/clusters 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/clusters/9-mds.yaml 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/clusters/3-mds.yaml 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/fs 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/mount 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/mount/kclient.yaml 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/mount/fuse.yaml 2023-10-06T04:46:20.852 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/begin.yaml 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/% 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/multimds/verify/tasks 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/1node 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/1node/clusters 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/1node/clusters/openstack.yaml 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/1node/clusters/+ 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/1node/clusters/fixed-1.yaml 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/1node/% 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/1node/tasks 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml 2023-10-06T04:46:20.853 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/systemd 2023-10-06T04:46:20.854 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/systemd/distro 2023-10-06T04:46:20.854 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/systemd/distro/ubuntu_16.04.yaml 2023-10-06T04:46:20.854 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/systemd/distro/centos_7.2.yaml 2023-10-06T04:46:20.854 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/systemd/% 2023-10-06T04:46:20.854 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/systemd/tasks 2023-10-06T04:46:20.854 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/systemd/tasks/systemd.yaml 2023-10-06T04:46:20.854 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/clusters 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/clusters/fixed-3-cephfs.yaml 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/fs 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/fs/btrfs.yaml 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/% 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/libcephfs_interface_tests.yaml 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_cache_snaps.yaml 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_cls_all.yaml 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_cli_import_export.yaml 2023-10-06T04:46:20.855 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.856 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_pjd.yaml 2023-10-06T04:46:20.860 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/mon_thrash.yaml 2023-10-06T04:46:20.860 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_direct_io.yaml 2023-10-06T04:46:20.860 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_fsx.yaml 2023-10-06T04:46:20.860 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_python_api_tests.yaml 2023-10-06T04:46:20.860 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_workunit_suites_iozone.yaml 2023-10-06T04:46:20.860 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_dbench.yaml 2023-10-06T04:46:20.860 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_api_tests.yaml 2023-10-06T04:46:20.860 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_blogbench.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_ec_snaps.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rgw_ec_s3tests.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_pjd.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_workunit_loadgen_mix.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_python.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rgw_swift.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_bench.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_api_tests.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_fsstress.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rgw_s3tests.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_iozone.yaml 2023-10-06T04:46:20.861 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/machine_types 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/machine_types/vps.yaml 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/machine_types/schedule_rados_ovh.sh 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/machine_types/schedule_rados.sh 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/mon_kv_backend 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/mon_kv_backend/leveldb.yaml 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/mon_kv_backend/rocksdb.yaml 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/README 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/rebuild_mondb.py 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/workunit.py 2023-10-06T04:46:20.862 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/osd_backfill.py 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/calamari_setup.py 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/object_source_down.py 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/populate_rbd_pool.py 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/util 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/util/rgw.py 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/util/__init__.py 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/util/rados.py 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/util/test 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/util/test/__init__.py 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/util/test/test_rados.py 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/osd_failsafe_enospc.py 2023-10-06T04:46:20.863 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/osd_recovery.py 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/die_on_err.py 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/calamari_nosetests.py 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/admin_socket.py 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mgr 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mgr/__init__.py 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mgr/test_failover.py 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mgr/mgr_test_case.py 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/thrash_pool_snaps.py 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/userdata_teardown.yaml 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/radosbenchsweep.py 2023-10-06T04:46:20.864 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mds_thrash.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/rbd.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/rgw.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/teuthology_integration.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mon_seesaw.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/repair_test.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/watch_notify_same_primary.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/peer.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/restart.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/ceph.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/tests 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/tests/test_buildpackages.py 2023-10-06T04:46:20.865 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/tests/test_radosgw_admin.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/tests/test_devstack.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/tests/__init__.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/rgw_logsocket.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/radosgw_admin.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/ceph_client.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/__init__.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/aver.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cram.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_misc.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_client_limits.py 2023-10-06T04:46:20.866 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_pool_perm.py 2023-10-06T04:46:20.867 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_data_scan.py 2023-10-06T04:46:20.867 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_client_recovery.py 2023-10-06T04:46:20.867 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_journal_migration.py 2023-10-06T04:46:20.867 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_dump_tree.py 2023-10-06T04:46:20.867 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_mantle.py 2023-10-06T04:46:20.867 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_sessionmap.py 2023-10-06T04:46:20.867 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/__init__.py 2023-10-06T04:46:20.868 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_journal_repair.py 2023-10-06T04:46:20.868 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/kernel_mount.py 2023-10-06T04:46:20.868 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_cap_flush.py 2023-10-06T04:46:20.868 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_readahead.py 2023-10-06T04:46:20.868 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_backtrace.py 2023-10-06T04:46:20.869 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_auto_repair.py 2023-10-06T04:46:20.869 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_strays.py 2023-10-06T04:46:20.869 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_volume_client.py 2023-10-06T04:46:20.870 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/cephfs_test_case.py 2023-10-06T04:46:20.870 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_fragment.py 2023-10-06T04:46:20.870 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_failover.py 2023-10-06T04:46:20.870 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_full.py 2023-10-06T04:46:20.870 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/filesystem.py 2023-10-06T04:46:20.870 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/mount.py 2023-10-06T04:46:20.870 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_damage.py 2023-10-06T04:46:20.870 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_scrub_checks.py 2023-10-06T04:46:20.870 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_config_commands.py 2023-10-06T04:46:20.871 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_flush.py 2023-10-06T04:46:20.871 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/fuse_mount.py 2023-10-06T04:46:20.871 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs/test_forward_scrub.py 2023-10-06T04:46:20.871 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/recovery_bench.py 2023-10-06T04:46:20.871 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/multibench.py 2023-10-06T04:46:20.871 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/devstack.py 2023-10-06T04:46:20.871 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cephfs_test_runner.py 2023-10-06T04:46:20.871 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/filestore_idempotent.py 2023-10-06T04:46:20.871 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mod_proxy_fcgi.tcp.conf.template 2023-10-06T04:46:20.871 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/scrub.py 2023-10-06T04:46:20.872 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/divergent_priors.py 2023-10-06T04:46:20.872 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/samba.py 2023-10-06T04:46:20.872 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/watch_notify_stress.py 2023-10-06T04:46:20.872 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/boto.cfg.template 2023-10-06T04:46:20.872 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages.py 2023-10-06T04:46:20.872 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/ceph_test_case.py 2023-10-06T04:46:20.872 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/s3roundtrip.py 2023-10-06T04:46:20.872 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/qemu.py 2023-10-06T04:46:20.872 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/locktest.py 2023-10-06T04:46:20.873 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/manypools.py 2023-10-06T04:46:20.873 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mds_creation_failure.py 2023-10-06T04:46:20.873 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/apache.conf.template 2023-10-06T04:46:20.873 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/ec_lost_unfound.py 2023-10-06T04:46:20.873 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages 2023-10-06T04:46:20.873 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/ubuntu-16.04-user-data.txt 2023-10-06T04:46:20.873 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/ubuntu-14.04-user-data.txt 2023-10-06T04:46:20.874 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/centos-6.5-user-data.txt 2023-10-06T04:46:20.874 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/centos-7.1-user-data.txt 2023-10-06T04:46:20.874 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/make-deb.sh 2023-10-06T04:46:20.874 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/centos-7.0-user-data.txt 2023-10-06T04:46:20.874 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/make-rpm.sh 2023-10-06T04:46:20.874 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/opensuse-42.1-user-data.txt 2023-10-06T04:46:20.875 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/Makefile 2023-10-06T04:46:20.875 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/ubuntu-12.04-user-data.txt 2023-10-06T04:46:20.875 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/common.sh 2023-10-06T04:46:20.875 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/user-data.txt 2023-10-06T04:46:20.875 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/debian-8.0-user-data.txt 2023-10-06T04:46:20.875 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/buildpackages/centos-7.2-user-data.txt 2023-10-06T04:46:20.876 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/rbd_mirror.py 2023-10-06T04:46:20.876 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/dump_stuck.py 2023-10-06T04:46:20.876 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/ceph_objectstore_tool.py 2023-10-06T04:46:20.876 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/rbd_fsx.py 2023-10-06T04:46:20.876 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/radosgw_agent.py 2023-10-06T04:46:20.877 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/tgt.py 2023-10-06T04:46:20.877 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/vstart_runner.py 2023-10-06T04:46:20.877 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/resolve_stuck_peering.py 2023-10-06T04:46:20.877 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/rados.py 2023-10-06T04:46:20.877 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/s3tests.py 2023-10-06T04:46:20.877 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/userdata_setup.yaml 2023-10-06T04:46:20.878 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/lost_unfound.py 2023-10-06T04:46:20.878 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/s3readwrite.py 2023-10-06T04:46:20.878 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/ceph_fuse.py 2023-10-06T04:46:20.878 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/rest_api.py 2023-10-06T04:46:20.878 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/reg11184.py 2023-10-06T04:46:20.879 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/rep_lost_unfound_delete.py 2023-10-06T04:46:20.879 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mod_proxy_fcgi.uds.conf.template 2023-10-06T04:46:20.879 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/ceph_deploy.py 2023-10-06T04:46:20.879 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/ceph_manager.py 2023-10-06T04:46:20.879 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/radosbench.py 2023-10-06T04:46:20.879 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/scrub_test.py 2023-10-06T04:46:20.880 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mon_clock_skew_check.py 2023-10-06T04:46:20.880 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/kclient.py 2023-10-06T04:46:20.880 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/omapbench.py 2023-10-06T04:46:20.880 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/autotest.py 2023-10-06T04:46:20.880 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mod_fastcgi.conf.template 2023-10-06T04:46:20.881 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/peering_speed_test.py 2023-10-06T04:46:20.881 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mon_recovery.py 2023-10-06T04:46:20.881 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/cifs_mount.py 2023-10-06T04:46:20.881 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/rbd_fio.py 2023-10-06T04:46:20.881 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/logrotate.conf 2023-10-06T04:46:20.882 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/mon_thrash.py 2023-10-06T04:46:20.882 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/metadata.yaml 2023-10-06T04:46:20.882 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/divergent_priors2.py 2023-10-06T04:46:20.882 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/blktrace.py 2023-10-06T04:46:20.882 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/thrashosds.py 2023-10-06T04:46:20.882 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/systemd.py 2023-10-06T04:46:20.882 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/radosgw_admin_rest.py 2023-10-06T04:46:20.883 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/tasks/create_verify_lfn_objects.py 2023-10-06T04:46:20.883 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/timezone 2023-10-06T04:46:20.883 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/timezone/random.yaml 2023-10-06T04:46:20.883 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/timezone/eastern.yaml 2023-10-06T04:46:20.883 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/timezone/pacific.yaml 2023-10-06T04:46:20.883 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/.gitignore 2023-10-06T04:46:20.883 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/debug 2023-10-06T04:46:20.884 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/debug/openstack-30G.yaml 2023-10-06T04:46:20.884 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/debug/buildpackages.yaml 2023-10-06T04:46:20.884 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/debug/mds_client.yaml 2023-10-06T04:46:20.884 INFO:teuthology.orchestra.run.smithi124.stdout:./ceph-qa-suite/debug/openstack-15G.yaml 2023-10-06T04:46:20.885 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:20.885 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:20.885 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:20.885 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:20.885 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T04:46:20.885 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:20.999 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-06T04:46:21.185 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:21.185 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:21.185 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:21.185 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:21.185 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite").st_ino) 2023-10-06T04:46:21.185 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:21.338 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627776 2023-10-06T04:46:21.523 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:21.523 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:21.523 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:21.523 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:21.523 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code").st_ino) 2023-10-06T04:46:21.523 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:21.676 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628340 2023-10-06T04:46:21.861 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:21.861 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:21.862 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:21.862 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:21.862 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml").st_ino) 2023-10-06T04:46:21.862 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:22.015 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627867 2023-10-06T04:46:22.201 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:22.201 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:22.201 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:22.201 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:22.201 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2023-10-06T04:46:22.201 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:22.353 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627866 2023-10-06T04:46:22.538 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:22.538 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:22.538 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:22.538 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:22.538 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=isa-k=2-m=1.yaml").st_ino) 2023-10-06T04:46:22.538 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:22.694 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627864 2023-10-06T04:46:22.876 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:22.876 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:22.876 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:22.877 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:22.877 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=2-m=1.yaml").st_ino) 2023-10-06T04:46:22.877 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:23.029 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627865 2023-10-06T04:46:23.214 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:23.214 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:23.214 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:23.214 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:23.214 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=shec-k=4-m=3-c=2.yaml").st_ino) 2023-10-06T04:46:23.214 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:23.367 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627868 2023-10-06T04:46:23.553 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:23.553 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:23.553 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:23.553 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:23.553 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-feature-plugins-v3.yaml").st_ino) 2023-10-06T04:46:23.553 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:23.706 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627861 2023-10-06T04:46:23.891 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:23.891 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:23.891 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:23.892 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:23.892 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-default.yaml").st_ino) 2023-10-06T04:46:23.892 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:24.045 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627862 2023-10-06T04:46:24.230 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:24.230 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:24.230 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:24.230 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:24.230 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-sequential.yaml").st_ino) 2023-10-06T04:46:24.230 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:24.384 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627869 2023-10-06T04:46:24.569 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:24.569 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:24.570 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:24.570 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:24.570 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-parallel.yaml").st_ino) 2023-10-06T04:46:24.570 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:24.726 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627863 2023-10-06T04:46:24.909 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:24.909 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:24.909 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:24.909 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:24.909 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-feature-plugins-v2.yaml").st_ino) 2023-10-06T04:46:24.909 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:25.062 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628341 2023-10-06T04:46:25.248 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:25.248 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:25.248 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:25.249 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:25.249 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases").st_ino) 2023-10-06T04:46:25.249 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:25.409 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628356 2023-10-06T04:46:25.594 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:25.594 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:25.594 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:25.594 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:25.594 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases/jewel.yaml").st_ino) 2023-10-06T04:46:25.595 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:25.748 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627880 2023-10-06T04:46:25.933 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:25.934 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:25.934 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:25.934 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:25.934 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases/kraken.yaml").st_ino) 2023-10-06T04:46:25.934 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:26.087 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627881 2023-10-06T04:46:26.271 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:26.271 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:26.272 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:26.272 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:26.272 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases/infernalis.yaml").st_ino) 2023-10-06T04:46:26.272 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:26.424 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628357 2023-10-06T04:46:26.609 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:26.609 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:26.610 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:26.610 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:26.610 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tox.ini").st_ino) 2023-10-06T04:46:26.610 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:26.762 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629085 2023-10-06T04:46:26.947 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:26.948 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:26.948 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:26.948 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:26.948 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides").st_ino) 2023-10-06T04:46:26.948 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:27.104 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628309 2023-10-06T04:46:27.289 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:27.289 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:27.289 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:27.290 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:27.290 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/enable_dmcrypt_diff_journal_disk.yaml").st_ino) 2023-10-06T04:46:27.290 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:27.442 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627815 2023-10-06T04:46:27.627 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:27.627 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:27.627 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:27.627 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:27.627 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/ceph_deploy_dmcrypt.yaml").st_ino) 2023-10-06T04:46:27.627 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:27.814 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628310 2023-10-06T04:46:27.998 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:27.999 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:27.999 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:27.999 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:27.999 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/enable_diff_journal_disk.yaml").st_ino) 2023-10-06T04:46:27.999 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:28.152 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627814 2023-10-06T04:46:28.337 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:28.337 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:28.337 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:28.337 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:28.337 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/disable_diff_journal_disk.yaml").st_ino) 2023-10-06T04:46:28.337 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:28.490 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627813 2023-10-06T04:46:28.675 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:28.675 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:28.675 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:28.675 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:28.675 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/nightlies").st_ino) 2023-10-06T04:46:28.676 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:28.827 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628348 2023-10-06T04:46:29.012 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:29.012 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:29.012 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:29.012 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:29.012 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/nightlies/cron_wrapper").st_ino) 2023-10-06T04:46:29.012 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:29.064 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:46:29.069 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:46:29.171 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628349 2023-10-06T04:46:29.355 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:29.355 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:29.356 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:29.356 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:29.356 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides").st_ino) 2023-10-06T04:46:29.356 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:29.509 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628352 2023-10-06T04:46:29.694 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:29.695 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:29.695 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:29.695 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:29.695 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/3-size-2-min-size.yaml").st_ino) 2023-10-06T04:46:29.695 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:29.848 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627877 2023-10-06T04:46:30.033 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:30.033 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:30.033 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:30.033 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:30.033 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:46:30.033 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:30.185 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627879 2023-10-06T04:46:30.371 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:30.371 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:30.371 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:30.371 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:30.371 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/2-size-2-min-size.yaml").st_ino) 2023-10-06T04:46:30.371 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:30.523 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627876 2023-10-06T04:46:30.708 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:30.709 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:30.709 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:30.709 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:30.709 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/2-size-1-min-size.yaml").st_ino) 2023-10-06T04:46:30.709 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:30.860 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628353 2023-10-06T04:46:31.045 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:31.045 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:31.046 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:31.046 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:31.046 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/short_pg_log.yaml").st_ino) 2023-10-06T04:46:31.046 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:31.198 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627878 2023-10-06T04:46:31.383 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:31.384 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:31.384 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:31.384 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:31.384 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/packages").st_ino) 2023-10-06T04:46:31.384 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:31.536 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628354 2023-10-06T04:46:31.721 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:31.721 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:31.721 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:31.722 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:31.722 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/packages/packages.yaml").st_ino) 2023-10-06T04:46:31.722 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:31.874 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628355 2023-10-06T04:46:32.059 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:32.060 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:32.060 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:32.060 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:32.060 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters").st_ino) 2023-10-06T04:46:32.060 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:32.211 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628324 2023-10-06T04:46:32.397 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:32.397 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:32.397 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:32.397 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:32.398 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/extra-client.yaml").st_ino) 2023-10-06T04:46:32.398 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:32.550 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628325 2023-10-06T04:46:32.735 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:32.735 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:32.735 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:32.735 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:32.736 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-2.yaml").st_ino) 2023-10-06T04:46:32.736 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:32.976 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627829 2023-10-06T04:46:33.161 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:33.161 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:33.161 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:33.161 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:33.161 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:46:33.161 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:33.318 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627831 2023-10-06T04:46:33.502 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:33.502 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:33.502 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:33.502 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:33.502 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-3-cephfs.yaml").st_ino) 2023-10-06T04:46:33.502 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:33.655 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627830 2023-10-06T04:46:33.840 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:33.840 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:33.840 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:33.840 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:33.841 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-4.yaml").st_ino) 2023-10-06T04:46:33.841 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:33.994 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627832 2023-10-06T04:46:34.179 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:34.179 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:34.179 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:34.180 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:34.180 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-1.yaml").st_ino) 2023-10-06T04:46:34.180 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:34.332 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627828 2023-10-06T04:46:34.517 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:34.517 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:34.517 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:34.517 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:34.517 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs").st_ino) 2023-10-06T04:46:34.517 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:34.670 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628311 2023-10-06T04:46:34.855 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:34.856 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:34.856 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:34.856 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:34.856 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides").st_ino) 2023-10-06T04:46:34.856 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:35.007 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628317 2023-10-06T04:46:35.193 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:35.193 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:35.193 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:35.193 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:35.193 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:46:35.194 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:35.346 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627822 2023-10-06T04:46:35.531 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:35.650 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:35.650 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:35.650 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:35.650 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/debug.yaml").st_ino) 2023-10-06T04:46:35.650 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:35.764 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628318 2023-10-06T04:46:35.949 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:35.949 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:35.949 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:35.949 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:35.949 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse").st_ino) 2023-10-06T04:46:35.950 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:36.102 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628319 2023-10-06T04:46:36.287 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:36.287 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:36.287 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:36.287 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:36.287 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm").st_ino) 2023-10-06T04:46:36.288 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:36.439 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628320 2023-10-06T04:46:36.625 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:36.625 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:36.625 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:36.625 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:36.626 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm/yes.yaml").st_ino) 2023-10-06T04:46:36.626 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:36.779 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627821 2023-10-06T04:46:36.964 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:36.964 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:36.964 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:36.964 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:36.964 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm/no.yaml").st_ino) 2023-10-06T04:46:36.965 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:37.118 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627820 2023-10-06T04:46:37.303 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:37.303 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:37.303 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:37.303 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:37.303 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm/%").st_ino) 2023-10-06T04:46:37.304 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:37.456 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628321 2023-10-06T04:46:37.642 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:37.642 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:37.642 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:37.642 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:37.642 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:46:37.642 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:37.796 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627819 2023-10-06T04:46:37.981 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:37.981 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:37.981 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:37.981 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:37.982 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters").st_ino) 2023-10-06T04:46:37.982 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:38.135 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628313 2023-10-06T04:46:38.319 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:38.320 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:38.320 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:38.320 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:38.320 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters/9-mds.yaml").st_ino) 2023-10-06T04:46:38.320 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:38.473 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627816 2023-10-06T04:46:38.658 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:38.658 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:38.658 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:38.659 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:38.659 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters/3-mds.yaml").st_ino) 2023-10-06T04:46:38.659 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:38.811 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628314 2023-10-06T04:46:38.996 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:38.996 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:38.996 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:38.997 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:38.997 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters/fixed-2-ucephfs.yaml").st_ino) 2023-10-06T04:46:38.997 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:39.149 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627817 2023-10-06T04:46:39.334 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:39.335 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:39.335 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:39.335 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:39.335 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/mount").st_ino) 2023-10-06T04:46:39.335 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:39.491 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628315 2023-10-06T04:46:39.676 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:39.676 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:39.676 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:39.676 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:39.676 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/mount/kclient.yaml").st_ino) 2023-10-06T04:46:39.676 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:39.829 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627818 2023-10-06T04:46:40.014 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:40.015 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:40.015 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:40.015 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:40.015 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/mount/fuse.yaml").st_ino) 2023-10-06T04:46:40.015 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:40.168 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628316 2023-10-06T04:46:40.353 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:40.353 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:40.353 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:40.353 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:40.353 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/begin.yaml").st_ino) 2023-10-06T04:46:40.353 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:40.505 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628312 2023-10-06T04:46:40.691 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:40.691 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:40.691 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:40.691 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:40.691 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks").st_ino) 2023-10-06T04:46:40.691 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:40.846 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628322 2023-10-06T04:46:41.031 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:41.031 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:41.031 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:41.031 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:41.031 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/libcephfs_interface_tests.yaml").st_ino) 2023-10-06T04:46:41.031 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:41.184 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627827 2023-10-06T04:46:41.370 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:41.370 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:41.370 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:41.371 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:41.371 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_trivial_sync.yaml").st_ino) 2023-10-06T04:46:41.371 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:41.523 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627826 2023-10-06T04:46:41.708 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:41.708 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:41.708 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:41.708 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:41.708 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2023-10-06T04:46:41.708 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:41.861 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627824 2023-10-06T04:46:42.046 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:42.046 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:42.046 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:42.046 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:42.046 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2023-10-06T04:46:42.047 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:42.198 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628323 2023-10-06T04:46:42.384 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:42.384 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:42.384 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:42.384 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:42.384 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:46:42.384 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:42.537 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627825 2023-10-06T04:46:42.722 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:42.723 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:42.723 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:42.723 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:42.723 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2023-10-06T04:46:42.723 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:42.874 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627823 2023-10-06T04:46:43.059 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:43.060 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:43.060 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:43.060 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:43.060 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/objectstore").st_ino) 2023-10-06T04:46:43.060 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:43.214 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628350 2023-10-06T04:46:43.399 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:43.399 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:43.399 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:43.399 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:43.400 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/objectstore/bluestore.yaml").st_ino) 2023-10-06T04:46:43.400 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:43.551 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628351 2023-10-06T04:46:43.737 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:43.737 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:43.737 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:43.737 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:43.737 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/objectstore/filestore.yaml").st_ino) 2023-10-06T04:46:43.738 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:43.890 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627875 2023-10-06T04:46:44.075 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:44.075 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:44.075 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:44.075 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:44.075 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config").st_ino) 2023-10-06T04:46:44.076 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:44.228 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628326 2023-10-06T04:46:44.413 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:44.413 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:44.413 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:44.413 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:44.413 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config/rados.yaml").st_ino) 2023-10-06T04:46:44.414 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:44.566 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628327 2023-10-06T04:46:44.751 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:44.751 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:44.751 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:44.751 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:44.751 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs").st_ino) 2023-10-06T04:46:44.752 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:44.905 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628307 2023-10-06T04:46:45.089 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:45.090 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:45.090 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:45.090 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:45.090 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/armv7.yaml").st_ino) 2023-10-06T04:46:45.090 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:45.242 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627810 2023-10-06T04:46:45.427 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:45.428 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:45.428 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:45.428 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:45.428 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/i686.yaml").st_ino) 2023-10-06T04:46:45.428 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:45.580 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627811 2023-10-06T04:46:45.765 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:45.765 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:45.765 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:45.765 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:45.765 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/aarch64.yaml").st_ino) 2023-10-06T04:46:45.765 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:45.927 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628308 2023-10-06T04:46:46.113 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:46.113 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:46.113 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:46.113 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:46.113 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/x86_64.yaml").st_ino) 2023-10-06T04:46:46.113 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:46.270 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627812 2023-10-06T04:46:46.455 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:46.456 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:46.456 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:46.456 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:46.456 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs").st_ino) 2023-10-06T04:46:46.456 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:46.616 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628342 2023-10-06T04:46:46.801 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:46.802 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:46.802 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:46.802 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:46.802 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs/btrfs.yaml").st_ino) 2023-10-06T04:46:46.802 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:46.955 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628343 2023-10-06T04:46:47.141 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:47.141 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:47.141 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:47.142 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:47.142 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs/xfs.yaml").st_ino) 2023-10-06T04:46:47.142 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:47.294 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627871 2023-10-06T04:46:47.480 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:47.480 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:47.480 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:47.480 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:47.480 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs/ext4.yaml").st_ino) 2023-10-06T04:46:47.480 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:47.633 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627870 2023-10-06T04:46:47.818 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:47.819 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:47.819 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:47.819 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:47.819 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type").st_ino) 2023-10-06T04:46:47.819 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:47.971 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628358 2023-10-06T04:46:48.156 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:48.157 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:48.157 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:48.157 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:48.157 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/ec-profile.yaml").st_ino) 2023-10-06T04:46:48.157 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:48.309 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627882 2023-10-06T04:46:48.494 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:48.494 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:48.495 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:48.495 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:48.495 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/ec.yaml").st_ino) 2023-10-06T04:46:48.495 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:48.647 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627883 2023-10-06T04:46:48.832 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:48.833 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:48.833 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:48.833 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:48.833 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/ec-cache.yaml").st_ino) 2023-10-06T04:46:48.833 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:48.985 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628359 2023-10-06T04:46:49.170 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:49.170 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:49.170 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:49.170 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:49.170 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/replicated.yaml").st_ino) 2023-10-06T04:46:49.170 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:49.323 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627884 2023-10-06T04:46:49.508 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:49.508 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:49.508 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:49.508 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:49.509 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git").st_ino) 2023-10-06T04:46:49.509 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:49.661 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627777 2023-10-06T04:46:49.847 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:49.848 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:49.848 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:49.848 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:49.848 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/HEAD").st_ino) 2023-10-06T04:46:49.848 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:50.002 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627804 2023-10-06T04:46:50.187 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:50.187 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:50.187 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:50.187 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:50.187 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/description").st_ino) 2023-10-06T04:46:50.187 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:50.338 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627778 2023-10-06T04:46:50.523 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:50.523 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:50.524 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:50.524 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:50.524 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/index").st_ino) 2023-10-06T04:46:50.524 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:50.678 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628305 2023-10-06T04:46:50.863 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:50.863 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:50.864 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:50.864 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:50.864 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects").st_ino) 2023-10-06T04:46:50.864 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:51.016 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628288 2023-10-06T04:46:51.201 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:51.201 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:51.201 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:51.202 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:51.202 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/info").st_ino) 2023-10-06T04:46:51.202 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:51.353 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628290 2023-10-06T04:46:51.539 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:51.539 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:51.539 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:51.539 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:51.539 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/pack").st_ino) 2023-10-06T04:46:51.539 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:51.692 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628289 2023-10-06T04:46:51.877 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:51.877 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:51.877 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:51.877 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:51.877 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.idx").st_ino) 2023-10-06T04:46:51.877 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:52.032 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628292 2023-10-06T04:46:52.217 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:52.217 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:52.217 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:52.217 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:52.218 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.pack").st_ino) 2023-10-06T04:46:52.218 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:52.370 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628291 2023-10-06T04:46:52.555 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:52.555 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:52.556 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:52.556 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:52.556 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks").st_ino) 2023-10-06T04:46:52.556 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:52.708 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628279 2023-10-06T04:46:52.894 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:52.894 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:52.894 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:52.895 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:52.895 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-merge-commit.sample").st_ino) 2023-10-06T04:46:52.895 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:53.047 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627780 2023-10-06T04:46:53.232 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:53.232 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:53.232 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:53.232 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:53.232 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-commit.sample").st_ino) 2023-10-06T04:46:53.233 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:53.386 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627786 2023-10-06T04:46:53.571 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:53.571 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:53.571 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:53.571 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:53.571 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/fsmonitor-watchman.sample").st_ino) 2023-10-06T04:46:53.571 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627785 2023-10-06T04:46:53.909 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:53.909 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:53.909 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:53.909 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:53.909 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/commit-msg.sample").st_ino) 2023-10-06T04:46:53.909 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627783 2023-10-06T04:46:54.248 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:54.248 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:54.248 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:54.248 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:54.248 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-rebase.sample").st_ino) 2023-10-06T04:46:54.248 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:54.404 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627781 2023-10-06T04:46:54.589 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:54.589 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:54.589 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:54.589 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:54.589 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-receive.sample").st_ino) 2023-10-06T04:46:54.589 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:54.741 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627787 2023-10-06T04:46:54.927 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:54.927 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:54.927 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:54.927 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:54.927 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/prepare-commit-msg.sample").st_ino) 2023-10-06T04:46:54.928 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:55.080 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627782 2023-10-06T04:46:55.266 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:55.266 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:55.266 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:55.266 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:55.266 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/update.sample").st_ino) 2023-10-06T04:46:55.266 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:55.422 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627779 2023-10-06T04:46:55.607 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:55.608 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:55.608 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:55.608 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:55.608 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-push.sample").st_ino) 2023-10-06T04:46:55.608 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:55.760 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627789 2023-10-06T04:46:55.945 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:55.945 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:55.945 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:55.945 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:55.946 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-applypatch.sample").st_ino) 2023-10-06T04:46:55.946 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:56.097 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627790 2023-10-06T04:46:56.282 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:56.283 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:56.283 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:56.283 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:56.283 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/push-to-checkout.sample").st_ino) 2023-10-06T04:46:56.283 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:56.435 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627784 2023-10-06T04:46:56.621 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:56.621 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:56.621 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:56.621 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:56.621 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/post-update.sample").st_ino) 2023-10-06T04:46:56.621 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:56.773 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628280 2023-10-06T04:46:56.958 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:56.958 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:56.958 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:56.958 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:56.958 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/applypatch-msg.sample").st_ino) 2023-10-06T04:46:56.959 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:57.110 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627788 2023-10-06T04:46:57.295 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:57.295 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:57.296 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:57.296 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:57.296 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs").st_ino) 2023-10-06T04:46:57.296 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:57.448 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628296 2023-10-06T04:46:57.634 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:57.634 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:57.634 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:57.634 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:57.634 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/HEAD").st_ino) 2023-10-06T04:46:57.634 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:57.786 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628302 2023-10-06T04:46:57.971 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:57.971 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:57.971 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:57.971 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:57.972 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs").st_ino) 2023-10-06T04:46:57.972 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:58.123 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628297 2023-10-06T04:46:58.309 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:58.309 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:58.309 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:58.309 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:58.309 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/heads").st_ino) 2023-10-06T04:46:58.309 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:58.462 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628303 2023-10-06T04:46:58.647 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:58.647 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:58.647 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:58.648 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:58.648 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/heads/master").st_ino) 2023-10-06T04:46:58.648 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:58.800 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628304 2023-10-06T04:46:58.986 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:58.986 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:58.986 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:58.986 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:58.986 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/remotes").st_ino) 2023-10-06T04:46:58.986 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:59.139 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628298 2023-10-06T04:46:59.178 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:46:59.182 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:46:59.323 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:59.323 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:59.324 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:59.324 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:59.324 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/remotes/origin").st_ino) 2023-10-06T04:46:59.324 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:59.436 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628299 2023-10-06T04:46:59.621 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:59.621 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:59.621 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:59.621 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:59.621 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/remotes/origin/HEAD").st_ino) 2023-10-06T04:46:59.621 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:46:59.734 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628300 2023-10-06T04:46:59.920 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:46:59.920 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:46:59.920 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:46:59.920 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:46:59.920 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/packed-refs").st_ino) 2023-10-06T04:46:59.920 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:00.073 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627803 2023-10-06T04:47:00.258 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:00.258 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:00.258 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:00.258 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:00.258 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/config").st_ino) 2023-10-06T04:47:00.259 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:00.411 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627808 2023-10-06T04:47:00.597 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:00.597 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:00.597 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:00.597 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:00.597 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/info").st_ino) 2023-10-06T04:47:00.597 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:00.750 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628282 2023-10-06T04:47:00.935 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:00.935 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:00.935 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:00.935 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:00.936 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/info/exclude").st_ino) 2023-10-06T04:47:00.936 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:01.088 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628283 2023-10-06T04:47:01.273 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:01.273 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:01.273 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:01.273 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:01.274 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs").st_ino) 2023-10-06T04:47:01.274 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:01.426 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628284 2023-10-06T04:47:01.611 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:01.611 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:01.611 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:01.612 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:01.612 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/tags").st_ino) 2023-10-06T04:47:01.612 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:01.765 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628286 2023-10-06T04:47:01.950 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:01.950 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:01.950 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:01.950 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:01.950 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/heads").st_ino) 2023-10-06T04:47:01.951 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:02.104 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628285 2023-10-06T04:47:02.289 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:02.290 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:02.290 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:02.290 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:02.290 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/heads/master").st_ino) 2023-10-06T04:47:02.290 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:02.443 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628301 2023-10-06T04:47:02.628 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:02.629 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:02.629 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:02.629 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:02.629 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/remotes").st_ino) 2023-10-06T04:47:02.629 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:02.782 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628293 2023-10-06T04:47:02.966 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:02.966 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:02.967 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:02.967 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:02.967 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/remotes/origin").st_ino) 2023-10-06T04:47:02.967 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:03.119 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628294 2023-10-06T04:47:03.305 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:03.305 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:03.305 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:03.305 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:03.306 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/remotes/origin/HEAD").st_ino) 2023-10-06T04:47:03.306 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:03.461 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628295 2023-10-06T04:47:03.647 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:03.647 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:03.647 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:03.647 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:03.647 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/branches").st_ino) 2023-10-06T04:47:03.647 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:03.800 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628281 2023-10-06T04:47:03.985 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:03.986 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:03.986 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:03.986 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:03.986 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config_options").st_ino) 2023-10-06T04:47:03.986 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:04.139 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628328 2023-10-06T04:47:04.323 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:04.323 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:04.323 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:04.324 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:04.324 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config_options/cephdeploy_conf.yaml").st_ino) 2023-10-06T04:47:04.324 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:04.477 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628329 2023-10-06T04:47:04.662 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:04.662 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:04.663 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:04.663 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:04.663 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros").st_ino) 2023-10-06T04:47:04.663 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:04.815 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628332 2023-10-06T04:47:05.000 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:05.000 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:05.000 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:05.000 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:05.000 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/a-supported-distro.yaml").st_ino) 2023-10-06T04:47:05.000 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:05.153 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628333 2023-10-06T04:47:05.338 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:05.338 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:05.338 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:05.339 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:05.339 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported").st_ino) 2023-10-06T04:47:05.339 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:05.491 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628336 2023-10-06T04:47:05.677 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:05.677 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:05.677 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:05.677 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:05.677 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported/ubuntu_16.04.yaml").st_ino) 2023-10-06T04:47:05.677 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:05.830 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628339 2023-10-06T04:47:06.015 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:06.015 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:06.016 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:06.016 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:06.016 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported/centos_7.2.yaml").st_ino) 2023-10-06T04:47:06.016 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:06.169 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628337 2023-10-06T04:47:06.354 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:06.354 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:06.354 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:06.354 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:06.354 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported/ubuntu_14.04.yaml").st_ino) 2023-10-06T04:47:06.355 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:06.506 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628338 2023-10-06T04:47:06.692 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:06.692 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:06.692 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:06.692 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:06.692 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all").st_ino) 2023-10-06T04:47:06.692 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:06.844 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628334 2023-10-06T04:47:07.030 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:07.030 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:07.030 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:07.030 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:07.030 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/fedora_17.yaml").st_ino) 2023-10-06T04:47:07.030 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:07.183 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627844 2023-10-06T04:47:07.368 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:07.369 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:07.369 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:07.369 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:07.369 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_6.4.yaml").st_ino) 2023-10-06T04:47:07.369 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:07.522 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627836 2023-10-06T04:47:07.707 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:07.707 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:07.707 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:07.707 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:07.708 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/debian_7.0.yaml").st_ino) 2023-10-06T04:47:07.708 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:07.860 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627842 2023-10-06T04:47:08.045 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:08.045 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:08.045 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:08.045 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:08.045 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/debian_6.0.yaml").st_ino) 2023-10-06T04:47:08.045 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:08.199 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627841 2023-10-06T04:47:08.383 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:08.383 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:08.384 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:08.384 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:08.384 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/fedora_19.yaml").st_ino) 2023-10-06T04:47:08.384 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:08.536 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627846 2023-10-06T04:47:08.721 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:08.721 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:08.721 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:08.722 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:08.722 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_16.04.yaml").st_ino) 2023-10-06T04:47:08.722 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:08.874 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627860 2023-10-06T04:47:09.060 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:09.060 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:09.060 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:09.060 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:09.060 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/opensuse_13.2.yaml").st_ino) 2023-10-06T04:47:09.060 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:09.214 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627848 2023-10-06T04:47:09.398 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:09.399 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:09.399 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:09.399 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:09.399 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/opensuse_12.2.yaml").st_ino) 2023-10-06T04:47:09.399 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:09.551 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627847 2023-10-06T04:47:09.736 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:09.736 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:09.736 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:09.736 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:09.736 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_6.3.yaml").st_ino) 2023-10-06T04:47:09.736 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:09.889 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627850 2023-10-06T04:47:10.075 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:10.075 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:10.075 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:10.075 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:10.075 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/sles_11-sp2.yaml").st_ino) 2023-10-06T04:47:10.075 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:10.230 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627854 2023-10-06T04:47:10.415 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:10.415 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:10.415 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:10.415 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:10.415 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_7.2.yaml").st_ino) 2023-10-06T04:47:10.415 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:10.568 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627840 2023-10-06T04:47:10.753 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:10.754 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:10.754 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:10.754 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:10.754 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_6.4.yaml").st_ino) 2023-10-06T04:47:10.754 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:10.906 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627851 2023-10-06T04:47:11.092 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:11.092 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:11.092 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:11.092 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:11.092 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_7.0.yaml").st_ino) 2023-10-06T04:47:11.092 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:11.245 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627838 2023-10-06T04:47:11.430 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:11.431 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:11.431 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:11.431 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:11.431 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_14.04_i686.yaml").st_ino) 2023-10-06T04:47:11.431 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:11.583 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627859 2023-10-06T04:47:11.768 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:11.768 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:11.768 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:11.768 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:11.768 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/opensuse_42.1.yaml").st_ino) 2023-10-06T04:47:11.768 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:11.922 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627849 2023-10-06T04:47:12.107 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:12.107 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:12.107 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:12.107 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:12.107 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/debian_8.0.yaml").st_ino) 2023-10-06T04:47:12.107 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:12.261 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627843 2023-10-06T04:47:12.447 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:12.447 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:12.447 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:12.447 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:12.447 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/fedora_18.yaml").st_ino) 2023-10-06T04:47:12.447 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:12.602 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627845 2023-10-06T04:47:12.786 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:12.786 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:12.787 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:12.787 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:12.787 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_7.0.yaml").st_ino) 2023-10-06T04:47:12.787 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:12.941 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627853 2023-10-06T04:47:13.125 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:13.126 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:13.126 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:13.126 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:13.126 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_14.04.yaml").st_ino) 2023-10-06T04:47:13.126 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:13.278 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627857 2023-10-06T04:47:13.463 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:13.463 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:13.463 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:13.463 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:13.464 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_7.1.yaml").st_ino) 2023-10-06T04:47:13.464 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:13.616 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627839 2023-10-06T04:47:13.801 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:13.801 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:13.801 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:13.801 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:13.801 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_12.10.yaml").st_ino) 2023-10-06T04:47:13.801 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:13.956 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627856 2023-10-06T04:47:14.140 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:14.140 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:14.140 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:14.140 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:14.140 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_12.04.yaml").st_ino) 2023-10-06T04:47:14.140 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:14.293 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627855 2023-10-06T04:47:14.479 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:14.479 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:14.479 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:14.479 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:14.479 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_6.3.yaml").st_ino) 2023-10-06T04:47:14.479 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:14.632 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628335 2023-10-06T04:47:14.818 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:14.818 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:14.818 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:14.818 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:14.818 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_6.5.yaml").st_ino) 2023-10-06T04:47:14.818 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:14.971 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627852 2023-10-06T04:47:15.158 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:15.158 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:15.158 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:15.158 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:15.158 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_14.04_aarch64.yaml").st_ino) 2023-10-06T04:47:15.158 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:15.311 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627858 2023-10-06T04:47:15.496 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:15.497 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:15.497 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:15.497 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:15.497 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_6.5.yaml").st_ino) 2023-10-06T04:47:15.497 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:15.649 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627837 2023-10-06T04:47:15.835 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:15.835 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:15.835 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:15.835 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:15.836 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites").st_ino) 2023-10-06T04:47:15.836 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:15.989 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628360 2023-10-06T04:47:16.175 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:16.175 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:16.175 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:16.175 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:16.175 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress").st_ino) 2023-10-06T04:47:16.175 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:16.328 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629772 2023-10-06T04:47:16.513 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:16.514 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:16.514 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:16.514 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:16.514 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench").st_ino) 2023-10-06T04:47:16.515 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:16.667 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629773 2023-10-06T04:47:16.852 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:16.852 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:16.852 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:16.852 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:16.852 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/clusters").st_ino) 2023-10-06T04:47:16.852 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:17.006 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629775 2023-10-06T04:47:17.192 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:17.192 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:17.192 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:17.192 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:17.193 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/clusters/fixed-3-cephfs.yaml").st_ino) 2023-10-06T04:47:17.193 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:17.345 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629776 2023-10-06T04:47:17.530 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:17.530 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:17.530 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:17.530 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:17.530 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/%").st_ino) 2023-10-06T04:47:17.530 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:17.682 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629774 2023-10-06T04:47:17.868 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:17.868 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:17.868 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:17.868 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:17.868 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/tasks").st_ino) 2023-10-06T04:47:17.868 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:18.021 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629777 2023-10-06T04:47:18.206 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:18.206 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:18.206 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:18.206 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:18.207 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/tasks/kclient_workunit_suites_fsx.yaml").st_ino) 2023-10-06T04:47:18.207 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:18.359 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628870 2023-10-06T04:47:18.545 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:18.545 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:18.545 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:18.545 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:18.545 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/tasks/cfuse_workunit_snaps.yaml").st_ino) 2023-10-06T04:47:18.545 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:18.698 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629778 2023-10-06T04:47:18.883 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:18.883 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:18.883 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:18.883 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:18.883 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash").st_ino) 2023-10-06T04:47:18.883 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:19.037 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629779 2023-10-06T04:47:19.221 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:19.221 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:19.221 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:19.221 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:19.222 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters").st_ino) 2023-10-06T04:47:19.222 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:19.374 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629782 2023-10-06T04:47:19.559 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:19.559 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:19.559 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:19.560 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:19.560 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters/16-osd.yaml").st_ino) 2023-10-06T04:47:19.560 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:19.713 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629783 2023-10-06T04:47:19.898 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:19.898 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:19.898 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:19.898 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:19.898 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters/3-osd-1-machine.yaml").st_ino) 2023-10-06T04:47:19.899 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:20.051 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628871 2023-10-06T04:47:20.236 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:20.237 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:20.237 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:20.237 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:20.237 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters/8-osd.yaml").st_ino) 2023-10-06T04:47:20.237 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:20.389 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628872 2023-10-06T04:47:20.573 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:20.574 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:20.574 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:20.574 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:20.574 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs").st_ino) 2023-10-06T04:47:20.574 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:20.727 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629784 2023-10-06T04:47:20.913 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:20.913 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:20.913 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:20.913 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:20.913 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs/none.yaml").st_ino) 2023-10-06T04:47:20.913 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:21.066 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629786 2023-10-06T04:47:21.251 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:21.252 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:21.252 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:21.252 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:21.252 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs/btrfs.yaml").st_ino) 2023-10-06T04:47:21.252 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:21.403 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629785 2023-10-06T04:47:21.589 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:21.589 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:21.589 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:21.589 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:21.589 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs/xfs.yaml").st_ino) 2023-10-06T04:47:21.589 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:21.742 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629787 2023-10-06T04:47:21.927 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:21.927 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:21.927 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:21.928 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:21.928 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads").st_ino) 2023-10-06T04:47:21.928 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:22.085 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629790 2023-10-06T04:47:22.270 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:22.270 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:22.270 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:22.271 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:22.271 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/readwrite.yaml").st_ino) 2023-10-06T04:47:22.271 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:22.423 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628877 2023-10-06T04:47:22.608 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:22.608 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:22.608 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:22.608 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:22.608 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/radosbench.yaml").st_ino) 2023-10-06T04:47:22.609 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:22.761 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628876 2023-10-06T04:47:22.946 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:22.946 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:22.946 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:22.947 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:22.947 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/iozone_cfuse.yaml").st_ino) 2023-10-06T04:47:22.947 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:23.099 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628875 2023-10-06T04:47:23.285 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:23.285 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:23.285 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:23.285 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:23.285 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/bonnie_cfuse.yaml").st_ino) 2023-10-06T04:47:23.285 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:23.439 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629791 2023-10-06T04:47:23.623 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:23.624 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:23.624 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:23.624 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:23.624 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/%").st_ino) 2023-10-06T04:47:23.624 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:23.776 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629780 2023-10-06T04:47:23.961 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:23.962 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:23.962 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:23.962 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:23.962 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers").st_ino) 2023-10-06T04:47:23.962 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:24.114 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629788 2023-10-06T04:47:24.300 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:24.300 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:24.300 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:24.300 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:24.300 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers/default.yaml").st_ino) 2023-10-06T04:47:24.300 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:24.453 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629789 2023-10-06T04:47:24.638 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:24.638 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:24.638 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:24.639 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:24.639 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers/more-down.yaml").st_ino) 2023-10-06T04:47:24.639 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:24.791 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628874 2023-10-06T04:47:24.976 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:24.976 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:24.976 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:24.976 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:24.976 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers/fast.yaml").st_ino) 2023-10-06T04:47:24.977 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:25.129 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628873 2023-10-06T04:47:25.314 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:25.314 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:25.314 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:25.314 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:25.314 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr").st_ino) 2023-10-06T04:47:25.314 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:25.467 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628797 2023-10-06T04:47:25.652 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:25.653 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:25.653 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:25.653 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:25.653 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic").st_ino) 2023-10-06T04:47:25.653 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:25.805 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628798 2023-10-06T04:47:25.990 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:25.990 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:25.990 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:25.991 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:25.991 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/clusters").st_ino) 2023-10-06T04:47:25.991 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:26.143 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628800 2023-10-06T04:47:26.328 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:26.328 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:26.328 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:26.328 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:26.328 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/clusters/2-node-mgr.yaml").st_ino) 2023-10-06T04:47:26.328 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:26.482 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628801 2023-10-06T04:47:26.667 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:26.667 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:26.667 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:26.667 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:26.667 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/fs").st_ino) 2023-10-06T04:47:26.667 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:26.819 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628804 2023-10-06T04:47:27.008 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:27.008 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:27.008 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:27.008 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:27.008 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/fs/xfs.yaml").st_ino) 2023-10-06T04:47:27.009 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:27.162 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628805 2023-10-06T04:47:27.347 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:27.347 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:27.347 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:27.347 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:27.347 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/%").st_ino) 2023-10-06T04:47:27.348 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:27.502 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628799 2023-10-06T04:47:27.687 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:27.687 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:27.687 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:27.687 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:27.688 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/tasks").st_ino) 2023-10-06T04:47:27.688 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:27.839 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628806 2023-10-06T04:47:28.024 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:28.024 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:28.024 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:28.024 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:28.025 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/tasks/failover.yaml").st_ino) 2023-10-06T04:47:28.025 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:28.178 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628807 2023-10-06T04:47:28.363 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:28.363 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:28.363 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:28.364 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:28.364 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/debug").st_ino) 2023-10-06T04:47:28.364 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:28.517 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628802 2023-10-06T04:47:28.702 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:28.702 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:28.703 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:28.703 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:28.703 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/debug/mgr.yaml").st_ino) 2023-10-06T04:47:28.703 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:28.855 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628803 2023-10-06T04:47:29.040 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:29.041 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:29.041 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:29.041 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:29.041 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle").st_ino) 2023-10-06T04:47:29.041 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:29.194 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628849 2023-10-06T04:47:29.379 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:29.379 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:29.379 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:29.379 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:29.379 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd").st_ino) 2023-10-06T04:47:29.379 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:29.464 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:47:29.469 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:47:29.536 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628850 2023-10-06T04:47:29.719 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:29.719 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:29.719 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:29.719 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:29.719 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/powercycle").st_ino) 2023-10-06T04:47:29.719 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:29.831 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628858 2023-10-06T04:47:30.016 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:30.016 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:30.016 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:30.017 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:30.017 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/powercycle/default.yaml").st_ino) 2023-10-06T04:47:30.017 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:30.169 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628859 2023-10-06T04:47:30.354 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:30.354 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:30.354 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:30.354 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:30.354 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/clusters").st_ino) 2023-10-06T04:47:30.354 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:30.507 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628852 2023-10-06T04:47:30.692 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:30.693 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:30.693 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:30.693 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:30.693 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/clusters/3osd-1per-target.yaml").st_ino) 2023-10-06T04:47:30.693 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:30.845 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628853 2023-10-06T04:47:31.030 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:31.030 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:31.030 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:31.031 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:31.031 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/objectstore").st_ino) 2023-10-06T04:47:31.031 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:31.182 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628857 2023-10-06T04:47:31.367 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:31.367 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:31.367 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:31.367 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:31.367 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/fs").st_ino) 2023-10-06T04:47:31.367 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:31.520 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628854 2023-10-06T04:47:31.705 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:31.705 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:31.705 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:31.705 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:31.705 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/fs/btrfs.yaml").st_ino) 2023-10-06T04:47:31.705 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:31.857 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628855 2023-10-06T04:47:32.043 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:32.043 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:32.043 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:32.043 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:32.044 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/fs/xfs.yaml").st_ino) 2023-10-06T04:47:32.044 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:32.197 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628856 2023-10-06T04:47:32.382 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:32.382 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:32.382 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:32.382 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:32.383 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/%").st_ino) 2023-10-06T04:47:32.383 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:32.535 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628851 2023-10-06T04:47:32.721 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:32.721 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:32.721 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:32.721 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:32.721 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks").st_ino) 2023-10-06T04:47:32.721 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:32.874 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628860 2023-10-06T04:47:33.059 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:33.059 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:33.059 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:33.059 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:33.059 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/readwrite.yaml").st_ino) 2023-10-06T04:47:33.059 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:33.212 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628032 2023-10-06T04:47:33.397 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:33.397 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:33.397 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:33.398 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:33.398 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsync.yaml").st_ino) 2023-10-06T04:47:33.398 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:33.550 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628027 2023-10-06T04:47:33.735 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:33.735 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:33.735 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:33.735 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:33.735 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/radosbench.yaml").st_ino) 2023-10-06T04:47:33.735 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:33.888 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628031 2023-10-06T04:47:34.074 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:34.074 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:34.074 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:34.074 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:34.075 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2023-10-06T04:47:34.075 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:34.228 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628028 2023-10-06T04:47:34.412 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:34.413 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:34.413 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:34.413 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:34.413 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2023-10-06T04:47:34.413 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:34.565 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628024 2023-10-06T04:47:34.751 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:34.751 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:34.751 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:34.751 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:34.751 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsx.yaml").st_ino) 2023-10-06T04:47:34.751 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:34.904 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628026 2023-10-06T04:47:35.089 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:35.090 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:35.090 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:35.090 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:35.090 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-few-objects.yaml").st_ino) 2023-10-06T04:47:35.090 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:35.242 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628033 2023-10-06T04:47:35.427 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:35.427 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:35.427 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:35.427 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:35.427 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_misc.yaml").st_ino) 2023-10-06T04:47:35.427 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:35.580 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628023 2023-10-06T04:47:35.765 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:35.765 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:35.766 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:35.766 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:35.766 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/admin_socket_objecter_requests.yaml").st_ino) 2023-10-06T04:47:35.766 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:35.918 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628861 2023-10-06T04:47:36.103 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:36.104 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:36.104 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:36.104 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:36.104 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_truncate_delay.yaml").st_ino) 2023-10-06T04:47:36.104 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:36.258 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628029 2023-10-06T04:47:36.443 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:36.443 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:36.443 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:36.443 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:36.443 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-many-objects.yaml").st_ino) 2023-10-06T04:47:36.444 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:36.596 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628034 2023-10-06T04:47:36.782 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:36.782 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:36.782 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:36.782 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:36.782 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_kernel_untar_build.yaml").st_ino) 2023-10-06T04:47:36.783 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:36.935 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628022 2023-10-06T04:47:37.120 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:37.120 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:37.120 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:37.120 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:37.120 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/rados_api_tests.yaml").st_ino) 2023-10-06T04:47:37.120 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:37.274 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628030 2023-10-06T04:47:37.458 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:37.459 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:37.459 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:37.459 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:37.459 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:47:37.459 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:37.611 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628025 2023-10-06T04:47:37.796 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:37.796 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:37.796 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:37.796 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:37.796 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd").st_ino) 2023-10-06T04:47:37.796 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:37.948 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629305 2023-10-06T04:47:38.133 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:38.133 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:38.133 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:38.133 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:38.133 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli").st_ino) 2023-10-06T04:47:38.134 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:38.286 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629322 2023-10-06T04:47:38.471 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:38.472 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:38.472 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:38.472 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:38.472 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features").st_ino) 2023-10-06T04:47:38.472 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:38.624 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629327 2023-10-06T04:47:38.809 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:38.809 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:38.809 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:38.809 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:38.809 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/defaults.yaml").st_ino) 2023-10-06T04:47:38.810 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:38.963 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629328 2023-10-06T04:47:39.148 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:39.148 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:39.148 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:39.148 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:39.148 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/journaling.yaml").st_ino) 2023-10-06T04:47:39.149 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:39.302 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628166 2023-10-06T04:47:39.487 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:39.489 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:39.489 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:39.489 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:39.489 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/layering.yaml").st_ino) 2023-10-06T04:47:39.489 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:39.640 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628167 2023-10-06T04:47:39.825 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:39.825 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:39.825 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:39.825 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:39.825 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/format-1.yaml").st_ino) 2023-10-06T04:47:39.825 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:39.978 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628165 2023-10-06T04:47:40.164 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:40.164 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:40.164 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:40.164 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:40.164 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/base").st_ino) 2023-10-06T04:47:40.164 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:40.317 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629324 2023-10-06T04:47:40.502 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:40.502 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:40.502 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:40.502 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:40.502 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/base/install.yaml").st_ino) 2023-10-06T04:47:40.502 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:40.655 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629325 2023-10-06T04:47:40.840 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:40.840 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:40.840 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:40.840 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:40.840 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool").st_ino) 2023-10-06T04:47:40.840 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:40.994 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629333 2023-10-06T04:47:41.179 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:41.179 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:41.179 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:41.179 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:41.179 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/small-cache-pool.yaml").st_ino) 2023-10-06T04:47:41.179 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:41.333 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628171 2023-10-06T04:47:41.517 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:41.517 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:41.517 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:41.517 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:41.517 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/replicated-data-pool.yaml").st_ino) 2023-10-06T04:47:41.517 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:41.671 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628170 2023-10-06T04:47:41.856 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:41.857 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:41.857 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:41.857 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:41.857 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/ec-data-pool.yaml").st_ino) 2023-10-06T04:47:41.857 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:42.010 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629334 2023-10-06T04:47:42.196 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:42.196 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:42.196 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:42.196 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:42.196 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/none.yaml").st_ino) 2023-10-06T04:47:42.196 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:42.348 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628169 2023-10-06T04:47:42.533 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:42.533 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:42.533 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:42.534 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:42.534 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/clusters").st_ino) 2023-10-06T04:47:42.534 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:42.688 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629326 2023-10-06T04:47:42.871 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:42.871 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:42.871 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:42.871 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:42.872 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/msgr-failures").st_ino) 2023-10-06T04:47:42.872 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:43.024 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629330 2023-10-06T04:47:43.209 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:43.209 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:43.209 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:43.209 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:43.209 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/msgr-failures/many.yaml").st_ino) 2023-10-06T04:47:43.209 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:43.362 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628168 2023-10-06T04:47:43.547 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:43.547 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:43.547 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:43.547 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:43.547 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/msgr-failures/few.yaml").st_ino) 2023-10-06T04:47:43.547 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:43.699 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629331 2023-10-06T04:47:43.885 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:43.885 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:43.885 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:43.885 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:43.885 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/objectstore").st_ino) 2023-10-06T04:47:43.885 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:44.040 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629332 2023-10-06T04:47:44.224 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:44.224 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:44.224 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:44.224 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:44.224 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/fs").st_ino) 2023-10-06T04:47:44.224 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:44.376 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629329 2023-10-06T04:47:44.561 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:44.561 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:44.561 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:44.561 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:44.561 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/workloads").st_ino) 2023-10-06T04:47:44.561 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:44.714 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629335 2023-10-06T04:47:44.900 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:44.900 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:44.901 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:44.901 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:44.901 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_import_export.yaml").st_ino) 2023-10-06T04:47:44.901 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:45.052 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628172 2023-10-06T04:47:45.238 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:45.238 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:45.238 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:45.238 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:45.238 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_copy.yaml").st_ino) 2023-10-06T04:47:45.239 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:45.391 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629336 2023-10-06T04:47:45.576 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:45.577 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:45.577 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:45.577 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:45.577 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/%").st_ino) 2023-10-06T04:47:45.577 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:45.729 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629323 2023-10-06T04:47:45.914 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:45.915 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:45.915 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:45.915 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:45.915 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance").st_ino) 2023-10-06T04:47:45.915 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:46.066 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629354 2023-10-06T04:47:46.251 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:46.252 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:46.252 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:46.252 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:46.252 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/base").st_ino) 2023-10-06T04:47:46.252 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:46.403 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629356 2023-10-06T04:47:46.589 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:46.589 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:46.589 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:46.589 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:46.589 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/base/install.yaml").st_ino) 2023-10-06T04:47:46.589 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:46.742 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629357 2023-10-06T04:47:46.927 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:46.927 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:46.927 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:46.927 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:46.927 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters").st_ino) 2023-10-06T04:47:46.927 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:47.079 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629358 2023-10-06T04:47:47.265 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:47.265 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:47.265 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:47.265 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:47.265 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters/openstack.yaml").st_ino) 2023-10-06T04:47:47.265 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:47.418 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629361 2023-10-06T04:47:47.603 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:47.603 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:47.604 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:47.604 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:47.604 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters/+").st_ino) 2023-10-06T04:47:47.604 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:47.757 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629359 2023-10-06T04:47:47.941 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:47.941 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:47.941 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:47.942 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:47.942 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:47:47.942 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:48.095 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629360 2023-10-06T04:47:48.280 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:48.280 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:48.280 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:48.280 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:48.280 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/objectstore").st_ino) 2023-10-06T04:47:48.280 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:48.434 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629362 2023-10-06T04:47:48.619 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:48.619 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:48.619 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:48.619 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:48.619 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/workloads").st_ino) 2023-10-06T04:47:48.619 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:48.773 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629365 2023-10-06T04:47:48.958 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:48.959 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:48.959 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:48.959 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:48.959 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/workloads/dynamic_features.yaml").st_ino) 2023-10-06T04:47:48.959 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:49.112 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629366 2023-10-06T04:47:49.297 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:49.297 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:49.297 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:49.298 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:49.298 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/workloads/rebuild_object_map.yaml").st_ino) 2023-10-06T04:47:49.298 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:49.451 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628188 2023-10-06T04:47:49.635 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:49.636 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:49.636 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:49.636 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:49.636 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/%").st_ino) 2023-10-06T04:47:49.636 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:49.788 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629355 2023-10-06T04:47:49.973 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:49.973 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:49.973 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:49.973 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:49.974 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/xfs.yaml").st_ino) 2023-10-06T04:47:49.974 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:50.127 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629367 2023-10-06T04:47:50.312 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:50.313 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:50.313 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:50.313 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:50.313 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/qemu").st_ino) 2023-10-06T04:47:50.313 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:50.466 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629363 2023-10-06T04:47:50.652 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:50.652 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:50.652 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:50.652 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:50.652 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/qemu/xfstests.yaml").st_ino) 2023-10-06T04:47:50.652 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:50.804 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629364 2023-10-06T04:47:50.989 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:50.989 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:50.989 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:50.989 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:50.989 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton").st_ino) 2023-10-06T04:47:50.989 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:51.141 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629410 2023-10-06T04:47:51.327 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:51.327 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:51.328 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:51.328 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:51.328 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/openstack.yaml").st_ino) 2023-10-06T04:47:51.328 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:51.482 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628219 2023-10-06T04:47:51.667 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:51.667 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:51.667 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:51.667 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:51.667 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/objectstore").st_ino) 2023-10-06T04:47:51.667 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:51.819 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629414 2023-10-06T04:47:52.005 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:52.005 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:52.005 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:52.005 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:52.005 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/%").st_ino) 2023-10-06T04:47:52.005 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:52.158 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629411 2023-10-06T04:47:52.343 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:52.343 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:52.343 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:52.344 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:52.344 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all").st_ino) 2023-10-06T04:47:52.344 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:52.496 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629412 2023-10-06T04:47:52.681 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:52.681 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:52.681 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:52.681 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:52.681 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/rbd-vs-unmanaged-snaps.yaml").st_ino) 2023-10-06T04:47:52.681 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:52.834 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628212 2023-10-06T04:47:53.020 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:53.020 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:53.020 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:53.020 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:53.020 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/rbd_mirror.yaml").st_ino) 2023-10-06T04:47:53.020 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:53.173 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628213 2023-10-06T04:47:53.358 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:53.358 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:53.358 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:53.358 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:53.358 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/verify_pool.yaml").st_ino) 2023-10-06T04:47:53.358 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:53.511 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628218 2023-10-06T04:47:53.696 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:53.696 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:53.697 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:53.697 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:53.697 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/formatted-output.yaml").st_ino) 2023-10-06T04:47:53.697 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628206 2023-10-06T04:47:54.034 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:54.035 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:54.035 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:54.035 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:54.035 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/rbdmap_RBDMAPFILE.yaml").st_ino) 2023-10-06T04:47:54.035 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:54.187 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628214 2023-10-06T04:47:54.373 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:54.373 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:54.373 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:54.373 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:54.373 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writeback.yaml").st_ino) 2023-10-06T04:47:54.373 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:54.526 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628210 2023-10-06T04:47:54.711 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:54.711 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:54.711 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:54.712 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:54.712 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writeback.yaml").st_ino) 2023-10-06T04:47:54.712 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:54.864 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628216 2023-10-06T04:47:55.049 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:55.049 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:55.049 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:55.049 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:55.049 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/permissions.yaml").st_ino) 2023-10-06T04:47:55.049 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:55.202 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628208 2023-10-06T04:47:55.386 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:55.387 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:55.387 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:55.387 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:55.387 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/read-flags-no-cache.yaml").st_ino) 2023-10-06T04:47:55.387 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:55.539 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628215 2023-10-06T04:47:55.724 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:55.724 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:55.725 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:55.725 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:55.725 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-no-cache.yaml").st_ino) 2023-10-06T04:47:55.725 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:55.877 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628209 2023-10-06T04:47:56.061 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:56.061 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:56.061 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:56.061 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:56.062 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writethrough.yaml").st_ino) 2023-10-06T04:47:56.062 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:56.213 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628211 2023-10-06T04:47:56.398 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:56.399 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:56.399 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:56.399 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:56.399 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writethrough.yaml").st_ino) 2023-10-06T04:47:56.399 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:56.550 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628217 2023-10-06T04:47:56.736 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:56.736 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:56.736 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:56.736 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:56.736 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/admin_socket.yaml").st_ino) 2023-10-06T04:47:56.736 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:56.889 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629413 2023-10-06T04:47:57.074 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:57.075 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:57.075 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:57.075 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:57.075 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/merge_diff.yaml").st_ino) 2023-10-06T04:47:57.075 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:57.227 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628207 2023-10-06T04:47:57.412 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:57.412 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:57.412 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:57.412 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:57.412 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic").st_ino) 2023-10-06T04:47:57.413 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:57.564 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629306 2023-10-06T04:47:57.749 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:57.749 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:57.749 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:57.750 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:57.750 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/base").st_ino) 2023-10-06T04:47:57.750 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:57.901 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629308 2023-10-06T04:47:58.087 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:58.087 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:58.087 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:58.087 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:58.087 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/base/install.yaml").st_ino) 2023-10-06T04:47:58.087 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:58.241 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629309 2023-10-06T04:47:58.425 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:58.426 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:58.426 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:58.426 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:58.426 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/cachepool").st_ino) 2023-10-06T04:47:58.426 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:58.577 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629310 2023-10-06T04:47:58.763 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:58.763 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:58.763 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:58.763 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:58.763 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/cachepool/none.yaml").st_ino) 2023-10-06T04:47:58.764 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:58.917 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629311 2023-10-06T04:47:59.101 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:59.102 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:59.102 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:59.102 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:59.102 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/cachepool/small.yaml").st_ino) 2023-10-06T04:47:59.102 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:59.254 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628158 2023-10-06T04:47:59.439 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:59.439 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:59.439 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:59.439 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:59.439 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters").st_ino) 2023-10-06T04:47:59.439 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:59.572 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:47:59.577 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:47:59.592 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629312 2023-10-06T04:47:59.777 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:47:59.777 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:47:59.777 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:47:59.777 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:47:59.777 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters/openstack.yaml").st_ino) 2023-10-06T04:47:59.777 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:47:59.890 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628159 2023-10-06T04:48:00.075 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:00.075 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:00.075 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:00.075 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:00.075 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters/+").st_ino) 2023-10-06T04:48:00.075 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:00.228 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629313 2023-10-06T04:48:00.413 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:00.414 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:00.414 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:00.414 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:00.414 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters/fixed-1.yaml").st_ino) 2023-10-06T04:48:00.414 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:00.566 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629314 2023-10-06T04:48:00.750 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:00.751 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:00.751 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:00.751 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:00.751 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/msgr-failures").st_ino) 2023-10-06T04:48:00.751 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:00.905 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629317 2023-10-06T04:48:01.090 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:01.090 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:01.090 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:01.090 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:01.090 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/msgr-failures/many.yaml").st_ino) 2023-10-06T04:48:01.090 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:01.244 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628160 2023-10-06T04:48:01.428 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:01.428 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:01.428 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:01.429 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:01.429 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/msgr-failures/few.yaml").st_ino) 2023-10-06T04:48:01.429 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:01.580 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629318 2023-10-06T04:48:01.766 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:01.766 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:01.766 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:01.766 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:01.766 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/objectstore").st_ino) 2023-10-06T04:48:01.766 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:01.918 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629319 2023-10-06T04:48:02.104 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:02.104 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:02.105 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:02.105 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:02.105 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/fs").st_ino) 2023-10-06T04:48:02.105 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:02.257 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629315 2023-10-06T04:48:02.443 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:02.443 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:02.443 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:02.443 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:02.443 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/fs/xfs.yaml").st_ino) 2023-10-06T04:48:02.443 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:02.594 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629316 2023-10-06T04:48:02.780 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:02.780 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:02.780 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:02.780 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:02.780 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/%").st_ino) 2023-10-06T04:48:02.780 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:02.933 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629307 2023-10-06T04:48:03.118 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:03.118 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:03.118 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:03.118 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:03.118 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks").st_ino) 2023-10-06T04:48:03.118 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:03.272 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629320 2023-10-06T04:48:03.457 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:03.457 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:03.457 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:03.457 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:03.458 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_lock_and_fence.yaml").st_ino) 2023-10-06T04:48:03.458 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:03.609 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628163 2023-10-06T04:48:03.794 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:03.794 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:03.794 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:03.794 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:03.795 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cli_tests.yaml").st_ino) 2023-10-06T04:48:03.795 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:03.946 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628161 2023-10-06T04:48:04.132 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:04.132 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:04.132 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:04.132 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:04.132 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_api_tests_old_format.yaml").st_ino) 2023-10-06T04:48:04.132 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:04.286 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629321 2023-10-06T04:48:04.471 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:04.471 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:04.471 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:04.471 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:04.471 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cls_tests.yaml").st_ino) 2023-10-06T04:48:04.471 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:04.624 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628162 2023-10-06T04:48:04.809 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:04.809 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:04.809 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:04.809 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:04.809 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_python_api_tests_old_format.yaml").st_ino) 2023-10-06T04:48:04.809 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:04.962 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628164 2023-10-06T04:48:05.148 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:05.148 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:05.148 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:05.148 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:05.148 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd").st_ino) 2023-10-06T04:48:05.148 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:05.302 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629337 2023-10-06T04:48:05.487 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:05.487 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:05.487 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:05.487 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:05.488 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool").st_ino) 2023-10-06T04:48:05.488 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:05.640 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629350 2023-10-06T04:48:05.826 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:05.826 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:05.826 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:05.826 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:05.826 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/small-cache-pool.yaml").st_ino) 2023-10-06T04:48:05.826 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:05.979 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628180 2023-10-06T04:48:06.164 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:06.164 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:06.164 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:06.164 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:06.164 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/replicated-data-pool.yaml").st_ino) 2023-10-06T04:48:06.165 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:06.318 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628179 2023-10-06T04:48:06.503 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:06.503 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:06.504 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:06.504 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:06.504 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/ec-data-pool.yaml").st_ino) 2023-10-06T04:48:06.504 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:06.656 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629351 2023-10-06T04:48:06.842 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:06.842 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:06.842 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:06.842 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:06.842 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/none.yaml").st_ino) 2023-10-06T04:48:06.842 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:06.996 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628178 2023-10-06T04:48:07.181 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:07.181 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:07.181 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:07.181 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:07.182 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters").st_ino) 2023-10-06T04:48:07.182 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:07.334 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629341 2023-10-06T04:48:07.519 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:07.519 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:07.519 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:07.519 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:07.519 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters/openstack.yaml").st_ino) 2023-10-06T04:48:07.519 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:07.670 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628175 2023-10-06T04:48:07.856 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:07.856 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:07.856 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:07.856 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:07.856 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters/+").st_ino) 2023-10-06T04:48:07.856 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:08.009 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629342 2023-10-06T04:48:08.194 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:08.194 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:08.194 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:08.195 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:08.195 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:48:08.195 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:08.348 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629343 2023-10-06T04:48:08.533 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:08.533 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:08.533 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:08.533 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:08.533 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/msgr-failures").st_ino) 2023-10-06T04:48:08.533 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:08.685 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629347 2023-10-06T04:48:08.871 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:08.871 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:08.871 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:08.871 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:08.871 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/msgr-failures/few.yaml").st_ino) 2023-10-06T04:48:08.871 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:09.024 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629348 2023-10-06T04:48:09.209 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:09.209 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:09.210 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:09.210 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:09.210 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/objectstore").st_ino) 2023-10-06T04:48:09.210 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:09.362 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629349 2023-10-06T04:48:09.547 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:09.547 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:09.547 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:09.548 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:09.548 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config").st_ino) 2023-10-06T04:48:09.548 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:09.701 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629344 2023-10-06T04:48:09.886 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:09.886 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:09.886 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:09.886 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:09.886 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config/skip-partial-discard.yaml").st_ino) 2023-10-06T04:48:09.886 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:10.039 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628177 2023-10-06T04:48:10.224 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:10.224 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:10.224 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:10.224 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:10.224 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config/none.yaml").st_ino) 2023-10-06T04:48:10.224 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:10.377 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628176 2023-10-06T04:48:10.562 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:10.562 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:10.562 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:10.563 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:10.563 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config/copy-on-read.yaml").st_ino) 2023-10-06T04:48:10.563 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:10.715 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629345 2023-10-06T04:48:10.900 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:10.900 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:10.900 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:10.900 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:10.901 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/fs").st_ino) 2023-10-06T04:48:10.901 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:11.052 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629346 2023-10-06T04:48:11.237 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:11.238 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:11.238 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:11.238 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:11.238 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads").st_ino) 2023-10-06T04:48:11.238 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:11.389 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629352 2023-10-06T04:48:11.574 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:11.574 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:11.574 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:11.574 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:11.575 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests.yaml").st_ino) 2023-10-06T04:48:11.575 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:11.726 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629353 2023-10-06T04:48:11.911 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:11.911 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:11.911 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:11.911 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:11.911 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/rbd_fio.yaml").st_ino) 2023-10-06T04:48:11.912 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:12.066 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628187 2023-10-06T04:48:12.250 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:12.250 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:12.250 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:12.250 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:12.250 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_defaults.yaml").st_ino) 2023-10-06T04:48:12.250 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:12.403 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628181 2023-10-06T04:48:12.588 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:12.588 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:12.588 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:12.588 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:12.589 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests.yaml").st_ino) 2023-10-06T04:48:12.589 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:12.741 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628184 2023-10-06T04:48:12.926 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:12.926 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:12.926 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:12.926 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:12.926 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/fsx.yaml").st_ino) 2023-10-06T04:48:12.926 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:13.081 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628183 2023-10-06T04:48:13.265 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:13.265 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:13.265 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:13.265 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:13.265 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_journaling.yaml").st_ino) 2023-10-06T04:48:13.265 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:13.418 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628186 2023-10-06T04:48:13.602 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:13.603 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:13.603 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:13.603 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:13.603 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_journaling.yaml").st_ino) 2023-10-06T04:48:13.603 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:13.756 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628182 2023-10-06T04:48:13.940 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:13.941 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:13.941 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:13.941 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:13.941 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_defaults.yaml").st_ino) 2023-10-06T04:48:13.941 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:14.094 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628185 2023-10-06T04:48:14.279 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:14.280 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:14.280 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:14.280 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:14.280 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache").st_ino) 2023-10-06T04:48:14.280 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:14.434 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629339 2023-10-06T04:48:14.618 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:14.618 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:14.618 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:14.618 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:14.618 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache/writeback.yaml").st_ino) 2023-10-06T04:48:14.618 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:14.771 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628173 2023-10-06T04:48:14.957 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:14.958 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:14.958 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:14.958 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:14.958 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache/writethrough.yaml").st_ino) 2023-10-06T04:48:14.958 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:15.109 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628174 2023-10-06T04:48:15.294 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:15.294 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:15.294 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:15.294 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:15.294 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache/none.yaml").st_ino) 2023-10-06T04:48:15.295 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:15.449 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629340 2023-10-06T04:48:15.634 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:15.634 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:15.634 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:15.634 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:15.635 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/%").st_ino) 2023-10-06T04:48:15.635 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:15.787 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629338 2023-10-06T04:48:15.973 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:15.973 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:15.973 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:15.973 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:15.973 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind").st_ino) 2023-10-06T04:48:15.973 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:16.125 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629431 2023-10-06T04:48:16.311 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:16.311 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:16.311 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:16.311 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:16.311 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/base").st_ino) 2023-10-06T04:48:16.312 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:16.464 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629433 2023-10-06T04:48:16.650 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:16.650 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:16.650 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:16.650 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:16.650 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/base/install.yaml").st_ino) 2023-10-06T04:48:16.650 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:16.803 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629434 2023-10-06T04:48:16.988 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:16.988 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:16.988 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:16.989 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:16.989 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/clusters").st_ino) 2023-10-06T04:48:16.989 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:17.142 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629435 2023-10-06T04:48:17.327 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:17.327 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:17.327 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:17.327 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:17.328 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/objectstore").st_ino) 2023-10-06T04:48:17.328 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:17.479 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629437 2023-10-06T04:48:17.664 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:17.664 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:17.664 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:17.664 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:17.664 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/fs").st_ino) 2023-10-06T04:48:17.664 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:17.817 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629436 2023-10-06T04:48:18.002 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:18.002 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:18.002 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:18.002 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:18.002 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads").st_ino) 2023-10-06T04:48:18.002 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:18.155 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629440 2023-10-06T04:48:18.340 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:18.340 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:18.340 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:18.340 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:18.340 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/rbd_mirror.yaml").st_ino) 2023-10-06T04:48:18.340 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:18.493 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628237 2023-10-06T04:48:18.678 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:18.679 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:18.679 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:18.679 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:18.679 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests.yaml").st_ino) 2023-10-06T04:48:18.679 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:18.830 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629441 2023-10-06T04:48:19.015 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:19.015 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:19.015 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:19.015 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:19.016 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_defaults.yaml").st_ino) 2023-10-06T04:48:19.016 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:19.168 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628231 2023-10-06T04:48:19.353 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:19.353 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:19.354 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:19.354 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:19.354 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests.yaml").st_ino) 2023-10-06T04:48:19.354 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:19.505 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628234 2023-10-06T04:48:19.690 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:19.690 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:19.691 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:19.691 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:19.691 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/fsx.yaml").st_ino) 2023-10-06T04:48:19.691 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:19.844 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628233 2023-10-06T04:48:20.029 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:20.030 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:20.030 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:20.030 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:20.030 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_journaling.yaml").st_ino) 2023-10-06T04:48:20.030 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:20.182 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628236 2023-10-06T04:48:20.368 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:20.368 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:20.368 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:20.368 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:20.369 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_journaling.yaml").st_ino) 2023-10-06T04:48:20.369 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:20.520 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628232 2023-10-06T04:48:20.706 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:20.707 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:20.707 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:20.707 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:20.707 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_defaults.yaml").st_ino) 2023-10-06T04:48:20.707 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:20.858 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628235 2023-10-06T04:48:21.043 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:21.043 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:21.044 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:21.044 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:21.044 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/validator").st_ino) 2023-10-06T04:48:21.044 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:21.197 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629438 2023-10-06T04:48:21.382 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:21.382 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:21.382 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:21.382 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:21.382 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/validator/memcheck.yaml").st_ino) 2023-10-06T04:48:21.383 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:21.535 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629439 2023-10-06T04:48:21.720 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:21.720 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:21.720 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:21.720 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:21.721 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/%").st_ino) 2023-10-06T04:48:21.721 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:21.874 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629432 2023-10-06T04:48:22.059 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:22.059 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:22.059 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:22.059 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:22.060 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd").st_ino) 2023-10-06T04:48:22.060 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:22.212 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629381 2023-10-06T04:48:22.397 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:22.397 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:22.397 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:22.397 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:22.397 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/base").st_ino) 2023-10-06T04:48:22.397 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:22.550 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629383 2023-10-06T04:48:22.735 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:22.735 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:22.735 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:22.735 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:22.735 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster").st_ino) 2023-10-06T04:48:22.736 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:22.888 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629384 2023-10-06T04:48:23.073 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:23.073 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:23.073 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:23.073 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:23.073 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster/openstack.yaml").st_ino) 2023-10-06T04:48:23.074 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:23.226 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629386 2023-10-06T04:48:23.412 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:23.412 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:23.412 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:23.412 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:23.412 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster/+").st_ino) 2023-10-06T04:48:23.413 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:23.565 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629385 2023-10-06T04:48:23.750 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:23.750 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:23.750 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:23.750 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:23.750 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster/fixed-3.yaml").st_ino) 2023-10-06T04:48:23.750 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:23.903 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628192 2023-10-06T04:48:24.088 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:24.088 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:24.088 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:24.089 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:24.089 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/msgr-failures").st_ino) 2023-10-06T04:48:24.089 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:24.241 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629388 2023-10-06T04:48:24.426 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:24.426 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:24.427 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:24.427 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:24.427 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/objectstore").st_ino) 2023-10-06T04:48:24.427 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:24.579 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629389 2023-10-06T04:48:24.765 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:24.765 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:24.765 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:24.765 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:24.765 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/fs").st_ino) 2023-10-06T04:48:24.765 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:24.918 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629387 2023-10-06T04:48:25.103 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:25.103 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:25.103 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:25.103 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:25.103 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/workloads").st_ino) 2023-10-06T04:48:25.103 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:25.255 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629391 2023-10-06T04:48:25.440 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:25.440 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:25.440 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:25.441 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:25.441 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_nbd.yaml").st_ino) 2023-10-06T04:48:25.441 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:25.593 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628193 2023-10-06T04:48:25.779 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:25.779 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:25.779 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:25.779 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:25.779 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_fsx_nbd.yaml").st_ino) 2023-10-06T04:48:25.779 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:25.932 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629392 2023-10-06T04:48:26.118 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:26.118 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:26.118 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:26.119 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:26.119 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/%").st_ino) 2023-10-06T04:48:26.119 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:26.270 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629382 2023-10-06T04:48:26.455 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:26.456 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:26.456 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:26.456 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:26.456 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/thrashers").st_ino) 2023-10-06T04:48:26.456 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:26.608 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629390 2023-10-06T04:48:26.793 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:26.793 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:26.793 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:26.793 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:26.793 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash").st_ino) 2023-10-06T04:48:26.793 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:26.946 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629415 2023-10-06T04:48:27.131 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:27.132 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:27.132 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:27.132 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:27.132 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/base").st_ino) 2023-10-06T04:48:27.132 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:27.286 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629417 2023-10-06T04:48:27.472 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:27.472 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:27.472 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:27.472 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:27.472 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/base/install.yaml").st_ino) 2023-10-06T04:48:27.472 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:27.624 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629418 2023-10-06T04:48:27.809 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:27.810 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:27.810 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:27.810 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:27.810 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters").st_ino) 2023-10-06T04:48:27.810 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:27.963 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629419 2023-10-06T04:48:28.147 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:28.148 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:28.148 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:28.148 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:28.148 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters/openstack.yaml").st_ino) 2023-10-06T04:48:28.148 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:28.300 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628220 2023-10-06T04:48:28.486 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:28.486 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:28.486 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:28.486 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:28.486 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters/fixed-2.yaml").st_ino) 2023-10-06T04:48:28.486 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:28.639 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629421 2023-10-06T04:48:28.824 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:28.824 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:28.824 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:28.824 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:28.825 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters/+").st_ino) 2023-10-06T04:48:28.825 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:28.978 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629420 2023-10-06T04:48:29.163 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:29.163 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:29.163 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:29.163 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:29.163 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/msgr-failures").st_ino) 2023-10-06T04:48:29.163 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:29.316 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629424 2023-10-06T04:48:29.501 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:29.501 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:29.502 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:29.502 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:29.502 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/msgr-failures/few.yaml").st_ino) 2023-10-06T04:48:29.502 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:29.655 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629425 2023-10-06T04:48:29.684 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:48:29.689 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:48:29.840 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:29.840 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:29.840 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:29.841 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:29.841 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/objectstore").st_ino) 2023-10-06T04:48:29.841 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:29.954 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629426 2023-10-06T04:48:30.139 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:30.139 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:30.139 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:30.140 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:30.140 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/fs").st_ino) 2023-10-06T04:48:30.140 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:30.292 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629422 2023-10-06T04:48:30.477 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:30.477 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:30.477 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:30.477 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:30.477 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/fs/xfs.yaml").st_ino) 2023-10-06T04:48:30.477 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:30.630 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629423 2023-10-06T04:48:30.816 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:30.816 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:30.816 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:30.816 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:30.816 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads").st_ino) 2023-10-06T04:48:30.817 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:30.968 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629429 2023-10-06T04:48:31.154 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:31.154 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:31.154 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:31.154 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:31.154 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writeback.yaml").st_ino) 2023-10-06T04:48:31.154 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:31.307 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628226 2023-10-06T04:48:31.492 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:31.492 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:31.492 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:31.492 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:31.493 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_copy_on_read.yaml").st_ino) 2023-10-06T04:48:31.493 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:31.644 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628228 2023-10-06T04:48:31.829 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:31.830 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:31.830 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:31.830 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:31.830 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_journal.yaml").st_ino) 2023-10-06T04:48:31.830 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:31.984 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628229 2023-10-06T04:48:32.169 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:32.169 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:32.169 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:32.169 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:32.169 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_journaling.yaml").st_ino) 2023-10-06T04:48:32.169 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:32.321 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628224 2023-10-06T04:48:32.507 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:32.507 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:32.507 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:32.507 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:32.507 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_nocache.yaml").st_ino) 2023-10-06T04:48:32.507 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:32.660 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628230 2023-10-06T04:48:32.845 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:32.845 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:32.845 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:32.846 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:32.846 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests.yaml").st_ino) 2023-10-06T04:48:32.846 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:32.998 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628222 2023-10-06T04:48:33.183 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:33.183 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:33.183 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:33.183 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:33.184 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/journal.yaml").st_ino) 2023-10-06T04:48:33.184 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:33.336 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629430 2023-10-06T04:48:33.521 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:33.521 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:33.521 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:33.521 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:33.521 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_copy_on_read.yaml").st_ino) 2023-10-06T04:48:33.521 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:33.674 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628223 2023-10-06T04:48:33.858 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:33.859 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:33.859 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:33.859 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:33.859 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_no_locking.yaml").st_ino) 2023-10-06T04:48:33.859 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:34.012 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628225 2023-10-06T04:48:34.198 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:34.198 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:34.198 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:34.198 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:34.198 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writethrough.yaml").st_ino) 2023-10-06T04:48:34.198 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:34.350 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628227 2023-10-06T04:48:34.535 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:34.535 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:34.535 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:34.536 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:34.536 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/%").st_ino) 2023-10-06T04:48:34.536 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:34.688 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629416 2023-10-06T04:48:34.873 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:34.873 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:34.873 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:34.873 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:34.873 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/thrashers").st_ino) 2023-10-06T04:48:34.873 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:35.027 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629427 2023-10-06T04:48:35.212 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:35.213 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:35.213 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:35.213 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:35.213 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/thrashers/default.yaml").st_ino) 2023-10-06T04:48:35.213 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:35.365 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628221 2023-10-06T04:48:35.550 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:35.550 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:35.550 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:35.550 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:35.551 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/thrashers/cache.yaml").st_ino) 2023-10-06T04:48:35.551 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:35.703 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629428 2023-10-06T04:48:35.888 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:35.888 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:35.888 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:35.888 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:35.888 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror").st_ino) 2023-10-06T04:48:35.888 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:36.041 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629368 2023-10-06T04:48:36.225 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:36.226 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:36.226 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:36.226 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:36.226 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/base").st_ino) 2023-10-06T04:48:36.226 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:36.379 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629370 2023-10-06T04:48:36.565 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:36.565 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:36.565 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:36.565 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:36.565 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/base/install.yaml").st_ino) 2023-10-06T04:48:36.565 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:36.718 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629371 2023-10-06T04:48:36.903 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:36.903 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:36.903 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:36.903 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:36.904 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster").st_ino) 2023-10-06T04:48:36.904 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:37.057 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629372 2023-10-06T04:48:37.242 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:37.242 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:37.243 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:37.243 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:37.243 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster/openstack.yaml").st_ino) 2023-10-06T04:48:37.243 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:37.396 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628190 2023-10-06T04:48:37.581 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:37.581 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:37.581 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:37.581 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:37.581 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster/2-node.yaml").st_ino) 2023-10-06T04:48:37.581 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:37.734 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628189 2023-10-06T04:48:37.919 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:37.920 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:37.920 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:37.920 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:37.920 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster/+").st_ino) 2023-10-06T04:48:37.920 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:38.073 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629373 2023-10-06T04:48:38.258 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:38.258 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:38.258 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:38.258 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:38.258 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/msgr-failures").st_ino) 2023-10-06T04:48:38.258 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:38.413 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629375 2023-10-06T04:48:38.599 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:38.599 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:38.599 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:38.599 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:38.599 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/objectstore").st_ino) 2023-10-06T04:48:38.599 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:38.751 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629376 2023-10-06T04:48:38.936 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:38.937 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:38.937 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:38.937 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:38.937 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/fs").st_ino) 2023-10-06T04:48:38.937 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:39.091 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629374 2023-10-06T04:48:39.275 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:39.275 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:39.275 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:39.275 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:39.275 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/workloads").st_ino) 2023-10-06T04:48:39.275 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:39.431 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629379 2023-10-06T04:48:39.615 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:39.616 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:39.616 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:39.616 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:39.616 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-stress-workunit.yaml").st_ino) 2023-10-06T04:48:39.616 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:39.768 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629380 2023-10-06T04:48:39.954 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:39.954 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:39.954 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:39.955 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:39.955 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-workunit.yaml").st_ino) 2023-10-06T04:48:39.955 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:40.106 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628191 2023-10-06T04:48:40.291 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:40.292 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:40.292 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:40.292 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:40.292 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/%").st_ino) 2023-10-06T04:48:40.292 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:40.444 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629369 2023-10-06T04:48:40.629 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:40.629 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:40.629 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:40.629 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:40.629 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/rbd-mirror").st_ino) 2023-10-06T04:48:40.629 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:40.782 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629377 2023-10-06T04:48:40.968 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:40.968 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:40.968 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:40.968 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:40.968 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/rbd-mirror/one-per-cluster.yaml").st_ino) 2023-10-06T04:48:40.968 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:41.122 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629378 2023-10-06T04:48:41.307 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:41.307 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:41.307 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:41.307 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:41.308 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu").st_ino) 2023-10-06T04:48:41.308 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:41.460 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629393 2023-10-06T04:48:41.645 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:41.645 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:41.645 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:41.645 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:41.645 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/features").st_ino) 2023-10-06T04:48:41.645 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:41.798 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629400 2023-10-06T04:48:41.983 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:41.983 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:41.983 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:41.983 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:41.983 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/features/defaults.yaml").st_ino) 2023-10-06T04:48:41.983 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:42.138 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629401 2023-10-06T04:48:42.323 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:42.323 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:42.323 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:42.324 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:42.324 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/features/journaling.yaml").st_ino) 2023-10-06T04:48:42.324 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:42.476 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628197 2023-10-06T04:48:42.661 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:42.661 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:42.661 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:42.661 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:42.661 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool").st_ino) 2023-10-06T04:48:42.661 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:42.813 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629406 2023-10-06T04:48:42.999 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:42.999 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:42.999 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:42.999 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:42.999 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/small-cache-pool.yaml").st_ino) 2023-10-06T04:48:42.999 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:43.152 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628201 2023-10-06T04:48:43.337 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:43.337 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:43.337 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:43.337 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:43.338 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/replicated-data-pool.yaml").st_ino) 2023-10-06T04:48:43.338 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:43.490 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628200 2023-10-06T04:48:43.675 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:43.695 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:43.695 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:43.695 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:43.695 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/ec-cache-pool.yaml").st_ino) 2023-10-06T04:48:43.695 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:43.827 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629407 2023-10-06T04:48:44.012 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:44.013 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:44.013 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:44.013 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:44.013 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/ec-data-pool.yaml").st_ino) 2023-10-06T04:48:44.013 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:44.164 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628198 2023-10-06T04:48:44.351 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:44.351 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:44.351 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:44.351 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:44.351 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/none.yaml").st_ino) 2023-10-06T04:48:44.351 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:44.502 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628199 2023-10-06T04:48:44.688 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:44.688 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:44.688 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:44.688 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:44.688 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters").st_ino) 2023-10-06T04:48:44.688 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:44.841 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629397 2023-10-06T04:48:45.026 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:45.027 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:45.027 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:45.027 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:45.027 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters/openstack.yaml").st_ino) 2023-10-06T04:48:45.027 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:45.179 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628196 2023-10-06T04:48:45.365 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:45.365 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:45.365 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:45.365 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:45.365 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters/+").st_ino) 2023-10-06T04:48:45.365 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:45.517 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629398 2023-10-06T04:48:45.703 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:45.703 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:45.703 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:45.703 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:45.703 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:48:45.703 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:45.857 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629399 2023-10-06T04:48:46.042 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:46.042 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:46.042 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:46.042 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:46.042 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/msgr-failures").st_ino) 2023-10-06T04:48:46.042 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:46.196 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629403 2023-10-06T04:48:46.382 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:46.382 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:46.382 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:46.382 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:46.382 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/msgr-failures/few.yaml").st_ino) 2023-10-06T04:48:46.382 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:46.534 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629404 2023-10-06T04:48:46.720 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:46.720 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:46.720 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:46.720 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:46.720 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/objectstore").st_ino) 2023-10-06T04:48:46.720 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:46.873 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629405 2023-10-06T04:48:47.058 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:47.058 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:47.058 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:47.058 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:47.058 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/fs").st_ino) 2023-10-06T04:48:47.059 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:47.210 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629402 2023-10-06T04:48:47.396 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:47.396 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:47.396 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:47.396 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:47.397 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads").st_ino) 2023-10-06T04:48:47.397 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:47.548 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629408 2023-10-06T04:48:47.733 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:47.734 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:47.734 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:47.734 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:47.734 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_iozone.yaml.disabled").st_ino) 2023-10-06T04:48:47.734 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:47.886 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628204 2023-10-06T04:48:48.072 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:48.072 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:48.072 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:48.072 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:48.072 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/#qemu_xfstests.yaml#").st_ino) 2023-10-06T04:48:48.072 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:48.225 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629409 2023-10-06T04:48:48.409 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:48.410 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:48.410 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:48.410 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:48.410 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_xfstests.yaml").st_ino) 2023-10-06T04:48:48.410 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:48.562 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628205 2023-10-06T04:48:48.747 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:48.747 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:48.747 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:48.747 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:48.748 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_fsstress.yaml").st_ino) 2023-10-06T04:48:48.748 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:48.900 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628203 2023-10-06T04:48:49.085 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:49.085 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:49.085 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:49.086 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:49.086 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_bonnie.yaml").st_ino) 2023-10-06T04:48:49.086 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:49.237 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628202 2023-10-06T04:48:49.423 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:49.423 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:49.423 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:49.423 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:49.423 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache").st_ino) 2023-10-06T04:48:49.424 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:49.576 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629395 2023-10-06T04:48:49.760 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:49.760 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:49.760 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:49.760 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:49.761 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache/writeback.yaml").st_ino) 2023-10-06T04:48:49.761 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:49.912 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628194 2023-10-06T04:48:50.099 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:50.099 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:50.099 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:50.099 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:50.099 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache/writethrough.yaml").st_ino) 2023-10-06T04:48:50.099 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:50.252 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628195 2023-10-06T04:48:50.437 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:50.437 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:50.437 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:50.437 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:50.437 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache/none.yaml").st_ino) 2023-10-06T04:48:50.438 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:50.590 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629396 2023-10-06T04:48:50.776 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:50.776 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:50.776 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:50.776 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:50.776 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/%").st_ino) 2023-10-06T04:48:50.777 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:50.929 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629394 2023-10-06T04:48:51.114 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:51.115 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:51.115 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:51.115 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:51.115 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest").st_ino) 2023-10-06T04:48:51.115 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:51.266 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629442 2023-10-06T04:48:51.452 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:51.452 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:51.452 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:51.452 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:51.452 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest/basic").st_ino) 2023-10-06T04:48:51.452 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:51.604 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629443 2023-10-06T04:48:51.790 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:51.790 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:51.790 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:51.790 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:51.790 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest/basic/tasks").st_ino) 2023-10-06T04:48:51.790 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:51.943 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629444 2023-10-06T04:48:52.129 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:52.129 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:52.129 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:52.129 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:52.129 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest/basic/tasks/rest_test.yaml").st_ino) 2023-10-06T04:48:52.129 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:52.282 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629445 2023-10-06T04:48:52.467 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:52.467 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:52.467 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:52.467 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:52.467 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw").st_ino) 2023-10-06T04:48:52.467 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:52.620 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629446 2023-10-06T04:48:52.805 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:52.806 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:52.806 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:52.806 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:52.806 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs").st_ino) 2023-10-06T04:48:52.806 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:52.958 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629447 2023-10-06T04:48:53.143 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:53.144 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:53.144 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:53.144 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:53.144 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/clusters").st_ino) 2023-10-06T04:48:53.144 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:53.297 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629449 2023-10-06T04:48:53.482 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:53.482 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:53.482 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:53.482 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:53.482 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/clusters/fixed-2.yaml").st_ino) 2023-10-06T04:48:53.482 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:53.635 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629450 2023-10-06T04:48:53.820 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:53.821 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:53.821 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:53.821 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:53.821 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/objectstore").st_ino) 2023-10-06T04:48:53.821 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629455 2023-10-06T04:48:54.158 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:54.158 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:54.158 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:54.158 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:54.159 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/fs").st_ino) 2023-10-06T04:48:54.159 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:54.312 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629453 2023-10-06T04:48:54.496 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:54.496 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:54.496 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:54.496 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:54.496 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/fs/xfs.yaml").st_ino) 2023-10-06T04:48:54.496 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:54.649 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629454 2023-10-06T04:48:54.834 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:54.835 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:54.835 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:54.835 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:54.835 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/rgw_pool_type").st_ino) 2023-10-06T04:48:54.835 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:54.988 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629456 2023-10-06T04:48:55.174 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:55.174 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:55.174 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:55.174 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:55.174 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/frontend").st_ino) 2023-10-06T04:48:55.174 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:55.326 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629451 2023-10-06T04:48:55.511 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:55.511 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:55.511 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:55.511 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:55.511 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/frontend/apache.yaml").st_ino) 2023-10-06T04:48:55.512 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:55.664 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629452 2023-10-06T04:48:55.849 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:55.849 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:55.849 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:55.849 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:55.850 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/frontend/civetweb.yaml").st_ino) 2023-10-06T04:48:55.850 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:56.002 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628238 2023-10-06T04:48:56.187 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:56.187 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:56.187 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:56.187 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:56.187 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/overrides.yaml").st_ino) 2023-10-06T04:48:56.188 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:56.340 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628239 2023-10-06T04:48:56.526 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:56.526 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:56.526 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:56.526 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:56.526 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/%").st_ino) 2023-10-06T04:48:56.526 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:56.680 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629448 2023-10-06T04:48:56.865 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:56.865 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:56.865 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:56.865 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:56.865 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks").st_ino) 2023-10-06T04:48:56.866 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:57.018 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629457 2023-10-06T04:48:57.203 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:57.203 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:57.203 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:57.203 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:57.203 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_roundtrip.yaml").st_ino) 2023-10-06T04:48:57.203 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:57.356 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628242 2023-10-06T04:48:57.541 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:57.541 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:57.541 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:57.541 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:57.541 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_multipart_upload.yaml").st_ino) 2023-10-06T04:48:57.541 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:57.694 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628240 2023-10-06T04:48:57.879 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:57.879 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:57.879 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:57.879 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:57.879 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_user_quota.yaml").st_ino) 2023-10-06T04:48:57.879 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:58.032 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628245 2023-10-06T04:48:58.217 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:58.218 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:58.218 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:58.218 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:58.218 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_readwrite.yaml").st_ino) 2023-10-06T04:48:58.218 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:58.370 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628241 2023-10-06T04:48:58.555 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:58.555 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:58.555 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:58.555 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:58.555 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_swift.yaml").st_ino) 2023-10-06T04:48:58.555 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:58.709 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628244 2023-10-06T04:48:58.894 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:58.894 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:58.894 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:58.894 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:58.894 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_s3tests.yaml").st_ino) 2023-10-06T04:48:58.895 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:59.047 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628243 2023-10-06T04:48:59.232 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:59.232 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:59.232 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:59.232 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:59.232 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_bucket_quota.yaml").st_ino) 2023-10-06T04:48:59.232 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:59.385 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629458 2023-10-06T04:48:59.570 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:59.570 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:59.570 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:59.570 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:59.570 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton").st_ino) 2023-10-06T04:48:59.571 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:48:59.722 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629459 2023-10-06T04:48:59.798 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:48:59.802 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:48:59.908 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:48:59.908 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:48:59.908 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:48:59.908 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:48:59.908 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/objectstore").st_ino) 2023-10-06T04:48:59.908 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:00.022 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629467 2023-10-06T04:49:00.207 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:00.207 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:00.207 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:00.208 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:00.208 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/fs").st_ino) 2023-10-06T04:49:00.208 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:00.322 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629465 2023-10-06T04:49:00.506 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:00.506 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:00.506 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:00.506 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:00.506 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/fs/xfs.yaml").st_ino) 2023-10-06T04:49:00.507 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:00.658 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629466 2023-10-06T04:49:00.844 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:00.844 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:00.844 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:00.844 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:00.844 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/rgw_pool_type").st_ino) 2023-10-06T04:49:00.844 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:00.999 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629468 2023-10-06T04:49:01.183 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:01.183 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:01.183 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:01.184 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:01.184 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/frontend").st_ino) 2023-10-06T04:49:01.184 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:01.337 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629463 2023-10-06T04:49:01.521 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:01.521 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:01.522 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:01.522 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:01.522 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/frontend/apache.yaml").st_ino) 2023-10-06T04:49:01.522 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:01.673 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629464 2023-10-06T04:49:01.859 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:01.859 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:01.859 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:01.859 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:01.859 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/frontend/civetweb.yaml").st_ino) 2023-10-06T04:49:01.859 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:02.013 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628249 2023-10-06T04:49:02.197 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:02.197 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:02.198 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:02.198 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:02.198 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/overrides.yaml").st_ino) 2023-10-06T04:49:02.198 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:02.350 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628250 2023-10-06T04:49:02.535 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:02.535 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:02.535 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:02.535 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:02.535 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/%").st_ino) 2023-10-06T04:49:02.535 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:02.687 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629460 2023-10-06T04:49:02.872 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:02.873 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:02.873 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:02.873 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:02.873 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/xfs.yaml").st_ino) 2023-10-06T04:49:02.873 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:03.025 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629469 2023-10-06T04:49:03.210 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:03.210 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:03.210 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:03.210 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:03.210 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all").st_ino) 2023-10-06T04:49:03.210 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:03.364 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629461 2023-10-06T04:49:03.549 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:03.549 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:03.549 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:03.550 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:03.550 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-multi-region.yaml").st_ino) 2023-10-06T04:49:03.550 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:03.702 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628246 2023-10-06T04:49:03.887 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:03.887 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:03.887 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:03.887 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:03.887 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin.yaml").st_ino) 2023-10-06T04:49:03.888 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:04.040 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628247 2023-10-06T04:49:04.225 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:04.225 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:04.225 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:04.225 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:04.226 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-data-sync.yaml").st_ino) 2023-10-06T04:49:04.226 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:04.377 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629462 2023-10-06T04:49:04.562 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:04.563 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:04.563 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:04.563 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:04.563 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-convert-to-region.yaml").st_ino) 2023-10-06T04:49:04.563 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:04.715 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628248 2023-10-06T04:49:04.901 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:04.901 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:04.901 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:04.901 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:04.901 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify").st_ino) 2023-10-06T04:49:04.901 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:05.053 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629470 2023-10-06T04:49:05.239 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:05.239 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:05.239 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:05.239 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:05.239 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/validater").st_ino) 2023-10-06T04:49:05.239 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:05.392 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629484 2023-10-06T04:49:05.577 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:05.577 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:05.577 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:05.577 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:05.577 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/validater/valgrind.yaml").st_ino) 2023-10-06T04:49:05.577 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:05.729 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628255 2023-10-06T04:49:05.914 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:05.915 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:05.915 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:05.915 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:05.915 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/validater/lockdep.yaml").st_ino) 2023-10-06T04:49:05.915 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:06.067 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629485 2023-10-06T04:49:06.252 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:06.252 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:06.252 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:06.252 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:06.253 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/clusters").st_ino) 2023-10-06T04:49:06.253 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:06.406 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629472 2023-10-06T04:49:06.590 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:06.590 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:06.590 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:06.590 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:06.591 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/clusters/fixed-2.yaml").st_ino) 2023-10-06T04:49:06.591 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:06.742 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629473 2023-10-06T04:49:06.928 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:06.928 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:06.928 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:06.928 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:06.928 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/msgr-failures").st_ino) 2023-10-06T04:49:06.928 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:07.082 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629478 2023-10-06T04:49:07.267 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:07.267 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:07.267 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:07.267 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:07.267 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/msgr-failures/few.yaml").st_ino) 2023-10-06T04:49:07.268 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:07.420 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629479 2023-10-06T04:49:07.606 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:07.606 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:07.606 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:07.606 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:07.606 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/objectstore").st_ino) 2023-10-06T04:49:07.606 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:07.759 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629480 2023-10-06T04:49:07.944 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:07.944 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:07.944 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:07.944 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:07.944 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/fs").st_ino) 2023-10-06T04:49:07.944 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:08.097 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629476 2023-10-06T04:49:08.282 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:08.282 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:08.282 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:08.283 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:08.283 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/fs/xfs.yaml").st_ino) 2023-10-06T04:49:08.283 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:08.435 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629477 2023-10-06T04:49:08.620 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:08.620 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:08.620 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:08.620 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:08.620 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/rgw_pool_type").st_ino) 2023-10-06T04:49:08.620 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:08.773 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629481 2023-10-06T04:49:08.958 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:08.958 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:08.958 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:08.958 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:08.958 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/frontend").st_ino) 2023-10-06T04:49:08.958 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:09.111 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629474 2023-10-06T04:49:09.297 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:09.297 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:09.298 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:09.298 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:09.298 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/frontend/apache.yaml").st_ino) 2023-10-06T04:49:09.298 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:09.448 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629475 2023-10-06T04:49:09.634 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:09.634 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:09.635 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:09.635 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:09.635 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/frontend/civetweb.yaml").st_ino) 2023-10-06T04:49:09.635 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:09.788 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628251 2023-10-06T04:49:09.973 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:09.973 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:09.973 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:09.973 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:09.974 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/overrides.yaml").st_ino) 2023-10-06T04:49:09.974 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:10.126 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628252 2023-10-06T04:49:10.313 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:10.313 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:10.313 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:10.313 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:10.313 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/%").st_ino) 2023-10-06T04:49:10.313 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:10.468 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629471 2023-10-06T04:49:10.653 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:10.653 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:10.653 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:10.653 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:10.653 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks").st_ino) 2023-10-06T04:49:10.653 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:10.805 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629482 2023-10-06T04:49:10.992 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:10.992 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:10.992 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:10.992 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:10.993 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests_multiregion.yaml").st_ino) 2023-10-06T04:49:10.993 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:11.146 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628253 2023-10-06T04:49:11.330 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:11.330 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:11.330 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:11.330 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:11.330 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks/rgw_swift.yaml").st_ino) 2023-10-06T04:49:11.330 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:11.485 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628254 2023-10-06T04:49:11.670 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:11.671 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:11.671 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:11.671 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:11.671 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests.yaml").st_ino) 2023-10-06T04:49:11.671 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:11.822 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629483 2023-10-06T04:49:12.008 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:12.008 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:12.008 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:12.008 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:12.008 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy").st_ino) 2023-10-06T04:49:12.008 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:12.162 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628407 2023-10-06T04:49:12.347 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:12.347 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:12.347 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:12.347 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:12.347 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic").st_ino) 2023-10-06T04:49:12.347 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:12.500 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628408 2023-10-06T04:49:12.685 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:12.685 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:12.685 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:12.685 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:12.685 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/ceph-deploy-overrides").st_ino) 2023-10-06T04:49:12.685 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:12.837 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628410 2023-10-06T04:49:13.022 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:13.022 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:13.022 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:13.022 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:13.023 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/python_versions").st_ino) 2023-10-06T04:49:13.023 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:13.176 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628413 2023-10-06T04:49:13.361 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:13.361 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:13.361 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:13.361 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:13.361 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_3.yaml").st_ino) 2023-10-06T04:49:13.361 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:13.514 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627893 2023-10-06T04:49:13.699 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:13.699 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:13.699 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:13.699 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:13.700 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_2.yaml").st_ino) 2023-10-06T04:49:13.700 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:13.852 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628414 2023-10-06T04:49:14.038 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:14.038 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:14.038 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:14.038 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:14.038 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/config_options").st_ino) 2023-10-06T04:49:14.038 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:14.191 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628411 2023-10-06T04:49:14.376 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:14.376 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:14.376 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:14.376 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:14.376 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/distros").st_ino) 2023-10-06T04:49:14.376 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:14.528 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628412 2023-10-06T04:49:14.713 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:14.714 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:14.714 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:14.714 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:14.714 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/%").st_ino) 2023-10-06T04:49:14.714 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:14.866 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628409 2023-10-06T04:49:15.051 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:15.051 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:15.051 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:15.051 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:15.051 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/tasks").st_ino) 2023-10-06T04:49:15.052 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:15.204 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628415 2023-10-06T04:49:15.389 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:15.390 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:15.390 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:15.390 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:15.390 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/tasks/ceph-admin-commands.yaml").st_ino) 2023-10-06T04:49:15.390 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:15.541 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628416 2023-10-06T04:49:15.727 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:15.727 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:15.727 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:15.727 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:15.727 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt").st_ino) 2023-10-06T04:49:15.727 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:15.879 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629829 2023-10-06T04:49:16.066 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:16.066 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:16.066 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:16.066 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:16.066 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic").st_ino) 2023-10-06T04:49:16.066 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:16.218 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629830 2023-10-06T04:49:16.403 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:16.403 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:16.404 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:16.404 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:16.404 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/clusters").st_ino) 2023-10-06T04:49:16.404 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:16.557 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629832 2023-10-06T04:49:16.742 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:16.742 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:16.742 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:16.742 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:16.742 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:49:16.742 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:16.896 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629833 2023-10-06T04:49:17.082 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:17.082 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:17.082 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:17.082 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:17.082 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/msgr-failures").st_ino) 2023-10-06T04:49:17.082 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:17.235 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629836 2023-10-06T04:49:17.420 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:17.421 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:17.421 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:17.421 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:17.421 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/msgr-failures/many.yaml").st_ino) 2023-10-06T04:49:17.421 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:17.573 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628885 2023-10-06T04:49:17.758 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:17.758 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:17.758 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:17.758 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:17.758 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/msgr-failures/few.yaml").st_ino) 2023-10-06T04:49:17.758 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:17.915 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629837 2023-10-06T04:49:18.099 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:18.100 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:18.100 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:18.100 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:18.100 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/fs").st_ino) 2023-10-06T04:49:18.100 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:18.252 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629834 2023-10-06T04:49:18.437 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:18.438 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:18.438 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:18.438 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:18.438 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/fs/btrfs.yaml").st_ino) 2023-10-06T04:49:18.438 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:18.590 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629835 2023-10-06T04:49:18.775 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:18.776 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:18.776 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:18.776 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:18.776 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/%").st_ino) 2023-10-06T04:49:18.776 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:18.928 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629831 2023-10-06T04:49:19.113 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:19.113 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:19.113 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:19.113 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:19.113 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks").st_ino) 2023-10-06T04:49:19.113 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:19.266 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629838 2023-10-06T04:49:19.452 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:19.452 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:19.452 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:19.453 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:19.453 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/iozone-sync.yaml").st_ino) 2023-10-06T04:49:19.453 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:19.605 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628895 2023-10-06T04:49:19.790 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:19.790 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:19.791 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:19.791 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:19.791 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/dbench-short.yaml").st_ino) 2023-10-06T04:49:19.791 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:19.943 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628887 2023-10-06T04:49:20.128 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:20.128 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:20.128 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:20.128 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:20.128 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/blogbench.yaml").st_ino) 2023-10-06T04:49:20.128 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:20.281 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629839 2023-10-06T04:49:20.466 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:20.466 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:20.466 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:20.466 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:20.466 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/ffsb.yaml").st_ino) 2023-10-06T04:49:20.466 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:20.619 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628889 2023-10-06T04:49:20.805 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:20.805 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:20.805 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:20.805 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:20.805 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/pjd.yaml").st_ino) 2023-10-06T04:49:20.805 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:20.957 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628897 2023-10-06T04:49:21.143 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:21.143 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:21.143 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:21.143 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:21.143 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fsync-tester.yaml").st_ino) 2023-10-06T04:49:21.144 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:21.297 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628893 2023-10-06T04:49:21.482 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:21.482 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:21.482 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:21.482 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:21.482 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/iogen.yaml").st_ino) 2023-10-06T04:49:21.482 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:21.635 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628894 2023-10-06T04:49:21.820 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:21.820 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:21.821 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:21.821 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:21.821 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fsx.yaml").st_ino) 2023-10-06T04:49:21.821 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:21.974 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628892 2023-10-06T04:49:22.159 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:22.159 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:22.159 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:22.159 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:22.159 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/bonnie.yaml").st_ino) 2023-10-06T04:49:22.159 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:22.312 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628886 2023-10-06T04:49:22.497 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:22.498 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:22.498 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:22.498 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:22.498 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fio.yaml").st_ino) 2023-10-06T04:49:22.498 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:22.649 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628890 2023-10-06T04:49:22.834 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:22.834 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:22.834 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:22.834 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:22.835 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/iozone.yaml").st_ino) 2023-10-06T04:49:22.835 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:22.986 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628896 2023-10-06T04:49:23.172 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:23.172 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:23.172 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:23.172 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:23.172 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/dbench.yaml").st_ino) 2023-10-06T04:49:23.172 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:23.325 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628888 2023-10-06T04:49:23.511 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:23.511 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:23.511 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:23.511 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:23.511 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fsstress.yaml").st_ino) 2023-10-06T04:49:23.511 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:23.664 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628891 2023-10-06T04:49:23.849 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:23.849 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:23.849 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:23.849 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:23.849 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba").st_ino) 2023-10-06T04:49:23.850 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:24.002 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629486 2023-10-06T04:49:24.188 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:24.188 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:24.188 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:24.188 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:24.188 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/install").st_ino) 2023-10-06T04:49:24.188 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:24.341 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629492 2023-10-06T04:49:24.525 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:24.526 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:24.526 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:24.526 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:24.526 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/install/install.yaml").st_ino) 2023-10-06T04:49:24.526 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:24.678 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629493 2023-10-06T04:49:24.864 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:24.864 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:24.864 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:24.864 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:24.864 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/clusters").st_ino) 2023-10-06T04:49:24.864 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:25.017 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629488 2023-10-06T04:49:25.203 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:25.203 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:25.203 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:25.203 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:25.203 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/clusters/samba-basic.yaml").st_ino) 2023-10-06T04:49:25.203 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:25.356 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629489 2023-10-06T04:49:25.542 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:25.542 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:25.542 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:25.542 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:25.542 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload").st_ino) 2023-10-06T04:49:25.542 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:25.694 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629496 2023-10-06T04:49:25.879 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:25.879 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:25.879 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:25.879 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:25.880 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/cifs-kernel-build.yaml.disabled").st_ino) 2023-10-06T04:49:25.880 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:26.032 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628260 2023-10-06T04:49:26.218 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:26.218 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:26.218 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:26.218 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:26.218 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/cifs-fsstress.yaml").st_ino) 2023-10-06T04:49:26.218 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:26.371 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628259 2023-10-06T04:49:26.556 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:26.556 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:26.556 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:26.557 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:26.557 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/smbtorture.yaml").st_ino) 2023-10-06T04:49:26.557 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:26.708 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628261 2023-10-06T04:49:26.894 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:26.894 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:26.894 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:26.894 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:26.894 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/cifs-dbench.yaml").st_ino) 2023-10-06T04:49:26.894 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:27.047 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629497 2023-10-06T04:49:27.233 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:27.233 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:27.233 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:27.234 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:27.234 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/fs").st_ino) 2023-10-06T04:49:27.234 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:27.385 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629490 2023-10-06T04:49:27.571 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:27.571 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:27.571 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:27.571 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:27.571 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/fs/xfs.yaml").st_ino) 2023-10-06T04:49:27.571 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:27.725 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629491 2023-10-06T04:49:27.911 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:27.911 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:27.911 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:27.911 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:27.911 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount").st_ino) 2023-10-06T04:49:27.912 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:28.065 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629494 2023-10-06T04:49:28.249 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:28.249 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:28.250 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:28.250 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:28.250 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/noceph.yaml").st_ino) 2023-10-06T04:49:28.250 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:28.402 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628258 2023-10-06T04:49:28.587 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:28.587 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:28.587 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:28.587 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:28.587 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/kclient.yaml").st_ino) 2023-10-06T04:49:28.588 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:28.739 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628256 2023-10-06T04:49:28.925 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:28.925 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:28.925 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:28.925 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:28.925 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/fuse.yaml").st_ino) 2023-10-06T04:49:28.925 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:29.079 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629495 2023-10-06T04:49:29.264 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:29.264 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:29.264 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:29.264 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:29.265 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/native.yaml").st_ino) 2023-10-06T04:49:29.265 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:29.416 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628257 2023-10-06T04:49:29.601 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:29.601 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:29.601 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:29.601 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:29.602 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/%").st_ino) 2023-10-06T04:49:29.602 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:29.753 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629487 2023-10-06T04:49:29.938 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:29.938 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:29.938 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:29.939 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:29.939 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible").st_ino) 2023-10-06T04:49:29.939 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:29.957 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:49:29.986 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:49:30.095 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628385 2023-10-06T04:49:30.278 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:30.278 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:30.279 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:30.279 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:30.279 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke").st_ino) 2023-10-06T04:49:30.279 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:30.430 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628386 2023-10-06T04:49:30.616 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:30.616 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:30.616 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:30.616 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:30.616 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests").st_ino) 2023-10-06T04:49:30.616 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:30.769 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628405 2023-10-06T04:49:30.954 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:30.954 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:30.954 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:30.955 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:30.955 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/cls.yaml").st_ino) 2023-10-06T04:49:30.955 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:31.107 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627890 2023-10-06T04:49:31.293 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:31.293 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:31.293 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:31.293 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:31.293 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_cli_tests.yaml.disabled").st_ino) 2023-10-06T04:49:31.293 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:31.447 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627891 2023-10-06T04:49:31.632 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:31.632 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:31.632 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:31.632 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:31.633 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_import_export.yaml").st_ino) 2023-10-06T04:49:31.633 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:31.785 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627892 2023-10-06T04:49:31.970 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:31.970 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:31.970 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:31.970 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:31.970 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/ceph-admin-commands.yaml").st_ino) 2023-10-06T04:49:31.970 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:32.123 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628406 2023-10-06T04:49:32.308 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:32.308 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:32.308 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:32.308 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:32.308 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/1-distros").st_ino) 2023-10-06T04:49:32.308 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:32.461 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628390 2023-10-06T04:49:32.646 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:32.646 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:32.646 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:32.646 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:32.646 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters").st_ino) 2023-10-06T04:49:32.646 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:32.799 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628388 2023-10-06T04:49:32.985 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:32.985 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:32.985 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:32.985 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:32.985 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/single_mon_osd.yaml").st_ino) 2023-10-06T04:49:32.985 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:33.138 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627888 2023-10-06T04:49:33.323 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:33.323 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:33.323 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:33.323 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:33.323 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/3-node.yaml").st_ino) 2023-10-06T04:49:33.323 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:33.476 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628389 2023-10-06T04:49:33.661 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:33.661 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:33.661 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:33.661 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:33.662 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common").st_ino) 2023-10-06T04:49:33.662 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:33.814 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628393 2023-10-06T04:49:33.999 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:34.000 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:34.000 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:34.000 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:34.000 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning").st_ino) 2023-10-06T04:49:34.000 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:34.154 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628395 2023-10-06T04:49:34.338 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:34.339 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:34.339 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:34.339 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:34.339 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning/vm_friendly.yaml").st_ino) 2023-10-06T04:49:34.339 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:34.491 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628396 2023-10-06T04:49:34.677 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:34.677 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:34.677 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:34.677 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:34.677 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source").st_ino) 2023-10-06T04:49:34.677 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:34.830 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628397 2023-10-06T04:49:35.015 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:35.016 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:35.016 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:35.016 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:35.016 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source/upstream_stable.yaml").st_ino) 2023-10-06T04:49:35.016 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:35.168 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628398 2023-10-06T04:49:35.353 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:35.353 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:35.353 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:35.354 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:35.354 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/%").st_ino) 2023-10-06T04:49:35.354 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:35.508 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628394 2023-10-06T04:49:35.693 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:35.693 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:35.693 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:35.693 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:35.693 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/%").st_ino) 2023-10-06T04:49:35.693 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:35.845 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628387 2023-10-06T04:49:36.031 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:36.031 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:36.031 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:36.032 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:36.032 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd").st_ino) 2023-10-06T04:49:36.032 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:36.186 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628399 2023-10-06T04:49:36.370 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:36.370 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:36.370 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:36.370 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:36.370 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal").st_ino) 2023-10-06T04:49:36.370 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:36.522 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628403 2023-10-06T04:49:36.708 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:36.708 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:36.708 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:36.708 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:36.708 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal/collocated.yaml").st_ino) 2023-10-06T04:49:36.708 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:36.861 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628404 2023-10-06T04:49:37.046 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:37.046 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:37.046 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:37.046 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:37.046 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/%").st_ino) 2023-10-06T04:49:37.046 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:37.199 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628400 2023-10-06T04:49:37.383 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:37.383 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:37.384 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:37.384 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:37.384 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices").st_ino) 2023-10-06T04:49:37.384 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:37.535 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628401 2023-10-06T04:49:37.721 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:37.721 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:37.721 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:37.721 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:37.721 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/osd_auto_discovery.yaml").st_ino) 2023-10-06T04:49:37.721 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:37.875 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627889 2023-10-06T04:49:38.060 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:38.060 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:38.060 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:38.060 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:38.060 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/from_teuthology.yaml").st_ino) 2023-10-06T04:49:38.060 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:38.215 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628402 2023-10-06T04:49:38.400 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:38.400 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:38.400 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:38.400 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:38.400 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup").st_ino) 2023-10-06T04:49:38.400 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:38.553 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628391 2023-10-06T04:49:38.737 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:38.738 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:38.738 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:38.738 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:38.738 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup/ceph_ansible.yaml").st_ino) 2023-10-06T04:49:38.738 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:38.890 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628392 2023-10-06T04:49:39.076 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:39.076 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:39.076 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:39.076 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:39.076 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big").st_ino) 2023-10-06T04:49:39.076 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:39.229 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628361 2023-10-06T04:49:39.414 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:39.415 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:39.415 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:39.415 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:39.415 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash").st_ino) 2023-10-06T04:49:39.415 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:39.567 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628362 2023-10-06T04:49:39.753 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:39.753 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:39.753 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:39.753 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:39.753 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters").st_ino) 2023-10-06T04:49:39.753 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:39.906 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628366 2023-10-06T04:49:40.091 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:40.091 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:40.091 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:40.091 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:40.091 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters/medium.yaml").st_ino) 2023-10-06T04:49:40.091 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:40.244 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627885 2023-10-06T04:49:40.430 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:40.430 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:40.430 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:40.430 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:40.430 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters/big.yaml").st_ino) 2023-10-06T04:49:40.430 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:40.584 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628367 2023-10-06T04:49:40.769 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:40.770 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:40.770 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:40.770 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:40.770 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters/small.yaml").st_ino) 2023-10-06T04:49:40.770 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:40.922 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627886 2023-10-06T04:49:41.107 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:41.107 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:41.108 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:41.108 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:41.108 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/fs").st_ino) 2023-10-06T04:49:41.108 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:41.260 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628368 2023-10-06T04:49:41.445 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:41.445 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:41.445 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:41.446 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:41.446 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/fs/btrfs.yaml").st_ino) 2023-10-06T04:49:41.446 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:41.598 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628369 2023-10-06T04:49:41.783 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:41.783 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:41.783 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:41.783 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:41.783 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/fs/xfs.yaml").st_ino) 2023-10-06T04:49:41.783 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:41.936 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627887 2023-10-06T04:49:42.121 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:42.122 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:42.122 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:42.122 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:42.122 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/workloads").st_ino) 2023-10-06T04:49:42.122 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:42.274 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628372 2023-10-06T04:49:42.460 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:42.460 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:42.460 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:42.460 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:42.460 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/workloads/snaps-few-objects.yaml").st_ino) 2023-10-06T04:49:42.460 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:42.614 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628373 2023-10-06T04:49:42.799 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:42.799 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:42.799 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:42.799 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:42.799 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/ceph").st_ino) 2023-10-06T04:49:42.799 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:42.951 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628364 2023-10-06T04:49:43.137 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:43.137 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:43.137 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:43.137 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:43.137 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/ceph/ceph.yaml").st_ino) 2023-10-06T04:49:43.137 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:43.291 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628365 2023-10-06T04:49:43.477 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:43.477 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:43.477 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:43.477 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:43.477 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/%").st_ino) 2023-10-06T04:49:43.477 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:43.630 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628363 2023-10-06T04:49:43.816 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:43.816 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:43.816 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:43.816 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:43.816 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/thrashers").st_ino) 2023-10-06T04:49:43.816 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:43.969 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628370 2023-10-06T04:49:44.154 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:44.154 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:44.154 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:44.154 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:44.154 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/thrashers/default.yaml").st_ino) 2023-10-06T04:49:44.154 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:44.306 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628371 2023-10-06T04:49:44.491 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:44.491 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:44.491 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:44.491 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:44.491 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients").st_ino) 2023-10-06T04:49:44.492 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:44.645 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628808 2023-10-06T04:49:44.830 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:44.830 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:44.830 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:44.830 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:44.830 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic").st_ino) 2023-10-06T04:49:44.830 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:44.984 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628809 2023-10-06T04:49:45.169 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:45.170 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:45.170 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:45.170 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:45.170 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/clusters").st_ino) 2023-10-06T04:49:45.170 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:45.322 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628810 2023-10-06T04:49:45.508 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:45.508 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:45.509 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:45.509 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:45.509 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:49:45.509 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:45.660 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628811 2023-10-06T04:49:45.846 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:45.846 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:45.847 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:45.847 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:45.847 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/fs").st_ino) 2023-10-06T04:49:45.847 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:45.999 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628812 2023-10-06T04:49:46.184 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:46.185 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:46.185 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:46.185 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:46.185 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/fs/btrfs.yaml").st_ino) 2023-10-06T04:49:46.185 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:46.337 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628813 2023-10-06T04:49:46.523 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:46.523 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:46.523 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:46.523 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:46.523 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/tasks").st_ino) 2023-10-06T04:49:46.523 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:46.676 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628814 2023-10-06T04:49:46.862 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:46.862 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:46.862 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:46.862 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:46.862 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml").st_ino) 2023-10-06T04:49:46.862 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:47.015 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628021 2023-10-06T04:49:47.200 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:47.201 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:47.201 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:47.201 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:47.201 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_dbench_iozone.yaml").st_ino) 2023-10-06T04:49:47.201 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:47.353 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628815 2023-10-06T04:49:47.538 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:47.538 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:47.539 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:47.539 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:47.539 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs").st_ino) 2023-10-06T04:49:47.539 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:47.690 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628434 2023-10-06T04:49:47.876 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:47.876 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:47.876 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:47.876 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:47.876 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless").st_ino) 2023-10-06T04:49:47.876 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:48.031 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628604 2023-10-06T04:49:48.216 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:48.216 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:48.216 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:48.216 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:48.216 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/traceless").st_ino) 2023-10-06T04:49:48.216 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:48.369 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628624 2023-10-06T04:49:48.555 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:48.555 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:48.555 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:48.555 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:48.555 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/traceless/50pc.yaml").st_ino) 2023-10-06T04:49:48.555 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:48.708 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628625 2023-10-06T04:49:48.893 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:48.894 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:48.894 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:48.894 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:48.894 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides").st_ino) 2023-10-06T04:49:48.894 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:49.047 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628614 2023-10-06T04:49:49.232 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:49.232 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:49.232 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:49.232 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:49.233 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:49:49.233 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:49.385 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628618 2023-10-06T04:49:49.570 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:49.570 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:49.570 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:49.570 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:49.570 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/debug.yaml").st_ino) 2023-10-06T04:49:49.570 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:49.723 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628616 2023-10-06T04:49:49.909 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:49.909 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:49.909 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:49.909 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:49.910 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/+").st_ino) 2023-10-06T04:49:49.910 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:50.063 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628615 2023-10-06T04:49:50.248 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:50.249 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:50.249 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:50.249 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:50.249 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:49:50.249 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:50.406 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628617 2023-10-06T04:49:50.591 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:50.591 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:50.591 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:50.591 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:50.591 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/clusters").st_ino) 2023-10-06T04:49:50.591 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:50.743 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628607 2023-10-06T04:49:50.929 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:50.929 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:50.929 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:50.929 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:50.929 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/clusters/fixed-2-ucephfs.yaml").st_ino) 2023-10-06T04:49:50.930 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:51.082 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628608 2023-10-06T04:49:51.266 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:51.267 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:51.267 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:51.267 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:51.267 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/objectstore").st_ino) 2023-10-06T04:49:51.267 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:51.424 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628613 2023-10-06T04:49:51.610 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:51.610 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:51.610 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:51.610 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:51.610 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/fs").st_ino) 2023-10-06T04:49:51.611 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:51.762 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628609 2023-10-06T04:49:51.947 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:51.947 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:51.947 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:51.947 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:51.948 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/fs/xfs.yaml").st_ino) 2023-10-06T04:49:51.948 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:52.101 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628610 2023-10-06T04:49:52.286 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:52.286 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:52.286 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:52.286 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:52.286 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/mount").st_ino) 2023-10-06T04:49:52.286 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:52.438 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628611 2023-10-06T04:49:52.623 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:52.624 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:52.624 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:52.624 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:52.624 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/mount/fuse.yaml").st_ino) 2023-10-06T04:49:52.624 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:52.776 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628612 2023-10-06T04:49:52.962 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:52.962 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:52.962 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:52.962 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:52.962 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/begin.yaml").st_ino) 2023-10-06T04:49:52.962 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:53.115 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628606 2023-10-06T04:49:53.300 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:53.300 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:53.300 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:53.300 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:53.300 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/%").st_ino) 2023-10-06T04:49:53.301 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:53.453 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628605 2023-10-06T04:49:53.638 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:53.639 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:53.639 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:53.639 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:53.639 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks").st_ino) 2023-10-06T04:49:53.639 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:53.792 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628619 2023-10-06T04:49:53.977 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:53.977 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:53.977 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:53.977 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:53.977 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2023-10-06T04:49:53.977 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:54.129 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628622 2023-10-06T04:49:54.314 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:54.315 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:54.315 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:54.315 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:54.315 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2023-10-06T04:49:54.315 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:54.468 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628620 2023-10-06T04:49:54.652 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:54.652 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:54.652 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:54.652 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:54.653 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:49:54.653 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:54.804 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628623 2023-10-06T04:49:54.990 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:54.990 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:54.990 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:54.990 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:54.991 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2023-10-06T04:49:54.991 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:55.143 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628621 2023-10-06T04:49:55.329 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:55.329 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:55.329 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:55.329 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:55.330 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs").st_ino) 2023-10-06T04:49:55.330 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:55.482 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628496 2023-10-06T04:49:55.667 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:55.668 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:55.668 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:55.668 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:55.668 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides").st_ino) 2023-10-06T04:49:55.668 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:55.820 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628506 2023-10-06T04:49:56.005 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:56.005 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:56.005 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:56.005 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:56.006 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:49:56.006 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:56.158 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628510 2023-10-06T04:49:56.344 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:56.344 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:56.344 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:56.344 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:56.344 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/mon-debug.yaml").st_ino) 2023-10-06T04:49:56.344 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:56.497 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627915 2023-10-06T04:49:56.682 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:56.683 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:56.683 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:56.683 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:56.683 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/debug.yaml").st_ino) 2023-10-06T04:49:56.683 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:56.835 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628508 2023-10-06T04:49:57.021 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:57.021 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:57.021 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:57.022 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:57.022 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/+").st_ino) 2023-10-06T04:49:57.022 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:57.174 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628507 2023-10-06T04:49:57.359 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:57.360 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:57.360 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:57.360 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:57.360 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:49:57.360 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:57.512 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628509 2023-10-06T04:49:57.697 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:57.697 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:57.697 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:57.697 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:57.697 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/clusters").st_ino) 2023-10-06T04:49:57.697 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:57.850 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628499 2023-10-06T04:49:58.036 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:58.036 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:58.036 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:58.036 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:58.036 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/clusters/2-remote-clients.yaml").st_ino) 2023-10-06T04:49:58.036 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:58.189 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628500 2023-10-06T04:49:58.374 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:58.374 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:58.375 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:58.375 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:58.375 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/objectstore").st_ino) 2023-10-06T04:49:58.375 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:58.526 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628505 2023-10-06T04:49:58.712 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:58.712 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:58.712 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:58.712 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:58.712 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/fs").st_ino) 2023-10-06T04:49:58.713 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:58.864 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628501 2023-10-06T04:49:59.049 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:59.049 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:59.049 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:59.049 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:59.049 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/fs/xfs.yaml").st_ino) 2023-10-06T04:49:59.050 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:59.202 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628502 2023-10-06T04:49:59.387 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:59.387 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:59.387 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:59.388 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:59.388 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/mount").st_ino) 2023-10-06T04:49:59.388 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:59.540 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628503 2023-10-06T04:49:59.725 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:49:59.725 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:49:59.725 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:49:59.725 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:49:59.725 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/mount/fuse.yaml").st_ino) 2023-10-06T04:49:59.725 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:49:59.878 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628504 2023-10-06T04:50:00.063 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:00.063 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:00.063 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:00.063 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:00.064 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/begin.yaml").st_ino) 2023-10-06T04:50:00.064 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:00.090 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:50:00.111 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:50:00.221 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628498 2023-10-06T04:50:00.406 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:00.406 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:00.406 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:00.406 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:00.406 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/%").st_ino) 2023-10-06T04:50:00.406 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:00.559 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628497 2023-10-06T04:50:00.744 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:00.744 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:00.744 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:00.744 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:00.744 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/tasks").st_ino) 2023-10-06T04:50:00.744 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:00.896 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628511 2023-10-06T04:50:01.082 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:01.082 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:01.082 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:01.082 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:01.082 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/tasks/failover.yaml").st_ino) 2023-10-06T04:50:01.082 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:01.236 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628512 2023-10-06T04:50:01.420 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:01.420 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:01.420 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:01.420 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:01.420 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps").st_ino) 2023-10-06T04:50:01.421 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:01.573 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628547 2023-10-06T04:50:01.758 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:01.759 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:01.759 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:01.759 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:01.759 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides").st_ino) 2023-10-06T04:50:01.759 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:01.910 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628557 2023-10-06T04:50:02.096 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:02.096 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:02.096 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:02.096 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:02.097 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:50:02.097 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:02.253 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628561 2023-10-06T04:50:02.439 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:02.439 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:02.439 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:02.439 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:02.439 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/debug.yaml").st_ino) 2023-10-06T04:50:02.439 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:02.591 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628559 2023-10-06T04:50:02.777 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:02.777 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:02.777 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:02.777 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:02.777 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/+").st_ino) 2023-10-06T04:50:02.777 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:02.931 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628558 2023-10-06T04:50:03.116 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:03.116 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:03.117 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:03.117 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:03.117 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:50:03.117 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:03.270 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628560 2023-10-06T04:50:03.455 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:03.456 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:03.456 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:03.456 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:03.456 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/clusters").st_ino) 2023-10-06T04:50:03.456 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:03.608 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628550 2023-10-06T04:50:03.794 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:03.794 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:03.794 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:03.794 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:03.794 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/clusters/fixed-2-ucephfs.yaml").st_ino) 2023-10-06T04:50:03.794 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:03.946 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628551 2023-10-06T04:50:04.131 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:04.131 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:04.131 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:04.131 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:04.131 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/objectstore").st_ino) 2023-10-06T04:50:04.131 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:04.284 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628556 2023-10-06T04:50:04.470 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:04.470 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:04.470 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:04.470 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:04.470 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/fs").st_ino) 2023-10-06T04:50:04.470 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:04.623 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628552 2023-10-06T04:50:04.807 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:04.808 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:04.808 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:04.808 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:04.808 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/fs/xfs.yaml").st_ino) 2023-10-06T04:50:04.808 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:04.960 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628553 2023-10-06T04:50:05.145 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:05.146 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:05.146 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:05.146 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:05.146 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/mount").st_ino) 2023-10-06T04:50:05.146 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:05.298 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628554 2023-10-06T04:50:05.483 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:05.483 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:05.483 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:05.484 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:05.484 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/mount/fuse.yaml").st_ino) 2023-10-06T04:50:05.484 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:05.636 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628555 2023-10-06T04:50:05.821 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:05.821 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:05.821 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:05.821 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:05.821 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/begin.yaml").st_ino) 2023-10-06T04:50:05.821 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:05.974 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628549 2023-10-06T04:50:06.159 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:06.159 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:06.159 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:06.159 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:06.159 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/%").st_ino) 2023-10-06T04:50:06.159 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:06.312 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628548 2023-10-06T04:50:06.497 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:06.497 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:06.498 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:06.498 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:06.498 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/tasks").st_ino) 2023-10-06T04:50:06.498 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:06.650 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628562 2023-10-06T04:50:06.836 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:06.836 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:06.836 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:06.836 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:06.836 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/tasks/snaptests.yaml").st_ino) 2023-10-06T04:50:06.836 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:06.990 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628563 2023-10-06T04:50:07.174 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:07.175 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:07.175 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:07.175 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:07.175 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic").st_ino) 2023-10-06T04:50:07.175 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:07.328 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628453 2023-10-06T04:50:07.512 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:07.512 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:07.513 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:07.513 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:07.513 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides").st_ino) 2023-10-06T04:50:07.513 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:07.664 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628465 2023-10-06T04:50:07.851 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:07.851 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:07.851 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:07.851 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:07.851 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:50:07.851 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:08.005 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628469 2023-10-06T04:50:08.190 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:08.190 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:08.190 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:08.190 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:08.190 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/debug.yaml").st_ino) 2023-10-06T04:50:08.190 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:08.344 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628467 2023-10-06T04:50:08.529 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:08.529 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:08.530 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:08.530 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:08.530 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/+").st_ino) 2023-10-06T04:50:08.530 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:08.681 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628466 2023-10-06T04:50:08.867 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:08.867 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:08.867 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:08.867 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:08.868 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:50:08.868 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:09.019 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628468 2023-10-06T04:50:09.205 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:09.205 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:09.205 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:09.205 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:09.205 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/clusters").st_ino) 2023-10-06T04:50:09.206 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:09.357 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628456 2023-10-06T04:50:09.543 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:09.543 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:09.543 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:09.543 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:09.543 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/clusters/fixed-2-ucephfs.yaml").st_ino) 2023-10-06T04:50:09.543 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:09.696 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628457 2023-10-06T04:50:09.880 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:09.881 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:09.881 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:09.881 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:09.881 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/objectstore").st_ino) 2023-10-06T04:50:09.881 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:10.033 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628464 2023-10-06T04:50:10.219 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:10.220 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:10.220 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:10.220 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:10.220 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/fs").st_ino) 2023-10-06T04:50:10.220 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:10.373 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628458 2023-10-06T04:50:10.557 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:10.557 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:10.557 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:10.558 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:10.558 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/fs/xfs.yaml").st_ino) 2023-10-06T04:50:10.558 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:10.709 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628459 2023-10-06T04:50:10.895 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:10.895 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:10.895 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:10.895 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:10.895 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/mount").st_ino) 2023-10-06T04:50:10.896 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:11.049 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628462 2023-10-06T04:50:11.234 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:11.234 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:11.234 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:11.234 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:11.235 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/mount/fuse.yaml").st_ino) 2023-10-06T04:50:11.235 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:11.386 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628463 2023-10-06T04:50:11.572 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:11.572 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:11.572 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:11.572 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:11.572 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/inline").st_ino) 2023-10-06T04:50:11.572 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:11.725 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628460 2023-10-06T04:50:11.911 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:11.911 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:11.911 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:11.911 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:11.911 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/inline/yes.yaml").st_ino) 2023-10-06T04:50:11.911 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:12.064 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627895 2023-10-06T04:50:12.249 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:12.249 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:12.250 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:12.250 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:12.250 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/inline/no.yaml").st_ino) 2023-10-06T04:50:12.250 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:12.401 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628461 2023-10-06T04:50:12.587 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:12.587 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:12.587 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:12.587 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:12.587 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/begin.yaml").st_ino) 2023-10-06T04:50:12.587 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:12.741 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628455 2023-10-06T04:50:12.926 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:12.926 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:12.926 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:12.926 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:12.926 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/%").st_ino) 2023-10-06T04:50:12.926 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:13.079 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628454 2023-10-06T04:50:13.264 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:13.264 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:13.264 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:13.264 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:13.264 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks").st_ino) 2023-10-06T04:50:13.264 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:13.417 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628470 2023-10-06T04:50:13.603 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:13.603 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:13.603 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:13.603 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:13.603 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsync.yaml").st_ino) 2023-10-06T04:50:13.603 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:13.756 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627903 2023-10-06T04:50:13.941 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:13.942 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:13.942 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:13.942 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:13.942 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_interface_tests.yaml").st_ino) 2023-10-06T04:50:13.942 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:14.096 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628477 2023-10-06T04:50:14.282 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:14.282 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:14.282 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:14.282 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:14.282 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2023-10-06T04:50:14.282 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:14.437 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627906 2023-10-06T04:50:14.623 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:14.623 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:14.623 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:14.623 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:14.623 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_norstats.yaml").st_ino) 2023-10-06T04:50:14.623 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:14.776 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627900 2023-10-06T04:50:14.961 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:14.962 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:14.962 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:14.962 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:14.962 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_trivial_sync.yaml").st_ino) 2023-10-06T04:50:14.962 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:15.114 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628476 2023-10-06T04:50:15.300 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:15.300 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:15.301 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:15.301 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:15.301 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2023-10-06T04:50:15.301 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:15.457 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628474 2023-10-06T04:50:15.642 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:15.642 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:15.642 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:15.642 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:15.642 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsx.yaml").st_ino) 2023-10-06T04:50:15.642 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:15.796 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627902 2023-10-06T04:50:15.981 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:15.981 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:15.981 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:15.981 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:15.981 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_java.yaml").st_ino) 2023-10-06T04:50:15.981 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:16.133 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627908 2023-10-06T04:50:16.319 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:16.319 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:16.319 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:16.319 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:16.320 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc.yaml").st_ino) 2023-10-06T04:50:16.320 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:16.472 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627898 2023-10-06T04:50:16.658 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:16.658 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:16.658 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:16.659 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:16.659 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc_test_o_trunc.yaml").st_ino) 2023-10-06T04:50:16.659 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:16.811 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627899 2023-10-06T04:50:16.995 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:16.996 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:16.996 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:16.996 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:16.996 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/mds_creation_retry.yaml").st_ino) 2023-10-06T04:50:16.996 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:17.149 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627910 2023-10-06T04:50:17.333 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:17.334 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:17.334 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:17.334 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:17.334 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/asok_dump_tree.yaml").st_ino) 2023-10-06T04:50:17.334 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:17.486 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628471 2023-10-06T04:50:17.671 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:17.671 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:17.671 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:17.672 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:17.672 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_quota.yaml").st_ino) 2023-10-06T04:50:17.672 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:17.823 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627901 2023-10-06T04:50:18.009 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:18.009 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:18.009 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:18.009 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:18.009 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_truncate_delay.yaml").st_ino) 2023-10-06T04:50:18.009 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:18.161 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627907 2023-10-06T04:50:18.346 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:18.346 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:18.347 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:18.347 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:18.347 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_kernel_untar_build.yaml").st_ino) 2023-10-06T04:50:18.347 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:18.499 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627897 2023-10-06T04:50:18.684 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:18.684 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:18.684 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:18.684 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:18.685 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2023-10-06T04:50:18.685 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:18.837 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628472 2023-10-06T04:50:19.022 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:19.022 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:19.023 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:19.023 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:19.023 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_python.yaml").st_ino) 2023-10-06T04:50:19.023 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:19.175 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627909 2023-10-06T04:50:19.360 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:19.360 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:19.361 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:19.361 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:19.361 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:50:19.361 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:19.513 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628475 2023-10-06T04:50:19.699 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:19.699 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:19.699 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:19.699 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:19.699 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cephfs_scrub_tests.yaml").st_ino) 2023-10-06T04:50:19.699 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:19.853 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627896 2023-10-06T04:50:20.038 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:20.038 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:20.038 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:20.038 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:20.038 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iogen.yaml").st_ino) 2023-10-06T04:50:20.038 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:20.191 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627904 2023-10-06T04:50:20.376 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:20.376 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:20.376 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:20.376 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:20.377 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2023-10-06T04:50:20.377 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:20.529 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628473 2023-10-06T04:50:20.714 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:20.714 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:20.715 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:20.715 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:20.715 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iozone.yaml").st_ino) 2023-10-06T04:50:20.715 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:20.867 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627905 2023-10-06T04:50:21.052 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:21.052 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:21.052 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:21.052 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:21.052 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery").st_ino) 2023-10-06T04:50:21.052 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:21.204 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628530 2023-10-06T04:50:21.390 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:21.391 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:21.391 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:21.391 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:21.391 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides").st_ino) 2023-10-06T04:50:21.391 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:21.544 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628540 2023-10-06T04:50:21.729 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:21.729 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:21.730 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:21.730 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:21.730 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:50:21.730 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:21.881 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628544 2023-10-06T04:50:22.067 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:22.067 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:22.067 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:22.067 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:22.067 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/fuse-unmounted.yaml").st_ino) 2023-10-06T04:50:22.068 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:22.220 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627917 2023-10-06T04:50:22.405 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:22.405 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:22.406 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:22.406 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:22.406 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/debug.yaml").st_ino) 2023-10-06T04:50:22.406 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:22.558 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628542 2023-10-06T04:50:22.743 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:22.743 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:22.743 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:22.743 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:22.744 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/+").st_ino) 2023-10-06T04:50:22.744 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:22.897 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628541 2023-10-06T04:50:23.082 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:23.082 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:23.082 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:23.082 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:23.082 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:50:23.082 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:23.236 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628543 2023-10-06T04:50:23.420 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:23.421 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:23.421 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:23.421 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:23.421 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/clusters").st_ino) 2023-10-06T04:50:23.421 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:23.572 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628533 2023-10-06T04:50:23.757 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:23.758 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:23.758 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:23.758 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:23.758 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/clusters/4-remote-clients.yaml").st_ino) 2023-10-06T04:50:23.758 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:23.910 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628534 2023-10-06T04:50:24.096 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:24.096 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:24.096 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:24.096 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:24.096 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/objectstore").st_ino) 2023-10-06T04:50:24.096 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:24.249 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628539 2023-10-06T04:50:24.434 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:24.434 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:24.434 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:24.434 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:24.434 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/fs").st_ino) 2023-10-06T04:50:24.434 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:24.587 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628535 2023-10-06T04:50:24.771 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:24.771 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:24.772 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:24.772 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:24.772 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/fs/xfs.yaml").st_ino) 2023-10-06T04:50:24.772 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:24.924 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628536 2023-10-06T04:50:25.109 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:25.110 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:25.110 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:25.110 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:25.110 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/mount").st_ino) 2023-10-06T04:50:25.110 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:25.262 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628537 2023-10-06T04:50:25.447 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:25.447 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:25.447 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:25.447 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:25.447 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/mount/fuse.yaml").st_ino) 2023-10-06T04:50:25.447 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:25.600 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628538 2023-10-06T04:50:25.785 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:25.785 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:25.786 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:25.786 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:25.786 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/begin.yaml").st_ino) 2023-10-06T04:50:25.786 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:25.939 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628532 2023-10-06T04:50:26.124 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:26.124 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:26.124 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:26.125 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:26.125 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/%").st_ino) 2023-10-06T04:50:26.125 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:26.277 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628531 2023-10-06T04:50:26.462 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:26.462 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:26.462 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:26.462 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:26.462 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks").st_ino) 2023-10-06T04:50:26.462 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:26.614 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628545 2023-10-06T04:50:26.799 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:26.799 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:26.799 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:26.799 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:26.799 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/backtrace.yaml").st_ino) 2023-10-06T04:50:26.799 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:26.951 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627918 2023-10-06T04:50:27.136 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:27.136 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:27.136 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:27.136 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:27.137 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/forward-scrub.yaml").st_ino) 2023-10-06T04:50:27.137 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:27.289 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627926 2023-10-06T04:50:27.474 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:27.474 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:27.475 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:27.475 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:27.475 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/client-readahad.yaml").st_ino) 2023-10-06T04:50:27.475 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:27.626 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627921 2023-10-06T04:50:27.811 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:27.812 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:27.812 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:27.812 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:27.812 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/volume-client.yaml").st_ino) 2023-10-06T04:50:27.812 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:27.965 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627934 2023-10-06T04:50:28.151 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:28.151 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:28.151 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:28.151 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:28.151 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/config-commands.yaml").st_ino) 2023-10-06T04:50:28.151 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:28.304 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627923 2023-10-06T04:50:28.490 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:28.490 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:28.490 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:28.490 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:28.490 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/mds-full.yaml").st_ino) 2023-10-06T04:50:28.490 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:28.642 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627930 2023-10-06T04:50:28.828 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:28.828 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:28.828 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:28.828 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:28.828 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/sessionmap.yaml").st_ino) 2023-10-06T04:50:28.828 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:28.981 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627932 2023-10-06T04:50:29.166 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:29.166 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:29.167 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:29.167 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:29.167 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/data-scan.yaml").st_ino) 2023-10-06T04:50:29.167 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:29.321 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627925 2023-10-06T04:50:29.506 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:29.506 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:29.506 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:29.506 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:29.506 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/cap-flush.yaml").st_ino) 2023-10-06T04:50:29.506 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:29.658 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627919 2023-10-06T04:50:29.844 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:29.844 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:29.844 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:29.844 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:29.844 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/mds-flush.yaml").st_ino) 2023-10-06T04:50:29.844 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:29.997 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627929 2023-10-06T04:50:30.182 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:30.182 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:30.182 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:30.182 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:30.182 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/auto-repair.yaml").st_ino) 2023-10-06T04:50:30.183 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:30.220 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:50:30.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:50:30.338 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628546 2023-10-06T04:50:30.523 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:30.523 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:30.523 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:30.525 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:30.525 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/damage.yaml").st_ino) 2023-10-06T04:50:30.525 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:30.637 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627924 2023-10-06T04:50:30.822 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:30.823 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:30.823 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:30.823 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:30.823 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/client-recovery.yaml").st_ino) 2023-10-06T04:50:30.823 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:30.976 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627922 2023-10-06T04:50:31.161 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:31.162 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:31.162 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:31.162 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:31.162 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/journal-repair.yaml").st_ino) 2023-10-06T04:50:31.162 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:31.315 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627928 2023-10-06T04:50:31.500 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:31.500 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:31.500 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:31.500 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:31.500 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/client-limits.yaml").st_ino) 2023-10-06T04:50:31.500 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:31.652 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627920 2023-10-06T04:50:31.837 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:31.838 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:31.838 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:31.838 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:31.838 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/strays.yaml").st_ino) 2023-10-06T04:50:31.838 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:31.991 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627933 2023-10-06T04:50:32.176 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:32.176 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:32.176 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:32.176 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:32.176 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/fragment.yaml").st_ino) 2023-10-06T04:50:32.176 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:32.329 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627927 2023-10-06T04:50:32.515 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:32.515 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:32.515 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:32.515 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:32.515 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/pool-perm.yaml").st_ino) 2023-10-06T04:50:32.515 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:32.669 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627931 2023-10-06T04:50:32.853 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:32.853 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:32.854 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:32.854 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:32.854 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission").st_ino) 2023-10-06T04:50:32.854 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:33.006 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628513 2023-10-06T04:50:33.191 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:33.191 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:33.191 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:33.191 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:33.191 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides").st_ino) 2023-10-06T04:50:33.192 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:33.344 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628523 2023-10-06T04:50:33.529 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:33.529 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:33.529 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:33.529 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:33.529 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:50:33.529 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:33.681 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628527 2023-10-06T04:50:33.867 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:33.867 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:33.867 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:33.867 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:33.867 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/debug.yaml").st_ino) 2023-10-06T04:50:33.867 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:34.020 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628525 2023-10-06T04:50:34.205 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:34.205 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:34.205 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:34.206 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:34.206 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/+").st_ino) 2023-10-06T04:50:34.206 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:34.358 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628524 2023-10-06T04:50:34.543 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:34.543 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:34.544 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:34.544 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:34.544 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:50:34.544 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:34.696 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628526 2023-10-06T04:50:34.881 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:34.881 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:34.881 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:34.881 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:34.882 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/clusters").st_ino) 2023-10-06T04:50:34.882 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:35.034 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628516 2023-10-06T04:50:35.219 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:35.219 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:35.219 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:35.220 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:35.220 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/clusters/fixed-2-ucephfs.yaml").st_ino) 2023-10-06T04:50:35.220 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:35.372 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628517 2023-10-06T04:50:35.557 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:35.557 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:35.557 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:35.557 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:35.558 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/objectstore").st_ino) 2023-10-06T04:50:35.558 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:35.710 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628522 2023-10-06T04:50:35.896 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:35.896 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:35.896 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:35.896 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:35.897 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/fs").st_ino) 2023-10-06T04:50:35.897 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:36.050 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628518 2023-10-06T04:50:36.235 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:36.235 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:36.235 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:36.235 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:36.235 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/fs/xfs.yaml").st_ino) 2023-10-06T04:50:36.235 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:36.388 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628519 2023-10-06T04:50:36.574 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:36.574 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:36.574 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:36.574 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:36.574 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/mount").st_ino) 2023-10-06T04:50:36.574 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:36.728 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628520 2023-10-06T04:50:36.913 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:36.913 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:36.913 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:36.913 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:36.913 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/mount/fuse.yaml").st_ino) 2023-10-06T04:50:36.913 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:37.066 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628521 2023-10-06T04:50:37.252 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:37.252 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:37.252 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:37.252 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:37.252 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/begin.yaml").st_ino) 2023-10-06T04:50:37.252 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:37.405 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628515 2023-10-06T04:50:37.590 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:37.590 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:37.590 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:37.590 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:37.590 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/%").st_ino) 2023-10-06T04:50:37.590 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:37.742 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628514 2023-10-06T04:50:37.929 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:37.929 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:37.929 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:37.929 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:37.929 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/tasks").st_ino) 2023-10-06T04:50:37.930 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:38.081 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628528 2023-10-06T04:50:38.267 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:38.267 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:38.268 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:38.268 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:38.268 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2023-10-06T04:50:38.268 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:38.421 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627916 2023-10-06T04:50:38.607 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:38.607 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:38.607 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:38.607 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:38.607 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_misc.yaml").st_ino) 2023-10-06T04:50:38.607 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:38.760 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628529 2023-10-06T04:50:38.945 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:38.945 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:38.946 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:38.946 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:38.946 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay").st_ino) 2023-10-06T04:50:38.946 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:39.100 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628564 2023-10-06T04:50:39.285 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:39.285 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:39.285 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:39.285 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:39.285 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides").st_ino) 2023-10-06T04:50:39.286 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:39.440 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628574 2023-10-06T04:50:39.625 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:39.625 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:39.625 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:39.626 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:39.626 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:50:39.626 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:39.777 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628578 2023-10-06T04:50:39.962 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:39.963 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:39.963 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:39.963 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:39.963 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/debug.yaml").st_ino) 2023-10-06T04:50:39.963 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:40.116 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628576 2023-10-06T04:50:40.302 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:40.302 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:40.302 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:40.302 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:40.302 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/+").st_ino) 2023-10-06T04:50:40.302 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:40.454 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628575 2023-10-06T04:50:40.639 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:40.639 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:40.640 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:40.640 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:40.640 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:50:40.640 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:40.792 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628577 2023-10-06T04:50:40.977 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:40.977 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:40.978 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:40.978 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:40.978 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/clusters").st_ino) 2023-10-06T04:50:40.978 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:41.129 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628567 2023-10-06T04:50:41.315 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:41.316 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:41.316 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:41.316 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:41.316 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/clusters/standby-replay.yaml").st_ino) 2023-10-06T04:50:41.316 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:41.468 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628568 2023-10-06T04:50:41.653 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:41.653 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:41.653 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:41.653 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:41.653 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/objectstore").st_ino) 2023-10-06T04:50:41.653 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:41.807 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628573 2023-10-06T04:50:41.992 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:41.992 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:41.992 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:41.993 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:41.993 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/fs").st_ino) 2023-10-06T04:50:41.993 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:42.146 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628569 2023-10-06T04:50:42.332 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:42.332 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:42.332 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:42.332 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:42.332 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/fs/xfs.yaml").st_ino) 2023-10-06T04:50:42.332 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:42.485 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628570 2023-10-06T04:50:42.671 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:42.671 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:42.671 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:42.671 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:42.671 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/mount").st_ino) 2023-10-06T04:50:42.671 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:42.824 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628571 2023-10-06T04:50:43.009 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:43.009 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:43.010 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:43.010 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:43.010 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/mount/fuse.yaml").st_ino) 2023-10-06T04:50:43.010 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:43.162 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628572 2023-10-06T04:50:43.348 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:43.348 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:43.348 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:43.348 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:43.348 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/begin.yaml").st_ino) 2023-10-06T04:50:43.348 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:43.501 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628566 2023-10-06T04:50:43.686 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:43.686 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:43.686 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:43.687 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:43.687 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/%").st_ino) 2023-10-06T04:50:43.687 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:43.839 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628565 2023-10-06T04:50:44.024 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:44.024 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:44.024 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:44.024 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:44.024 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/tasks").st_ino) 2023-10-06T04:50:44.024 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:44.177 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628579 2023-10-06T04:50:44.363 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:44.363 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:44.363 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:44.363 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:44.363 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/tasks/migration.yaml").st_ino) 2023-10-06T04:50:44.363 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:44.516 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628580 2023-10-06T04:50:44.701 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:44.701 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:44.702 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:44.702 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:44.702 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits").st_ino) 2023-10-06T04:50:44.702 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:44.854 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628435 2023-10-06T04:50:45.039 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:45.040 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:45.040 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:45.040 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:45.040 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides").st_ino) 2023-10-06T04:50:45.040 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:45.191 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628445 2023-10-06T04:50:45.377 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:45.377 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:45.377 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:45.377 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:45.377 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:50:45.377 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:45.529 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628449 2023-10-06T04:50:45.714 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:45.714 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:45.714 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:45.714 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:45.714 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/debug.yaml").st_ino) 2023-10-06T04:50:45.715 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:45.867 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628447 2023-10-06T04:50:46.052 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:46.052 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:46.053 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:46.053 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:46.053 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/+").st_ino) 2023-10-06T04:50:46.053 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:46.205 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628446 2023-10-06T04:50:46.390 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:46.390 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:46.390 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:46.391 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:46.391 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/faked-ino.yaml").st_ino) 2023-10-06T04:50:46.391 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:46.542 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627894 2023-10-06T04:50:46.728 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:46.728 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:46.728 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:46.728 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:46.728 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:50:46.728 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:46.880 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628448 2023-10-06T04:50:47.065 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:47.065 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:47.065 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:47.065 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:47.065 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/clusters").st_ino) 2023-10-06T04:50:47.066 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:47.218 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628438 2023-10-06T04:50:47.404 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:47.404 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:47.404 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:47.405 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:47.405 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/clusters/fixed-2-ucephfs.yaml").st_ino) 2023-10-06T04:50:47.405 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:47.556 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628439 2023-10-06T04:50:47.741 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:47.742 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:47.742 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:47.742 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:47.742 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/objectstore").st_ino) 2023-10-06T04:50:47.742 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:47.894 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628444 2023-10-06T04:50:48.079 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:48.079 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:48.079 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:48.079 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:48.080 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/fs").st_ino) 2023-10-06T04:50:48.080 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:48.232 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628440 2023-10-06T04:50:48.417 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:48.417 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:48.418 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:48.418 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:48.418 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/fs/xfs.yaml").st_ino) 2023-10-06T04:50:48.418 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:48.570 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628441 2023-10-06T04:50:48.755 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:48.755 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:48.756 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:48.756 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:48.756 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/mount").st_ino) 2023-10-06T04:50:48.756 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:48.909 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628442 2023-10-06T04:50:49.094 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:49.094 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:49.094 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:49.094 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:49.094 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/mount/fuse.yaml").st_ino) 2023-10-06T04:50:49.094 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:49.247 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628443 2023-10-06T04:50:49.432 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:49.432 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:49.432 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:49.432 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:49.432 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/begin.yaml").st_ino) 2023-10-06T04:50:49.433 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:49.585 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628437 2023-10-06T04:50:49.770 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:49.771 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:49.771 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:49.771 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:49.771 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/%").st_ino) 2023-10-06T04:50:49.771 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:49.922 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628436 2023-10-06T04:50:50.108 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:50.108 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:50.108 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:50.108 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:50.108 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/tasks").st_ino) 2023-10-06T04:50:50.108 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:50.261 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628450 2023-10-06T04:50:50.446 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:50.446 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:50.446 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:50.446 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:50.446 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2023-10-06T04:50:50.447 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:50.598 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628452 2023-10-06T04:50:50.784 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:50.784 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:50.784 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:50.784 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:50.784 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:50:50.784 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:50.937 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628451 2023-10-06T04:50:51.123 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:51.123 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:51.123 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:51.123 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:51.123 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash").st_ino) 2023-10-06T04:50:51.123 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:51.276 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628581 2023-10-06T04:50:51.462 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:51.462 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:51.462 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:51.462 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:51.462 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/ceph-thrash").st_ino) 2023-10-06T04:50:51.462 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:51.615 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628584 2023-10-06T04:50:51.801 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:51.801 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:51.801 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:51.801 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:51.801 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/ceph-thrash/default.yaml").st_ino) 2023-10-06T04:50:51.801 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:51.954 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628585 2023-10-06T04:50:52.139 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:52.139 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:52.139 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:52.139 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:52.140 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides").st_ino) 2023-10-06T04:50:52.140 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:52.293 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628595 2023-10-06T04:50:52.477 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:52.478 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:52.478 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:52.478 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:52.478 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:50:52.478 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:52.630 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628599 2023-10-06T04:50:52.815 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:52.815 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:52.816 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:52.816 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:52.816 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/debug.yaml").st_ino) 2023-10-06T04:50:52.816 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:52.968 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628597 2023-10-06T04:50:53.153 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:53.153 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:53.153 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:53.153 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:53.153 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/+").st_ino) 2023-10-06T04:50:53.154 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:53.305 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628596 2023-10-06T04:50:53.490 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:53.491 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:53.491 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:53.491 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:53.491 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:50:53.491 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:53.643 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628598 2023-10-06T04:50:53.828 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:53.828 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:53.828 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:53.828 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:53.828 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/clusters").st_ino) 2023-10-06T04:50:53.828 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628586 2023-10-06T04:50:54.165 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:54.165 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:54.166 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:54.166 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:54.166 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/clusters/mds-1active-1standby.yaml").st_ino) 2023-10-06T04:50:54.166 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:54.317 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628587 2023-10-06T04:50:54.502 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:54.502 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:54.503 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:54.503 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:54.503 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/msgr-failures").st_ino) 2023-10-06T04:50:54.503 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:54.655 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628592 2023-10-06T04:50:54.840 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:54.840 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:54.840 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:54.840 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:54.840 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/msgr-failures/osd-mds-delay.yaml").st_ino) 2023-10-06T04:50:54.841 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:54.994 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627935 2023-10-06T04:50:55.179 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:55.179 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:55.179 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:55.179 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:55.179 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/msgr-failures/none.yaml").st_ino) 2023-10-06T04:50:55.179 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:55.332 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628593 2023-10-06T04:50:55.518 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:55.518 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:55.518 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:55.518 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:55.518 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/objectstore").st_ino) 2023-10-06T04:50:55.518 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:55.670 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628594 2023-10-06T04:50:55.856 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:55.856 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:55.856 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:55.856 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:55.856 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/fs").st_ino) 2023-10-06T04:50:55.856 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:56.010 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628588 2023-10-06T04:50:56.195 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:56.195 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:56.195 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:56.195 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:56.196 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/fs/xfs.yaml").st_ino) 2023-10-06T04:50:56.196 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:56.349 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628589 2023-10-06T04:50:56.534 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:56.534 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:56.534 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:56.534 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:56.534 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/mount").st_ino) 2023-10-06T04:50:56.535 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:56.687 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628590 2023-10-06T04:50:56.873 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:56.873 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:56.873 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:56.873 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:56.873 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/mount/fuse.yaml").st_ino) 2023-10-06T04:50:56.873 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:57.027 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628591 2023-10-06T04:50:57.212 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:57.212 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:57.212 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:57.212 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:57.212 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/begin.yaml").st_ino) 2023-10-06T04:50:57.212 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:57.365 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628583 2023-10-06T04:50:57.550 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:57.582 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:57.582 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:57.582 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:57.582 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/%").st_ino) 2023-10-06T04:50:57.582 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:57.702 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628582 2023-10-06T04:50:57.888 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:57.888 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:57.888 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:57.888 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:57.888 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks").st_ino) 2023-10-06T04:50:57.888 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:58.042 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628600 2023-10-06T04:50:58.252 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:58.252 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:58.252 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:58.252 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:58.252 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2023-10-06T04:50:58.252 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:58.405 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627936 2023-10-06T04:50:58.591 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:58.591 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:58.591 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:58.591 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:58.592 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_trivial_sync.yaml").st_ino) 2023-10-06T04:50:58.592 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:58.743 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628603 2023-10-06T04:50:58.927 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:58.927 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:58.928 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:58.928 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:58.928 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_snaptests.yaml").st_ino) 2023-10-06T04:50:58.928 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:59.079 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628601 2023-10-06T04:50:59.264 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:59.264 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:59.264 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:59.265 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:59.265 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:50:59.265 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:59.416 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628602 2023-10-06T04:50:59.602 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:59.602 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:59.602 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:59.602 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:59.602 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify").st_ino) 2023-10-06T04:50:59.602 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:50:59.754 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628626 2023-10-06T04:50:59.939 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:50:59.939 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:50:59.939 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:50:59.939 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:50:59.939 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/validater").st_ino) 2023-10-06T04:50:59.940 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:00.093 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628645 2023-10-06T04:51:00.278 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:00.278 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:00.278 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:00.278 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:00.278 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml").st_ino) 2023-10-06T04:51:00.278 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:00.431 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627938 2023-10-06T04:51:00.443 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:51:00.448 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:51:00.616 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:00.616 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:00.616 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:00.616 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:00.616 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/validater/lockdep.yaml").st_ino) 2023-10-06T04:51:00.616 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:00.730 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628646 2023-10-06T04:51:00.915 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:00.915 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:00.915 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:00.915 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:00.915 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides").st_ino) 2023-10-06T04:51:00.915 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:01.029 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628636 2023-10-06T04:51:01.214 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:01.214 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:01.214 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:01.214 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:01.214 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:51:01.214 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:01.367 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628640 2023-10-06T04:51:01.553 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:01.553 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:01.553 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:01.553 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:01.553 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/mon-debug.yaml").st_ino) 2023-10-06T04:51:01.553 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:01.706 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627937 2023-10-06T04:51:01.891 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:01.891 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:01.891 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:01.891 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:01.891 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/debug.yaml").st_ino) 2023-10-06T04:51:01.891 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:02.043 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628638 2023-10-06T04:51:02.228 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:02.228 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:02.228 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:02.228 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:02.229 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/+").st_ino) 2023-10-06T04:51:02.229 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:02.381 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628637 2023-10-06T04:51:02.566 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:02.567 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:02.567 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:02.567 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:02.567 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:51:02.567 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:02.719 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628639 2023-10-06T04:51:02.904 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:02.904 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:02.905 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:02.905 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:02.905 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/clusters").st_ino) 2023-10-06T04:51:02.905 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:03.056 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628629 2023-10-06T04:51:03.241 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:03.241 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:03.241 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:03.241 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:03.242 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/clusters/fixed-2-ucephfs.yaml").st_ino) 2023-10-06T04:51:03.242 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:03.396 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628630 2023-10-06T04:51:03.579 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:03.579 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:03.579 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:03.579 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:03.579 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/objectstore").st_ino) 2023-10-06T04:51:03.580 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:03.731 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628635 2023-10-06T04:51:03.917 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:03.917 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:03.917 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:03.917 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:03.918 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/fs").st_ino) 2023-10-06T04:51:03.918 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:04.071 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628631 2023-10-06T04:51:04.256 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:04.256 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:04.256 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:04.256 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:04.256 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/fs/xfs.yaml").st_ino) 2023-10-06T04:51:04.256 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:04.409 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628632 2023-10-06T04:51:04.594 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:04.594 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:04.594 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:04.594 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:04.595 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/mount").st_ino) 2023-10-06T04:51:04.595 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:04.746 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628633 2023-10-06T04:51:04.932 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:04.932 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:04.932 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:04.932 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:04.932 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/mount/fuse.yaml").st_ino) 2023-10-06T04:51:04.932 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:05.085 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628634 2023-10-06T04:51:05.272 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:05.272 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:05.272 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:05.272 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:05.272 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/begin.yaml").st_ino) 2023-10-06T04:51:05.272 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:05.425 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628628 2023-10-06T04:51:05.609 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:05.610 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:05.610 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:05.610 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:05.610 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/%").st_ino) 2023-10-06T04:51:05.610 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:05.762 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628627 2023-10-06T04:51:05.947 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:05.947 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:05.947 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:05.948 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:05.948 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks").st_ino) 2023-10-06T04:51:05.948 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:06.100 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628641 2023-10-06T04:51:06.284 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:06.302 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:06.303 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:06.303 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:06.303 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks/libcephfs_interface_tests.yaml").st_ino) 2023-10-06T04:51:06.303 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:06.438 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628644 2023-10-06T04:51:06.659 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:06.660 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:06.660 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:06.660 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:06.660 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:51:06.660 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:06.812 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628643 2023-10-06T04:51:06.997 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:06.997 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:06.997 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:06.997 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:06.998 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2023-10-06T04:51:06.998 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:07.151 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628642 2023-10-06T04:51:07.336 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:07.336 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:07.336 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:07.337 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:07.337 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient").st_ino) 2023-10-06T04:51:07.337 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:07.488 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628478 2023-10-06T04:51:07.673 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:07.673 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:07.674 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:07.674 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:07.674 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides").st_ino) 2023-10-06T04:51:07.674 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:07.826 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628489 2023-10-06T04:51:08.011 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:08.011 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:08.011 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:08.011 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:08.012 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2023-10-06T04:51:08.012 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:08.164 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628493 2023-10-06T04:51:08.349 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:08.349 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:08.349 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:08.349 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:08.350 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/debug.yaml").st_ino) 2023-10-06T04:51:08.350 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:08.501 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628491 2023-10-06T04:51:08.686 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:08.686 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:08.686 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:08.686 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:08.687 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/+").st_ino) 2023-10-06T04:51:08.687 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:08.839 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628490 2023-10-06T04:51:09.025 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:09.025 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:09.025 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:09.025 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:09.025 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/frag_enable.yaml").st_ino) 2023-10-06T04:51:09.025 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:09.178 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628492 2023-10-06T04:51:09.363 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:09.363 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:09.364 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:09.364 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:09.364 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/clusters").st_ino) 2023-10-06T04:51:09.364 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:09.515 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628481 2023-10-06T04:51:09.701 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:09.701 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:09.701 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:09.701 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:09.701 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/clusters/three_clients.yaml").st_ino) 2023-10-06T04:51:09.701 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:09.854 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628482 2023-10-06T04:51:10.039 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:10.040 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:10.040 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:10.040 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:10.040 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/clusters/two_clients.yaml").st_ino) 2023-10-06T04:51:10.040 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:10.192 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627911 2023-10-06T04:51:10.377 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:10.377 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:10.378 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:10.378 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:10.378 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/objectstore").st_ino) 2023-10-06T04:51:10.378 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:10.529 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628488 2023-10-06T04:51:10.715 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:10.715 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:10.715 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:10.715 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:10.715 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/fs").st_ino) 2023-10-06T04:51:10.715 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:10.869 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628483 2023-10-06T04:51:11.054 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:11.054 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:11.054 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:11.054 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:11.054 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/fs/xfs.yaml").st_ino) 2023-10-06T04:51:11.055 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:11.208 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628484 2023-10-06T04:51:11.393 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:11.393 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:11.394 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:11.394 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:11.394 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/mount").st_ino) 2023-10-06T04:51:11.394 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:11.546 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628485 2023-10-06T04:51:11.731 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:11.731 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:11.731 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:11.731 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:11.731 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/mount/fuse.yaml").st_ino) 2023-10-06T04:51:11.731 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:11.883 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628486 2023-10-06T04:51:12.068 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:12.068 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:12.069 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:12.069 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:12.069 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/mount/kclient.yaml.disabled").st_ino) 2023-10-06T04:51:12.069 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:12.221 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628487 2023-10-06T04:51:12.406 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:12.406 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:12.406 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:12.406 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:12.406 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/begin.yaml").st_ino) 2023-10-06T04:51:12.406 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:12.559 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628480 2023-10-06T04:51:12.743 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:12.744 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:12.744 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:12.744 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:12.744 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/%").st_ino) 2023-10-06T04:51:12.744 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:12.897 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628479 2023-10-06T04:51:13.081 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:13.081 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:13.082 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:13.082 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:13.082 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks").st_ino) 2023-10-06T04:51:13.082 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:13.234 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628494 2023-10-06T04:51:13.419 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:13.419 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:13.420 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:13.420 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:13.420 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/fsx-mpi.yaml.disabled").st_ino) 2023-10-06T04:51:13.420 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:13.572 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627912 2023-10-06T04:51:13.758 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:13.758 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:13.758 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:13.758 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:13.758 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/ior-shared-file.yaml").st_ino) 2023-10-06T04:51:13.758 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:13.911 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627913 2023-10-06T04:51:14.096 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:14.096 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:14.097 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:14.097 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:14.097 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/cephfs_misc_tests.yaml").st_ino) 2023-10-06T04:51:14.097 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:14.250 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628495 2023-10-06T04:51:14.435 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:14.435 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:14.435 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:14.435 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:14.436 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/mdtest.yaml").st_ino) 2023-10-06T04:51:14.436 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:14.588 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627914 2023-10-06T04:51:14.774 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:14.774 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:14.774 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:14.774 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:14.775 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk").st_ino) 2023-10-06T04:51:14.775 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:14.927 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628417 2023-10-06T04:51:15.113 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:15.113 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:15.113 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:15.113 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:15.113 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic").st_ino) 2023-10-06T04:51:15.113 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:15.266 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628418 2023-10-06T04:51:15.451 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:15.452 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:15.452 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:15.452 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:15.452 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/distros").st_ino) 2023-10-06T04:51:15.452 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:15.604 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628420 2023-10-06T04:51:15.789 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:15.789 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:15.789 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:15.789 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:15.790 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/%").st_ino) 2023-10-06T04:51:15.790 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:15.942 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628419 2023-10-06T04:51:16.127 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:16.127 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:16.128 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:16.128 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:16.128 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/tasks").st_ino) 2023-10-06T04:51:16.128 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:16.279 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628421 2023-10-06T04:51:16.465 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:16.466 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:16.466 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:16.466 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:16.466 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/tasks/ceph-disk.yaml").st_ino) 2023-10-06T04:51:16.466 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:16.617 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628422 2023-10-06T04:51:16.802 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:16.802 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:16.802 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:16.802 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:16.802 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd").st_ino) 2023-10-06T04:51:16.803 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:16.954 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628710 2023-10-06T04:51:17.140 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:17.140 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:17.140 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:17.140 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:17.140 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap").st_ino) 2023-10-06T04:51:17.141 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:17.294 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628751 2023-10-06T04:51:17.478 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:17.479 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:17.479 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:17.479 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:17.479 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/clusters").st_ino) 2023-10-06T04:51:17.479 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:17.632 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628755 2023-10-06T04:51:17.818 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:17.818 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:17.818 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:17.818 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:17.818 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/clusters/separate-client.yaml").st_ino) 2023-10-06T04:51:17.818 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:17.970 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628756 2023-10-06T04:51:18.155 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:18.155 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:18.156 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:18.156 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:18.156 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/ceph").st_ino) 2023-10-06T04:51:18.156 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:18.309 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628753 2023-10-06T04:51:18.494 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:18.494 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:18.494 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:18.494 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:18.494 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/ceph/ceph.yaml").st_ino) 2023-10-06T04:51:18.494 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:18.647 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628754 2023-10-06T04:51:18.831 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:18.832 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:18.832 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:18.832 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:18.832 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels").st_ino) 2023-10-06T04:51:18.832 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:18.984 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628757 2023-10-06T04:51:19.169 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:19.169 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:19.169 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:19.169 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:19.169 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels/pre-single-major.yaml").st_ino) 2023-10-06T04:51:19.170 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:19.322 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628758 2023-10-06T04:51:19.507 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:19.507 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:19.507 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:19.507 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:19.507 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-on.yaml").st_ino) 2023-10-06T04:51:19.508 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:19.660 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628010 2023-10-06T04:51:19.845 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:19.845 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:19.845 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:19.845 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:19.845 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-off.yaml").st_ino) 2023-10-06T04:51:19.845 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:19.998 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628009 2023-10-06T04:51:20.183 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:20.183 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:20.183 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:20.184 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:20.184 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/conf.yaml").st_ino) 2023-10-06T04:51:20.184 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:20.337 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628008 2023-10-06T04:51:20.522 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:20.522 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:20.522 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:20.522 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:20.522 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/%").st_ino) 2023-10-06T04:51:20.522 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:20.674 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628752 2023-10-06T04:51:20.859 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:20.859 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:20.859 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:20.859 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:20.860 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/xfs.yaml").st_ino) 2023-10-06T04:51:20.860 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:21.011 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628761 2023-10-06T04:51:21.197 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:21.197 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:21.198 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:21.198 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:21.198 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/tasks").st_ino) 2023-10-06T04:51:21.198 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:21.350 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628759 2023-10-06T04:51:21.536 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:21.536 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:21.536 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:21.536 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:21.536 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/tasks/unmap.yaml").st_ino) 2023-10-06T04:51:21.537 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:21.687 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628760 2023-10-06T04:51:21.872 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:21.872 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:21.872 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:21.873 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:21.873 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd").st_ino) 2023-10-06T04:51:21.873 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:22.026 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628723 2023-10-06T04:51:22.210 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:22.210 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:22.210 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:22.210 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:22.210 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/clusters").st_ino) 2023-10-06T04:51:22.210 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:22.363 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628725 2023-10-06T04:51:22.547 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:22.548 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:22.548 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:22.548 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:22.548 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:51:22.548 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:22.702 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628726 2023-10-06T04:51:22.888 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:22.888 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:22.888 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:22.888 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:22.888 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/msgr-failures").st_ino) 2023-10-06T04:51:22.888 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:23.041 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628729 2023-10-06T04:51:23.226 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:23.226 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:23.227 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:23.227 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:23.227 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/msgr-failures/many.yaml").st_ino) 2023-10-06T04:51:23.227 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:23.379 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627992 2023-10-06T04:51:23.564 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:23.565 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:23.565 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:23.565 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:23.565 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/msgr-failures/few.yaml").st_ino) 2023-10-06T04:51:23.565 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:23.717 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628730 2023-10-06T04:51:23.903 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:23.903 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:23.903 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:23.903 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:23.903 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/fs").st_ino) 2023-10-06T04:51:23.903 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:24.057 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628727 2023-10-06T04:51:24.243 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:24.243 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:24.243 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:24.243 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:24.243 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/fs/btrfs.yaml").st_ino) 2023-10-06T04:51:24.243 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:24.395 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628728 2023-10-06T04:51:24.580 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:24.580 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:24.580 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:24.581 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:24.581 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/conf.yaml").st_ino) 2023-10-06T04:51:24.581 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:24.733 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627991 2023-10-06T04:51:24.919 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:24.919 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:24.919 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:24.919 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:24.919 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/%").st_ino) 2023-10-06T04:51:24.919 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:25.071 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628724 2023-10-06T04:51:25.256 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:25.256 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:25.256 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:25.256 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:25.256 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks").st_ino) 2023-10-06T04:51:25.256 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:25.409 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628731 2023-10-06T04:51:25.595 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:25.595 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:25.595 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:25.595 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:25.595 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:51:25.595 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:25.748 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627996 2023-10-06T04:51:25.933 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:25.933 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:25.933 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:25.933 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:25.933 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_fio.yaml").st_ino) 2023-10-06T04:51:25.933 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:26.086 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628732 2023-10-06T04:51:26.271 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:26.271 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:26.271 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:26.271 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:26.272 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_ffsb.yaml").st_ino) 2023-10-06T04:51:26.272 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:26.425 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627995 2023-10-06T04:51:26.611 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:26.611 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:26.611 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:26.611 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:26.611 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_ext4.yaml").st_ino) 2023-10-06T04:51:26.612 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:26.764 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627998 2023-10-06T04:51:26.949 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:26.949 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:26.949 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:26.949 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:26.950 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_iozone.yaml").st_ino) 2023-10-06T04:51:26.950 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:27.102 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628000 2023-10-06T04:51:27.287 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:27.287 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:27.287 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:27.287 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:27.287 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_dbench.yaml").st_ino) 2023-10-06T04:51:27.287 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:27.442 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627994 2023-10-06T04:51:27.628 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:27.628 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:27.628 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:27.628 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:27.628 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_kernel_untar_build.yaml").st_ino) 2023-10-06T04:51:27.628 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:27.780 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627993 2023-10-06T04:51:27.966 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:27.966 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:27.966 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:27.967 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:27.967 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_trivial_sync.yaml").st_ino) 2023-10-06T04:51:27.967 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:28.120 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628001 2023-10-06T04:51:28.305 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:28.305 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:28.305 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:28.305 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:28.306 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_btrfs.yaml").st_ino) 2023-10-06T04:51:28.306 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:28.459 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627997 2023-10-06T04:51:28.644 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:28.645 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:28.645 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:28.645 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:28.645 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsx.yaml").st_ino) 2023-10-06T04:51:28.645 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:28.797 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627999 2023-10-06T04:51:28.982 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:28.982 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:28.983 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:28.983 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:28.983 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton").st_ino) 2023-10-06T04:51:28.983 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:29.135 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628733 2023-10-06T04:51:29.320 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:29.320 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:29.320 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:29.320 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:29.320 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/msgr-failures").st_ino) 2023-10-06T04:51:29.320 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:29.473 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628737 2023-10-06T04:51:29.658 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:29.658 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:29.658 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:29.658 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:29.658 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/msgr-failures/many.yaml").st_ino) 2023-10-06T04:51:29.658 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:29.810 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628003 2023-10-06T04:51:29.996 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:29.996 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:29.996 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:29.996 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:29.996 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/msgr-failures/few.yaml").st_ino) 2023-10-06T04:51:29.996 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:30.148 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628738 2023-10-06T04:51:30.333 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:30.334 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:30.334 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:30.334 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:30.334 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/fs").st_ino) 2023-10-06T04:51:30.334 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:30.485 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628735 2023-10-06T04:51:30.671 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:30.671 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:30.671 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:30.671 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:30.671 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/fs/btrfs.yaml").st_ino) 2023-10-06T04:51:30.671 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:30.824 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628736 2023-10-06T04:51:30.858 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:51:30.863 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:51:31.010 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:31.010 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:31.010 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:31.010 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:31.010 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/conf.yaml").st_ino) 2023-10-06T04:51:31.010 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:31.124 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628002 2023-10-06T04:51:31.309 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:31.309 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:31.309 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:31.309 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:31.309 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/%").st_ino) 2023-10-06T04:51:31.309 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:31.462 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628734 2023-10-06T04:51:31.647 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:31.647 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:31.647 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:31.648 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:31.648 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/tasks").st_ino) 2023-10-06T04:51:31.648 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:31.800 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628739 2023-10-06T04:51:31.985 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:31.985 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:31.985 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:31.986 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:31.986 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/tasks/rbd_xfstests.yaml").st_ino) 2023-10-06T04:51:31.986 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:32.138 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628740 2023-10-06T04:51:32.323 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:32.323 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:32.323 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:32.324 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:32.324 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount").st_ino) 2023-10-06T04:51:32.324 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:32.475 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628711 2023-10-06T04:51:32.661 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:32.661 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:32.661 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:32.661 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:32.661 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/install").st_ino) 2023-10-06T04:51:32.662 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:32.815 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628717 2023-10-06T04:51:33.000 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:33.000 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:33.001 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:33.001 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:33.001 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/install/ceph.yaml").st_ino) 2023-10-06T04:51:33.001 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:33.153 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628718 2023-10-06T04:51:33.338 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:33.338 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:33.338 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:33.338 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:33.338 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/clusters").st_ino) 2023-10-06T04:51:33.338 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:33.491 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628713 2023-10-06T04:51:33.676 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:33.676 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:33.676 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:33.676 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:33.677 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:51:33.677 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:33.830 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628714 2023-10-06T04:51:34.015 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:34.015 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:34.015 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:34.015 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:34.016 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures").st_ino) 2023-10-06T04:51:34.016 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:34.168 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628719 2023-10-06T04:51:34.353 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:34.353 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:34.353 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:34.353 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:34.353 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/many.yaml").st_ino) 2023-10-06T04:51:34.354 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:34.507 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627983 2023-10-06T04:51:34.692 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:34.692 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:34.692 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:34.693 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:34.693 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/few.yaml").st_ino) 2023-10-06T04:51:34.693 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:34.845 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628720 2023-10-06T04:51:35.030 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:35.030 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:35.030 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:35.030 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:35.030 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/fs").st_ino) 2023-10-06T04:51:35.030 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:35.184 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628715 2023-10-06T04:51:35.368 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:35.369 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:35.369 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:35.369 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:35.369 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/fs/btrfs.yaml").st_ino) 2023-10-06T04:51:35.369 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:35.523 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628716 2023-10-06T04:51:35.708 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:35.708 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:35.708 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:35.708 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:35.708 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/conf.yaml").st_ino) 2023-10-06T04:51:35.708 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:35.862 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627982 2023-10-06T04:51:36.046 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:36.046 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:36.046 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:36.046 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:36.046 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/%").st_ino) 2023-10-06T04:51:36.046 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:36.200 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628712 2023-10-06T04:51:36.386 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:36.386 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:36.386 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:36.386 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:36.386 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks").st_ino) 2023-10-06T04:51:36.386 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:36.539 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628721 2023-10-06T04:51:36.724 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:36.724 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:36.724 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:36.724 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:36.724 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_unmap.yaml").st_ino) 2023-10-06T04:51:36.724 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:36.877 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627989 2023-10-06T04:51:37.062 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:37.062 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:37.063 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:37.063 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:37.063 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kfsx.yaml").st_ino) 2023-10-06T04:51:37.063 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:37.216 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627987 2023-10-06T04:51:37.401 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:37.402 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:37.402 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:37.402 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:37.402 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_image_read.yaml").st_ino) 2023-10-06T04:51:37.402 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:37.554 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627985 2023-10-06T04:51:37.739 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:37.739 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:37.740 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:37.740 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:37.740 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_simple_big.yaml").st_ino) 2023-10-06T04:51:37.740 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:37.892 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627990 2023-10-06T04:51:38.078 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:38.078 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:38.078 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:38.078 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:38.078 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_concurrent.yaml").st_ino) 2023-10-06T04:51:38.078 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:38.232 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628722 2023-10-06T04:51:38.416 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:38.417 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:38.417 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:38.417 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:38.417 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_snapshot_io.yaml").st_ino) 2023-10-06T04:51:38.417 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:38.569 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627988 2023-10-06T04:51:38.754 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:38.754 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:38.755 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:38.755 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:38.755 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_huge_tickets.yaml").st_ino) 2023-10-06T04:51:38.755 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:38.908 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627984 2023-10-06T04:51:39.093 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:39.093 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:39.093 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:39.093 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:39.093 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kernel.yaml").st_ino) 2023-10-06T04:51:39.093 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:39.246 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627986 2023-10-06T04:51:39.432 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:39.432 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:39.432 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:39.432 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:39.432 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash").st_ino) 2023-10-06T04:51:39.432 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:39.585 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628741 2023-10-06T04:51:39.770 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:39.770 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:39.770 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:39.770 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:39.770 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/clusters").st_ino) 2023-10-06T04:51:39.770 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:39.922 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628743 2023-10-06T04:51:40.108 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:40.108 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:40.108 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:40.108 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:40.108 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:51:40.108 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:40.262 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628744 2023-10-06T04:51:40.447 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:40.447 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:40.447 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:40.447 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:40.448 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/fs").st_ino) 2023-10-06T04:51:40.448 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:40.600 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628745 2023-10-06T04:51:40.786 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:40.786 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:40.786 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:40.786 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:40.787 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/fs/btrfs.yaml").st_ino) 2023-10-06T04:51:40.787 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:40.938 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628746 2023-10-06T04:51:41.124 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:41.124 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:41.124 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:41.124 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:41.124 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads").st_ino) 2023-10-06T04:51:41.124 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:41.278 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628749 2023-10-06T04:51:41.463 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:41.463 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:41.463 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:41.463 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:41.463 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_fio.yaml").st_ino) 2023-10-06T04:51:41.463 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:41.616 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628750 2023-10-06T04:51:41.802 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:41.802 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:41.802 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:41.802 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:41.802 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_ffsb.yaml").st_ino) 2023-10-06T04:51:41.802 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:41.956 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628006 2023-10-06T04:51:42.140 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:42.140 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:42.140 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:42.141 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:42.141 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_iozone.yaml.disabled").st_ino) 2023-10-06T04:51:42.141 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:42.293 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628007 2023-10-06T04:51:42.478 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:42.478 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:42.478 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:42.478 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:42.478 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/conf.yaml").st_ino) 2023-10-06T04:51:42.478 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:42.630 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628004 2023-10-06T04:51:42.816 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:42.816 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:42.816 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:42.816 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:42.816 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/%").st_ino) 2023-10-06T04:51:42.817 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:42.969 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628742 2023-10-06T04:51:43.154 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:43.155 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:43.155 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:43.155 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:43.155 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/thrashers").st_ino) 2023-10-06T04:51:43.155 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:43.306 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628747 2023-10-06T04:51:43.492 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:43.492 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:43.492 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:43.492 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:43.492 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/thrashers/default.yaml").st_ino) 2023-10-06T04:51:43.492 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:43.645 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628748 2023-10-06T04:51:43.831 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:43.831 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:43.831 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:43.831 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:43.831 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/thrashers/mon-thrasher.yaml").st_ino) 2023-10-06T04:51:43.831 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:43.985 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628005 2023-10-06T04:51:44.170 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:44.170 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:44.170 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:44.170 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:44.170 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages").st_ino) 2023-10-06T04:51:44.171 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:44.323 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628374 2023-10-06T04:51:44.508 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:44.509 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:44.509 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:44.509 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:44.509 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests").st_ino) 2023-10-06T04:51:44.509 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:44.662 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628380 2023-10-06T04:51:44.847 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:44.847 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:44.847 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:44.847 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:44.847 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/distros").st_ino) 2023-10-06T04:51:44.848 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:45.001 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628382 2023-10-06T04:51:45.187 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:45.187 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:45.187 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:45.187 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:45.187 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/%").st_ino) 2023-10-06T04:51:45.187 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:45.341 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628381 2023-10-06T04:51:45.527 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:45.527 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:45.527 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:45.527 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:45.527 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/tasks").st_ino) 2023-10-06T04:51:45.528 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:45.680 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628383 2023-10-06T04:51:45.865 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:45.865 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:45.865 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:45.866 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:45.866 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/tasks/release.yaml").st_ino) 2023-10-06T04:51:45.866 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:46.020 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628384 2023-10-06T04:51:46.204 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:46.204 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:46.204 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:46.205 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:46.205 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any").st_ino) 2023-10-06T04:51:46.205 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:46.356 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628375 2023-10-06T04:51:46.543 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:46.543 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:46.543 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:46.543 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:46.543 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/distros").st_ino) 2023-10-06T04:51:46.543 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:46.694 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628377 2023-10-06T04:51:46.879 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:46.879 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:46.879 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:46.879 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:46.879 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/%").st_ino) 2023-10-06T04:51:46.879 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:47.031 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628376 2023-10-06T04:51:47.217 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:47.217 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:47.217 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:47.217 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:47.217 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/tasks").st_ino) 2023-10-06T04:51:47.217 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:47.370 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628378 2023-10-06T04:51:47.556 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:47.556 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:47.556 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:47.556 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:47.556 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/tasks/release.yaml").st_ino) 2023-10-06T04:51:47.556 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:47.708 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628379 2023-10-06T04:51:47.894 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:47.894 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:47.894 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:47.894 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:47.894 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados").st_ino) 2023-10-06T04:51:47.894 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:48.049 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629113 2023-10-06T04:51:48.234 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:48.234 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:48.234 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:48.234 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:48.234 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore").st_ino) 2023-10-06T04:51:48.234 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:48.387 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629163 2023-10-06T04:51:48.572 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:48.572 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:48.572 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:48.572 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:48.572 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent-aio-journal.yaml").st_ino) 2023-10-06T04:51:48.572 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:48.724 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628068 2023-10-06T04:51:48.910 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:48.910 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:48.910 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:48.910 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:48.911 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/ceph_objectstore_tool.yaml").st_ino) 2023-10-06T04:51:48.911 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:49.063 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628066 2023-10-06T04:51:49.249 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:49.249 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:49.249 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:49.249 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:49.249 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/fusestore.yaml").st_ino) 2023-10-06T04:51:49.249 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:49.405 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628070 2023-10-06T04:51:49.590 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:49.590 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:49.591 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:49.591 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:49.591 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/keyvaluedb.yaml").st_ino) 2023-10-06T04:51:49.591 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:49.743 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628071 2023-10-06T04:51:49.928 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:49.928 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:49.928 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:49.928 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:49.929 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/objectstore.yaml").st_ino) 2023-10-06T04:51:49.929 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:50.083 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628073 2023-10-06T04:51:50.268 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:50.268 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:50.268 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:50.268 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:50.269 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/alloc-hint.yaml").st_ino) 2023-10-06T04:51:50.269 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:50.422 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629164 2023-10-06T04:51:50.608 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:50.608 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:50.608 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:50.608 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:50.608 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/filejournal.yaml").st_ino) 2023-10-06T04:51:50.608 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:50.760 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628067 2023-10-06T04:51:50.945 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:50.946 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:50.946 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:50.946 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:50.946 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/objectcacher-stress.yaml").st_ino) 2023-10-06T04:51:50.946 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:51.098 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628072 2023-10-06T04:51:51.283 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:51.283 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:51.283 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:51.283 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:51.284 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent.yaml").st_ino) 2023-10-06T04:51:51.284 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:51.438 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628069 2023-10-06T04:51:51.624 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:51.624 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:51.624 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:51.624 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:51.624 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton").st_ino) 2023-10-06T04:51:51.624 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:51.777 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629170 2023-10-06T04:51:51.962 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:51.962 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:51.963 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:51.963 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:51.963 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr").st_ino) 2023-10-06T04:51:51.963 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:52.116 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629176 2023-10-06T04:51:52.301 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:52.302 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:52.302 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:52.302 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:52.302 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr-failures").st_ino) 2023-10-06T04:51:52.302 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:52.454 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629177 2023-10-06T04:51:52.639 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:52.639 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:52.639 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:52.639 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:52.639 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr-failures/many.yaml").st_ino) 2023-10-06T04:51:52.639 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:52.793 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628104 2023-10-06T04:51:52.978 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:52.978 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:52.978 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:52.978 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:52.978 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr-failures/few.yaml").st_ino) 2023-10-06T04:51:52.978 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:53.132 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629178 2023-10-06T04:51:53.317 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:53.317 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:53.317 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:53.318 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:53.318 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/objectstore").st_ino) 2023-10-06T04:51:53.318 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:53.469 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629179 2023-10-06T04:51:53.655 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:53.655 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:53.655 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:53.655 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:53.655 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/fs").st_ino) 2023-10-06T04:51:53.655 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629174 2023-10-06T04:51:53.994 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:53.994 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:53.994 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:53.994 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:53.995 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/fs/xfs.yaml").st_ino) 2023-10-06T04:51:53.995 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:54.148 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629175 2023-10-06T04:51:54.332 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:54.333 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:54.333 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:54.333 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:54.333 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/%").st_ino) 2023-10-06T04:51:54.333 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:54.485 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629171 2023-10-06T04:51:54.671 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:54.671 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:54.671 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:54.671 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:54.671 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all").st_ino) 2023-10-06T04:51:54.671 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:54.824 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629172 2023-10-06T04:51:55.010 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:55.010 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:55.010 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:55.010 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:55.010 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/divergent_priors.yaml").st_ino) 2023-10-06T04:51:55.010 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:55.163 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628081 2023-10-06T04:51:55.348 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:55.348 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:55.348 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:55.348 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:55.348 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/watch-notify-same-primary.yaml").st_ino) 2023-10-06T04:51:55.348 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:55.501 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628103 2023-10-06T04:51:55.686 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:55.686 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:55.686 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:55.686 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:55.687 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/ec-lost-unfound.yaml").st_ino) 2023-10-06T04:51:55.687 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:55.839 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628084 2023-10-06T04:51:56.024 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:56.024 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:56.024 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:56.024 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:56.025 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/rest-api.yaml").st_ino) 2023-10-06T04:51:56.025 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:56.177 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628099 2023-10-06T04:51:56.362 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:56.362 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:56.362 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:56.362 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:56.362 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/mon-config-keys.yaml").st_ino) 2023-10-06T04:51:56.362 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:56.515 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628087 2023-10-06T04:51:56.700 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:56.700 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:56.701 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:56.701 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:56.701 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/mon-thrasher.yaml").st_ino) 2023-10-06T04:51:56.701 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:56.854 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628089 2023-10-06T04:51:57.039 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:57.039 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:57.039 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:57.039 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:57.040 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/osd-recovery-incomplete.yaml").st_ino) 2023-10-06T04:51:57.040 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:57.193 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628091 2023-10-06T04:51:57.378 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:57.378 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:57.378 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:57.378 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:57.378 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/osd-recovery.yaml").st_ino) 2023-10-06T04:51:57.378 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:57.530 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628092 2023-10-06T04:51:57.716 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:57.716 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:57.716 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:57.716 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:57.716 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/admin-socket.yaml").st_ino) 2023-10-06T04:51:57.716 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:57.869 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629173 2023-10-06T04:51:58.054 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:58.055 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:58.055 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:58.055 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:58.055 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/reg11184.yaml").st_ino) 2023-10-06T04:51:58.055 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:58.207 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628097 2023-10-06T04:51:58.392 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:58.392 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:58.392 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:58.392 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:58.392 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/mon-seesaw.yaml").st_ino) 2023-10-06T04:51:58.392 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:58.545 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628088 2023-10-06T04:51:58.730 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:58.731 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:58.731 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:58.731 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:58.731 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/radostool.yaml").st_ino) 2023-10-06T04:51:58.731 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:58.883 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628095 2023-10-06T04:51:59.068 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:59.068 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:59.068 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:59.068 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:59.068 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/thrash_cache_writeback_proxy_none.yaml").st_ino) 2023-10-06T04:51:59.068 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:59.222 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628102 2023-10-06T04:51:59.407 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:59.407 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:59.407 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:59.407 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:59.407 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/dump-stuck.yaml").st_ino) 2023-10-06T04:51:59.407 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:59.560 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628083 2023-10-06T04:51:59.745 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:51:59.745 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:51:59.745 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:51:59.745 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:51:59.745 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/resolve_stuck_peering.yaml").st_ino) 2023-10-06T04:51:59.745 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:51:59.898 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628098 2023-10-06T04:52:00.083 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:00.083 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:00.083 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:00.084 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:00.084 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/osd-backfill.yaml").st_ino) 2023-10-06T04:52:00.084 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:00.237 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628090 2023-10-06T04:52:00.422 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:00.422 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:00.422 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:00.422 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:00.422 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/divergent_priors2.yaml").st_ino) 2023-10-06T04:52:00.422 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:00.575 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628082 2023-10-06T04:52:00.760 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:00.761 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:00.761 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:00.761 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:00.761 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/peer.yaml").st_ino) 2023-10-06T04:52:00.761 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:00.913 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628093 2023-10-06T04:52:00.970 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:52:00.977 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:52:01.098 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:01.098 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:01.098 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:01.098 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:01.098 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/test_envlibrados_for_rocksdb.yaml").st_ino) 2023-10-06T04:52:01.098 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:01.252 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628100 2023-10-06T04:52:01.438 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:01.438 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:01.438 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:01.438 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:01.438 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/thrash-rados.yaml").st_ino) 2023-10-06T04:52:01.438 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:01.591 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628101 2023-10-06T04:52:01.777 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:01.777 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:01.777 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:01.777 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:01.777 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/lost-unfound.yaml").st_ino) 2023-10-06T04:52:01.777 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:01.930 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628086 2023-10-06T04:52:02.115 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:02.115 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:02.116 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:02.116 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:02.116 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/cephtool.yaml").st_ino) 2023-10-06T04:52:02.116 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:02.268 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628080 2023-10-06T04:52:02.453 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:02.453 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:02.454 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:02.454 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:02.454 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/pg-removal-interruption.yaml").st_ino) 2023-10-06T04:52:02.454 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:02.605 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628094 2023-10-06T04:52:02.790 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:02.791 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:02.791 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:02.791 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:02.791 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/rebuild-mondb.yaml").st_ino) 2023-10-06T04:52:02.791 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:02.943 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628096 2023-10-06T04:52:03.128 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:03.128 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:03.128 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:03.128 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:03.128 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/lost-unfound-delete.yaml").st_ino) 2023-10-06T04:52:03.128 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:03.282 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628085 2023-10-06T04:52:03.467 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:03.467 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:03.467 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:03.467 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:03.467 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/rados.yaml").st_ino) 2023-10-06T04:52:03.467 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:03.619 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629180 2023-10-06T04:52:03.805 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:03.805 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:03.805 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:03.805 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:03.805 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic").st_ino) 2023-10-06T04:52:03.805 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:03.958 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629114 2023-10-06T04:52:04.144 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:04.144 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:04.144 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:04.144 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:04.144 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr").st_ino) 2023-10-06T04:52:04.144 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:04.298 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629125 2023-10-06T04:52:04.482 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:04.483 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:04.483 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:04.483 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:04.483 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr/async.yaml").st_ino) 2023-10-06T04:52:04.483 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:04.635 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629126 2023-10-06T04:52:04.820 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:04.820 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:04.820 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:04.821 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:04.821 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr/simple.yaml").st_ino) 2023-10-06T04:52:04.821 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:04.974 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628038 2023-10-06T04:52:05.159 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:05.159 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:05.159 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:05.159 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:05.159 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr/random.yaml").st_ino) 2023-10-06T04:52:05.160 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:05.313 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628037 2023-10-06T04:52:05.498 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:05.498 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:05.498 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:05.498 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:05.498 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters").st_ino) 2023-10-06T04:52:05.498 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:05.651 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629116 2023-10-06T04:52:05.835 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:05.836 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:05.836 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:05.836 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:05.836 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters/openstack.yaml").st_ino) 2023-10-06T04:52:05.836 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:05.989 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628035 2023-10-06T04:52:06.174 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:06.175 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:06.175 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:06.175 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:06.175 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters/fixed-2.yaml").st_ino) 2023-10-06T04:52:06.175 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:06.329 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629118 2023-10-06T04:52:07.165 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:07.165 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:07.165 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:07.165 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:07.165 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters/+").st_ino) 2023-10-06T04:52:07.165 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:07.323 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629117 2023-10-06T04:52:07.508 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:07.508 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:07.508 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:07.508 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:07.508 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr-failures").st_ino) 2023-10-06T04:52:07.508 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:07.660 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629123 2023-10-06T04:52:07.846 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:08.000 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:08.000 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:08.000 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:08.001 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr-failures/many.yaml").st_ino) 2023-10-06T04:52:08.001 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:08.115 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628036 2023-10-06T04:52:08.301 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:08.301 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:08.301 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:08.301 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:08.301 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr-failures/few.yaml").st_ino) 2023-10-06T04:52:08.301 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:08.454 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629124 2023-10-06T04:52:08.639 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:08.639 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:08.639 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:08.639 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:08.639 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/objectstore").st_ino) 2023-10-06T04:52:08.639 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:08.792 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629127 2023-10-06T04:52:08.977 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:08.977 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:08.977 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:08.977 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:08.977 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/fs").st_ino) 2023-10-06T04:52:08.978 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:09.130 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629119 2023-10-06T04:52:09.315 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:09.315 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:09.315 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:09.315 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:09.315 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/fs/btrfs.yaml").st_ino) 2023-10-06T04:52:09.316 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:09.469 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629120 2023-10-06T04:52:09.654 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:09.654 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:09.654 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:09.654 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:09.654 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/fs/xfs.yaml").st_ino) 2023-10-06T04:52:09.654 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:09.806 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629121 2023-10-06T04:52:09.991 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:09.992 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:09.992 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:09.992 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:09.992 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/%").st_ino) 2023-10-06T04:52:09.992 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:10.145 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629115 2023-10-06T04:52:10.330 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:10.330 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:10.330 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:10.330 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:10.330 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/mon_kv_backend").st_ino) 2023-10-06T04:52:10.330 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:10.483 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629122 2023-10-06T04:52:10.668 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:10.668 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:10.668 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:10.668 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:10.668 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks").st_ino) 2023-10-06T04:52:10.668 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:10.821 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629129 2023-10-06T04:52:11.006 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:11.007 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:11.007 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:11.007 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:11.007 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/readwrite.yaml").st_ino) 2023-10-06T04:52:11.007 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:11.159 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628046 2023-10-06T04:52:11.344 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:11.345 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:11.345 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:11.345 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:11.345 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_cls_all.yaml").st_ino) 2023-10-06T04:52:11.345 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:11.497 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628039 2023-10-06T04:52:11.682 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:11.682 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:11.683 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:11.683 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:11.683 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mostlyread.yaml").st_ino) 2023-10-06T04:52:11.683 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:11.835 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628045 2023-10-06T04:52:12.020 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:12.021 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:12.021 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:12.021 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:12.021 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_stress_watch.yaml").st_ino) 2023-10-06T04:52:12.021 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:12.174 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628041 2023-10-06T04:52:12.359 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:12.359 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:12.360 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:12.360 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:12.360 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_big.yaml").st_ino) 2023-10-06T04:52:12.360 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:12.512 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628043 2023-10-06T04:52:12.697 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:12.697 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:12.697 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:12.697 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:12.697 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/scrub_test.yaml").st_ino) 2023-10-06T04:52:12.697 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:12.850 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628049 2023-10-06T04:52:13.035 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:13.036 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:13.036 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:13.036 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:13.036 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mix.yaml").st_ino) 2023-10-06T04:52:13.036 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:13.189 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628044 2023-10-06T04:52:13.374 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:13.374 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:13.374 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:13.374 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:13.374 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_python.yaml").st_ino) 2023-10-06T04:52:13.375 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:13.528 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628040 2023-10-06T04:52:13.712 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:13.712 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:13.712 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:13.713 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:13.713 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/repair_test.yaml").st_ino) 2023-10-06T04:52:13.713 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:13.865 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628047 2023-10-06T04:52:14.050 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:14.050 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:14.051 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:14.051 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:14.051 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_api_tests.yaml").st_ino) 2023-10-06T04:52:14.051 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:14.204 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629130 2023-10-06T04:52:14.389 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:14.389 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:14.389 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:14.389 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:14.389 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rgw_snaps.yaml").st_ino) 2023-10-06T04:52:14.389 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:14.542 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628048 2023-10-06T04:52:14.727 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:14.727 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:14.727 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:14.727 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:14.728 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_striper.yaml").st_ino) 2023-10-06T04:52:14.728 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:14.879 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628042 2023-10-06T04:52:15.065 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:15.065 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:15.066 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:15.066 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:15.066 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/rados.yaml").st_ino) 2023-10-06T04:52:15.066 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:15.218 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629128 2023-10-06T04:52:15.403 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:15.404 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:15.404 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:15.404 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:15.404 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec").st_ino) 2023-10-06T04:52:15.404 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:15.556 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629208 2023-10-06T04:52:15.742 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:15.742 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:15.742 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:15.743 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:15.743 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/leveldb.yaml").st_ino) 2023-10-06T04:52:15.743 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:15.895 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629215 2023-10-06T04:52:16.080 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:16.080 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:16.080 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:16.080 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:16.080 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters").st_ino) 2023-10-06T04:52:16.080 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:16.233 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629210 2023-10-06T04:52:16.418 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:16.418 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:16.418 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:16.418 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:16.418 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/openstack.yaml").st_ino) 2023-10-06T04:52:16.418 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:16.571 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628111 2023-10-06T04:52:16.756 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:16.756 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:16.756 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:16.756 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:16.757 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/+").st_ino) 2023-10-06T04:52:16.757 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:16.909 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629211 2023-10-06T04:52:17.094 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:17.094 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:17.094 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:17.094 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:17.094 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/fixed-4.yaml").st_ino) 2023-10-06T04:52:17.095 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:17.248 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629212 2023-10-06T04:52:17.432 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:17.432 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:17.433 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:17.433 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:17.433 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/msgr-failures").st_ino) 2023-10-06T04:52:17.433 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:17.584 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629216 2023-10-06T04:52:17.770 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:17.770 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:17.771 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:17.771 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:17.771 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/objectstore").st_ino) 2023-10-06T04:52:17.771 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:17.923 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629217 2023-10-06T04:52:18.108 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:18.108 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:18.108 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:18.109 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:18.109 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs").st_ino) 2023-10-06T04:52:18.109 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:18.262 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629213 2023-10-06T04:52:18.447 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:18.447 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:18.448 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:18.448 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:18.448 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs/xfs.yaml").st_ino) 2023-10-06T04:52:18.448 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:18.600 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629214 2023-10-06T04:52:18.788 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:18.788 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:18.788 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:18.788 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:18.788 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads").st_ino) 2023-10-06T04:52:18.788 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:18.943 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629221 2023-10-06T04:52:19.128 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:19.128 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:19.129 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:19.129 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:19.129 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml").st_ino) 2023-10-06T04:52:19.129 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:19.282 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629222 2023-10-06T04:52:19.467 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:19.467 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:19.467 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:19.467 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:19.467 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/%").st_ino) 2023-10-06T04:52:19.468 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:19.620 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629209 2023-10-06T04:52:19.804 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:19.805 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:19.805 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:19.805 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:19.805 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers").st_ino) 2023-10-06T04:52:19.805 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:19.956 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629219 2023-10-06T04:52:20.141 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:20.142 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:20.142 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:20.142 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:20.142 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers/default.yaml").st_ino) 2023-10-06T04:52:20.142 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:20.294 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629220 2023-10-06T04:52:20.479 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:20.479 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:20.479 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:20.480 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:20.480 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/rados.yaml").st_ino) 2023-10-06T04:52:20.480 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:20.633 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629218 2023-10-06T04:52:20.818 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:20.818 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:20.818 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:20.818 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:20.818 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code").st_ino) 2023-10-06T04:52:20.818 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:20.972 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629223 2023-10-06T04:52:21.157 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:21.157 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:21.157 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:21.158 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:21.158 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fast").st_ino) 2023-10-06T04:52:21.158 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:21.310 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629226 2023-10-06T04:52:21.495 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:21.495 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:21.495 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:21.495 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:21.495 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/normal.yaml").st_ino) 2023-10-06T04:52:21.495 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:21.648 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628112 2023-10-06T04:52:21.833 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:21.833 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:21.833 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:21.833 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:21.833 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/fast.yaml").st_ino) 2023-10-06T04:52:21.833 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:21.986 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629227 2023-10-06T04:52:22.171 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:22.171 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:22.171 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:22.171 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:22.171 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/leveldb.yaml").st_ino) 2023-10-06T04:52:22.171 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:22.324 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629229 2023-10-06T04:52:22.509 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:22.509 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:22.509 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:22.509 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:22.510 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/clusters").st_ino) 2023-10-06T04:52:22.510 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:22.662 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629225 2023-10-06T04:52:22.847 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:22.847 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:22.847 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:22.847 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:22.847 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/msgr-failures").st_ino) 2023-10-06T04:52:22.847 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:23.001 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629230 2023-10-06T04:52:23.187 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:23.187 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:23.187 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:23.187 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:23.187 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/objectstore").st_ino) 2023-10-06T04:52:23.187 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:23.341 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629231 2023-10-06T04:52:23.527 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:23.527 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:23.527 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:23.527 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:23.528 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fs").st_ino) 2023-10-06T04:52:23.528 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:23.680 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629228 2023-10-06T04:52:23.865 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:23.865 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:23.866 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:23.866 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:23.866 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads").st_ino) 2023-10-06T04:52:23.866 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:24.019 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629235 2023-10-06T04:52:24.205 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:24.205 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:24.205 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:24.205 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:24.205 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read-overwrites.yaml").st_ino) 2023-10-06T04:52:24.205 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:24.359 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628118 2023-10-06T04:52:24.544 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:24.544 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:24.545 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:24.545 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:24.545 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-overwrites.yaml").st_ino) 2023-10-06T04:52:24.545 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:24.698 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628120 2023-10-06T04:52:24.882 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:24.883 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:24.883 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:24.883 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:24.883 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2023-10-06T04:52:24.883 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:25.035 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629238 2023-10-06T04:52:25.221 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:25.221 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:25.221 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:25.221 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:25.221 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-snaps-few-objects-overwrites.yaml").st_ino) 2023-10-06T04:52:25.221 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:25.375 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628122 2023-10-06T04:52:25.559 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:25.559 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:25.559 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:25.560 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:25.560 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-radosbench.yaml").st_ino) 2023-10-06T04:52:25.560 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:25.712 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628117 2023-10-06T04:52:25.896 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:25.897 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:25.897 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:25.897 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:25.897 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml").st_ino) 2023-10-06T04:52:25.897 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:26.050 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629237 2023-10-06T04:52:26.235 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:26.235 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:26.235 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:26.235 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:26.235 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects.yaml").st_ino) 2023-10-06T04:52:26.235 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:26.388 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628121 2023-10-06T04:52:26.574 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:26.574 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:26.574 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:26.574 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:26.574 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read.yaml").st_ino) 2023-10-06T04:52:26.574 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:26.726 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628119 2023-10-06T04:52:26.911 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:26.911 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:26.911 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:26.912 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:26.912 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-pool-snaps-few-objects-overwrites.yaml").st_ino) 2023-10-06T04:52:26.912 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:27.064 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629236 2023-10-06T04:52:27.249 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:27.249 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:27.249 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:27.249 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:27.249 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/%").st_ino) 2023-10-06T04:52:27.249 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:27.402 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629224 2023-10-06T04:52:27.588 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:27.588 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:27.588 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:27.588 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:27.588 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers").st_ino) 2023-10-06T04:52:27.588 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:27.741 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629233 2023-10-06T04:52:27.926 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:27.926 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:27.927 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:27.927 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:27.927 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/default.yaml").st_ino) 2023-10-06T04:52:27.927 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:28.080 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629234 2023-10-06T04:52:28.265 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:28.265 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:28.265 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:28.265 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:28.265 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/fastread.yaml").st_ino) 2023-10-06T04:52:28.265 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:28.418 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628113 2023-10-06T04:52:28.603 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:28.603 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:28.604 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:28.604 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:28.604 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/morepggrow.yaml").st_ino) 2023-10-06T04:52:28.604 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:28.755 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628115 2023-10-06T04:52:28.941 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:28.941 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:28.941 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:28.941 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:28.942 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/pggrow.yaml").st_ino) 2023-10-06T04:52:28.942 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:29.095 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628116 2023-10-06T04:52:29.280 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:29.281 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:29.281 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:29.281 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:29.281 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/mapgap.yaml").st_ino) 2023-10-06T04:52:29.281 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:29.439 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628114 2023-10-06T04:52:29.624 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:29.624 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:29.624 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:29.625 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:29.625 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/rados.yaml").st_ino) 2023-10-06T04:52:29.625 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:29.781 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629232 2023-10-06T04:52:29.966 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:29.966 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:29.966 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:29.966 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:29.966 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr").st_ino) 2023-10-06T04:52:29.967 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:30.119 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629165 2023-10-06T04:52:30.304 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:30.304 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:30.304 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:30.304 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:30.304 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/%").st_ino) 2023-10-06T04:52:30.305 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:30.458 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629166 2023-10-06T04:52:30.643 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:30.644 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:30.644 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:30.644 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:30.644 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all").st_ino) 2023-10-06T04:52:30.644 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:30.796 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629167 2023-10-06T04:52:30.980 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:30.981 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:30.981 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:30.981 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:30.981 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/multi-backfill-reject.yaml").st_ino) 2023-10-06T04:52:30.981 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:31.090 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:52:31.097 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:52:31.136 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628078 2023-10-06T04:52:31.319 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:31.319 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:31.319 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:31.319 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:31.319 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/full-tiering.yaml").st_ino) 2023-10-06T04:52:31.320 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:31.435 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628076 2023-10-06T04:52:31.620 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:31.620 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:31.620 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:31.620 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:31.620 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/cache-fs-trunc.yaml").st_ino) 2023-10-06T04:52:31.620 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:31.774 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629168 2023-10-06T04:52:31.959 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:31.959 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:31.959 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:31.959 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:31.959 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/msgr.yaml").st_ino) 2023-10-06T04:52:31.959 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:32.113 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628077 2023-10-06T04:52:32.297 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:32.297 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:32.297 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:32.298 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:32.298 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/ceph-post-file.yaml").st_ino) 2023-10-06T04:52:32.298 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:32.451 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628074 2023-10-06T04:52:32.636 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:32.637 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:32.637 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:32.637 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:32.637 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/export-after-evict.yaml").st_ino) 2023-10-06T04:52:32.637 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:32.788 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628075 2023-10-06T04:52:32.973 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:32.974 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:32.974 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:32.974 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:32.974 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/valgrind-leaks.yaml").st_ino) 2023-10-06T04:52:32.974 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:33.126 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628079 2023-10-06T04:52:33.312 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:33.312 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:33.312 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:33.312 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:33.312 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/rados.yaml").st_ino) 2023-10-06T04:52:33.313 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:33.466 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629169 2023-10-06T04:52:33.651 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:33.651 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:33.651 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:33.651 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:33.651 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade").st_ino) 2023-10-06T04:52:33.652 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:33.804 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629264 2023-10-06T04:52:33.989 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:33.989 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:33.990 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:33.990 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:33.990 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton").st_ino) 2023-10-06T04:52:33.990 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:34.144 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629265 2023-10-06T04:52:34.329 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:34.330 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:34.330 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:34.330 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:34.330 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon").st_ino) 2023-10-06T04:52:34.330 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:34.482 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629279 2023-10-06T04:52:34.667 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:34.667 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:34.668 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:34.668 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:34.668 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon/monb.yaml").st_ino) 2023-10-06T04:52:34.668 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:34.820 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629781 2023-10-06T04:52:35.005 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:35.005 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:35.006 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:35.006 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:35.006 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon").st_ino) 2023-10-06T04:52:35.006 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:35.157 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629282 2023-10-06T04:52:35.342 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:35.342 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:35.343 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:35.343 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:35.343 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon/monc.yaml").st_ino) 2023-10-06T04:52:35.343 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:35.495 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629283 2023-10-06T04:52:35.679 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:35.679 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:35.679 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:35.679 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:35.680 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install").st_ino) 2023-10-06T04:52:35.680 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:35.832 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629269 2023-10-06T04:52:36.017 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:36.017 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:36.018 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:36.018 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:36.018 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install/jewel.yaml").st_ino) 2023-10-06T04:52:36.018 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:36.170 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629270 2023-10-06T04:52:36.355 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:36.355 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:36.355 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:36.355 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:36.355 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload").st_ino) 2023-10-06T04:52:36.355 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:36.508 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629277 2023-10-06T04:52:36.692 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:36.693 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:36.693 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:36.693 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:36.693 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/readwrite.yaml").st_ino) 2023-10-06T04:52:36.693 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:36.846 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628146 2023-10-06T04:52:37.031 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:37.031 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:37.031 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:37.032 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:37.032 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/snaps-few-objects.yaml").st_ino) 2023-10-06T04:52:37.032 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:37.184 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628147 2023-10-06T04:52:37.369 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:37.369 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:37.370 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:37.370 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:37.370 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-cls.yaml").st_ino) 2023-10-06T04:52:37.370 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:37.522 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628144 2023-10-06T04:52:37.707 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:37.707 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:37.707 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:37.707 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:37.707 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-import-export.yaml").st_ino) 2023-10-06T04:52:37.708 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:37.859 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628145 2023-10-06T04:52:38.045 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:38.045 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:38.045 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:38.045 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:38.045 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/+").st_ino) 2023-10-06T04:52:38.046 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:38.198 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629278 2023-10-06T04:52:38.383 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:38.384 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:38.384 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:38.384 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:38.384 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon").st_ino) 2023-10-06T04:52:38.384 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:38.536 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629275 2023-10-06T04:52:38.721 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:38.721 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:38.721 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:38.721 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:38.721 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon/mona.yaml").st_ino) 2023-10-06T04:52:38.722 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:38.874 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629276 2023-10-06T04:52:39.059 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:39.060 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:39.060 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:39.060 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:39.060 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/%").st_ino) 2023-10-06T04:52:39.060 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:39.212 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629266 2023-10-06T04:52:39.398 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:39.398 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:39.398 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:39.398 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:39.398 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload").st_ino) 2023-10-06T04:52:39.398 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:39.551 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629284 2023-10-06T04:52:39.737 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:39.737 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:39.737 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:39.737 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:39.737 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rbd-python.yaml").st_ino) 2023-10-06T04:52:39.737 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:39.892 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628150 2023-10-06T04:52:40.077 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:40.077 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:40.077 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:40.077 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:40.077 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rgw-swift.yaml").st_ino) 2023-10-06T04:52:40.077 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:40.230 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628151 2023-10-06T04:52:40.416 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:40.416 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:40.416 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:40.416 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:40.416 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/snaps-many-objects.yaml").st_ino) 2023-10-06T04:52:40.416 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:40.569 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628152 2023-10-06T04:52:40.754 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:40.754 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:40.754 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:40.754 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:40.754 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/+").st_ino) 2023-10-06T04:52:40.754 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:40.907 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629285 2023-10-06T04:52:41.092 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:41.092 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:41.092 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:41.092 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:41.092 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade").st_ino) 2023-10-06T04:52:41.092 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:41.244 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629271 2023-10-06T04:52:41.430 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:41.430 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:41.430 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:41.430 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:41.430 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade/firsthalf.yaml").st_ino) 2023-10-06T04:52:41.431 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:41.582 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629272 2023-10-06T04:52:41.768 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:41.768 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:41.768 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:41.768 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:41.768 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash").st_ino) 2023-10-06T04:52:41.769 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:41.920 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629273 2023-10-06T04:52:42.105 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:42.106 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:42.106 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:42.106 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:42.106 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash/default.yaml").st_ino) 2023-10-06T04:52:42.106 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:42.257 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629274 2023-10-06T04:52:42.442 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:42.442 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:42.442 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:42.442 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:42.442 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload").st_ino) 2023-10-06T04:52:42.442 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:42.594 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629280 2023-10-06T04:52:42.780 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:42.780 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:42.781 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:42.781 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:42.781 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/radosbench.yaml").st_ino) 2023-10-06T04:52:42.781 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:42.933 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628148 2023-10-06T04:52:43.118 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:43.118 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:43.119 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:43.119 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:43.119 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/rbd_api.yaml").st_ino) 2023-10-06T04:52:43.119 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:43.270 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628149 2023-10-06T04:52:43.456 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:43.456 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:43.456 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:43.456 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:43.456 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/+").st_ino) 2023-10-06T04:52:43.456 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:43.609 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629281 2023-10-06T04:52:43.793 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:43.793 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:43.794 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:43.794 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:43.794 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster").st_ino) 2023-10-06T04:52:43.794 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:43.945 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629267 2023-10-06T04:52:44.131 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:44.131 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:44.131 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:44.131 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:44.131 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/openstack.yaml").st_ino) 2023-10-06T04:52:44.131 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:44.284 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628142 2023-10-06T04:52:44.469 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:44.469 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:44.470 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:44.470 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:44.470 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/+").st_ino) 2023-10-06T04:52:44.470 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:44.622 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629268 2023-10-06T04:52:44.808 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:44.808 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:44.808 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:44.808 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:44.808 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/start.yaml").st_ino) 2023-10-06T04:52:44.809 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:44.965 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628143 2023-10-06T04:52:45.149 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:45.150 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:45.150 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:45.150 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:45.150 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash").st_ino) 2023-10-06T04:52:45.150 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:45.304 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629131 2023-10-06T04:52:45.489 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:45.489 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:45.489 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:45.489 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:45.489 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr").st_ino) 2023-10-06T04:52:45.490 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:45.642 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629140 2023-10-06T04:52:45.827 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:45.827 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:45.827 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:45.827 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:45.827 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/clusters").st_ino) 2023-10-06T04:52:45.827 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:45.980 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629135 2023-10-06T04:52:46.166 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:46.166 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:46.166 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:46.166 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:46.166 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/clusters/3-mons.yaml").st_ino) 2023-10-06T04:52:46.166 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:46.320 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629136 2023-10-06T04:52:46.505 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:46.506 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:46.506 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:46.506 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:46.506 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/clusters/9-mons.yaml").st_ino) 2023-10-06T04:52:46.506 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:46.658 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628050 2023-10-06T04:52:46.843 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:46.843 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:46.843 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:46.843 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:46.843 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr-failures").st_ino) 2023-10-06T04:52:46.843 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:46.998 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629141 2023-10-06T04:52:47.184 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:47.184 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:47.185 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:47.185 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:47.185 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr-failures/mon-delay.yaml").st_ino) 2023-10-06T04:52:47.185 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:47.339 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628051 2023-10-06T04:52:47.524 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:47.524 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:47.524 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:47.524 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:47.524 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr-failures/few.yaml").st_ino) 2023-10-06T04:52:47.524 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:47.677 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629142 2023-10-06T04:52:47.862 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:47.863 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:47.863 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:47.863 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:47.863 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/objectstore").st_ino) 2023-10-06T04:52:47.863 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:48.016 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629143 2023-10-06T04:52:48.201 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:48.202 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:48.202 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:48.202 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:48.202 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/fs").st_ino) 2023-10-06T04:52:48.202 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:48.354 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629137 2023-10-06T04:52:48.539 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:48.540 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:48.540 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:48.540 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:48.540 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/fs/xfs.yaml").st_ino) 2023-10-06T04:52:48.540 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:48.693 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629138 2023-10-06T04:52:48.878 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:48.878 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:48.878 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:48.879 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:48.879 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads").st_ino) 2023-10-06T04:52:48.879 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:49.030 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629147 2023-10-06T04:52:49.215 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:49.215 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:49.216 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:49.216 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:49.216 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/pool-create-delete.yaml").st_ino) 2023-10-06T04:52:49.216 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:49.368 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629148 2023-10-06T04:52:49.552 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:49.553 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:49.553 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:49.553 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:49.553 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/snaps-few-objects.yaml").st_ino) 2023-10-06T04:52:49.553 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:49.704 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628059 2023-10-06T04:52:49.890 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:49.890 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:49.890 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:49.890 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:49.890 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/rados_mon_workunits.yaml").st_ino) 2023-10-06T04:52:49.890 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:50.044 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628058 2023-10-06T04:52:50.229 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:50.229 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:50.229 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:50.229 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:50.229 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/rados_5925.yaml").st_ino) 2023-10-06T04:52:50.229 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:50.383 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628056 2023-10-06T04:52:50.568 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:50.568 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:50.568 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:50.568 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:50.568 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/rados_api_tests.yaml").st_ino) 2023-10-06T04:52:50.568 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:50.720 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628057 2023-10-06T04:52:50.905 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:50.906 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:50.906 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:50.906 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:50.906 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/ceph").st_ino) 2023-10-06T04:52:50.906 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:51.058 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629133 2023-10-06T04:52:51.244 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:51.244 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:51.244 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:51.244 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:51.244 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/ceph/ceph.yaml").st_ino) 2023-10-06T04:52:51.244 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:51.398 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629134 2023-10-06T04:52:51.583 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:51.583 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:51.583 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:51.583 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:51.583 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/%").st_ino) 2023-10-06T04:52:51.583 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:51.736 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629132 2023-10-06T04:52:51.921 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:51.921 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:51.921 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:51.921 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:51.921 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/mon_kv_backend").st_ino) 2023-10-06T04:52:51.921 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:52.074 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629139 2023-10-06T04:52:52.260 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:52.260 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:52.260 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:52.260 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:52.260 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers").st_ino) 2023-10-06T04:52:52.260 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:52.412 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629145 2023-10-06T04:52:52.597 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:52.597 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:52.597 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:52.597 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:52.597 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/many.yaml").st_ino) 2023-10-06T04:52:52.597 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:52.751 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628052 2023-10-06T04:52:52.936 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:52.936 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:52.936 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:52.936 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:52.936 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/one.yaml").st_ino) 2023-10-06T04:52:52.937 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:53.089 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628053 2023-10-06T04:52:53.274 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:53.274 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:53.275 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:53.275 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:53.275 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/sync.yaml").st_ino) 2023-10-06T04:52:53.275 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:53.427 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628055 2023-10-06T04:52:53.612 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:53.612 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:53.613 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:53.613 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:53.613 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/sync-many.yaml").st_ino) 2023-10-06T04:52:53.613 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:53.765 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628054 2023-10-06T04:52:53.950 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:53.951 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:53.951 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:53.951 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:53.951 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/force-sync-many.yaml").st_ino) 2023-10-06T04:52:53.951 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:54.105 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629146 2023-10-06T04:52:54.290 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:54.290 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:54.290 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:54.291 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:54.291 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/rados.yaml").st_ino) 2023-10-06T04:52:54.291 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:54.444 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629144 2023-10-06T04:52:54.629 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:54.629 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:54.629 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:54.629 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:54.630 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash").st_ino) 2023-10-06T04:52:54.630 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:54.782 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629239 2023-10-06T04:52:54.967 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:54.967 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:54.967 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:54.967 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:54.967 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr").st_ino) 2023-10-06T04:52:54.968 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:55.120 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629254 2023-10-06T04:52:55.306 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:55.306 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:55.306 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:55.307 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:55.307 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters").st_ino) 2023-10-06T04:52:55.307 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:55.464 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629248 2023-10-06T04:52:55.650 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:55.650 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:55.650 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:55.650 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:55.650 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters/openstack.yaml").st_ino) 2023-10-06T04:52:55.650 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:55.804 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628123 2023-10-06T04:52:55.988 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:55.988 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:55.988 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:55.989 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:55.989 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters/fixed-2.yaml").st_ino) 2023-10-06T04:52:55.989 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:56.143 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629250 2023-10-06T04:52:56.328 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:56.328 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:56.328 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:56.328 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:56.328 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters/+").st_ino) 2023-10-06T04:52:56.329 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:56.480 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629249 2023-10-06T04:52:56.666 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:56.666 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:56.666 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:56.666 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:56.666 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides").st_ino) 2023-10-06T04:52:56.666 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:56.819 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629245 2023-10-06T04:52:57.004 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:57.004 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:57.004 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:57.005 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:57.005 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/normal_pg_log.yaml").st_ino) 2023-10-06T04:52:57.005 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:57.157 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629246 2023-10-06T04:52:57.342 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:57.342 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:57.342 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:57.343 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:57.343 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/short_pg_log.yaml").st_ino) 2023-10-06T04:52:57.343 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:57.495 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629247 2023-10-06T04:52:57.681 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:57.681 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:57.681 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:57.681 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:57.681 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures").st_ino) 2023-10-06T04:52:57.681 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:57.834 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629255 2023-10-06T04:52:58.019 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:58.019 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:58.019 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:58.019 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:58.019 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures/few.yaml").st_ino) 2023-10-06T04:52:58.019 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:58.173 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628125 2023-10-06T04:52:58.357 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:58.357 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:58.357 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:58.357 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:58.357 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures/fastclose.yaml").st_ino) 2023-10-06T04:52:58.358 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:58.510 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629256 2023-10-06T04:52:58.695 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:58.695 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:58.695 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:58.695 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:58.695 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures/osd-delay.yaml").st_ino) 2023-10-06T04:52:58.695 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:58.848 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628126 2023-10-06T04:52:59.032 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:59.033 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:59.033 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:59.033 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:59.033 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides").st_ino) 2023-10-06T04:52:59.033 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:59.184 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629241 2023-10-06T04:52:59.370 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:59.370 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:59.370 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:59.370 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:59.370 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/3-size-2-min-size.yaml").st_ino) 2023-10-06T04:52:59.370 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:59.524 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629244 2023-10-06T04:52:59.709 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:52:59.709 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:52:59.709 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:52:59.709 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:52:59.709 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-2-min-size.yaml").st_ino) 2023-10-06T04:52:59.709 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:52:59.862 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629243 2023-10-06T04:53:00.047 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:00.047 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:00.047 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:00.047 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:00.047 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-1-min-size.yaml").st_ino) 2023-10-06T04:53:00.047 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:00.200 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629242 2023-10-06T04:53:00.385 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:00.386 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:00.386 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:00.386 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:00.386 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/objectstore").st_ino) 2023-10-06T04:53:00.386 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:00.538 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629257 2023-10-06T04:53:00.723 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:00.723 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:00.723 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:00.724 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:00.724 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/fs").st_ino) 2023-10-06T04:53:00.724 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:00.876 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629251 2023-10-06T04:53:01.061 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:01.062 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:01.062 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:01.062 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:01.062 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/fs/btrfs.yaml").st_ino) 2023-10-06T04:53:01.062 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:01.204 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:53:01.209 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:53:01.214 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629252 2023-10-06T04:53:01.398 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:01.398 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:01.398 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:01.398 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:01.398 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/fs/xfs.yaml").st_ino) 2023-10-06T04:53:01.399 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:01.512 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629253 2023-10-06T04:53:01.696 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:01.696 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:01.697 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:01.697 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:01.697 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads").st_ino) 2023-10-06T04:53:01.697 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:01.849 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629262 2023-10-06T04:53:02.033 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:02.034 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:02.034 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:02.034 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:02.034 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/radosbench.yaml").st_ino) 2023-10-06T04:53:02.034 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:02.186 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628138 2023-10-06T04:53:02.372 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:02.372 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:02.372 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:02.372 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:02.372 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-big.yaml").st_ino) 2023-10-06T04:53:02.372 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:02.525 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628130 2023-10-06T04:53:02.711 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:02.711 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:02.711 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:02.711 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:02.711 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache.yaml").st_ino) 2023-10-06T04:53:02.711 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:02.865 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628135 2023-10-06T04:53:03.050 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:03.050 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:03.051 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:03.051 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:03.051 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-small.yaml").st_ino) 2023-10-06T04:53:03.051 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:03.203 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628131 2023-10-06T04:53:03.388 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:03.388 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:03.388 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:03.388 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:03.388 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/snaps-few-objects.yaml").st_ino) 2023-10-06T04:53:03.388 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:03.540 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628140 2023-10-06T04:53:03.725 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:03.726 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:03.726 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:03.726 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:03.726 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/write_fadvise_dontneed.yaml").st_ino) 2023-10-06T04:53:03.726 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:03.878 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628141 2023-10-06T04:53:04.063 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:04.063 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:04.063 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:04.064 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:04.064 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps.yaml").st_ino) 2023-10-06T04:53:04.064 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:04.217 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628133 2023-10-06T04:53:04.403 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:04.403 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:04.403 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:04.403 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:04.403 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/admin_socket_objecter_requests.yaml").st_ino) 2023-10-06T04:53:04.403 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:04.555 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629263 2023-10-06T04:53:04.741 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:04.741 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:04.741 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:04.741 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:04.741 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps-readproxy.yaml").st_ino) 2023-10-06T04:53:04.741 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:04.894 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628132 2023-10-06T04:53:05.079 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:05.080 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:05.080 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:05.080 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:05.080 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-snaps.yaml").st_ino) 2023-10-06T04:53:05.080 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:05.233 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628134 2023-10-06T04:53:05.419 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:05.419 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:05.419 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:05.419 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:05.419 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/pool-snaps-few-objects.yaml").st_ino) 2023-10-06T04:53:05.419 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:05.574 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628136 2023-10-06T04:53:05.759 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:05.759 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:05.759 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:05.759 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:05.759 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/rados_api_tests.yaml").st_ino) 2023-10-06T04:53:05.759 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:05.912 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628137 2023-10-06T04:53:06.098 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:06.098 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:06.098 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:06.098 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:06.098 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/small-objects.yaml").st_ino) 2023-10-06T04:53:06.098 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:06.250 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628139 2023-10-06T04:53:06.436 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:06.436 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:06.436 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:06.436 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:06.436 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/hobj-sort.yaml").st_ino) 2023-10-06T04:53:06.436 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:06.589 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628124 2023-10-06T04:53:06.774 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:06.774 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:06.774 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:06.774 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:06.774 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/%").st_ino) 2023-10-06T04:53:06.775 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:06.927 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629240 2023-10-06T04:53:07.113 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:07.113 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:07.114 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:07.114 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:07.114 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers").st_ino) 2023-10-06T04:53:07.114 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:07.267 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629260 2023-10-06T04:53:07.452 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:07.452 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:07.452 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:07.452 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:07.452 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/default.yaml").st_ino) 2023-10-06T04:53:07.453 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:07.606 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629261 2023-10-06T04:53:07.791 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:07.791 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:07.791 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:07.791 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:07.791 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/morepggrow.yaml").st_ino) 2023-10-06T04:53:07.791 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:07.945 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628128 2023-10-06T04:53:08.130 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:08.131 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:08.131 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:08.131 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:08.131 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/pggrow.yaml").st_ino) 2023-10-06T04:53:08.131 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:08.283 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628129 2023-10-06T04:53:08.469 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:08.469 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:08.469 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:08.469 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:08.469 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/mapgap.yaml").st_ino) 2023-10-06T04:53:08.469 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:08.622 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628127 2023-10-06T04:53:08.807 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:08.807 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:08.807 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:08.808 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:08.808 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/rocksdb.yaml").st_ino) 2023-10-06T04:53:08.808 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:08.959 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629259 2023-10-06T04:53:09.144 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:09.144 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:09.144 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:09.144 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:09.144 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/rados.yaml").st_ino) 2023-10-06T04:53:09.144 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:09.297 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629258 2023-10-06T04:53:09.482 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:09.482 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:09.482 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:09.482 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:09.483 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify").st_ino) 2023-10-06T04:53:09.483 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:09.635 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629286 2023-10-06T04:53:09.820 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:09.820 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:09.820 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:09.821 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:09.821 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/msgr").st_ino) 2023-10-06T04:53:09.821 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:09.973 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629296 2023-10-06T04:53:10.158 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:10.158 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:10.158 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:10.158 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:10.159 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/validater").st_ino) 2023-10-06T04:53:10.159 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:10.311 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629303 2023-10-06T04:53:10.496 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:10.496 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:10.496 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:10.497 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:10.497 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/validater/valgrind.yaml").st_ino) 2023-10-06T04:53:10.497 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:10.659 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628157 2023-10-06T04:53:10.844 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:10.845 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:10.845 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:10.845 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:10.845 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/validater/lockdep.yaml").st_ino) 2023-10-06T04:53:10.845 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:11.001 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629304 2023-10-06T04:53:11.187 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:11.187 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:11.187 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:11.187 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:11.187 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters").st_ino) 2023-10-06T04:53:11.187 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:11.341 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629290 2023-10-06T04:53:11.525 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:11.526 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:11.526 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:11.526 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:11.526 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters/openstack.yaml").st_ino) 2023-10-06T04:53:11.526 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:11.678 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628154 2023-10-06T04:53:11.863 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:11.863 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:11.863 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:11.863 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:11.864 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters/fixed-2.yaml").st_ino) 2023-10-06T04:53:11.864 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:12.017 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629292 2023-10-06T04:53:12.203 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:12.203 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:12.203 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:12.203 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:12.203 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters/+").st_ino) 2023-10-06T04:53:12.203 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:12.356 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629291 2023-10-06T04:53:12.541 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:12.542 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:12.542 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:12.542 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:12.542 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/msgr-failures").st_ino) 2023-10-06T04:53:12.542 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:12.694 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629297 2023-10-06T04:53:12.879 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:12.879 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:12.879 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:12.879 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:12.879 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/msgr-failures/few.yaml").st_ino) 2023-10-06T04:53:12.879 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:13.032 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629298 2023-10-06T04:53:13.218 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:13.218 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:13.218 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:13.218 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:13.218 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/objectstore").st_ino) 2023-10-06T04:53:13.218 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:13.372 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629299 2023-10-06T04:53:13.557 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:13.557 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:13.557 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:13.557 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:13.557 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/fs").st_ino) 2023-10-06T04:53:13.557 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:13.710 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629293 2023-10-06T04:53:13.895 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:13.895 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:13.896 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:13.896 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:13.896 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/fs/btrfs.yaml").st_ino) 2023-10-06T04:53:13.896 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:14.050 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629294 2023-10-06T04:53:14.234 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:14.234 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:14.234 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:14.234 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:14.235 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/1thrash").st_ino) 2023-10-06T04:53:14.235 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:14.386 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629288 2023-10-06T04:53:14.572 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:14.572 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:14.572 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:14.572 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:14.572 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/1thrash/default.yaml").st_ino) 2023-10-06T04:53:14.572 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:14.725 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629289 2023-10-06T04:53:14.910 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:14.910 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:14.910 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:14.910 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:14.910 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/1thrash/none.yaml").st_ino) 2023-10-06T04:53:14.911 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:15.063 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628153 2023-10-06T04:53:15.247 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:15.248 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:15.248 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:15.248 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:15.248 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/%").st_ino) 2023-10-06T04:53:15.248 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:15.400 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629287 2023-10-06T04:53:15.586 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:15.586 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:15.586 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:15.586 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:15.586 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/mon_kv_backend").st_ino) 2023-10-06T04:53:15.586 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:15.738 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629295 2023-10-06T04:53:15.923 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:15.923 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:15.923 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:15.924 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:15.924 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks").st_ino) 2023-10-06T04:53:15.924 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:16.077 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629301 2023-10-06T04:53:16.261 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:16.261 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:16.262 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:16.262 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:16.262 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks/rados_cls_all.yaml").st_ino) 2023-10-06T04:53:16.262 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:16.413 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628156 2023-10-06T04:53:16.599 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:16.599 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:16.599 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:16.599 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:16.599 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks/mon_recovery.yaml").st_ino) 2023-10-06T04:53:16.599 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:16.752 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629302 2023-10-06T04:53:16.938 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:16.938 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:16.938 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:16.938 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:16.938 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks/rados_api_tests.yaml").st_ino) 2023-10-06T04:53:16.939 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:17.091 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628155 2023-10-06T04:53:17.277 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:17.277 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:17.277 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:17.277 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:17.277 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/rados.yaml").st_ino) 2023-10-06T04:53:17.277 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:17.429 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629300 2023-10-06T04:53:17.614 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:17.615 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:17.615 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:17.615 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:17.615 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon").st_ino) 2023-10-06T04:53:17.615 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:17.767 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629149 2023-10-06T04:53:17.952 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:17.952 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:17.952 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:17.952 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:17.952 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr").st_ino) 2023-10-06T04:53:17.953 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:18.105 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629156 2023-10-06T04:53:18.291 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:18.291 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:18.291 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:18.291 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:18.291 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters").st_ino) 2023-10-06T04:53:18.291 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:18.446 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629151 2023-10-06T04:53:18.630 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:18.630 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:18.630 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:18.631 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:18.631 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/21.yaml").st_ino) 2023-10-06T04:53:18.631 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:18.783 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629152 2023-10-06T04:53:18.968 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:18.968 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:18.968 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:18.969 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:18.969 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/9.yaml").st_ino) 2023-10-06T04:53:18.969 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:19.122 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628062 2023-10-06T04:53:19.307 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:19.307 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:19.308 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:19.308 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:19.308 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/3.yaml").st_ino) 2023-10-06T04:53:19.308 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:19.462 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628060 2023-10-06T04:53:19.647 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:19.648 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:19.648 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:19.648 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:19.648 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/6.yaml").st_ino) 2023-10-06T04:53:19.648 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:19.800 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628061 2023-10-06T04:53:19.985 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:19.985 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:19.986 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:19.986 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:19.986 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr-failures").st_ino) 2023-10-06T04:53:19.986 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:20.139 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629157 2023-10-06T04:53:20.324 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:20.324 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:20.325 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:20.325 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:20.325 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr-failures/many.yaml").st_ino) 2023-10-06T04:53:20.325 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:20.477 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628063 2023-10-06T04:53:20.662 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:20.662 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:20.662 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:20.663 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:20.663 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr-failures/few.yaml").st_ino) 2023-10-06T04:53:20.663 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:20.815 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629158 2023-10-06T04:53:21.000 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:21.000 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:21.000 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:21.000 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:21.001 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/objectstore").st_ino) 2023-10-06T04:53:21.001 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:21.154 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629159 2023-10-06T04:53:21.339 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:21.339 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:21.339 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:21.339 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:21.339 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/fs").st_ino) 2023-10-06T04:53:21.339 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:21.491 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629153 2023-10-06T04:53:21.676 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:21.676 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:21.676 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:21.677 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:21.677 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/fs/xfs.yaml").st_ino) 2023-10-06T04:53:21.677 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:21.829 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629154 2023-10-06T04:53:22.014 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:22.014 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:22.015 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:22.015 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:22.015 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/%").st_ino) 2023-10-06T04:53:22.015 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:22.170 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629150 2023-10-06T04:53:22.355 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:22.355 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:22.355 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:22.355 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:22.355 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/mon_kv_backend").st_ino) 2023-10-06T04:53:22.355 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:22.510 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629155 2023-10-06T04:53:22.694 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:22.694 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:22.694 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:22.694 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:22.694 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks").st_ino) 2023-10-06T04:53:22.694 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:22.847 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629161 2023-10-06T04:53:23.032 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:23.033 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:23.033 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:23.033 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:23.033 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_with_skews.yaml").st_ino) 2023-10-06T04:53:23.033 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:23.185 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628064 2023-10-06T04:53:23.371 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:23.371 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:23.371 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:23.371 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:23.371 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks/mon_recovery.yaml").st_ino) 2023-10-06T04:53:23.371 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:23.524 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628065 2023-10-06T04:53:23.712 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:23.713 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:23.713 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:23.713 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:23.713 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_no_skews.yaml").st_ino) 2023-10-06T04:53:23.713 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:23.865 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629162 2023-10-06T04:53:24.051 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:24.051 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:24.051 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:24.051 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:24.052 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/rados.yaml").st_ino) 2023-10-06T04:53:24.052 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:24.205 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629160 2023-10-06T04:53:24.391 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:24.391 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:24.391 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:24.391 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:24.391 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa").st_ino) 2023-10-06T04:53:24.391 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:24.544 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629194 2023-10-06T04:53:24.729 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:24.729 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:24.729 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:24.729 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:24.729 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/leveldb.yaml").st_ino) 2023-10-06T04:53:24.730 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:24.882 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629200 2023-10-06T04:53:25.067 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:25.067 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:25.067 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:25.068 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:25.068 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/clusters").st_ino) 2023-10-06T04:53:25.068 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:25.220 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629198 2023-10-06T04:53:25.405 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:25.405 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:25.405 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:25.405 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:25.405 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/msgr-failures").st_ino) 2023-10-06T04:53:25.405 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:25.558 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629201 2023-10-06T04:53:25.744 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:25.744 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:25.744 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:25.744 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:25.744 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/objectstore").st_ino) 2023-10-06T04:53:25.744 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:25.897 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629202 2023-10-06T04:53:26.083 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:26.474 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:26.474 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:26.474 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:26.474 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/supported").st_ino) 2023-10-06T04:53:26.474 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:26.590 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629204 2023-10-06T04:53:26.775 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:26.775 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:26.776 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:26.776 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:26.776 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/fs").st_ino) 2023-10-06T04:53:26.776 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:26.928 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629199 2023-10-06T04:53:27.114 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:27.114 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:27.114 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:27.114 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:27.115 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads").st_ino) 2023-10-06T04:53:27.115 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:27.267 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629206 2023-10-06T04:53:27.452 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:27.452 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:27.452 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:27.452 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:27.452 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads/ec-rados-plugin=isa-k=2-m=1.yaml").st_ino) 2023-10-06T04:53:27.452 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:27.605 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629207 2023-10-06T04:53:27.790 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:27.790 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:27.790 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:27.790 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:27.790 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch").st_ino) 2023-10-06T04:53:27.791 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:27.942 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629196 2023-10-06T04:53:28.128 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:28.128 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:28.128 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:28.128 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:28.128 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch/x86_64.yaml").st_ino) 2023-10-06T04:53:28.128 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:28.281 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629197 2023-10-06T04:53:28.467 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:28.467 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:28.467 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:28.467 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:28.467 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/%").st_ino) 2023-10-06T04:53:28.467 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:28.619 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629195 2023-10-06T04:53:28.804 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:28.805 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:28.805 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:28.805 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:28.805 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/thrashers").st_ino) 2023-10-06T04:53:28.805 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:28.957 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629205 2023-10-06T04:53:29.142 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:29.142 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:29.142 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:29.142 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:29.142 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/rados.yaml").st_ino) 2023-10-06T04:53:29.143 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:29.295 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629203 2023-10-06T04:53:29.480 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:29.480 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:29.481 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:29.481 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:29.481 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big").st_ino) 2023-10-06T04:53:29.481 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:29.634 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629181 2023-10-06T04:53:29.819 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:29.819 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:29.819 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:29.819 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:29.819 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster").st_ino) 2023-10-06T04:53:29.819 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:29.972 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629183 2023-10-06T04:53:30.158 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:30.158 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:30.158 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:30.158 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:30.158 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/openstack.yaml").st_ino) 2023-10-06T04:53:30.158 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:30.312 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628106 2023-10-06T04:53:30.497 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:30.497 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:30.497 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:30.498 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:30.498 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/12-osds.yaml").st_ino) 2023-10-06T04:53:30.498 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:30.649 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628105 2023-10-06T04:53:30.834 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:30.834 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:30.834 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:30.834 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:30.834 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/+").st_ino) 2023-10-06T04:53:30.834 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:30.987 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629184 2023-10-06T04:53:31.173 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:31.173 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:31.173 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:31.173 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:31.173 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/leveldb.yaml").st_ino) 2023-10-06T04:53:31.173 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:31.318 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:53:31.323 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:53:31.326 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629186 2023-10-06T04:53:31.511 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:31.511 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:31.511 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:31.511 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:31.511 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/msgr-failures").st_ino) 2023-10-06T04:53:31.511 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:31.624 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629187 2023-10-06T04:53:31.810 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:31.810 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:31.810 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:31.810 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:31.810 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/objectstore").st_ino) 2023-10-06T04:53:31.810 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:31.963 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629188 2023-10-06T04:53:32.150 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:32.150 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:32.150 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:32.150 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:32.151 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/fs").st_ino) 2023-10-06T04:53:32.151 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:32.302 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629185 2023-10-06T04:53:32.488 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:32.490 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:32.490 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:32.490 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:32.490 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads").st_ino) 2023-10-06T04:53:32.490 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:32.642 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629192 2023-10-06T04:53:32.827 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:32.827 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:32.827 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:32.827 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:32.827 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml").st_ino) 2023-10-06T04:53:32.827 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:32.980 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629193 2023-10-06T04:53:33.165 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:33.165 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:33.165 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:33.166 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:33.166 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/%").st_ino) 2023-10-06T04:53:33.166 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:33.318 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629182 2023-10-06T04:53:33.503 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:33.503 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:33.503 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:33.503 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:33.503 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers").st_ino) 2023-10-06T04:53:33.504 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:33.656 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629190 2023-10-06T04:53:33.841 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:33.841 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:33.841 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:33.842 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:33.842 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/default.yaml").st_ino) 2023-10-06T04:53:33.842 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:33.995 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629191 2023-10-06T04:53:34.179 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:34.179 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:34.180 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:34.180 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:34.180 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/fastread.yaml").st_ino) 2023-10-06T04:53:34.180 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:34.332 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628107 2023-10-06T04:53:34.517 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:34.517 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:34.517 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:34.517 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:34.518 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/morepggrow.yaml").st_ino) 2023-10-06T04:53:34.518 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:34.669 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628109 2023-10-06T04:53:34.855 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:34.855 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:34.856 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:34.856 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:34.856 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/pggrow.yaml").st_ino) 2023-10-06T04:53:34.856 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:35.010 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628110 2023-10-06T04:53:35.195 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:35.195 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:35.195 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:35.195 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:35.195 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/mapgap.yaml").st_ino) 2023-10-06T04:53:35.195 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:35.348 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628108 2023-10-06T04:53:35.534 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:35.534 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:35.534 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:35.534 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:35.534 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/rados.yaml").st_ino) 2023-10-06T04:53:35.535 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:35.687 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629189 2023-10-06T04:53:35.872 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:35.872 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:35.872 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:35.872 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:35.872 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs").st_ino) 2023-10-06T04:53:35.872 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:36.026 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628697 2023-10-06T04:53:36.211 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:36.211 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:36.211 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:36.212 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:36.212 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic").st_ino) 2023-10-06T04:53:36.212 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:36.364 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628698 2023-10-06T04:53:36.549 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:36.550 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:36.550 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:36.550 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:36.550 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/clusters").st_ino) 2023-10-06T04:53:36.550 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:36.703 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628702 2023-10-06T04:53:36.887 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:36.887 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:36.887 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:36.888 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:36.888 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/clusters/extra-client.yaml").st_ino) 2023-10-06T04:53:36.888 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:37.040 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628703 2023-10-06T04:53:37.226 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:37.227 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:37.227 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:37.227 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:37.227 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/fs").st_ino) 2023-10-06T04:53:37.227 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:37.380 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628704 2023-10-06T04:53:37.565 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:37.566 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:37.566 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:37.566 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:37.566 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/fs/xfs.yaml").st_ino) 2023-10-06T04:53:37.566 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:37.719 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628705 2023-10-06T04:53:37.904 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:37.904 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:37.904 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:37.904 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:37.904 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/mount").st_ino) 2023-10-06T04:53:37.904 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:38.057 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628706 2023-10-06T04:53:38.242 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:38.242 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:38.242 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:38.242 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:38.242 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/mount/v4.yaml").st_ino) 2023-10-06T04:53:38.242 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:38.395 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627975 2023-10-06T04:53:38.580 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:38.580 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:38.580 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:38.581 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:38.581 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/mount/v3.yaml").st_ino) 2023-10-06T04:53:38.581 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:38.733 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628707 2023-10-06T04:53:38.918 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:38.918 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:38.918 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:38.918 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:38.918 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/ceph").st_ino) 2023-10-06T04:53:38.918 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:39.071 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628700 2023-10-06T04:53:39.256 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:39.256 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:39.257 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:39.257 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:39.257 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/ceph/base.yaml").st_ino) 2023-10-06T04:53:39.257 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:39.409 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628701 2023-10-06T04:53:39.594 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:39.594 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:39.595 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:39.595 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:39.595 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/%").st_ino) 2023-10-06T04:53:39.595 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:39.747 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628699 2023-10-06T04:53:39.932 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:39.932 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:39.932 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:39.932 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:39.933 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks").st_ino) 2023-10-06T04:53:39.933 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:40.085 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628708 2023-10-06T04:53:40.271 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:40.271 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:40.271 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:40.271 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:40.271 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_dbench.yaml").st_ino) 2023-10-06T04:53:40.271 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:40.424 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627978 2023-10-06T04:53:40.609 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:40.609 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:40.609 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:40.609 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:40.609 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs-workunit-kernel-untar-build.yaml").st_ino) 2023-10-06T04:53:40.609 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:40.761 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628709 2023-10-06T04:53:40.947 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:40.947 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:40.947 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:40.947 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:40.947 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_ffsb.yaml").st_ino) 2023-10-06T04:53:40.947 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:41.101 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627979 2023-10-06T04:53:41.287 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:41.287 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:41.287 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:41.287 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:41.287 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_blogbench.yaml").st_ino) 2023-10-06T04:53:41.287 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:41.441 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627977 2023-10-06T04:53:41.625 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:41.626 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:41.626 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:41.626 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:41.626 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_misc.yaml").st_ino) 2023-10-06T04:53:41.626 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:41.781 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627976 2023-10-06T04:53:41.965 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:41.966 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:41.966 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:41.966 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:41.966 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:53:41.966 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:42.120 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627980 2023-10-06T04:53:42.304 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:42.304 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:42.304 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:42.305 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:42.305 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_iozone.yaml").st_ino) 2023-10-06T04:53:42.305 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:42.458 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627981 2023-10-06T04:53:42.644 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:42.644 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:42.644 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:42.644 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:42.644 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental").st_ino) 2023-10-06T04:53:42.644 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:42.796 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628427 2023-10-06T04:53:42.982 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:42.982 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:42.982 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:42.983 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:42.983 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds").st_ino) 2023-10-06T04:53:42.983 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:43.135 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628428 2023-10-06T04:53:43.320 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:43.320 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:43.320 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:43.320 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:43.321 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/clusters").st_ino) 2023-10-06T04:53:43.321 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:43.474 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628430 2023-10-06T04:53:43.659 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:43.659 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:43.659 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:43.659 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:43.659 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/clusters/7-multimds.yaml").st_ino) 2023-10-06T04:53:43.660 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:43.812 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628431 2023-10-06T04:53:43.997 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:43.997 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:43.997 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:43.997 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:43.998 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/%").st_ino) 2023-10-06T04:53:43.998 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:44.151 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628429 2023-10-06T04:53:44.336 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:44.336 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:44.336 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:44.336 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:44.336 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/tasks").st_ino) 2023-10-06T04:53:44.337 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:44.489 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628432 2023-10-06T04:53:44.674 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:44.674 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:44.674 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:44.674 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:44.674 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/tasks/fsstress_thrash_subtrees.yaml").st_ino) 2023-10-06T04:53:44.674 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:44.826 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628433 2023-10-06T04:53:45.012 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:45.012 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:45.012 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:45.012 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:45.012 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal").st_ino) 2023-10-06T04:53:45.012 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:45.165 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628762 2023-10-06T04:53:45.350 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:45.350 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:45.350 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:45.351 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:45.351 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc").st_ino) 2023-10-06T04:53:45.351 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:45.502 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628771 2023-10-06T04:53:45.687 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:45.688 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:45.688 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:45.688 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:45.688 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/clusters").st_ino) 2023-10-06T04:53:45.688 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:45.839 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628773 2023-10-06T04:53:46.025 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:46.025 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:46.025 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:46.025 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:46.025 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/clusters/two_clients.yaml").st_ino) 2023-10-06T04:53:46.025 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:46.178 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628774 2023-10-06T04:53:46.363 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:46.363 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:46.364 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:46.364 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:46.364 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/fs").st_ino) 2023-10-06T04:53:46.364 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:46.516 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628775 2023-10-06T04:53:46.701 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:46.701 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:46.701 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:46.701 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:46.702 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/fs/btrfs.yaml").st_ino) 2023-10-06T04:53:46.702 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:46.854 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628776 2023-10-06T04:53:47.039 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:47.039 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:47.039 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:47.039 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:47.039 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/%").st_ino) 2023-10-06T04:53:47.039 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:47.194 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628772 2023-10-06T04:53:47.378 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:47.378 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:47.378 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:47.378 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:47.378 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/tasks").st_ino) 2023-10-06T04:53:47.378 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:47.531 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628777 2023-10-06T04:53:47.716 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:47.716 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:47.716 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:47.716 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:47.716 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/tasks/locktest.yaml").st_ino) 2023-10-06T04:53:47.716 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:47.870 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628778 2023-10-06T04:53:48.055 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:48.055 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:48.055 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:48.055 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:48.055 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic").st_ino) 2023-10-06T04:53:48.055 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:48.208 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628763 2023-10-06T04:53:48.393 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:48.393 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:48.393 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:48.394 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:48.394 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/clusters").st_ino) 2023-10-06T04:53:48.394 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:48.545 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628765 2023-10-06T04:53:48.731 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:48.731 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:48.731 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:48.731 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:48.732 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:53:48.732 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:48.884 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628766 2023-10-06T04:53:49.070 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:49.070 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:49.070 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:49.070 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:49.070 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/fs").st_ino) 2023-10-06T04:53:49.071 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:49.223 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628767 2023-10-06T04:53:49.408 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:49.409 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:49.409 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:49.409 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:49.409 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/fs/btrfs.yaml").st_ino) 2023-10-06T04:53:49.409 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:49.562 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628768 2023-10-06T04:53:49.746 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:49.746 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:49.746 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:49.746 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:49.746 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/%").st_ino) 2023-10-06T04:53:49.746 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:49.900 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628764 2023-10-06T04:53:50.085 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:50.085 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:50.085 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:50.085 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:50.085 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/tasks").st_ino) 2023-10-06T04:53:50.085 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:50.239 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628769 2023-10-06T04:53:50.424 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:50.424 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:50.424 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:50.424 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:50.424 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_blogbench.yaml").st_ino) 2023-10-06T04:53:50.424 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:50.577 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628770 2023-10-06T04:53:50.762 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:50.762 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:50.762 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:50.762 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:50.762 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_fsx.yaml").st_ino) 2023-10-06T04:53:50.762 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:50.915 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628011 2023-10-06T04:53:51.100 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:51.101 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:51.101 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:51.101 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:51.101 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart").st_ino) 2023-10-06T04:53:51.101 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:51.253 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628779 2023-10-06T04:53:51.439 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:51.439 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:51.439 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:51.439 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:51.439 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/clusters").st_ino) 2023-10-06T04:53:51.439 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:51.593 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628781 2023-10-06T04:53:51.778 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:51.778 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:51.778 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:51.778 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:51.778 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/clusters/one_mds.yaml").st_ino) 2023-10-06T04:53:51.778 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:51.932 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628782 2023-10-06T04:53:52.117 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:52.117 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:52.117 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:52.117 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:52.117 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/%").st_ino) 2023-10-06T04:53:52.118 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:52.273 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628780 2023-10-06T04:53:52.458 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:52.458 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:52.458 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:52.458 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:52.458 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/tasks").st_ino) 2023-10-06T04:53:52.459 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:52.612 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628783 2023-10-06T04:53:52.797 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:52.797 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:52.797 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:52.797 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:52.797 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/tasks/restart-workunit-backtraces.yaml").st_ino) 2023-10-06T04:53:52.797 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:52.951 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628784 2023-10-06T04:53:53.136 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:53.136 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:53.136 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:53.136 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:53.136 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds").st_ino) 2023-10-06T04:53:53.136 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:53.290 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628785 2023-10-06T04:53:53.475 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:53.475 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:53.475 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:53.475 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:53.475 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/clusters").st_ino) 2023-10-06T04:53:53.476 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:53.628 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628787 2023-10-06T04:53:53.814 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:53.814 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:53.814 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:53.814 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:53.814 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-3-mds.yaml").st_ino) 2023-10-06T04:53:53.815 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628788 2023-10-06T04:53:54.152 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:54.152 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:54.153 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:54.153 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:54.153 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-9-mds.yaml").st_ino) 2023-10-06T04:53:54.153 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:54.305 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628012 2023-10-06T04:53:54.489 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:54.489 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:54.490 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:54.490 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:54.490 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/fs").st_ino) 2023-10-06T04:53:54.490 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:54.642 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628789 2023-10-06T04:53:54.828 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:54.828 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:54.828 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:54.828 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:54.828 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/fs/btrfs.yaml").st_ino) 2023-10-06T04:53:54.828 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:54.982 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628790 2023-10-06T04:53:55.166 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:55.166 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:55.167 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:55.167 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:55.167 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/%").st_ino) 2023-10-06T04:53:55.167 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:55.318 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628786 2023-10-06T04:53:55.503 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:55.504 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:55.504 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:55.504 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:55.504 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/mounts").st_ino) 2023-10-06T04:53:55.504 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:55.655 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628791 2023-10-06T04:53:55.840 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:55.840 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:55.840 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:55.841 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:55.841 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/mounts/ceph-fuse.yaml").st_ino) 2023-10-06T04:53:55.841 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:55.993 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628792 2023-10-06T04:53:56.178 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:56.179 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:56.179 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:56.179 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:56.179 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/mounts/kclient.yaml").st_ino) 2023-10-06T04:53:56.179 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:56.330 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628013 2023-10-06T04:53:56.517 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:56.518 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:56.518 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:56.518 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:56.518 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks").st_ino) 2023-10-06T04:53:56.518 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:56.669 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628793 2023-10-06T04:53:56.854 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:56.854 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:56.854 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:56.854 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:56.854 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_pjd.yaml").st_ino) 2023-10-06T04:53:56.854 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:57.007 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628018 2023-10-06T04:53:57.192 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:57.192 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:57.192 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:57.192 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:57.192 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:53:57.193 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:57.345 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628016 2023-10-06T04:53:57.531 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:57.531 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:57.531 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:57.531 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:57.531 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_truncate_delay.yaml").st_ino) 2023-10-06T04:53:57.531 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:57.683 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628019 2023-10-06T04:53:57.869 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:57.870 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:57.870 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:57.870 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:57.870 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_misc.yaml").st_ino) 2023-10-06T04:53:57.870 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:58.022 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628794 2023-10-06T04:53:58.208 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:58.208 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:58.208 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:58.208 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:58.208 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_blogbench.yaml").st_ino) 2023-10-06T04:53:58.208 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:58.363 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628014 2023-10-06T04:53:58.549 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:58.549 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:58.549 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:58.549 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:58.549 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsync.yaml").st_ino) 2023-10-06T04:53:58.549 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:58.701 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628017 2023-10-06T04:53:58.887 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:58.887 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:58.887 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:58.887 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:58.887 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_dbench.yaml").st_ino) 2023-10-06T04:53:58.887 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:59.040 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628015 2023-10-06T04:53:59.226 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:59.226 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:59.226 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:59.227 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:59.227 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/thrash").st_ino) 2023-10-06T04:53:59.227 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:59.379 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628795 2023-10-06T04:53:59.564 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:59.565 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:59.565 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:59.565 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:59.565 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/thrash/normal.yaml").st_ino) 2023-10-06T04:53:59.565 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:53:59.717 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628020 2023-10-06T04:53:59.902 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:53:59.902 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:53:59.902 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:53:59.902 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:53:59.902 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/thrash/exports.yaml").st_ino) 2023-10-06T04:53:59.902 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:00.054 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628796 2023-10-06T04:54:00.240 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:00.240 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:00.240 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:00.240 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:00.240 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs").st_ino) 2023-10-06T04:54:00.240 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:00.394 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628655 2023-10-06T04:54:00.580 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:00.581 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:00.581 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:00.581 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:00.581 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs").st_ino) 2023-10-06T04:54:00.581 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:00.734 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628656 2023-10-06T04:54:00.919 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:00.919 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:00.920 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:00.920 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:00.920 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/clusters").st_ino) 2023-10-06T04:54:00.920 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:01.073 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628658 2023-10-06T04:54:01.258 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:01.258 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:01.258 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:01.258 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:01.258 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/clusters/fixed-3-cephfs.yaml").st_ino) 2023-10-06T04:54:01.258 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:01.411 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628659 2023-10-06T04:54:01.432 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:54:01.436 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:54:01.597 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:01.597 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:01.597 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:01.597 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:01.597 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/fs").st_ino) 2023-10-06T04:54:01.597 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:01.709 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628660 2023-10-06T04:54:01.894 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:01.894 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:01.894 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:01.895 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:01.895 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/fs/xfs.yaml").st_ino) 2023-10-06T04:54:01.895 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:02.048 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628661 2023-10-06T04:54:02.234 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:02.234 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:02.235 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:02.235 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:02.235 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/inline").st_ino) 2023-10-06T04:54:02.235 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:02.388 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628662 2023-10-06T04:54:02.573 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:02.573 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:02.573 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:02.573 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:02.573 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/inline/yes.yaml").st_ino) 2023-10-06T04:54:02.573 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:02.734 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627942 2023-10-06T04:54:02.919 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:02.919 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:02.919 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:02.919 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:02.919 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/inline/no.yaml").st_ino) 2023-10-06T04:54:02.919 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:03.073 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628663 2023-10-06T04:54:03.258 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:03.258 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:03.258 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:03.258 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:03.258 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/conf.yaml").st_ino) 2023-10-06T04:54:03.258 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:03.411 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627941 2023-10-06T04:54:03.597 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:03.597 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:03.597 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:03.597 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:03.597 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/%").st_ino) 2023-10-06T04:54:03.597 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:03.750 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628657 2023-10-06T04:54:03.935 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:03.935 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:03.935 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:03.935 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:03.935 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks").st_ino) 2023-10-06T04:54:03.935 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:04.090 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628664 2023-10-06T04:54:04.275 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:04.275 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:04.275 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:04.275 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:04.275 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_misc.yaml").st_ino) 2023-10-06T04:54:04.275 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:04.431 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627944 2023-10-06T04:54:04.616 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:04.616 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:04.616 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:04.616 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:04.616 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:54:04.616 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:04.768 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627949 2023-10-06T04:54:04.954 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:04.954 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:04.954 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:04.954 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:04.954 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_trivial_sync.yaml").st_ino) 2023-10-06T04:54:04.954 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:05.107 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627954 2023-10-06T04:54:05.292 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:05.292 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:05.293 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:05.293 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:05.293 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_snaps.yaml").st_ino) 2023-10-06T04:54:05.293 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:05.444 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627946 2023-10-06T04:54:05.629 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:05.630 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:05.630 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:05.630 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:05.630 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_direct_io.yaml").st_ino) 2023-10-06T04:54:05.630 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:05.783 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628665 2023-10-06T04:54:05.968 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:05.968 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:05.968 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:05.968 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:05.969 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsx.yaml").st_ino) 2023-10-06T04:54:05.969 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:06.122 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627950 2023-10-06T04:54:06.307 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:06.307 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:06.308 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:06.308 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:06.308 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_kernel_untar_build.yaml").st_ino) 2023-10-06T04:54:06.308 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:06.462 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627943 2023-10-06T04:54:06.647 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:06.647 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:06.647 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:06.647 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:06.647 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_ffsb.yaml").st_ino) 2023-10-06T04:54:06.647 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:06.801 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627948 2023-10-06T04:54:06.986 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:06.987 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:06.987 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:06.987 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:06.988 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_dbench.yaml").st_ino) 2023-10-06T04:54:06.988 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:07.139 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627947 2023-10-06T04:54:07.324 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:07.324 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:07.325 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:07.325 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:07.325 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsync.yaml").st_ino) 2023-10-06T04:54:07.325 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:07.479 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627951 2023-10-06T04:54:07.664 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:07.664 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:07.664 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:07.664 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:07.665 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_pjd.yaml").st_ino) 2023-10-06T04:54:07.665 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:07.817 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627953 2023-10-06T04:54:08.001 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:08.002 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:08.002 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:08.002 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:08.002 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_iozone.yaml").st_ino) 2023-10-06T04:54:08.002 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:08.154 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627952 2023-10-06T04:54:08.339 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:08.339 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:08.339 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:08.339 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:08.339 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_o_trunc.yaml").st_ino) 2023-10-06T04:54:08.339 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:08.492 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627945 2023-10-06T04:54:08.678 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:08.678 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:08.678 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:08.678 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:08.678 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients").st_ino) 2023-10-06T04:54:08.678 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:08.831 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628666 2023-10-06T04:54:09.016 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:09.016 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:09.016 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:09.016 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:09.016 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters").st_ino) 2023-10-06T04:54:09.017 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:09.169 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628668 2023-10-06T04:54:09.354 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:09.355 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:09.355 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:09.355 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:09.355 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters/2-clients.yaml").st_ino) 2023-10-06T04:54:09.355 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:09.506 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628669 2023-10-06T04:54:09.691 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:09.691 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:09.691 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:09.692 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:09.692 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/fs").st_ino) 2023-10-06T04:54:09.692 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:09.843 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628670 2023-10-06T04:54:10.029 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:10.029 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:10.029 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:10.029 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:10.029 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/fs/xfs.yaml").st_ino) 2023-10-06T04:54:10.030 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:10.181 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628671 2023-10-06T04:54:10.367 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:10.367 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:10.367 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:10.367 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:10.367 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/conf.yaml").st_ino) 2023-10-06T04:54:10.367 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:10.519 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627955 2023-10-06T04:54:10.705 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:10.706 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:10.706 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:10.706 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:10.706 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/%").st_ino) 2023-10-06T04:54:10.706 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:10.859 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628667 2023-10-06T04:54:11.044 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:11.044 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:11.044 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:11.045 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:11.045 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks").st_ino) 2023-10-06T04:54:11.045 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:11.197 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628672 2023-10-06T04:54:11.383 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:11.383 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:11.383 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:11.383 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:11.384 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml").st_ino) 2023-10-06T04:54:11.384 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:11.537 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627956 2023-10-06T04:54:11.722 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:11.722 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:11.722 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:11.722 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:11.722 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_dbench_iozone.yaml").st_ino) 2023-10-06T04:54:11.722 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:11.875 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628673 2023-10-06T04:54:12.060 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:12.061 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:12.061 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:12.061 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:12.061 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery").st_ino) 2023-10-06T04:54:12.061 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:12.213 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628674 2023-10-06T04:54:12.398 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:12.398 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:12.398 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:12.399 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:12.399 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/dirfrag").st_ino) 2023-10-06T04:54:12.399 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:12.551 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628680 2023-10-06T04:54:12.737 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:12.737 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:12.737 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:12.737 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:12.737 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/dirfrag/frag_enable.yaml").st_ino) 2023-10-06T04:54:12.737 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:12.890 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628681 2023-10-06T04:54:13.076 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:13.076 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:13.076 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:13.076 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:13.076 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/clusters").st_ino) 2023-10-06T04:54:13.076 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:13.238 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628676 2023-10-06T04:54:13.423 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:13.424 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:13.425 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:13.425 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:13.425 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/clusters/4-remote-clients.yaml").st_ino) 2023-10-06T04:54:13.425 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:13.578 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628677 2023-10-06T04:54:13.764 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:13.764 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:13.764 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:13.764 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:13.764 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/%").st_ino) 2023-10-06T04:54:13.764 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:13.917 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628675 2023-10-06T04:54:14.102 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:14.103 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:14.103 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:14.103 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:14.103 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/mounts").st_ino) 2023-10-06T04:54:14.103 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:14.254 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628682 2023-10-06T04:54:14.439 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:14.440 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:14.440 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:14.440 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:14.440 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/mounts/kmounts.yaml").st_ino) 2023-10-06T04:54:14.440 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:14.591 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628683 2023-10-06T04:54:14.776 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:14.776 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:14.776 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:14.777 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:14.777 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/xfs.yaml").st_ino) 2023-10-06T04:54:14.777 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:14.929 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628686 2023-10-06T04:54:15.114 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:15.114 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:15.114 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:15.114 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:15.115 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks").st_ino) 2023-10-06T04:54:15.115 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:15.267 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628684 2023-10-06T04:54:15.453 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:15.453 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:15.453 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:15.453 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:15.453 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/backtrace.yaml").st_ino) 2023-10-06T04:54:15.453 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:15.606 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627957 2023-10-06T04:54:15.791 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:15.791 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:15.791 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:15.791 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:15.791 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/forward-scrub.yaml").st_ino) 2023-10-06T04:54:15.792 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:15.944 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627964 2023-10-06T04:54:16.130 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:16.130 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:16.130 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:16.130 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:16.130 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/volume-client.yaml").st_ino) 2023-10-06T04:54:16.130 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:16.284 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627970 2023-10-06T04:54:16.469 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:16.469 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:16.469 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:16.469 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:16.469 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/config-commands.yaml").st_ino) 2023-10-06T04:54:16.469 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:16.622 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627960 2023-10-06T04:54:16.807 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:16.807 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:16.807 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:16.807 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:16.807 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/sessionmap.yaml").st_ino) 2023-10-06T04:54:16.807 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:16.961 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627968 2023-10-06T04:54:17.146 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:17.146 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:17.146 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:17.146 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:17.146 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/failover.yaml.disabled").st_ino) 2023-10-06T04:54:17.146 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:17.299 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627963 2023-10-06T04:54:17.484 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:17.485 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:17.485 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:17.485 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:17.485 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/data-scan.yaml").st_ino) 2023-10-06T04:54:17.485 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:17.637 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627962 2023-10-06T04:54:17.821 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:17.822 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:17.822 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:17.822 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:17.822 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/mds-flush.yaml").st_ino) 2023-10-06T04:54:17.822 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:17.973 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627966 2023-10-06T04:54:18.159 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:18.159 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:18.159 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:18.159 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:18.160 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/auto-repair.yaml").st_ino) 2023-10-06T04:54:18.160 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:18.313 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628685 2023-10-06T04:54:18.498 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:18.498 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:18.498 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:18.498 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:18.498 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/damage.yaml").st_ino) 2023-10-06T04:54:18.498 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:18.651 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627961 2023-10-06T04:54:18.836 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:18.836 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:18.836 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:18.836 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:18.836 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-recovery.yaml").st_ino) 2023-10-06T04:54:18.836 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:18.989 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627959 2023-10-06T04:54:19.174 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:19.174 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:19.174 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:19.174 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:19.174 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/journal-repair.yaml").st_ino) 2023-10-06T04:54:19.174 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:19.327 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627965 2023-10-06T04:54:19.513 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:19.514 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:19.514 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:19.514 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:19.514 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-limits.yaml").st_ino) 2023-10-06T04:54:19.514 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:19.666 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627958 2023-10-06T04:54:19.851 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:19.851 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:19.851 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:19.851 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:19.852 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/strays.yaml.disabled").st_ino) 2023-10-06T04:54:19.852 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:20.005 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627969 2023-10-06T04:54:20.190 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:20.190 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:20.190 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:20.190 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:20.191 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/pool-perm.yaml").st_ino) 2023-10-06T04:54:20.191 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:20.344 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627967 2023-10-06T04:54:20.529 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:20.529 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:20.529 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:20.529 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:20.530 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/debug").st_ino) 2023-10-06T04:54:20.530 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:20.681 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628678 2023-10-06T04:54:20.867 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:20.867 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:20.867 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:20.867 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:20.867 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/debug/mds_client.yaml").st_ino) 2023-10-06T04:54:20.867 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:21.021 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628679 2023-10-06T04:54:21.207 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:21.207 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:21.207 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:21.207 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:21.207 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash").st_ino) 2023-10-06T04:54:21.207 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:21.361 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628687 2023-10-06T04:54:21.545 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:21.545 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:21.546 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:21.546 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:21.546 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/clusters").st_ino) 2023-10-06T04:54:21.546 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:21.697 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628689 2023-10-06T04:54:21.882 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:21.883 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:21.883 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:21.883 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:21.883 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/clusters/fixed-3-cephfs.yaml").st_ino) 2023-10-06T04:54:21.883 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:22.036 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628690 2023-10-06T04:54:22.221 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:22.221 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:22.221 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:22.221 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:22.221 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/fs").st_ino) 2023-10-06T04:54:22.221 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:22.375 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628691 2023-10-06T04:54:22.561 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:22.561 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:22.561 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:22.561 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:22.561 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/fs/xfs.yaml").st_ino) 2023-10-06T04:54:22.561 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:22.715 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628692 2023-10-06T04:54:22.900 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:22.900 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:22.900 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:22.900 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:22.901 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/workloads").st_ino) 2023-10-06T04:54:22.901 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:23.052 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628695 2023-10-06T04:54:23.237 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:23.237 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:23.237 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:23.238 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:23.238 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_ffsb.yaml").st_ino) 2023-10-06T04:54:23.238 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:23.391 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628696 2023-10-06T04:54:23.576 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:23.576 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:23.576 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:23.576 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:23.576 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_iozone.yaml").st_ino) 2023-10-06T04:54:23.576 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:23.728 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627974 2023-10-06T04:54:23.914 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:23.914 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:23.914 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:23.915 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:23.915 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/conf.yaml").st_ino) 2023-10-06T04:54:23.915 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:24.067 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627971 2023-10-06T04:54:24.252 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:24.252 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:24.252 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:24.252 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:24.252 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/%").st_ino) 2023-10-06T04:54:24.252 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:24.405 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628688 2023-10-06T04:54:24.590 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:24.590 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:24.590 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:24.590 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:24.591 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers").st_ino) 2023-10-06T04:54:24.591 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:24.744 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628693 2023-10-06T04:54:24.930 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:24.930 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:24.930 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:24.930 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:24.930 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers/default.yaml").st_ino) 2023-10-06T04:54:24.930 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:25.083 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628694 2023-10-06T04:54:25.268 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:25.268 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:25.268 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:25.268 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:25.268 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mon.yaml").st_ino) 2023-10-06T04:54:25.268 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:25.421 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627973 2023-10-06T04:54:25.606 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:25.607 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:25.607 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:25.607 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:25.607 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mds.yaml").st_ino) 2023-10-06T04:54:25.607 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:25.759 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627972 2023-10-06T04:54:25.945 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:25.945 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:25.945 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:25.945 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:25.945 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade").st_ino) 2023-10-06T04:54:25.945 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:26.099 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629840 2023-10-06T04:54:26.284 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:26.285 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:26.285 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:26.285 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:26.285 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x").st_ino) 2023-10-06T04:54:26.285 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:26.438 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629914 2023-10-06T04:54:26.623 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:26.623 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:26.624 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:26.624 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:26.624 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x").st_ino) 2023-10-06T04:54:26.624 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:26.775 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629930 2023-10-06T04:54:26.961 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:26.961 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:26.961 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:26.961 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:26.962 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/point-to-point-upgrade.yaml").st_ino) 2023-10-06T04:54:26.962 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:27.115 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628937 2023-10-06T04:54:27.301 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:27.301 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:27.301 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:27.301 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:27.301 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros").st_ino) 2023-10-06T04:54:27.301 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:27.455 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629932 2023-10-06T04:54:27.639 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:27.639 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:27.639 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:27.640 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:27.640 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/centos_7.2.yaml").st_ino) 2023-10-06T04:54:27.640 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:27.791 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629933 2023-10-06T04:54:27.976 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:27.976 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:27.977 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:27.977 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:27.977 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/ubuntu_14.04.yaml").st_ino) 2023-10-06T04:54:27.977 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:28.131 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629934 2023-10-06T04:54:28.316 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:28.316 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:28.316 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:28.316 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:28.316 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/%").st_ino) 2023-10-06T04:54:28.316 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:28.468 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629931 2023-10-06T04:54:28.654 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:28.654 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:28.654 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:28.654 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:28.654 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel").st_ino) 2023-10-06T04:54:28.654 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:28.807 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629915 2023-10-06T04:54:28.992 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:28.993 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:28.993 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:28.993 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:28.993 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/kraken.yaml").st_ino) 2023-10-06T04:54:28.993 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:29.147 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629929 2023-10-06T04:54:29.332 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:29.332 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:29.332 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:29.332 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:29.332 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install").st_ino) 2023-10-06T04:54:29.332 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:29.485 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629919 2023-10-06T04:54:29.670 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:29.670 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:29.670 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:29.670 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:29.670 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install/jewel.yaml").st_ino) 2023-10-06T04:54:29.671 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:29.824 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629920 2023-10-06T04:54:30.009 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:30.009 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:30.010 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:30.010 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:30.010 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/4-kraken.yaml").st_ino) 2023-10-06T04:54:30.010 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:30.162 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629925 2023-10-06T04:54:30.347 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:30.347 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:30.347 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:30.347 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:30.347 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence").st_ino) 2023-10-06T04:54:30.347 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:30.501 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629923 2023-10-06T04:54:30.686 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:30.686 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:30.686 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:30.687 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:30.687 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml").st_ino) 2023-10-06T04:54:30.687 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:30.839 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629924 2023-10-06T04:54:31.024 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:31.025 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:31.025 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:31.025 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:31.025 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-mon-osd-mds.yaml").st_ino) 2023-10-06T04:54:31.025 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:31.177 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628929 2023-10-06T04:54:31.362 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:31.362 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:31.362 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:31.362 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:31.362 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/distros").st_ino) 2023-10-06T04:54:31.362 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:31.516 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629928 2023-10-06T04:54:31.544 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:54:31.548 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:54:31.701 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:31.701 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:31.701 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:31.701 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:31.701 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/%").st_ino) 2023-10-06T04:54:31.701 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:31.813 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629916 2023-10-06T04:54:31.999 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:31.999 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:31.999 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:31.999 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:31.999 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload").st_ino) 2023-10-06T04:54:31.999 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:32.152 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629921 2023-10-06T04:54:32.338 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:32.338 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:32.338 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:32.339 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:32.339 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_python.yaml").st_ino) 2023-10-06T04:54:32.339 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:32.491 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628928 2023-10-06T04:54:32.676 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:32.676 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:32.677 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:32.677 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:32.677 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/blogbench.yaml").st_ino) 2023-10-06T04:54:32.677 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:32.829 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628923 2023-10-06T04:54:33.014 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:33.014 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:33.015 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:33.015 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:33.015 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_api.yaml").st_ino) 2023-10-06T04:54:33.015 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:33.167 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628925 2023-10-06T04:54:33.352 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:33.352 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:33.353 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:33.353 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:33.353 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_loadgenbig.yaml").st_ino) 2023-10-06T04:54:33.353 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:33.505 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628926 2023-10-06T04:54:33.690 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:33.690 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:33.690 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:33.690 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:33.690 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/ec-rados-default.yaml").st_ino) 2023-10-06T04:54:33.690 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:33.843 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628924 2023-10-06T04:54:34.028 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:34.028 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:34.029 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:34.029 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:34.029 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/+").st_ino) 2023-10-06T04:54:34.029 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:34.181 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629922 2023-10-06T04:54:34.366 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:34.366 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:34.366 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:34.366 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:34.366 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_api.yaml").st_ino) 2023-10-06T04:54:34.366 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:34.519 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628927 2023-10-06T04:54:34.704 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:34.704 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:34.704 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:34.705 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:34.705 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster").st_ino) 2023-10-06T04:54:34.705 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:34.857 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629917 2023-10-06T04:54:35.042 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:35.042 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:35.042 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:35.042 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:35.042 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/openstack.yaml").st_ino) 2023-10-06T04:54:35.042 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:35.195 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628921 2023-10-06T04:54:35.380 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:35.381 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:35.381 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:35.381 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:35.381 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/+").st_ino) 2023-10-06T04:54:35.381 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:35.533 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629918 2023-10-06T04:54:35.718 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:35.718 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:35.718 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:35.718 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:35.718 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/start.yaml").st_ino) 2023-10-06T04:54:35.719 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:35.871 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628922 2023-10-06T04:54:36.056 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:36.056 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:36.056 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:36.056 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:36.056 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload").st_ino) 2023-10-06T04:54:36.056 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:36.209 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629926 2023-10-06T04:54:36.395 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:36.395 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:36.395 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:36.395 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:36.395 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/blogbench.yaml").st_ino) 2023-10-06T04:54:36.395 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:36.548 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628930 2023-10-06T04:54:36.734 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:36.734 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:36.734 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:36.734 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:36.734 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados-snaps-few-objects.yaml").st_ino) 2023-10-06T04:54:36.734 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:36.888 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628931 2023-10-06T04:54:37.073 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:37.073 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:37.073 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:37.073 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:37.073 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/+").st_ino) 2023-10-06T04:54:37.073 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:37.227 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629927 2023-10-06T04:54:37.413 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:37.413 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:37.413 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:37.413 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:37.413 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_loadgenmix.yaml").st_ino) 2023-10-06T04:54:37.413 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:37.565 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628932 2023-10-06T04:54:37.751 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:37.751 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:37.751 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:37.751 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:37.751 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_cls.yaml").st_ino) 2023-10-06T04:54:37.752 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:37.904 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628934 2023-10-06T04:54:38.089 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:38.089 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:38.089 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:38.089 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:38.089 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_mon_thrash.yaml").st_ino) 2023-10-06T04:54:38.089 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:38.243 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628933 2023-10-06T04:54:38.428 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:38.428 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:38.428 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:38.428 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:38.428 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rgw_swift.yaml").st_ino) 2023-10-06T04:54:38.428 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:38.582 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628936 2023-10-06T04:54:38.767 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:38.767 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:38.767 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:38.767 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:38.767 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_import_export.yaml").st_ino) 2023-10-06T04:54:38.767 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:38.920 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628935 2023-10-06T04:54:39.105 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:39.105 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:39.105 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:39.105 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:39.105 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split").st_ino) 2023-10-06T04:54:39.105 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:39.257 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629964 2023-10-06T04:54:39.443 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:39.443 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:39.443 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:39.443 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:39.443 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon").st_ino) 2023-10-06T04:54:39.444 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:39.596 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629978 2023-10-06T04:54:39.781 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:39.781 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:39.781 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:39.781 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:39.781 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon/monb.yaml").st_ino) 2023-10-06T04:54:39.781 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:39.934 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629979 2023-10-06T04:54:40.119 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:40.119 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:40.119 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:40.119 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:40.119 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon").st_ino) 2023-10-06T04:54:40.119 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:40.271 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629982 2023-10-06T04:54:40.456 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:40.456 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:40.456 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:40.456 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:40.457 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon/monc.yaml").st_ino) 2023-10-06T04:54:40.457 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:40.609 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629983 2023-10-06T04:54:40.794 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:40.794 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:40.794 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:40.794 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:40.794 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install").st_ino) 2023-10-06T04:54:40.794 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:40.947 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629968 2023-10-06T04:54:41.132 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:41.132 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:41.132 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:41.133 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:41.133 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install/jewel.yaml").st_ino) 2023-10-06T04:54:41.133 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:41.287 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629969 2023-10-06T04:54:41.471 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:41.471 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:41.471 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:41.471 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:41.471 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload").st_ino) 2023-10-06T04:54:41.471 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:41.624 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629976 2023-10-06T04:54:41.809 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:41.809 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:41.809 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:41.810 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:41.810 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/readwrite.yaml").st_ino) 2023-10-06T04:54:41.810 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:41.962 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628943 2023-10-06T04:54:42.147 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:42.147 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:42.147 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:42.147 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:42.147 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/snaps-few-objects.yaml").st_ino) 2023-10-06T04:54:42.148 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:42.301 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628944 2023-10-06T04:54:42.485 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:42.485 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:42.486 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:42.486 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:42.486 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-cls.yaml").st_ino) 2023-10-06T04:54:42.486 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:42.638 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628941 2023-10-06T04:54:42.823 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:42.823 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:42.823 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:42.823 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:42.823 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-import-export.yaml").st_ino) 2023-10-06T04:54:42.824 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:42.976 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628942 2023-10-06T04:54:43.161 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:43.161 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:43.161 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:43.161 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:43.161 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/+").st_ino) 2023-10-06T04:54:43.161 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:43.315 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629977 2023-10-06T04:54:43.500 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:43.500 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:43.500 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:43.500 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:43.500 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon").st_ino) 2023-10-06T04:54:43.500 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:43.653 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629974 2023-10-06T04:54:43.837 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:43.838 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:43.838 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:43.838 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:43.838 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon/mona.yaml").st_ino) 2023-10-06T04:54:43.838 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:43.990 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629975 2023-10-06T04:54:44.175 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:44.176 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:44.176 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:44.176 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:44.176 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/distros").st_ino) 2023-10-06T04:54:44.176 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:44.337 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629986 2023-10-06T04:54:44.521 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:44.522 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:44.522 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:44.522 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:44.522 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/%").st_ino) 2023-10-06T04:54:44.522 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:44.677 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629965 2023-10-06T04:54:44.862 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:44.862 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:44.862 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:44.863 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:44.863 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload").st_ino) 2023-10-06T04:54:44.863 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:45.015 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629984 2023-10-06T04:54:45.200 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:45.200 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:45.200 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:45.200 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:45.201 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rbd-python.yaml").st_ino) 2023-10-06T04:54:45.201 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:45.355 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628947 2023-10-06T04:54:45.539 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:45.540 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:45.540 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:45.540 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:45.540 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rgw-swift.yaml").st_ino) 2023-10-06T04:54:45.540 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:45.693 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628948 2023-10-06T04:54:45.878 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:45.878 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:45.878 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:45.878 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:45.878 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/snaps-many-objects.yaml").st_ino) 2023-10-06T04:54:45.878 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:46.031 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628949 2023-10-06T04:54:46.216 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:46.216 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:46.216 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:46.216 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:46.216 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/+").st_ino) 2023-10-06T04:54:46.217 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:46.370 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629985 2023-10-06T04:54:46.555 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:46.555 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:46.555 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:46.555 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:46.556 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade").st_ino) 2023-10-06T04:54:46.556 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:46.708 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629970 2023-10-06T04:54:46.893 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:46.893 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:46.893 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:46.893 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:46.893 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade/firsthalf.yaml").st_ino) 2023-10-06T04:54:46.893 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:47.047 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629971 2023-10-06T04:54:47.232 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:47.232 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:47.232 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:47.232 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:47.232 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash").st_ino) 2023-10-06T04:54:47.232 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:47.385 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629972 2023-10-06T04:54:47.571 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:47.571 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:47.571 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:47.571 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:47.571 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash/default.yaml").st_ino) 2023-10-06T04:54:47.571 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:47.723 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629973 2023-10-06T04:54:47.909 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:47.909 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:47.910 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:47.910 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:47.910 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload").st_ino) 2023-10-06T04:54:47.910 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:48.062 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629980 2023-10-06T04:54:48.247 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:48.247 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:48.247 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:48.248 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:48.248 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/radosbench.yaml").st_ino) 2023-10-06T04:54:48.248 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:48.400 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628945 2023-10-06T04:54:48.585 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:48.585 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:48.586 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:48.586 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:48.586 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/rbd_api.yaml").st_ino) 2023-10-06T04:54:48.586 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:48.738 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628946 2023-10-06T04:54:48.924 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:48.924 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:48.924 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:48.924 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:48.924 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/+").st_ino) 2023-10-06T04:54:48.924 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:49.076 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629981 2023-10-06T04:54:49.262 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:49.262 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:49.262 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:49.262 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:49.262 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster").st_ino) 2023-10-06T04:54:49.262 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:49.414 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629966 2023-10-06T04:54:49.600 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:49.600 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:49.600 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:49.600 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:49.600 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/openstack.yaml").st_ino) 2023-10-06T04:54:49.601 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:49.753 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628939 2023-10-06T04:54:49.938 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:49.938 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:49.939 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:49.939 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:49.939 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/+").st_ino) 2023-10-06T04:54:49.939 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:50.091 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629967 2023-10-06T04:54:50.276 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:50.277 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:50.277 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:50.277 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:50.277 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/start.yaml").st_ino) 2023-10-06T04:54:50.277 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:50.428 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628940 2023-10-06T04:54:50.614 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:50.615 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:50.615 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:50.615 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:50.615 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64").st_ino) 2023-10-06T04:54:50.615 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:50.768 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629935 2023-10-06T04:54:50.954 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:50.955 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:50.955 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:50.955 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:50.955 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/6-next-mon").st_ino) 2023-10-06T04:54:50.955 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:51.107 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629945 2023-10-06T04:54:51.293 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:51.294 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:51.294 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:51.294 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:51.294 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/8-next-mon").st_ino) 2023-10-06T04:54:51.294 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:51.447 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629946 2023-10-06T04:54:51.632 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:51.632 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:51.632 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:51.632 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:51.632 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/1-jewel-install").st_ino) 2023-10-06T04:54:51.632 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:51.785 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629938 2023-10-06T04:54:51.970 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:51.970 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:51.970 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:51.971 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:51.971 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload").st_ino) 2023-10-06T04:54:51.971 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:52.125 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629943 2023-10-06T04:54:52.309 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:52.309 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:52.309 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:52.310 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:52.310 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload/ec-rados-default.yaml").st_ino) 2023-10-06T04:54:52.310 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:52.462 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629944 2023-10-06T04:54:52.648 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:52.648 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:52.648 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:52.648 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:52.648 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/4-mon").st_ino) 2023-10-06T04:54:52.648 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:52.801 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629942 2023-10-06T04:54:52.987 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:52.987 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:52.987 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:52.987 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:52.988 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/%").st_ino) 2023-10-06T04:54:52.988 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:53.141 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629936 2023-10-06T04:54:53.326 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:53.326 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:53.326 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:53.327 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:53.327 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-x86_64.yaml").st_ino) 2023-10-06T04:54:53.327 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:53.478 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628938 2023-10-06T04:54:53.664 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:53.664 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:53.664 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:53.664 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:53.664 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload").st_ino) 2023-10-06T04:54:53.664 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629947 2023-10-06T04:54:54.001 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:54.001 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:54.001 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:54.001 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:54.002 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2023-10-06T04:54:54.002 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:54.154 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629948 2023-10-06T04:54:54.340 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:54.340 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:54.340 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:54.340 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:54.340 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/2-partial-upgrade").st_ino) 2023-10-06T04:54:54.340 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:54.494 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629939 2023-10-06T04:54:54.679 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:54.680 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:54.680 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:54.680 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:54.680 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash").st_ino) 2023-10-06T04:54:54.680 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:54.832 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629940 2023-10-06T04:54:55.018 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:55.018 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:55.018 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:55.018 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:55.018 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash/default.yaml").st_ino) 2023-10-06T04:54:55.018 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:55.171 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629941 2023-10-06T04:54:55.356 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:55.357 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:55.357 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:55.357 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:55.357 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-cluster").st_ino) 2023-10-06T04:54:55.357 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:55.510 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629937 2023-10-06T04:54:55.696 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:55.696 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:55.696 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:55.696 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:55.696 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code").st_ino) 2023-10-06T04:54:55.696 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:55.849 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629949 2023-10-06T04:54:56.035 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:56.035 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:56.035 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:56.035 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:56.035 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/6-next-mon").st_ino) 2023-10-06T04:54:56.036 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:56.188 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629959 2023-10-06T04:54:56.374 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:56.374 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:56.374 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:56.374 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:56.374 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/8-next-mon").st_ino) 2023-10-06T04:54:56.374 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:56.527 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629960 2023-10-06T04:54:56.713 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:56.713 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:56.713 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:56.713 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:56.713 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/1-jewel-install").st_ino) 2023-10-06T04:54:56.713 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:56.866 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629952 2023-10-06T04:54:57.051 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:57.051 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:57.052 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:57.052 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:57.052 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload").st_ino) 2023-10-06T04:54:57.052 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:57.204 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629957 2023-10-06T04:54:57.389 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:57.390 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:57.390 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:57.390 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:57.390 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload/ec-rados-default.yaml").st_ino) 2023-10-06T04:54:57.390 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:57.542 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629958 2023-10-06T04:54:57.727 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:57.727 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:57.727 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:57.727 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:57.727 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/4-mon").st_ino) 2023-10-06T04:54:57.727 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:57.881 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629956 2023-10-06T04:54:58.066 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:58.066 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:58.066 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:58.066 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:58.067 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/distros").st_ino) 2023-10-06T04:54:58.067 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:58.220 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629963 2023-10-06T04:54:58.405 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:58.405 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:58.405 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:58.405 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:58.405 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/%").st_ino) 2023-10-06T04:54:58.405 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:58.557 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629950 2023-10-06T04:54:58.743 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:58.743 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:58.743 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:58.743 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:58.743 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload").st_ino) 2023-10-06T04:54:58.743 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:58.896 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629961 2023-10-06T04:54:59.081 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:59.081 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:59.081 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:59.082 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:59.082 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2023-10-06T04:54:59.082 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:59.234 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629962 2023-10-06T04:54:59.419 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:59.420 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:59.420 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:59.420 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:59.420 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/2-partial-upgrade").st_ino) 2023-10-06T04:54:59.420 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:59.573 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629953 2023-10-06T04:54:59.757 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:54:59.757 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:54:59.758 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:54:59.758 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:54:59.758 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash").st_ino) 2023-10-06T04:54:59.758 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:54:59.914 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629954 2023-10-06T04:55:00.097 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:00.097 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:00.097 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:00.097 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:00.097 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash/default.yaml").st_ino) 2023-10-06T04:55:00.097 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:00.250 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629955 2023-10-06T04:55:00.436 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:00.437 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:00.437 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:00.437 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:00.437 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/0-cluster").st_ino) 2023-10-06T04:55:00.437 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:00.590 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629951 2023-10-06T04:55:00.776 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:00.776 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:00.776 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:00.776 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:00.777 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x").st_ino) 2023-10-06T04:55:00.777 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:00.929 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629876 2023-10-06T04:55:01.114 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:01.114 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:01.114 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:01.114 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:01.114 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel").st_ino) 2023-10-06T04:55:01.114 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:01.268 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629877 2023-10-06T04:55:01.454 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:01.454 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:01.454 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:01.454 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:01.454 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/8-kraken.yaml").st_ino) 2023-10-06T04:55:01.454 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:01.607 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629894 2023-10-06T04:55:01.658 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:55:01.662 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:55:01.791 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:01.791 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:01.792 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:01.792 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:01.792 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install").st_ino) 2023-10-06T04:55:01.792 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:01.944 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629881 2023-10-06T04:55:02.129 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:02.129 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:02.129 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:02.130 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:02.130 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install/hammer-jewel.yaml").st_ino) 2023-10-06T04:55:02.130 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:02.282 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629882 2023-10-06T04:55:02.467 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:02.468 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:02.468 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:02.468 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:02.468 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/4-jewel.yaml").st_ino) 2023-10-06T04:55:02.468 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:02.620 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629887 2023-10-06T04:55:02.806 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:02.806 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:02.806 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:02.806 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:02.806 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3.5-finish.yaml").st_ino) 2023-10-06T04:55:02.806 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:02.959 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628906 2023-10-06T04:55:03.145 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:03.145 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:03.145 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:03.145 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:03.145 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence").st_ino) 2023-10-06T04:55:03.145 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:03.298 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629885 2023-10-06T04:55:03.483 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:03.483 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:03.483 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:03.483 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:03.483 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-osd-mds-mon.yaml").st_ino) 2023-10-06T04:55:03.484 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:03.636 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628905 2023-10-06T04:55:03.822 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:03.822 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:03.822 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:03.822 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:03.822 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml").st_ino) 2023-10-06T04:55:03.822 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:03.974 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629886 2023-10-06T04:55:04.159 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:04.159 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:04.159 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:04.160 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:04.160 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence").st_ino) 2023-10-06T04:55:04.160 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:04.312 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629892 2023-10-06T04:55:04.498 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:04.498 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:04.498 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:04.498 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:04.498 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-by-daemon.yaml").st_ino) 2023-10-06T04:55:04.498 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:04.651 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628912 2023-10-06T04:55:04.836 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:04.836 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:04.836 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:04.836 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:04.836 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-all.yaml").st_ino) 2023-10-06T04:55:04.836 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:04.989 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629893 2023-10-06T04:55:05.175 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:05.175 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:05.175 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:05.175 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:05.175 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros").st_ino) 2023-10-06T04:55:05.175 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:05.326 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629897 2023-10-06T04:55:05.511 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:05.511 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:05.511 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:05.512 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:05.512 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/centos_7.2.yaml").st_ino) 2023-10-06T04:55:05.512 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:05.663 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629898 2023-10-06T04:55:05.849 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:05.849 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:05.849 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:05.849 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:05.849 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/ubuntu_14.04.yaml").st_ino) 2023-10-06T04:55:05.849 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:06.002 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628919 2023-10-06T04:55:06.188 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:06.188 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:06.188 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:06.188 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:06.188 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/%").st_ino) 2023-10-06T04:55:06.188 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:06.342 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629878 2023-10-06T04:55:06.527 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:06.527 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:06.527 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:06.527 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:06.528 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload").st_ino) 2023-10-06T04:55:06.528 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:06.681 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629895 2023-10-06T04:55:06.866 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:06.866 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:06.866 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:06.866 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:06.866 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados-snaps-few-objects.yaml").st_ino) 2023-10-06T04:55:06.866 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:07.019 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628913 2023-10-06T04:55:07.205 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:07.205 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:07.205 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:07.205 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:07.206 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/+").st_ino) 2023-10-06T04:55:07.206 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:07.359 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629896 2023-10-06T04:55:07.545 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:07.545 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:07.545 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:07.545 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:07.545 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_loadgenmix.yaml").st_ino) 2023-10-06T04:55:07.545 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:07.699 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628914 2023-10-06T04:55:07.884 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:07.884 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:07.884 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:07.884 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:07.885 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_cls.yaml").st_ino) 2023-10-06T04:55:07.885 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:08.037 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628916 2023-10-06T04:55:08.223 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:08.223 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:08.223 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:08.223 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:08.224 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_mon_thrash.yaml").st_ino) 2023-10-06T04:55:08.224 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:08.377 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628915 2023-10-06T04:55:08.563 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:09.471 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:09.471 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:09.472 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:09.472 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_import_export.yaml").st_ino) 2023-10-06T04:55:09.472 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:09.593 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628917 2023-10-06T04:55:09.778 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:09.778 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:09.778 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:09.779 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:09.779 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rgw_s3tests.yaml").st_ino) 2023-10-06T04:55:09.779 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:09.932 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628918 2023-10-06T04:55:10.118 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:10.118 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:10.118 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:10.118 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:10.118 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload").st_ino) 2023-10-06T04:55:10.118 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:10.271 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629883 2023-10-06T04:55:10.456 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:10.456 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:10.456 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:10.456 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:10.456 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_python.yaml").st_ino) 2023-10-06T04:55:10.456 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:10.608 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628904 2023-10-06T04:55:10.795 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:10.795 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:10.795 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:10.795 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:10.795 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_api.yaml").st_ino) 2023-10-06T04:55:10.795 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:10.947 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628901 2023-10-06T04:55:11.132 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:11.133 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:11.133 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:11.133 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:11.133 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_loadgenbig.yaml").st_ino) 2023-10-06T04:55:11.133 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:11.285 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628902 2023-10-06T04:55:11.470 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:11.470 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:11.471 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:11.471 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:11.471 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/ec-rados-default.yaml").st_ino) 2023-10-06T04:55:11.471 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:11.623 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628900 2023-10-06T04:55:11.811 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:11.811 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:11.811 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:11.811 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:11.811 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/+").st_ino) 2023-10-06T04:55:11.811 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:11.964 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629884 2023-10-06T04:55:12.149 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:12.149 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:12.149 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:12.149 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:12.150 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_api.yaml").st_ino) 2023-10-06T04:55:12.150 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:12.303 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628903 2023-10-06T04:55:12.488 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:12.488 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:12.488 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:12.488 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:12.488 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload").st_ino) 2023-10-06T04:55:12.488 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:12.641 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629890 2023-10-06T04:55:12.826 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:12.826 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:12.827 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:12.827 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:12.827 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_python.yaml").st_ino) 2023-10-06T04:55:12.827 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:12.979 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628911 2023-10-06T04:55:13.165 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:13.165 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:13.165 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:13.165 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:13.165 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_api.yaml").st_ino) 2023-10-06T04:55:13.165 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:13.317 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628908 2023-10-06T04:55:13.502 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:13.502 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:13.502 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:13.503 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:13.503 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_loadgenbig.yaml").st_ino) 2023-10-06T04:55:13.503 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:13.655 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628909 2023-10-06T04:55:13.840 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:13.840 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:13.840 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:13.840 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:13.840 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/ec-rados-default.yaml").st_ino) 2023-10-06T04:55:13.840 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:13.994 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628907 2023-10-06T04:55:14.178 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:14.178 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:14.179 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:14.179 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:14.179 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/+").st_ino) 2023-10-06T04:55:14.179 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:14.331 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629891 2023-10-06T04:55:14.517 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:14.517 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:14.517 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:14.517 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:14.517 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_api.yaml").st_ino) 2023-10-06T04:55:14.517 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:14.670 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628910 2023-10-06T04:55:14.855 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:14.856 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:14.856 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:14.856 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:14.856 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade").st_ino) 2023-10-06T04:55:14.856 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:15.009 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629888 2023-10-06T04:55:15.194 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:15.194 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:15.194 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:15.194 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:15.194 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade/hammer-jewel-x.yaml").st_ino) 2023-10-06T04:55:15.194 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:15.347 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629889 2023-10-06T04:55:15.532 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:15.532 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:15.532 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:15.532 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:15.532 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster").st_ino) 2023-10-06T04:55:15.532 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:15.684 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629879 2023-10-06T04:55:15.869 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:15.870 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:15.870 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:15.870 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:15.870 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster/start.yaml").st_ino) 2023-10-06T04:55:15.870 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:16.022 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629880 2023-10-06T04:55:16.207 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:16.207 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:16.207 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:16.207 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:16.207 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split").st_ino) 2023-10-06T04:55:16.208 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:16.360 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629899 2023-10-06T04:55:16.545 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:16.545 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:16.545 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:16.545 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:16.545 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/6-next-mon").st_ino) 2023-10-06T04:55:16.545 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:16.700 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629908 2023-10-06T04:55:16.884 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:16.885 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:16.885 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:16.885 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:16.885 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/8-next-mon").st_ino) 2023-10-06T04:55:16.885 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:17.037 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629910 2023-10-06T04:55:17.222 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:17.223 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:17.223 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:17.223 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:17.223 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/5-workload").st_ino) 2023-10-06T04:55:17.223 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:17.374 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629907 2023-10-06T04:55:17.560 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:17.560 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:17.560 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:17.560 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:17.560 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/4-mon").st_ino) 2023-10-06T04:55:17.560 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:17.712 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629906 2023-10-06T04:55:17.898 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:17.899 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:17.899 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:17.899 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:17.899 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros").st_ino) 2023-10-06T04:55:17.899 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:18.050 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629912 2023-10-06T04:55:18.235 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:18.236 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:18.236 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:18.236 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:18.236 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/centos_7.2.yaml").st_ino) 2023-10-06T04:55:18.236 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:18.389 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629913 2023-10-06T04:55:18.573 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:18.573 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:18.573 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:18.573 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:18.574 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/ubuntu_14.04.yaml").st_ino) 2023-10-06T04:55:18.574 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:18.726 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628920 2023-10-06T04:55:18.912 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:18.912 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:18.912 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:18.912 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:18.912 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/%").st_ino) 2023-10-06T04:55:18.912 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:19.065 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629900 2023-10-06T04:55:19.250 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:19.251 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:19.251 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:19.251 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:19.251 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/9-workload").st_ino) 2023-10-06T04:55:19.251 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:19.406 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629911 2023-10-06T04:55:19.590 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:19.590 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:19.590 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:19.590 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:19.590 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel").st_ino) 2023-10-06T04:55:19.590 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:19.743 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629902 2023-10-06T04:55:19.928 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:19.929 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:19.929 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:19.929 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:19.929 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel/hammer-to-jewel.yaml").st_ino) 2023-10-06T04:55:19.929 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:20.081 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629903 2023-10-06T04:55:20.267 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:20.268 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:20.268 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:20.268 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:20.268 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/2-partial-upgrade").st_ino) 2023-10-06T04:55:20.268 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:20.420 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629904 2023-10-06T04:55:20.605 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:20.605 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:20.605 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:20.605 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:20.605 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/3-thrash").st_ino) 2023-10-06T04:55:20.605 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:20.759 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629905 2023-10-06T04:55:20.944 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:20.944 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:20.944 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:20.944 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:20.944 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/7-workload").st_ino) 2023-10-06T04:55:20.944 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:21.098 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629909 2023-10-06T04:55:21.283 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:21.283 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:21.283 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:21.283 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:21.283 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/0-cluster").st_ino) 2023-10-06T04:55:21.283 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:21.436 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629901 2023-10-06T04:55:21.620 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:21.620 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:21.620 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:21.621 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:21.621 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade").st_ino) 2023-10-06T04:55:21.621 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:21.772 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629841 2023-10-06T04:55:21.958 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:21.958 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:21.958 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:21.958 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:21.958 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x").st_ino) 2023-10-06T04:55:21.958 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:22.112 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629842 2023-10-06T04:55:22.297 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:22.297 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:22.297 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:22.297 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:22.297 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd").st_ino) 2023-10-06T04:55:22.297 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:22.450 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629851 2023-10-06T04:55:22.635 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:22.636 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:22.636 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:22.636 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:22.636 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install").st_ino) 2023-10-06T04:55:22.636 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:22.788 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629855 2023-10-06T04:55:22.974 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:22.974 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:22.975 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:22.975 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:22.975 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install/hammer-client-x.yaml").st_ino) 2023-10-06T04:55:22.975 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:23.126 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629856 2023-10-06T04:55:23.312 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:23.312 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:23.312 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:23.312 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:23.312 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/%").st_ino) 2023-10-06T04:55:23.312 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:23.465 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629852 2023-10-06T04:55:23.650 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:23.650 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:23.650 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:23.650 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:23.650 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload").st_ino) 2023-10-06T04:55:23.651 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:23.804 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629857 2023-10-06T04:55:23.989 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:23.989 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:23.989 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:23.989 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:23.989 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload/rbd_notification_tests.yaml").st_ino) 2023-10-06T04:55:23.989 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:24.143 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629858 2023-10-06T04:55:24.328 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:24.328 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:24.328 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:24.328 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:24.328 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster").st_ino) 2023-10-06T04:55:24.328 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:24.480 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629853 2023-10-06T04:55:24.665 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:24.665 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:24.666 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:24.666 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:24.666 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster/start.yaml").st_ino) 2023-10-06T04:55:24.666 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:24.819 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629854 2023-10-06T04:55:25.005 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:25.005 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:25.005 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:25.005 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:25.005 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic").st_ino) 2023-10-06T04:55:25.005 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:25.157 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629843 2023-10-06T04:55:25.341 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:25.341 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:25.342 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:25.342 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:25.342 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install").st_ino) 2023-10-06T04:55:25.342 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:25.494 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629847 2023-10-06T04:55:25.679 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:25.679 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:25.679 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:25.679 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:25.679 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install/hammer-client-x.yaml").st_ino) 2023-10-06T04:55:25.680 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:25.832 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629848 2023-10-06T04:55:26.017 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:26.018 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:26.018 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:26.018 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:26.018 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/%").st_ino) 2023-10-06T04:55:26.018 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:26.170 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629844 2023-10-06T04:55:26.356 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:26.356 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:26.356 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:26.357 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:26.357 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload").st_ino) 2023-10-06T04:55:26.357 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:26.510 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629849 2023-10-06T04:55:26.695 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:26.695 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:26.695 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:26.695 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:26.695 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_cli_import_export.yaml").st_ino) 2023-10-06T04:55:26.696 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:26.848 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628898 2023-10-06T04:55:27.034 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:27.034 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:27.034 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:27.034 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:27.034 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_api_tests.yaml").st_ino) 2023-10-06T04:55:27.034 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:27.188 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629850 2023-10-06T04:55:27.374 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:27.375 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:27.375 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:27.375 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:27.375 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster").st_ino) 2023-10-06T04:55:27.375 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:27.527 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629845 2023-10-06T04:55:27.712 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:27.712 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:27.712 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:27.712 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:27.712 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster/start.yaml").st_ino) 2023-10-06T04:55:27.712 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:27.865 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629846 2023-10-06T04:55:28.051 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:28.051 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:28.051 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:28.051 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:28.051 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x").st_ino) 2023-10-06T04:55:28.051 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:28.205 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629859 2023-10-06T04:55:28.391 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:28.391 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:28.391 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:28.391 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:28.391 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd").st_ino) 2023-10-06T04:55:28.391 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:28.544 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629868 2023-10-06T04:55:28.730 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:28.730 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:28.730 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:28.731 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:28.731 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install").st_ino) 2023-10-06T04:55:28.732 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:28.882 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629872 2023-10-06T04:55:29.067 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:29.068 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:29.068 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:29.068 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:29.068 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install/jewel-client-x.yaml").st_ino) 2023-10-06T04:55:29.068 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:29.220 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629873 2023-10-06T04:55:29.406 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:29.406 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:29.406 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:29.406 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:29.406 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/%").st_ino) 2023-10-06T04:55:29.406 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:29.559 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629869 2023-10-06T04:55:29.744 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:29.744 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:29.744 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:29.745 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:29.745 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload").st_ino) 2023-10-06T04:55:29.745 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:29.896 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629874 2023-10-06T04:55:30.082 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:30.082 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:30.083 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:30.083 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:30.083 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload/rbd_notification_tests.yaml").st_ino) 2023-10-06T04:55:30.083 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:30.235 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629875 2023-10-06T04:55:30.420 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:30.420 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:30.420 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:30.420 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:30.420 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster").st_ino) 2023-10-06T04:55:30.420 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:30.573 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629870 2023-10-06T04:55:30.758 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:30.758 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:30.758 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:30.758 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:30.758 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster/start.yaml").st_ino) 2023-10-06T04:55:30.758 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:30.911 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629871 2023-10-06T04:55:31.096 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:31.096 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:31.097 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:31.097 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:31.097 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic").st_ino) 2023-10-06T04:55:31.097 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:31.249 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629860 2023-10-06T04:55:31.434 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:31.434 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:31.435 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:31.435 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:31.435 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install").st_ino) 2023-10-06T04:55:31.435 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:31.586 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629864 2023-10-06T04:55:31.771 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:31.771 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:31.771 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:31.772 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:31.772 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install/jewel-client-x.yaml").st_ino) 2023-10-06T04:55:31.772 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:31.796 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:55:31.819 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:55:31.929 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629865 2023-10-06T04:55:32.112 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:32.112 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:32.113 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:32.113 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:32.113 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/%").st_ino) 2023-10-06T04:55:32.113 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:32.266 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629861 2023-10-06T04:55:32.451 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:32.451 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:32.451 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:32.452 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:32.452 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload").st_ino) 2023-10-06T04:55:32.452 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:32.604 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629866 2023-10-06T04:55:32.789 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:32.789 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:32.789 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:32.789 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:32.789 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_cli_import_export.yaml").st_ino) 2023-10-06T04:55:32.789 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:32.942 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628899 2023-10-06T04:55:33.128 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:33.128 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:33.128 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:33.128 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:33.128 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_api_tests.yaml").st_ino) 2023-10-06T04:55:33.128 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:33.281 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629867 2023-10-06T04:55:33.466 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:33.466 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:33.466 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:33.466 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:33.466 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster").st_ino) 2023-10-06T04:55:33.466 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:33.619 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629862 2023-10-06T04:55:33.804 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:33.804 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:33.804 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:33.804 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:33.804 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster/start.yaml").st_ino) 2023-10-06T04:55:33.804 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:33.957 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629863 2023-10-06T04:55:34.142 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:34.143 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:34.143 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:34.143 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:34.143 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy").st_ino) 2023-10-06T04:55:34.143 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:34.296 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628423 2023-10-06T04:55:34.481 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:34.481 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:34.481 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:34.481 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:34.481 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy/%").st_ino) 2023-10-06T04:55:34.481 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:34.633 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628424 2023-10-06T04:55:34.819 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:34.819 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:34.819 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:34.819 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:34.819 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy/all").st_ino) 2023-10-06T04:55:34.819 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:34.972 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628425 2023-10-06T04:55:35.158 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:35.158 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:35.158 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:35.158 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:35.158 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy/all/nop.yaml").st_ino) 2023-10-06T04:55:35.159 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:35.311 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628426 2023-10-06T04:55:35.496 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:35.496 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:35.496 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:35.496 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:35.496 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop").st_ino) 2023-10-06T04:55:35.497 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:35.649 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628647 2023-10-06T04:55:35.834 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:35.834 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:35.834 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:35.835 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:35.835 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic").st_ino) 2023-10-06T04:55:35.835 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:35.986 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628648 2023-10-06T04:55:36.171 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:36.172 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:36.172 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:36.172 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:36.172 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/clusters").st_ino) 2023-10-06T04:55:36.172 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:36.323 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628650 2023-10-06T04:55:36.509 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:36.509 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:36.509 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:36.509 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:36.509 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/clusters/fixed-3.yaml").st_ino) 2023-10-06T04:55:36.509 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:36.661 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628651 2023-10-06T04:55:36.847 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:36.847 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:36.847 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:36.847 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:36.847 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/%").st_ino) 2023-10-06T04:55:36.847 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:36.999 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628649 2023-10-06T04:55:37.186 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:37.186 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:37.186 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:37.186 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:37.186 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/xfs.yaml").st_ino) 2023-10-06T04:55:37.186 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:37.340 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628654 2023-10-06T04:55:37.525 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:37.525 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:37.525 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:37.525 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:37.525 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks").st_ino) 2023-10-06T04:55:37.526 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:37.678 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628652 2023-10-06T04:55:37.862 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:37.862 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:37.862 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:37.863 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:37.863 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks/wordcount.yaml").st_ino) 2023-10-06T04:55:37.863 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:38.015 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627940 2023-10-06T04:55:38.200 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:38.200 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:38.200 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:38.200 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:38.200 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks/repl.yaml").st_ino) 2023-10-06T04:55:38.200 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:38.353 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628653 2023-10-06T04:55:38.537 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:38.538 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:38.538 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:38.538 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:38.538 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks/terasort.yaml").st_ino) 2023-10-06T04:55:38.538 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:38.689 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627939 2023-10-06T04:55:38.874 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:38.874 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:38.874 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:38.875 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:38.875 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology").st_ino) 2023-10-06T04:55:38.875 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:39.027 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629792 2023-10-06T04:55:39.212 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:39.213 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:39.213 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:39.213 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:39.213 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/integration.yaml").st_ino) 2023-10-06T04:55:39.213 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:39.366 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629805 2023-10-06T04:55:39.551 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:39.551 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:39.551 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:39.551 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:39.552 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop").st_ino) 2023-10-06T04:55:39.552 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:39.703 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629818 2023-10-06T04:55:39.889 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:39.889 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:39.889 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:39.889 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:39.889 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop/%").st_ino) 2023-10-06T04:55:39.889 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:40.042 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629819 2023-10-06T04:55:40.227 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:40.227 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:40.227 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:40.227 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:40.227 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop/all").st_ino) 2023-10-06T04:55:40.227 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:40.380 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629820 2023-10-06T04:55:40.565 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:40.565 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:40.565 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:40.566 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:40.566 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop/all/nop.yaml").st_ino) 2023-10-06T04:55:40.566 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:40.718 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629821 2023-10-06T04:55:40.904 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:40.904 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:40.904 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:40.904 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:40.904 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw").st_ino) 2023-10-06T04:55:40.904 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:41.057 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629822 2023-10-06T04:55:41.242 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:41.243 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:41.243 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:41.243 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:41.243 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/distros").st_ino) 2023-10-06T04:55:41.243 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:41.395 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629824 2023-10-06T04:55:41.580 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:41.580 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:41.581 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:41.581 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:41.581 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/%").st_ino) 2023-10-06T04:55:41.581 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:41.734 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629823 2023-10-06T04:55:41.920 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:41.920 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:41.920 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:41.920 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:41.920 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks").st_ino) 2023-10-06T04:55:41.920 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:42.073 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629825 2023-10-06T04:55:42.259 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:42.259 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:42.259 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:42.259 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:42.259 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fastcgi.yaml").st_ino) 2023-10-06T04:55:42.259 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:42.414 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628883 2023-10-06T04:55:42.598 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:42.598 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:42.598 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:42.598 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:42.598 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fcgi.yaml").st_ino) 2023-10-06T04:55:42.598 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:42.752 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628884 2023-10-06T04:55:42.937 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:42.937 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:42.937 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:42.938 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:42.938 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-civetweb.yaml").st_ino) 2023-10-06T04:55:42.938 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:43.090 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629826 2023-10-06T04:55:43.275 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:43.275 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:43.275 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:43.276 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:43.276 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph").st_ino) 2023-10-06T04:55:43.276 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:43.431 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629812 2023-10-06T04:55:43.616 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:43.616 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:43.616 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:43.617 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:43.617 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/clusters").st_ino) 2023-10-06T04:55:43.617 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:43.769 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629814 2023-10-06T04:55:43.954 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:43.954 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:43.954 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:43.954 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:43.954 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/clusters/single.yaml").st_ino) 2023-10-06T04:55:43.954 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:44.107 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629815 2023-10-06T04:55:44.292 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:44.293 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:44.293 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:44.293 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:44.293 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/%").st_ino) 2023-10-06T04:55:44.293 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:44.444 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629813 2023-10-06T04:55:44.630 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:44.630 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:44.631 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:44.631 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:44.631 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/tasks").st_ino) 2023-10-06T04:55:44.631 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:44.782 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629816 2023-10-06T04:55:44.968 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:44.968 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:44.969 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:44.969 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:44.969 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/tasks/teuthology.yaml").st_ino) 2023-10-06T04:55:44.969 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:45.121 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629817 2023-10-06T04:55:45.306 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:45.306 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:45.306 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:45.306 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:45.307 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph").st_ino) 2023-10-06T04:55:45.307 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:45.459 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629798 2023-10-06T04:55:45.644 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:45.644 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:45.644 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:45.644 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:45.644 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/clusters").st_ino) 2023-10-06T04:55:45.644 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:45.796 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629800 2023-10-06T04:55:45.982 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:45.982 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:45.982 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:45.982 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:45.982 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/clusters/single.yaml").st_ino) 2023-10-06T04:55:45.982 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:46.135 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629801 2023-10-06T04:55:46.321 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:46.321 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:46.322 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:46.322 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:46.322 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/distros").st_ino) 2023-10-06T04:55:46.322 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:46.475 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629802 2023-10-06T04:55:46.661 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:46.662 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:46.662 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:46.662 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:46.662 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/%").st_ino) 2023-10-06T04:55:46.662 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:46.812 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629799 2023-10-06T04:55:46.997 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:46.997 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:46.997 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:46.997 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:46.998 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/tasks").st_ino) 2023-10-06T04:55:46.998 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:47.150 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629803 2023-10-06T04:55:47.335 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:47.335 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:47.335 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:47.336 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:47.336 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/tasks/teuthology.yaml").st_ino) 2023-10-06T04:55:47.336 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:47.488 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629804 2023-10-06T04:55:47.673 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:47.673 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:47.674 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:47.674 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:47.674 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages").st_ino) 2023-10-06T04:55:47.674 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:47.827 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629793 2023-10-06T04:55:48.012 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:48.012 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:48.012 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:48.013 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:48.013 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/distros").st_ino) 2023-10-06T04:55:48.013 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:48.166 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629795 2023-10-06T04:55:48.352 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:48.352 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:48.352 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:48.352 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:48.352 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/%").st_ino) 2023-10-06T04:55:48.352 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:48.505 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629794 2023-10-06T04:55:48.690 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:48.690 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:48.690 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:48.690 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:48.690 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks").st_ino) 2023-10-06T04:55:48.690 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:48.843 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629796 2023-10-06T04:55:49.028 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:49.028 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:49.028 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:49.028 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:49.029 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks/default.yaml").st_ino) 2023-10-06T04:55:49.029 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:49.181 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628878 2023-10-06T04:55:49.366 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:49.367 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:49.367 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:49.367 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:49.367 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks/tag.yaml").st_ino) 2023-10-06T04:55:49.367 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:49.519 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628879 2023-10-06T04:55:49.703 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:49.704 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:49.704 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:49.704 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:49.704 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks/branch.yaml").st_ino) 2023-10-06T04:55:49.704 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:49.856 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629797 2023-10-06T04:55:50.042 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:50.042 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:50.042 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:50.042 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:50.042 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster").st_ino) 2023-10-06T04:55:50.042 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:50.196 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629806 2023-10-06T04:55:50.381 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:50.382 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:50.382 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:50.382 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:50.382 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/fs").st_ino) 2023-10-06T04:55:50.382 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:50.535 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629810 2023-10-06T04:55:50.719 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:50.720 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:50.720 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:50.720 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:50.720 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/fs/xfs.yaml").st_ino) 2023-10-06T04:55:50.720 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:50.875 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629811 2023-10-06T04:55:51.060 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:51.061 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:51.061 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:51.061 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:51.061 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/%").st_ino) 2023-10-06T04:55:51.061 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:51.216 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629807 2023-10-06T04:55:51.402 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:51.402 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:51.403 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:51.403 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:51.403 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all").st_ino) 2023-10-06T04:55:51.403 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:51.554 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629808 2023-10-06T04:55:51.740 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:51.740 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:51.740 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:51.740 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:51.740 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/thrashosds.yaml").st_ino) 2023-10-06T04:55:51.740 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:51.894 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628880 2023-10-06T04:55:52.079 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:52.079 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:52.080 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:52.080 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:52.080 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/ceph.yaml").st_ino) 2023-10-06T04:55:52.080 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:52.234 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629809 2023-10-06T04:55:52.419 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:52.419 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:52.419 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:52.419 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:52.419 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/upgrade.yaml").st_ino) 2023-10-06T04:55:52.419 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:52.571 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628881 2023-10-06T04:55:52.757 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:52.758 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:52.758 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:52.758 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:52.758 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/workunit.yaml").st_ino) 2023-10-06T04:55:52.758 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:52.911 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628882 2023-10-06T04:55:53.096 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:53.096 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:53.096 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:53.096 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:53.096 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/workunits").st_ino) 2023-10-06T04:55:53.096 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:53.249 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629827 2023-10-06T04:55:53.434 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:53.434 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:53.434 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:53.435 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:53.435 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/workunits/yes.yaml").st_ino) 2023-10-06T04:55:53.435 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:53.587 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629828 2023-10-06T04:55:53.773 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:53.773 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:53.773 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:53.773 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:53.773 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds").st_ino) 2023-10-06T04:55:53.773 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:53.927 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628816 2023-10-06T04:55:54.112 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:54.112 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:54.112 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:54.113 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:54.113 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic").st_ino) 2023-10-06T04:55:54.113 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:54.265 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628817 2023-10-06T04:55:54.450 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:54.451 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:54.451 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:54.451 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:54.451 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides").st_ino) 2023-10-06T04:55:54.451 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:54.603 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628828 2023-10-06T04:55:54.788 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:54.788 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:54.788 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:54.788 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:54.788 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides/fuse-default-perm-no.yaml").st_ino) 2023-10-06T04:55:54.788 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:54.942 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628831 2023-10-06T04:55:55.126 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:55.126 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:55.127 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:55.127 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:55.127 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides/basic").st_ino) 2023-10-06T04:55:55.127 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:55.280 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628830 2023-10-06T04:55:55.465 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:55.465 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:55.465 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:55.465 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:55.465 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides/%").st_ino) 2023-10-06T04:55:55.465 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:55.617 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628829 2023-10-06T04:55:55.803 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:55.803 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:55.803 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:55.803 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:55.803 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/clusters").st_ino) 2023-10-06T04:55:55.803 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:55.956 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628820 2023-10-06T04:55:56.141 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:56.141 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:56.142 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:56.142 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:56.142 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/clusters/9-mds.yaml").st_ino) 2023-10-06T04:55:56.142 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:56.298 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628822 2023-10-06T04:55:56.483 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:56.483 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:56.483 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:56.483 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:56.483 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/clusters/3-mds.yaml").st_ino) 2023-10-06T04:55:56.483 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:56.642 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628821 2023-10-06T04:55:56.828 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:56.828 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:56.828 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:56.828 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:56.828 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/fs").st_ino) 2023-10-06T04:55:56.828 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:56.982 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628823 2023-10-06T04:55:57.167 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:57.168 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:57.168 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:57.168 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:57.168 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/mount").st_ino) 2023-10-06T04:55:57.168 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:57.320 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628825 2023-10-06T04:55:57.506 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:57.506 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:57.506 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:57.506 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:57.506 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/mount/kclient.yaml").st_ino) 2023-10-06T04:55:57.506 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:57.660 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628827 2023-10-06T04:55:57.846 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:57.846 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:57.846 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:57.846 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:57.846 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/mount/fuse.yaml").st_ino) 2023-10-06T04:55:57.846 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:57.999 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628826 2023-10-06T04:55:58.184 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:58.184 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:58.185 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:58.185 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:58.185 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/inline").st_ino) 2023-10-06T04:55:58.185 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:58.337 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628824 2023-10-06T04:55:58.522 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:58.522 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:58.523 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:58.523 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:58.523 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/begin.yaml").st_ino) 2023-10-06T04:55:58.523 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:58.675 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628819 2023-10-06T04:55:58.860 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:58.860 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:58.860 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:58.860 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:58.860 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/%").st_ino) 2023-10-06T04:55:58.860 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:59.013 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628818 2023-10-06T04:55:59.199 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:59.199 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:59.199 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:59.199 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:59.199 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/tasks").st_ino) 2023-10-06T04:55:59.200 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:59.352 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628832 2023-10-06T04:55:59.538 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:59.538 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:59.538 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:59.538 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:59.538 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify").st_ino) 2023-10-06T04:55:59.538 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:55:59.691 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628833 2023-10-06T04:55:59.877 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:55:59.877 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:55:59.877 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:55:59.877 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:55:59.877 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/validater").st_ino) 2023-10-06T04:55:59.877 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:00.030 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628848 2023-10-06T04:56:00.216 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:00.216 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:00.216 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:00.216 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:00.216 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides").st_ino) 2023-10-06T04:56:00.216 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:00.368 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628843 2023-10-06T04:56:00.553 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:00.554 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:00.554 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:00.555 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:00.555 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides/fuse-default-perm-no.yaml").st_ino) 2023-10-06T04:56:00.555 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:00.705 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628845 2023-10-06T04:56:00.891 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:00.891 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:00.891 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:00.891 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:00.891 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides/%").st_ino) 2023-10-06T04:56:00.892 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:01.043 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628844 2023-10-06T04:56:01.228 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:01.228 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:01.229 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:01.229 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:01.229 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides/verify").st_ino) 2023-10-06T04:56:01.229 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:01.380 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628846 2023-10-06T04:56:01.565 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:01.566 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:01.566 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:01.566 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:01.566 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/clusters").st_ino) 2023-10-06T04:56:01.566 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:01.718 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628836 2023-10-06T04:56:01.903 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:01.903 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:01.904 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:01.904 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:01.904 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/clusters/9-mds.yaml").st_ino) 2023-10-06T04:56:01.904 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:01.922 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:56:01.950 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:56:02.058 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628838 2023-10-06T04:56:02.245 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:02.245 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:02.245 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:02.245 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:02.246 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/clusters/3-mds.yaml").st_ino) 2023-10-06T04:56:02.246 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:02.399 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628837 2023-10-06T04:56:02.584 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:02.584 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:02.584 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:02.584 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:02.585 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/fs").st_ino) 2023-10-06T04:56:02.585 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:02.737 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628839 2023-10-06T04:56:02.922 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:02.922 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:02.922 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:02.922 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:02.922 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/mount").st_ino) 2023-10-06T04:56:02.923 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:03.074 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628840 2023-10-06T04:56:03.260 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:03.260 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:03.260 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:03.260 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:03.260 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/mount/kclient.yaml").st_ino) 2023-10-06T04:56:03.261 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:03.414 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628842 2023-10-06T04:56:03.599 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:03.599 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:03.599 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:03.599 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:03.599 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/mount/fuse.yaml").st_ino) 2023-10-06T04:56:03.599 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:03.751 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628841 2023-10-06T04:56:03.937 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:03.937 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:03.937 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:03.937 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:03.937 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/begin.yaml").st_ino) 2023-10-06T04:56:03.937 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:04.090 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628835 2023-10-06T04:56:04.275 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:04.275 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:04.276 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:04.276 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:04.276 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/%").st_ino) 2023-10-06T04:56:04.276 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:04.429 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628834 2023-10-06T04:56:04.614 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:04.614 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:04.614 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:04.614 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:04.614 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/tasks").st_ino) 2023-10-06T04:56:04.614 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:04.767 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628847 2023-10-06T04:56:04.952 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:04.952 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:04.953 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:04.953 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:04.953 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke").st_ino) 2023-10-06T04:56:04.953 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:05.105 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629498 2023-10-06T04:56:05.290 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:05.291 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:05.291 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:05.291 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:05.291 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node").st_ino) 2023-10-06T04:56:05.291 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:05.443 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629499 2023-10-06T04:56:05.628 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:05.628 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:05.628 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:05.628 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:05.628 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters").st_ino) 2023-10-06T04:56:05.629 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:05.780 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629501 2023-10-06T04:56:05.967 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:05.967 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:05.967 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:05.967 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:05.967 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters/openstack.yaml").st_ino) 2023-10-06T04:56:05.967 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:06.119 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628262 2023-10-06T04:56:06.304 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:06.304 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:06.304 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:06.304 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:06.304 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters/+").st_ino) 2023-10-06T04:56:06.305 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:06.459 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629502 2023-10-06T04:56:06.643 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:06.644 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:06.644 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:06.644 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:06.644 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters/fixed-1.yaml").st_ino) 2023-10-06T04:56:06.644 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:06.797 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629503 2023-10-06T04:56:06.982 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:06.982 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:06.982 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:06.982 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:06.982 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/%").st_ino) 2023-10-06T04:56:06.982 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:07.135 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629500 2023-10-06T04:56:07.320 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:07.320 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:07.320 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:07.320 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:07.320 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/tasks").st_ino) 2023-10-06T04:56:07.320 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:07.474 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629504 2023-10-06T04:56:07.660 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:07.660 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:07.660 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:07.660 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:07.660 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml").st_ino) 2023-10-06T04:56:07.660 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:07.813 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629505 2023-10-06T04:56:07.998 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:07.998 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:07.998 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:07.998 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:07.998 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd").st_ino) 2023-10-06T04:56:07.998 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:08.152 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629765 2023-10-06T04:56:08.338 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:08.338 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:08.338 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:08.338 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:08.338 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/distro").st_ino) 2023-10-06T04:56:08.338 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:08.491 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629767 2023-10-06T04:56:08.676 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:08.677 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:08.677 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:08.677 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:08.677 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/distro/ubuntu_16.04.yaml").st_ino) 2023-10-06T04:56:08.677 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:08.829 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629769 2023-10-06T04:56:09.014 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:09.014 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:09.014 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:09.015 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:09.015 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/distro/centos_7.2.yaml").st_ino) 2023-10-06T04:56:09.015 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:09.167 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629768 2023-10-06T04:56:09.352 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:09.352 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:09.352 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:09.353 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:09.353 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/%").st_ino) 2023-10-06T04:56:09.353 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:09.504 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629766 2023-10-06T04:56:09.690 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:09.690 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:09.691 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:09.691 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:09.691 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/tasks").st_ino) 2023-10-06T04:56:09.691 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:09.842 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629770 2023-10-06T04:56:10.027 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:10.027 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:10.027 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:10.027 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:10.027 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/tasks/systemd.yaml").st_ino) 2023-10-06T04:56:10.027 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:10.181 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629771 2023-10-06T04:56:10.366 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:10.366 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:10.366 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:10.367 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:10.367 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic").st_ino) 2023-10-06T04:56:10.367 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:10.518 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629506 2023-10-06T04:56:10.704 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:10.705 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:10.705 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:10.705 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:10.705 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/clusters").st_ino) 2023-10-06T04:56:10.705 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:10.857 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629508 2023-10-06T04:56:11.042 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:11.043 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:11.043 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:11.043 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:11.043 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/clusters/fixed-3-cephfs.yaml").st_ino) 2023-10-06T04:56:11.043 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:11.195 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629509 2023-10-06T04:56:11.380 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:11.380 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:11.380 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:11.380 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:11.381 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/fs").st_ino) 2023-10-06T04:56:11.381 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:11.533 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629510 2023-10-06T04:56:11.719 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:11.719 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:11.719 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:11.719 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:11.719 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/fs/btrfs.yaml").st_ino) 2023-10-06T04:56:11.719 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:11.873 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629511 2023-10-06T04:56:12.058 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:12.058 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:12.058 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:12.058 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:12.058 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/%").st_ino) 2023-10-06T04:56:12.058 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:12.211 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629507 2023-10-06T04:56:12.397 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:12.397 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:12.397 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:12.397 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:12.397 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks").st_ino) 2023-10-06T04:56:12.397 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:12.549 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629512 2023-10-06T04:56:12.735 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:12.735 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:12.735 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:12.735 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:12.735 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/libcephfs_interface_tests.yaml").st_ino) 2023-10-06T04:56:12.736 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:12.888 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628270 2023-10-06T04:56:13.073 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:13.073 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:13.074 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:13.074 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:13.074 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_cache_snaps.yaml").st_ino) 2023-10-06T04:56:13.074 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:13.225 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628274 2023-10-06T04:56:13.411 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:13.411 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:13.411 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:13.411 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:13.411 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_cls_all.yaml").st_ino) 2023-10-06T04:56:13.411 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:13.563 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628275 2023-10-06T04:56:13.748 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:13.748 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:13.748 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:13.749 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:13.749 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_cli_import_export.yaml").st_ino) 2023-10-06T04:56:13.749 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:13.902 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628863 2023-10-06T04:56:14.087 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:14.087 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:14.087 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:14.087 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:14.087 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:56:14.087 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:14.242 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628268 2023-10-06T04:56:14.427 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:14.427 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:14.427 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:14.427 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:14.427 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2023-10-06T04:56:14.427 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:14.580 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628265 2023-10-06T04:56:14.766 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:14.766 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:14.766 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:14.766 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:14.766 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/mon_thrash.yaml").st_ino) 2023-10-06T04:56:14.766 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:14.919 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628271 2023-10-06T04:56:15.104 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:15.104 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:15.104 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:15.104 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:15.104 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_direct_io.yaml").st_ino) 2023-10-06T04:56:15.104 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:15.257 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628266 2023-10-06T04:56:15.442 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:15.443 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:15.443 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:15.443 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:15.443 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_fsx.yaml").st_ino) 2023-10-06T04:56:15.443 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:15.595 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628864 2023-10-06T04:56:15.780 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:15.780 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:15.780 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:15.780 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:15.781 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_python_api_tests.yaml").st_ino) 2023-10-06T04:56:15.781 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:15.934 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628865 2023-10-06T04:56:16.120 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:16.120 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:16.120 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:16.120 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:16.120 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_workunit_suites_iozone.yaml").st_ino) 2023-10-06T04:56:16.120 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:16.273 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628866 2023-10-06T04:56:16.459 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:16.459 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:16.459 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:16.459 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:16.459 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_dbench.yaml").st_ino) 2023-10-06T04:56:16.459 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:16.612 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628267 2023-10-06T04:56:16.797 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:16.798 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:16.798 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:16.798 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:16.798 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_api_tests.yaml").st_ino) 2023-10-06T04:56:16.798 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:16.951 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628862 2023-10-06T04:56:17.137 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:17.137 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:17.137 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:17.137 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:17.137 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2023-10-06T04:56:17.138 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:17.290 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629513 2023-10-06T04:56:17.474 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:17.475 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:17.475 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:17.475 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:17.475 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_ec_snaps.yaml").st_ino) 2023-10-06T04:56:17.475 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:17.627 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628276 2023-10-06T04:56:17.812 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:17.812 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:17.812 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:17.812 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:17.812 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rgw_ec_s3tests.yaml").st_ino) 2023-10-06T04:56:17.813 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:17.966 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628867 2023-10-06T04:56:18.152 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:18.152 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:18.152 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:18.153 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:18.153 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_pjd.yaml").st_ino) 2023-10-06T04:56:18.153 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:18.306 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628269 2023-10-06T04:56:18.491 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:18.492 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:18.492 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:18.492 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:18.492 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_workunit_loadgen_mix.yaml").st_ino) 2023-10-06T04:56:18.492 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:18.644 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628278 2023-10-06T04:56:18.830 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:18.830 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:18.830 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:18.830 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:18.830 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_python.yaml").st_ino) 2023-10-06T04:56:18.830 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:18.983 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628277 2023-10-06T04:56:19.168 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:19.169 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:19.169 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:19.169 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:19.169 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rgw_swift.yaml").st_ino) 2023-10-06T04:56:19.169 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:19.321 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628869 2023-10-06T04:56:19.507 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:19.507 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:19.507 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:19.507 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:19.507 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_bench.yaml").st_ino) 2023-10-06T04:56:19.507 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:19.659 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628273 2023-10-06T04:56:19.845 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:19.845 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:19.845 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:19.845 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:19.845 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_api_tests.yaml").st_ino) 2023-10-06T04:56:19.845 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:19.998 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628272 2023-10-06T04:56:20.184 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:20.184 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:20.184 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:20.184 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:20.184 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2023-10-06T04:56:20.184 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:20.337 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628263 2023-10-06T04:56:20.523 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:20.523 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:20.523 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:20.523 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:20.523 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rgw_s3tests.yaml").st_ino) 2023-10-06T04:56:20.523 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:20.676 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628868 2023-10-06T04:56:20.861 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:20.861 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:20.862 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:20.862 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:20.862 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_iozone.yaml").st_ino) 2023-10-06T04:56:20.862 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:21.014 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628264 2023-10-06T04:56:21.199 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:21.199 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:21.199 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:21.199 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:21.200 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types").st_ino) 2023-10-06T04:56:21.200 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:21.353 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628344 2023-10-06T04:56:21.538 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:21.539 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:21.539 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:21.539 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:21.539 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types/vps.yaml").st_ino) 2023-10-06T04:56:21.539 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:21.691 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627873 2023-10-06T04:56:21.877 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:21.877 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:21.877 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:21.877 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:21.877 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types/schedule_rados_ovh.sh").st_ino) 2023-10-06T04:56:21.877 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:22.029 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627872 2023-10-06T04:56:22.215 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:22.215 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:22.215 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:22.215 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:22.215 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types/schedule_rados.sh").st_ino) 2023-10-06T04:56:22.215 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:22.368 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628345 2023-10-06T04:56:22.553 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:22.553 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:22.553 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:22.553 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:22.553 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/mon_kv_backend").st_ino) 2023-10-06T04:56:22.554 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:22.705 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628346 2023-10-06T04:56:22.891 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:22.891 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:22.891 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:22.891 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:22.891 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/mon_kv_backend/leveldb.yaml").st_ino) 2023-10-06T04:56:22.891 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:23.043 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628347 2023-10-06T04:56:23.229 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:23.229 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:23.229 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:23.229 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:23.230 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/mon_kv_backend/rocksdb.yaml").st_ino) 2023-10-06T04:56:23.230 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:23.382 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627874 2023-10-06T04:56:23.567 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:23.568 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:23.568 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:23.568 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:23.568 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/README").st_ino) 2023-10-06T04:56:23.568 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:23.721 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627809 2023-10-06T04:56:23.906 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:23.906 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:23.906 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:23.906 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:23.906 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks").st_ino) 2023-10-06T04:56:23.907 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:24.058 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629987 2023-10-06T04:56:24.243 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:24.243 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:24.244 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:24.244 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:24.244 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rebuild_mondb.py").st_ino) 2023-10-06T04:56:24.244 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:24.397 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629050 2023-10-06T04:56:24.583 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:24.583 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:24.583 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:24.583 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:24.584 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/workunit.py").st_ino) 2023-10-06T04:56:24.584 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:24.737 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629082 2023-10-06T04:56:24.923 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:24.923 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:24.923 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:24.923 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:24.923 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/osd_backfill.py").st_ino) 2023-10-06T04:56:24.923 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:25.076 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629033 2023-10-06T04:56:25.261 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:25.261 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:25.261 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:25.261 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:25.262 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/calamari_setup.py").st_ino) 2023-10-06T04:56:25.262 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:25.414 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628965 2023-10-06T04:56:25.599 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:25.600 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:25.600 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:25.600 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:25.600 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/object_source_down.py").st_ino) 2023-10-06T04:56:25.600 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:25.752 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629031 2023-10-06T04:56:25.937 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:25.938 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:25.938 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:25.938 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:25.938 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/populate_rbd_pool.py").st_ino) 2023-10-06T04:56:25.938 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:26.091 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629038 2023-10-06T04:56:26.276 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:26.342 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:26.342 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:26.342 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:26.342 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util").st_ino) 2023-10-06T04:56:26.342 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:26.455 INFO:teuthology.orchestra.run.smithi124.stdout:1099511630003 2023-10-06T04:56:26.640 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:26.640 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:26.640 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:26.640 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:26.641 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/rgw.py").st_ino) 2023-10-06T04:56:26.641 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:26.793 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629077 2023-10-06T04:56:26.978 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:26.978 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:26.978 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:26.978 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:26.978 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/__init__.py").st_ino) 2023-10-06T04:56:26.978 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:27.131 INFO:teuthology.orchestra.run.smithi124.stdout:1099511630004 2023-10-06T04:56:27.317 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:27.317 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:27.317 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:27.317 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:27.317 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/rados.py").st_ino) 2023-10-06T04:56:27.317 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:27.470 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629076 2023-10-06T04:56:27.655 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:27.655 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:27.655 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:27.655 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:27.655 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/test").st_ino) 2023-10-06T04:56:27.655 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:27.807 INFO:teuthology.orchestra.run.smithi124.stdout:1099511630005 2023-10-06T04:56:27.993 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:27.993 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:27.993 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:27.993 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:27.993 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/test/__init__.py").st_ino) 2023-10-06T04:56:27.993 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:28.147 INFO:teuthology.orchestra.run.smithi124.stdout:1099511630006 2023-10-06T04:56:28.332 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:28.332 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:28.332 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:28.332 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:28.332 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/test/test_rados.py").st_ino) 2023-10-06T04:56:28.332 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:28.485 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629078 2023-10-06T04:56:28.671 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:28.671 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:28.671 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:28.671 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:28.671 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/osd_failsafe_enospc.py").st_ino) 2023-10-06T04:56:28.671 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:28.824 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629034 2023-10-06T04:56:29.009 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:29.010 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:29.010 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:29.010 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:29.010 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/osd_recovery.py").st_ino) 2023-10-06T04:56:29.010 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:29.162 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629035 2023-10-06T04:56:29.348 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:29.348 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:29.348 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:29.348 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:29.348 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/die_on_err.py").st_ino) 2023-10-06T04:56:29.348 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:29.500 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629007 2023-10-06T04:56:29.685 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:29.685 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:29.685 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:29.685 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:29.685 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/calamari_nosetests.py").st_ino) 2023-10-06T04:56:29.685 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:29.838 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628964 2023-10-06T04:56:30.024 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:30.024 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:30.024 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:30.024 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:30.024 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/admin_socket.py").st_ino) 2023-10-06T04:56:30.024 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:30.177 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628950 2023-10-06T04:56:30.363 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:30.363 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:30.363 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:30.363 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:30.363 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr").st_ino) 2023-10-06T04:56:30.363 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629999 2023-10-06T04:56:30.702 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:30.703 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:30.703 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:30.703 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:30.703 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr/__init__.py").st_ino) 2023-10-06T04:56:30.703 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:30.855 INFO:teuthology.orchestra.run.smithi124.stdout:1099511630000 2023-10-06T04:56:31.041 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:31.041 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:31.041 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:31.041 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:31.041 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr/test_failover.py").st_ino) 2023-10-06T04:56:31.041 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:31.194 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629022 2023-10-06T04:56:31.378 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:31.378 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:31.379 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:31.379 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:31.379 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr/mgr_test_case.py").st_ino) 2023-10-06T04:56:31.379 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:31.530 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629021 2023-10-06T04:56:31.716 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:31.716 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:31.716 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:31.716 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:31.716 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/thrash_pool_snaps.py").st_ino) 2023-10-06T04:56:31.717 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:31.870 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629072 2023-10-06T04:56:32.056 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:32.056 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:32.056 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:32.056 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:32.056 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/userdata_teardown.yaml").st_ino) 2023-10-06T04:56:32.057 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:32.057 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:56:32.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:56:32.211 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629075 2023-10-06T04:56:32.397 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:32.397 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:32.397 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:32.397 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:32.397 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosbenchsweep.py").st_ino) 2023-10-06T04:56:32.398 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:32.549 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629042 2023-10-06T04:56:32.735 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:32.735 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:32.735 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:32.735 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:32.735 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mds_thrash.py").st_ino) 2023-10-06T04:56:32.736 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:32.888 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629019 2023-10-06T04:56:33.074 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:33.074 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:33.074 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:33.074 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:33.074 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd.py").st_ino) 2023-10-06T04:56:33.075 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:33.227 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629046 2023-10-06T04:56:33.412 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:33.412 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:33.412 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:33.412 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:33.412 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rgw.py").st_ino) 2023-10-06T04:56:33.412 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:33.564 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629058 2023-10-06T04:56:33.750 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:33.750 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:33.750 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:33.750 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:33.750 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/teuthology_integration.py").st_ino) 2023-10-06T04:56:33.750 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:33.903 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629070 2023-10-06T04:56:34.089 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:34.089 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:34.089 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:34.089 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:34.089 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_seesaw.py").st_ino) 2023-10-06T04:56:34.089 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:34.241 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629028 2023-10-06T04:56:34.427 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:34.427 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:34.427 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:34.427 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:34.428 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/repair_test.py").st_ino) 2023-10-06T04:56:34.428 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:34.579 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629054 2023-10-06T04:56:34.765 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:34.765 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:34.765 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:34.765 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:34.765 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/watch_notify_same_primary.py").st_ino) 2023-10-06T04:56:34.765 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:34.917 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629080 2023-10-06T04:56:35.102 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:35.102 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:35.102 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:35.103 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:35.103 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/peer.py").st_ino) 2023-10-06T04:56:35.103 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:35.255 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629036 2023-10-06T04:56:35.440 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:35.440 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:35.440 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:35.441 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:35.441 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/restart.py").st_ino) 2023-10-06T04:56:35.441 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:35.592 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629057 2023-10-06T04:56:35.777 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:35.777 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:35.777 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:35.778 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:35.778 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph.py").st_ino) 2023-10-06T04:56:35.778 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:35.930 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628966 2023-10-06T04:56:36.115 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:36.115 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:36.115 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:36.115 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:36.116 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests").st_ino) 2023-10-06T04:56:36.116 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:36.268 INFO:teuthology.orchestra.run.smithi124.stdout:1099511630001 2023-10-06T04:56:36.452 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:36.452 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:36.453 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:36.453 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:36.453 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/test_buildpackages.py").st_ino) 2023-10-06T04:56:36.453 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:36.604 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629067 2023-10-06T04:56:36.790 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:36.790 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:36.791 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:36.791 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:36.791 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/test_radosgw_admin.py").st_ino) 2023-10-06T04:56:36.791 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:36.943 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629069 2023-10-06T04:56:37.129 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:37.129 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:37.129 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:37.129 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:37.129 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/test_devstack.py").st_ino) 2023-10-06T04:56:37.129 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:37.282 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629068 2023-10-06T04:56:37.466 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:37.466 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:37.467 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:37.467 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:37.467 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/__init__.py").st_ino) 2023-10-06T04:56:37.467 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:37.618 INFO:teuthology.orchestra.run.smithi124.stdout:1099511630002 2023-10-06T04:56:37.804 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:37.804 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:37.804 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:37.804 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:37.804 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rgw_logsocket.py").st_ino) 2023-10-06T04:56:37.804 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:37.956 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629059 2023-10-06T04:56:38.142 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:38.142 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:38.142 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:38.142 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:38.142 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosgw_admin.py").st_ino) 2023-10-06T04:56:38.142 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:38.295 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629043 2023-10-06T04:56:38.482 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:38.482 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:38.482 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:38.482 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:38.482 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_client.py").st_ino) 2023-10-06T04:56:38.483 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:38.634 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628967 2023-10-06T04:56:38.819 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:38.820 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:38.820 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:38.820 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:38.820 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/__init__.py").st_ino) 2023-10-06T04:56:38.820 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:38.972 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629988 2023-10-06T04:56:39.157 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:39.157 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:39.158 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:39.158 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:39.158 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/aver.py").st_ino) 2023-10-06T04:56:39.158 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:39.310 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628953 2023-10-06T04:56:39.496 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:39.496 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:39.496 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:39.496 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:39.496 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cram.py").st_ino) 2023-10-06T04:56:39.496 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:39.649 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629004 2023-10-06T04:56:39.834 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:39.835 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:39.835 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:39.835 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:39.835 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs").st_ino) 2023-10-06T04:56:39.835 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:39.986 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629997 2023-10-06T04:56:40.171 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:40.172 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:40.172 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:40.172 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:40.172 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_misc.py").st_ino) 2023-10-06T04:56:40.172 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:40.324 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628995 2023-10-06T04:56:40.510 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:40.510 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:40.510 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:40.510 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:40.510 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_client_limits.py").st_ino) 2023-10-06T04:56:40.510 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:40.663 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628981 2023-10-06T04:56:40.849 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:40.849 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:40.850 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:40.850 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:40.850 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_pool_perm.py").st_ino) 2023-10-06T04:56:40.850 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:41.002 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628996 2023-10-06T04:56:41.187 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:41.187 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:41.187 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:41.187 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:41.187 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_data_scan.py").st_ino) 2023-10-06T04:56:41.188 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:41.341 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628985 2023-10-06T04:56:41.527 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:41.527 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:41.527 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:41.527 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:41.528 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_client_recovery.py").st_ino) 2023-10-06T04:56:41.528 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:41.680 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628982 2023-10-06T04:56:41.865 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:41.865 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:41.865 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:41.865 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:41.865 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_journal_migration.py").st_ino) 2023-10-06T04:56:41.865 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:42.018 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628992 2023-10-06T04:56:42.204 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:42.204 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:42.204 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:42.204 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:42.204 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_dump_tree.py").st_ino) 2023-10-06T04:56:42.204 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:42.357 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628986 2023-10-06T04:56:42.541 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:42.542 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:42.542 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:42.542 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:42.542 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_mantle.py").st_ino) 2023-10-06T04:56:42.542 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:42.693 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628994 2023-10-06T04:56:42.879 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:42.879 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:42.879 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:42.879 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:42.879 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_sessionmap.py").st_ino) 2023-10-06T04:56:42.879 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:43.032 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628999 2023-10-06T04:56:43.217 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:43.218 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:43.218 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:43.218 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:43.218 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/__init__.py").st_ino) 2023-10-06T04:56:43.218 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:43.371 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629998 2023-10-06T04:56:43.556 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:43.556 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:43.556 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:43.556 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:43.556 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_journal_repair.py").st_ino) 2023-10-06T04:56:43.556 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:43.709 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628993 2023-10-06T04:56:43.894 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:43.894 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:43.895 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:43.895 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:43.895 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/kernel_mount.py").st_ino) 2023-10-06T04:56:43.895 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:44.047 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628976 2023-10-06T04:56:44.232 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:44.232 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:44.232 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:44.233 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:44.233 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_cap_flush.py").st_ino) 2023-10-06T04:56:44.233 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:44.386 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628980 2023-10-06T04:56:44.571 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:44.572 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:44.572 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:44.572 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:44.572 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_readahead.py").st_ino) 2023-10-06T04:56:44.572 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:44.724 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628997 2023-10-06T04:56:44.909 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:44.909 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:44.909 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:44.909 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:44.909 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_backtrace.py").st_ino) 2023-10-06T04:56:44.909 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:45.062 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628979 2023-10-06T04:56:45.249 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:45.249 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:45.250 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:45.250 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:45.250 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_auto_repair.py").st_ino) 2023-10-06T04:56:45.250 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:45.403 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628978 2023-10-06T04:56:45.588 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:45.588 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:45.588 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:45.588 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:45.588 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_strays.py").st_ino) 2023-10-06T04:56:45.588 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:45.741 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629000 2023-10-06T04:56:45.925 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:45.926 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:45.926 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:45.926 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:45.926 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_volume_client.py").st_ino) 2023-10-06T04:56:45.926 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:46.078 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629001 2023-10-06T04:56:46.263 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:46.263 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:46.263 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:46.263 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:46.263 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/cephfs_test_case.py").st_ino) 2023-10-06T04:56:46.263 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:46.417 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628973 2023-10-06T04:56:46.602 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:46.602 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:46.602 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:46.602 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:46.602 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_fragment.py").st_ino) 2023-10-06T04:56:46.602 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:46.754 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628990 2023-10-06T04:56:46.940 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:46.941 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:46.941 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:46.941 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:46.941 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_failover.py").st_ino) 2023-10-06T04:56:46.941 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:47.092 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628987 2023-10-06T04:56:47.278 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:47.278 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:47.278 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:47.278 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:47.279 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_full.py").st_ino) 2023-10-06T04:56:47.279 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:47.434 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628991 2023-10-06T04:56:47.619 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:47.619 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:47.619 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:47.619 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:47.619 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/filesystem.py").st_ino) 2023-10-06T04:56:47.619 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:47.772 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628974 2023-10-06T04:56:47.957 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:47.957 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:47.957 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:47.957 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:47.957 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/mount.py").st_ino) 2023-10-06T04:56:47.958 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:48.109 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628977 2023-10-06T04:56:48.295 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:48.296 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:48.296 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:48.296 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:48.296 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_damage.py").st_ino) 2023-10-06T04:56:48.296 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:48.448 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628984 2023-10-06T04:56:48.633 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:48.633 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:48.633 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:48.634 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:48.634 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_scrub_checks.py").st_ino) 2023-10-06T04:56:48.634 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:48.786 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628998 2023-10-06T04:56:48.972 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:48.972 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:48.972 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:48.973 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:48.973 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_config_commands.py").st_ino) 2023-10-06T04:56:48.973 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:49.126 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628983 2023-10-06T04:56:49.312 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:49.312 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:49.312 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:49.312 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:49.312 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_flush.py").st_ino) 2023-10-06T04:56:49.312 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:49.466 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628988 2023-10-06T04:56:49.651 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:49.651 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:49.651 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:49.652 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:49.652 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/fuse_mount.py").st_ino) 2023-10-06T04:56:49.652 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:49.803 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628975 2023-10-06T04:56:49.988 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:49.988 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:49.988 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:49.988 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:49.988 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_forward_scrub.py").st_ino) 2023-10-06T04:56:49.988 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:50.143 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628989 2023-10-06T04:56:50.327 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:50.328 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:50.328 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:50.328 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:50.328 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/recovery_bench.py").st_ino) 2023-10-06T04:56:50.328 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:50.482 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629051 2023-10-06T04:56:50.666 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:50.667 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:50.667 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:50.667 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:50.667 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/multibench.py").st_ino) 2023-10-06T04:56:50.667 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:50.820 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629030 2023-10-06T04:56:51.005 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:51.005 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:51.005 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:51.005 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:51.005 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/devstack.py").st_ino) 2023-10-06T04:56:51.006 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:51.158 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629006 2023-10-06T04:56:51.343 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:51.343 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:51.343 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:51.344 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:51.344 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs_test_runner.py").st_ino) 2023-10-06T04:56:51.344 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:51.495 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629002 2023-10-06T04:56:51.680 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:51.680 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:51.681 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:51.681 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:51.681 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/filestore_idempotent.py").st_ino) 2023-10-06T04:56:51.681 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:51.834 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629012 2023-10-06T04:56:52.019 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:52.019 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:52.019 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:52.020 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:52.020 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mod_proxy_fcgi.tcp.conf.template").st_ino) 2023-10-06T04:56:52.020 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:52.172 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629024 2023-10-06T04:56:52.358 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:52.358 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:52.358 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:52.358 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:52.358 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/scrub.py").st_ino) 2023-10-06T04:56:52.359 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:52.511 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629064 2023-10-06T04:56:52.695 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:52.696 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:52.696 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:52.696 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:52.696 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/divergent_priors.py").st_ino) 2023-10-06T04:56:52.696 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:52.848 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629008 2023-10-06T04:56:53.034 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:53.034 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:53.034 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:53.034 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:53.035 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/samba.py").st_ino) 2023-10-06T04:56:53.035 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:53.188 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629063 2023-10-06T04:56:53.374 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:53.374 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:53.374 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:53.375 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:53.375 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/watch_notify_stress.py").st_ino) 2023-10-06T04:56:53.375 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:53.533 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629081 2023-10-06T04:56:53.719 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:53.719 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:53.719 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:53.719 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:53.719 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/boto.cfg.template").st_ino) 2023-10-06T04:56:53.719 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:53.874 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628955 2023-10-06T04:56:54.060 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:54.060 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:54.060 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:54.060 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:54.060 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages.py").st_ino) 2023-10-06T04:56:54.060 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:54.213 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628956 2023-10-06T04:56:54.399 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:54.399 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:54.399 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:54.399 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:54.399 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_test_case.py").st_ino) 2023-10-06T04:56:54.399 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:54.551 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628972 2023-10-06T04:56:54.736 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:54.736 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:54.737 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:54.737 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:54.737 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/s3roundtrip.py").st_ino) 2023-10-06T04:56:54.737 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:54.888 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629061 2023-10-06T04:56:55.075 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:55.075 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:55.075 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:55.075 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:55.075 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/qemu.py").st_ino) 2023-10-06T04:56:55.075 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:55.227 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629039 2023-10-06T04:56:55.413 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:55.414 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:55.414 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:55.414 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:55.414 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/locktest.py").st_ino) 2023-10-06T04:56:55.414 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:55.566 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629014 2023-10-06T04:56:55.751 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:55.751 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:55.751 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:55.751 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:55.751 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/manypools.py").st_ino) 2023-10-06T04:56:55.752 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:55.904 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629017 2023-10-06T04:56:56.089 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:56.089 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:56.089 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:56.089 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:56.089 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mds_creation_failure.py").st_ino) 2023-10-06T04:56:56.089 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:56.242 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629018 2023-10-06T04:56:56.427 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:56.427 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:56.427 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:56.427 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:56.428 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/apache.conf.template").st_ino) 2023-10-06T04:56:56.428 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:56.580 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628951 2023-10-06T04:56:56.765 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:56.765 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:56.765 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:56.765 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:56.765 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ec_lost_unfound.py").st_ino) 2023-10-06T04:56:56.765 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:56.919 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629011 2023-10-06T04:56:57.103 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:57.103 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:57.103 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:57.104 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:57.104 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages").st_ino) 2023-10-06T04:56:57.104 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:57.257 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629989 2023-10-06T04:56:57.442 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:57.442 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:57.442 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:57.442 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:57.442 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/ubuntu-16.04-user-data.txt").st_ino) 2023-10-06T04:56:57.442 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:57.595 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629996 2023-10-06T04:56:57.780 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:57.780 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:57.780 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:57.780 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:57.780 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/ubuntu-14.04-user-data.txt").st_ino) 2023-10-06T04:56:57.780 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:57.933 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629995 2023-10-06T04:56:58.119 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:58.119 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:58.119 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:58.119 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:58.119 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-6.5-user-data.txt").st_ino) 2023-10-06T04:56:58.119 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:58.272 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628957 2023-10-06T04:56:58.457 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:58.457 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:58.458 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:58.458 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:58.458 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-7.1-user-data.txt").st_ino) 2023-10-06T04:56:58.458 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:58.609 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629992 2023-10-06T04:56:58.794 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:58.795 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:58.795 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:58.795 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:58.795 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/make-deb.sh").st_ino) 2023-10-06T04:56:58.795 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:58.947 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628960 2023-10-06T04:56:59.133 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:59.133 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:59.133 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:59.133 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:59.133 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-7.0-user-data.txt").st_ino) 2023-10-06T04:56:59.133 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:59.287 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629991 2023-10-06T04:56:59.472 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:59.473 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:59.473 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:59.473 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:59.473 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/make-rpm.sh").st_ino) 2023-10-06T04:56:59.473 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:59.626 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628961 2023-10-06T04:56:59.812 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:56:59.812 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:56:59.812 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:56:59.812 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:56:59.812 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/opensuse-42.1-user-data.txt").st_ino) 2023-10-06T04:56:59.812 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:56:59.965 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628962 2023-10-06T04:57:00.150 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:00.150 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:00.150 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:00.150 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:00.150 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/Makefile").st_ino) 2023-10-06T04:57:00.150 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:00.304 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629990 2023-10-06T04:57:00.488 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:00.489 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:00.489 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:00.489 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:00.489 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/ubuntu-12.04-user-data.txt").st_ino) 2023-10-06T04:57:00.489 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:00.640 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629994 2023-10-06T04:57:00.826 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:00.826 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:00.827 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:00.827 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:00.827 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/common.sh").st_ino) 2023-10-06T04:57:00.827 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:00.979 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628958 2023-10-06T04:57:01.165 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:01.165 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:01.166 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:01.166 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:01.166 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/user-data.txt").st_ino) 2023-10-06T04:57:01.166 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:01.319 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628963 2023-10-06T04:57:01.504 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:01.505 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:01.505 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:01.505 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:01.505 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/debian-8.0-user-data.txt").st_ino) 2023-10-06T04:57:01.505 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:01.657 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628959 2023-10-06T04:57:01.845 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:01.845 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:01.845 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:01.845 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:01.846 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-7.2-user-data.txt").st_ino) 2023-10-06T04:57:01.846 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:01.996 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629993 2023-10-06T04:57:02.181 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:02.181 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:02.181 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:02.181 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:02.181 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd_mirror.py").st_ino) 2023-10-06T04:57:02.181 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:02.204 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:57:02.228 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:57:02.336 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629049 2023-10-06T04:57:02.521 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:02.521 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:02.521 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:02.521 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:02.521 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/dump_stuck.py").st_ino) 2023-10-06T04:57:02.521 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:02.674 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629010 2023-10-06T04:57:02.859 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:02.859 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:02.859 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:02.859 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:02.859 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_objectstore_tool.py").st_ino) 2023-10-06T04:57:02.859 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:03.012 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628971 2023-10-06T04:57:03.197 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:03.198 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:03.198 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:03.198 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:03.198 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd_fsx.py").st_ino) 2023-10-06T04:57:03.198 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:03.351 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629048 2023-10-06T04:57:03.536 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:03.536 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:03.537 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:03.537 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:03.537 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosgw_agent.py").st_ino) 2023-10-06T04:57:03.537 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:03.690 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629045 2023-10-06T04:57:03.874 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:03.874 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:03.875 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:03.875 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:03.875 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tgt.py").st_ino) 2023-10-06T04:57:03.875 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:04.027 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629071 2023-10-06T04:57:04.212 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:04.212 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:04.213 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:04.213 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:04.213 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/vstart_runner.py").st_ino) 2023-10-06T04:57:04.213 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:04.365 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629079 2023-10-06T04:57:04.550 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:04.550 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:04.550 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:04.551 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:04.551 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/resolve_stuck_peering.py").st_ino) 2023-10-06T04:57:04.551 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:04.704 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629055 2023-10-06T04:57:04.888 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:04.888 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:04.888 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:04.889 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:04.889 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rados.py").st_ino) 2023-10-06T04:57:04.889 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:05.041 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629040 2023-10-06T04:57:05.225 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:05.226 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:05.226 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:05.226 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:05.226 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/s3tests.py").st_ino) 2023-10-06T04:57:05.226 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:05.379 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629062 2023-10-06T04:57:05.564 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:05.565 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:05.565 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:05.565 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:05.565 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/userdata_setup.yaml").st_ino) 2023-10-06T04:57:05.565 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:05.717 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629074 2023-10-06T04:57:05.902 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:05.902 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:05.902 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:05.903 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:05.903 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/lost_unfound.py").st_ino) 2023-10-06T04:57:05.903 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:06.055 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629016 2023-10-06T04:57:06.240 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:06.241 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:06.241 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:06.241 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:06.241 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/s3readwrite.py").st_ino) 2023-10-06T04:57:06.241 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:06.395 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629060 2023-10-06T04:57:06.579 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:06.580 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:06.580 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:06.580 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:06.580 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_fuse.py").st_ino) 2023-10-06T04:57:06.580 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:06.732 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628969 2023-10-06T04:57:06.917 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:06.917 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:06.917 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:06.917 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:06.917 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rest_api.py").st_ino) 2023-10-06T04:57:06.917 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:07.069 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629056 2023-10-06T04:57:07.255 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:07.255 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:07.255 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:07.255 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:07.255 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/reg11184.py").st_ino) 2023-10-06T04:57:07.256 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:07.408 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629052 2023-10-06T04:57:07.594 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:07.594 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:07.595 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:07.595 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:07.595 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rep_lost_unfound_delete.py").st_ino) 2023-10-06T04:57:07.595 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:07.748 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629053 2023-10-06T04:57:07.932 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:07.933 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:07.933 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:07.933 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:07.933 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mod_proxy_fcgi.uds.conf.template").st_ino) 2023-10-06T04:57:07.933 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:08.085 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629025 2023-10-06T04:57:08.270 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:08.270 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:08.270 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:08.270 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:08.270 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_deploy.py").st_ino) 2023-10-06T04:57:08.270 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:08.423 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628968 2023-10-06T04:57:08.610 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:08.611 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:08.611 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:08.611 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:08.612 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_manager.py").st_ino) 2023-10-06T04:57:08.612 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:08.764 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628970 2023-10-06T04:57:08.949 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:08.949 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:08.949 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:08.949 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:08.950 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosbench.py").st_ino) 2023-10-06T04:57:08.950 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:09.102 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629041 2023-10-06T04:57:09.287 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:09.288 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:09.288 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:09.288 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:09.288 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/scrub_test.py").st_ino) 2023-10-06T04:57:09.288 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:09.439 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629065 2023-10-06T04:57:09.625 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:09.625 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:09.625 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:09.625 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:09.625 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_clock_skew_check.py").st_ino) 2023-10-06T04:57:09.625 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:09.778 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629026 2023-10-06T04:57:09.963 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:09.963 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:09.963 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:09.963 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:09.963 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/kclient.py").st_ino) 2023-10-06T04:57:09.963 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:10.117 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629013 2023-10-06T04:57:10.302 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:10.302 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:10.302 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:10.302 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:10.302 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/omapbench.py").st_ino) 2023-10-06T04:57:10.302 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:10.457 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629032 2023-10-06T04:57:10.643 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:10.643 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:10.643 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:10.643 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:10.643 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/autotest.py").st_ino) 2023-10-06T04:57:10.644 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:10.795 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628952 2023-10-06T04:57:10.981 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:10.981 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:10.981 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:10.981 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:10.981 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mod_fastcgi.conf.template").st_ino) 2023-10-06T04:57:10.981 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:11.134 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629023 2023-10-06T04:57:11.320 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:11.320 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:11.320 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:11.320 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:11.320 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/peering_speed_test.py").st_ino) 2023-10-06T04:57:11.321 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:11.476 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629037 2023-10-06T04:57:11.662 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:11.662 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:11.662 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:11.662 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:11.662 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_recovery.py").st_ino) 2023-10-06T04:57:11.662 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:11.815 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629027 2023-10-06T04:57:12.001 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:12.001 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:12.001 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:12.001 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:12.001 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cifs_mount.py").st_ino) 2023-10-06T04:57:12.002 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:12.155 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629003 2023-10-06T04:57:12.339 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:12.340 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:12.340 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:12.340 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:12.340 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd_fio.py").st_ino) 2023-10-06T04:57:12.340 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:12.493 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629047 2023-10-06T04:57:12.678 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:12.678 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:12.679 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:12.679 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:12.679 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/logrotate.conf").st_ino) 2023-10-06T04:57:12.679 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:12.831 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629015 2023-10-06T04:57:13.016 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:13.016 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:13.016 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:13.016 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:13.016 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_thrash.py").st_ino) 2023-10-06T04:57:13.017 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:13.169 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629029 2023-10-06T04:57:13.354 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:13.354 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:13.354 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:13.354 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:13.354 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/metadata.yaml").st_ino) 2023-10-06T04:57:13.354 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:13.507 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629020 2023-10-06T04:57:13.692 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:13.693 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:13.693 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:13.693 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:13.693 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/divergent_priors2.py").st_ino) 2023-10-06T04:57:13.693 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:13.844 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629009 2023-10-06T04:57:14.030 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:14.030 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:14.030 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:14.030 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:14.030 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/blktrace.py").st_ino) 2023-10-06T04:57:14.031 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:14.185 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628954 2023-10-06T04:57:14.370 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:14.370 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:14.370 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:14.370 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:14.370 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/thrashosds.py").st_ino) 2023-10-06T04:57:14.370 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:14.523 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629073 2023-10-06T04:57:14.709 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:14.709 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:14.709 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:14.709 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:14.709 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/systemd.py").st_ino) 2023-10-06T04:57:14.709 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:14.861 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629066 2023-10-06T04:57:15.047 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:15.047 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:15.047 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:15.047 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:15.047 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosgw_admin_rest.py").st_ino) 2023-10-06T04:57:15.047 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:15.200 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629044 2023-10-06T04:57:15.385 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:15.385 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:15.386 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:15.386 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:15.386 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/create_verify_lfn_objects.py").st_ino) 2023-10-06T04:57:15.386 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:15.540 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629005 2023-10-06T04:57:15.723 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:15.723 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:15.723 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:15.723 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:15.723 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone").st_ino) 2023-10-06T04:57:15.723 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:15.877 INFO:teuthology.orchestra.run.smithi124.stdout:1099511630007 2023-10-06T04:57:16.062 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:16.062 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:16.062 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:16.062 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:16.062 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone/random.yaml").st_ino) 2023-10-06T04:57:16.063 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:16.215 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629084 2023-10-06T04:57:16.401 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:16.401 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:16.401 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:16.401 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:16.401 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone/eastern.yaml").st_ino) 2023-10-06T04:57:16.401 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:16.554 INFO:teuthology.orchestra.run.smithi124.stdout:1099511630008 2023-10-06T04:57:16.739 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:16.739 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:16.739 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:16.739 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:16.739 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone/pacific.yaml").st_ino) 2023-10-06T04:57:16.739 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:16.892 INFO:teuthology.orchestra.run.smithi124.stdout:1099511629083 2023-10-06T04:57:17.077 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:17.077 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:17.077 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:17.077 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:17.077 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.gitignore").st_ino) 2023-10-06T04:57:17.077 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:17.230 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628306 2023-10-06T04:57:17.415 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:17.415 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:17.415 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:17.415 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:17.415 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug").st_ino) 2023-10-06T04:57:17.415 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:17.567 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628330 2023-10-06T04:57:17.752 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:17.753 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:17.753 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:17.753 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:17.753 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/openstack-30G.yaml").st_ino) 2023-10-06T04:57:17.753 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:17.906 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627835 2023-10-06T04:57:18.091 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:18.091 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:18.092 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:18.092 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:18.092 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/buildpackages.yaml").st_ino) 2023-10-06T04:57:18.092 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:18.244 INFO:teuthology.orchestra.run.smithi124.stdout:1099511628331 2023-10-06T04:57:18.429 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:18.429 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:18.429 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:18.429 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:18.429 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/mds_client.yaml").st_ino) 2023-10-06T04:57:18.430 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:18.582 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627833 2023-10-06T04:57:18.771 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:57:18.771 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T04:57:18.771 DEBUG:teuthology.orchestra.run.smithi124:> import stat 2023-10-06T04:57:18.771 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T04:57:18.771 DEBUG:teuthology.orchestra.run.smithi124:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/openstack-15G.yaml").st_ino) 2023-10-06T04:57:18.772 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T04:57:18.930 INFO:teuthology.orchestra.run.smithi124.stdout:1099511627834 2023-10-06T04:57:19.116 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:57:19.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.346+0000 7faaf43ff700 1 Processor -- start 2023-10-06T04:57:19.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.346+0000 7faaf43ff700 1 -- start start 2023-10-06T04:57:19.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.347+0000 7faaf43ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7930 0x7faaec0c9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:19.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.347+0000 7faaf43ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faaec0a7d00 0x7faaec0675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:19.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.347+0000 7faaf43ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec159f30 con 0x7faaec06bef0 2023-10-06T04:57:19.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.347+0000 7faaf43ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec15a210 con 0x7faaec0a7d00 2023-10-06T04:57:19.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.347+0000 7faaf43ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec15a4f0 con 0x7faaec0a7930 2023-10-06T04:57:19.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf299c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7faaec06bef0 0x7faaec06e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50966/0 (socket says 172.21.15.124:50966) 2023-10-06T04:57:19.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf299c700 1 -- 172.21.15.124:0/3695702896 learned_addr learned my addr 172.21.15.124:0/3695702896 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:19.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf219b700 1 --2- 172.21.15.124:0/3695702896 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7930 0x7faaec0c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:19.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf199a700 1 --2- 172.21.15.124:0/3695702896 >> v2:172.21.15.158:3300/0 conn(0x7faaec0a7d00 0x7faaec0675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:19.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf1199700 1 -- 172.21.15.124:0/3695702896 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228325966 0 0) 0x7faaec159f30 con 0x7faaec06bef0 2023-10-06T04:57:19.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf1199700 1 -- 172.21.15.124:0/3695702896 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad8003570 con 0x7faaec06bef0 2023-10-06T04:57:19.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf199a700 1 -- 172.21.15.124:0/3695702896 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7930 msgr2=0x7faaec0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:19.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf199a700 1 --2- 172.21.15.124:0/3695702896 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7930 0x7faaec0c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf199a700 1 -- 172.21.15.124:0/3695702896 >> v1:172.21.15.124:6789/0 conn(0x7faaec06bef0 legacy=0x7faaec06e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:19.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf199a700 1 -- 172.21.15.124:0/3695702896 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec15a7d0 con 0x7faaec0a7d00 2023-10-06T04:57:19.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.348+0000 7faaf219b700 1 --2- 172.21.15.124:0/3695702896 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7930 0x7faaec0c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:57:19.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.349+0000 7faaf199a700 1 --2- 172.21.15.124:0/3695702896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faaec0a7d00 0x7faaec0675f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faadc0098e0 tx=0x7faadc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c114542f36faccf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:19.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.349+0000 7faaf1199700 1 -- 172.21.15.124:0/3695702896 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc011630 con 0x7faaec0a7d00 2023-10-06T04:57:19.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.349+0000 7faaf1199700 1 -- 172.21.15.124:0/3695702896 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc011790 con 0x7faaec0a7d00 2023-10-06T04:57:19.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.349+0000 7faaf1199700 1 -- 172.21.15.124:0/3695702896 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc011b30 con 0x7faaec0a7d00 2023-10-06T04:57:19.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.349+0000 7faaf43ff700 1 -- 172.21.15.124:0/3695702896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faaec0a7d00 msgr2=0x7faaec0675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:19.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.349+0000 7faaf43ff700 1 --2- 172.21.15.124:0/3695702896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faaec0a7d00 0x7faaec0675f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faadc0098e0 tx=0x7faadc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.350+0000 7faaf43ff700 1 -- 172.21.15.124:0/3695702896 shutdown_connections 2023-10-06T04:57:19.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.350+0000 7faaf43ff700 1 --2- 172.21.15.124:0/3695702896 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7930 0x7faaec0c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.350+0000 7faaf43ff700 1 --2- 172.21.15.124:0/3695702896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faaec0a7d00 0x7faaec0675f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.350+0000 7faaf43ff700 1 -- 172.21.15.124:0/3695702896 >> 172.21.15.124:0/3695702896 conn(0x7faaec0691d0 msgr2=0x7faaec0cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:19.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.350+0000 7faaf43ff700 1 -- 172.21.15.124:0/3695702896 shutdown_connections 2023-10-06T04:57:19.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.350+0000 7faaf43ff700 1 -- 172.21.15.124:0/3695702896 wait complete. 2023-10-06T04:57:19.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.351+0000 7faaf43ff700 1 Processor -- start 2023-10-06T04:57:19.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.351+0000 7faaf43ff700 1 -- start start 2023-10-06T04:57:19.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.352+0000 7faaf43ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faaec06bef0 0x7faaec15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:19.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.352+0000 7faaf43ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faaec0a7930 0x7faaec1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:19.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.352+0000 7faaf43ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7d00 0x7faaec0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:19.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.352+0000 7faaf43ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec15cb30 con 0x7faaec06bef0 2023-10-06T04:57:19.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.352+0000 7faaf43ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec15bfb0 con 0x7faaec0a7930 2023-10-06T04:57:19.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.352+0000 7faaf43ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec15c290 con 0x7faaec0a7d00 2023-10-06T04:57:19.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.352+0000 7faaf219b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faaec06bef0 0x7faaec15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:19.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.352+0000 7faaf219b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faaec06bef0 0x7faaec15b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60468/0 (socket says 172.21.15.124:60468) 2023-10-06T04:57:19.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.352+0000 7faaf219b700 1 -- 172.21.15.124:0/959444344 learned_addr learned my addr 172.21.15.124:0/959444344 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:19.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faaf199a700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faaec0a7930 0x7faaec1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:19.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faaf299c700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7d00 0x7faaec0ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:19.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faaf219b700 1 -- 172.21.15.124:0/959444344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7d00 msgr2=0x7faaec0ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:19.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faaf219b700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7d00 0x7faaec0ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faaf219b700 1 -- 172.21.15.124:0/959444344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faaec0a7930 msgr2=0x7faaec1525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:19.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faaf219b700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faaec0a7930 0x7faaec1525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faaf219b700 1 -- 172.21.15.124:0/959444344 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8009420 con 0x7faaec06bef0 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faaf299c700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7d00 0x7faaec0ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faaf219b700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faaec06bef0 0x7faaec15b710 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faae800ec80 tx=0x7faae80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faae27fc700 1 -- 172.21.15.124:0/959444344 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800c9d0 con 0x7faaec06bef0 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faae27fc700 1 -- 172.21.15.124:0/959444344 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae800cb30 con 0x7faaec06bef0 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faaf43ff700 1 -- 172.21.15.124:0/959444344 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc009420 con 0x7faaec06bef0 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.353+0000 7faae27fc700 1 -- 172.21.15.124:0/959444344 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800ceb0 con 0x7faaec06bef0 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.354+0000 7faaf43ff700 1 -- 172.21.15.124:0/959444344 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaec15c850 con 0x7faaec06bef0 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.354+0000 7faaf43ff700 1 -- 172.21.15.124:0/959444344 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaec169850 con 0x7faaec06bef0 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.355+0000 7faae27fc700 1 -- 172.21.15.124:0/959444344 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faae8013680 con 0x7faaec06bef0 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.356+0000 7faae27fc700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faad0066f30 0x7faad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:19.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.356+0000 7faae27fc700 1 -- 172.21.15.124:0/959444344 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7faae8084bc0 con 0x7faaec06bef0 2023-10-06T04:57:19.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.357+0000 7faaf199a700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faad0066f30 0x7faad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:19.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.357+0000 7faaf199a700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faad0066f30 0x7faad00693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faadc0091e0 tx=0x7faadc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:19.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.361+0000 7faae27fc700 1 -- 172.21.15.124:0/959444344 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faae8051bf0 con 0x7faaec06bef0 2023-10-06T04:57:19.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.594+0000 7faaf43ff700 1 -- 172.21.15.124:0/959444344 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaec0717a0 con 0x7faaec06bef0 2023-10-06T04:57:19.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.595+0000 7faae27fc700 1 -- 172.21.15.124:0/959444344 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7faae8055210 con 0x7faaec06bef0 2023-10-06T04:57:19.597 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:19.597 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/267826992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":267826992},{"type":"v1","addr":"172.21.15.158:6835","nonce":267826992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/361532770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":361532770},{"type":"v1","addr":"172.21.15.124:6835","nonce":361532770}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1150240645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6836","nonce":1150240645},{"type":"v1","addr":"172.21.15.124:6837","nonce":1150240645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:58.847255+0000","modified":"2023-10-06T04:46:02.379103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6834/1553392288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1553392288},{"type":"v1","addr":"172.21.15.158:6834","nonce":1553392288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:57:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 -- 172.21.15.124:0/959444344 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faad0066f30 msgr2=0x7faad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faad0066f30 0x7faad00693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faadc0091e0 tx=0x7faadc017000 comp rx=0 tx=0).stop 2023-10-06T04:57:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 -- 172.21.15.124:0/959444344 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faaec06bef0 msgr2=0x7faaec15b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faaec06bef0 0x7faaec15b710 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faae800ec80 tx=0x7faae80091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 -- 172.21.15.124:0/959444344 shutdown_connections 2023-10-06T04:57:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7faad0066f30 0x7faad00693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faaec0a7d00 0x7faaec0ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faaec06bef0 0x7faaec15b710 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 --2- 172.21.15.124:0/959444344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faaec0a7930 0x7faaec1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 -- 172.21.15.124:0/959444344 >> 172.21.15.124:0/959444344 conn(0x7faaec0691d0 msgr2=0x7faaec06b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 -- 172.21.15.124:0/959444344 shutdown_connections 2023-10-06T04:57:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:19.597+0000 7faaf43ff700 1 -- 172.21.15.124:0/959444344 wait complete. 2023-10-06T04:57:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 25 2023-10-06T04:57:19.617 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump tree /ceph-qa-suite/suites/smoke/1node/tasks 2023-10-06T04:57:19.835 INFO:teuthology.orchestra.run.smithi158.stdout:[{"ino":1099511629505,"rdev":0,"ctime":"2023-10-06T04:46:19.562185+0000","btime":"2023-10-06T04:46:19.561185+0000","mode":33204,"uid":1000,"gid":1285,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":8,"pool_ns":""},"old_pools":[],"size":216,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2023-10-06T04:46:19.562185+0000","atime":"2023-10-06T04:46:19.561185+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2023-10-06T04:46:19.562185+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2023-10-06T04:46:19.562185+0000"},"version":4,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:cephfs_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"lock":0,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4973,"pending":"pAsLsXsFsc","issued":"pAsLsXsFsc","wanted":"-","last_sent":3}],"loner":4973,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[]},{"ino":1099511629504,"rdev":0,"ctime":"2023-10-06T04:46:19.561185+0000","btime":"2023-10-06T04:46:19.558185+0000","mode":16893,"uid":1000,"gid":1285,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2023-10-06T04:46:19.561185+0000","atime":"2023-10-06T04:46:19.558185+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2023-10-06T04:46:19.561185+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2023-10-06T04:46:19.562185+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2023-10-06T04:46:19.562185+0000"},"version":19,"file_data_version":0,"xattr_version":1,"backtrace_version":12,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:cephfs_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"waiter":0,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4973,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":7}],"loner":4973,"want_loner":4973,"mds_caps_wanted":[],"dirfrags":[{"path":"/ceph-qa-suite/suites/smoke/1node/tasks","dirfrag":"0x100000006c0","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629505,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}]}] 2023-10-06T04:57:19.836 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 216, "rctime": "2023-10-06T04:46:19.562185+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2023-10-06T04:46:19.561185+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2023-10-06T04:46:19.561185+0000", "change_attr": 1, "client_caps": [ { "client_id": 4973, "issued": "pAsLsXsFsc", "last_sent": 3, "pending": "pAsLsXsFsc", "wanted": "-" } ], "client_ranges": [], "ctime": "2023-10-06T04:46:19.562185+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1285, "ino": 1099511629505, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 8, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 4973, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33204, "mtime": "2023-10-06T04:46:19.562185+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "ptrwaiter": 0, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2023-10-06T04:46:19.562185+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 216, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:cephfs_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 216, "rctime": "2023-10-06T04:46:19.562185+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2023-10-06T04:46:19.558185+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 12, "btime": "2023-10-06T04:46:19.558185+0000", "change_attr": 1, "client_caps": [ { "client_id": 4973, "issued": "pAsLsXsFsx", "last_sent": 7, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2023-10-06T04:46:19.561185+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629505, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000006c0", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/ceph-qa-suite/suites/smoke/1node/tasks", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2023-10-06T04:46:19.561185+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 1285, "ino": 1099511629504, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4973, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2023-10-06T04:46:19.561185+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0, "waiter": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2023-10-06T04:46:19.562185+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 19, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 4973, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:cephfs_t:s0\u0000" } ] } ] 2023-10-06T04:57:19.837 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:57:20.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.028+0000 7f7980fff700 1 Processor -- start 2023-10-06T04:57:20.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.028+0000 7f7980fff700 1 -- start start 2023-10-06T04:57:20.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.029+0000 7f7980fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 0x7f797c06a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:20.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.029+0000 7f7980fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c0c9930 con 0x7f797c0a7930 2023-10-06T04:57:20.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.029+0000 7f7980fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c159f30 con 0x7f797c0a7d00 2023-10-06T04:57:20.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.029+0000 7f7980fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c15a210 con 0x7f797c067d00 2023-10-06T04:57:20.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.029+0000 7f797a59c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f797c0a7930 0x7f797c0c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50978/0 (socket says 172.21.15.124:50978) 2023-10-06T04:57:20.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.029+0000 7f797a59c700 1 -- 172.21.15.124:0/4102659177 learned_addr learned my addr 172.21.15.124:0/4102659177 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:20.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.029+0000 7f797ad9d700 1 --2- 172.21.15.124:0/4102659177 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 0x7f797c06a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:20.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.030+0000 7f797959a700 1 -- 172.21.15.124:0/4102659177 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115616845 0 0) 0x7f796c001110 con 0x7f797c0a7930 2023-10-06T04:57:20.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.030+0000 7f797959a700 1 -- 172.21.15.124:0/4102659177 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7964003570 con 0x7f797c0a7930 2023-10-06T04:57:20.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.030+0000 7f797959a700 1 -- 172.21.15.124:0/4102659177 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732910381 0 0) 0x7f797c159f30 con 0x7f797c0a7d00 2023-10-06T04:57:20.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.030+0000 7f797959a700 1 -- 172.21.15.124:0/4102659177 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f796c001110 con 0x7f797c0a7d00 2023-10-06T04:57:20.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.030+0000 7f797ad9d700 1 -- 172.21.15.124:0/4102659177 >> v1:172.21.15.158:6789/0 conn(0x7f797c0a7d00 legacy=0x7f797c0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:20.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.030+0000 7f797ad9d700 1 -- 172.21.15.124:0/4102659177 >> v1:172.21.15.124:6789/0 conn(0x7f797c0a7930 legacy=0x7f797c0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:20.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.030+0000 7f797ad9d700 1 -- 172.21.15.124:0/4102659177 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c15a4f0 con 0x7f797c067d00 2023-10-06T04:57:20.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.030+0000 7f797ad9d700 1 --2- 172.21.15.124:0/4102659177 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 0x7f797c06a1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7974009e90 tx=0x7f7974009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b67bbbd190e3476e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:20.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.030+0000 7f797959a700 1 -- 172.21.15.124:0/4102659177 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400e070 con 0x7f797c067d00 2023-10-06T04:57:20.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.031+0000 7f797959a700 1 -- 172.21.15.124:0/4102659177 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797400bb80 con 0x7f797c067d00 2023-10-06T04:57:20.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.031+0000 7f797959a700 1 -- 172.21.15.124:0/4102659177 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974012430 con 0x7f797c067d00 2023-10-06T04:57:20.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.031+0000 7f7980fff700 1 -- 172.21.15.124:0/4102659177 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 msgr2=0x7f797c06a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:20.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.031+0000 7f7980fff700 1 --2- 172.21.15.124:0/4102659177 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 0x7f797c06a1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7974009e90 tx=0x7f7974009780 comp rx=0 tx=0).stop 2023-10-06T04:57:20.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.031+0000 7f7980fff700 1 -- 172.21.15.124:0/4102659177 shutdown_connections 2023-10-06T04:57:20.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.031+0000 7f7980fff700 1 --2- 172.21.15.124:0/4102659177 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 0x7f797c06a1c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:20.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.031+0000 7f7980fff700 1 -- 172.21.15.124:0/4102659177 >> 172.21.15.124:0/4102659177 conn(0x7f797c0691d0 msgr2=0x7f797c0cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:20.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.031+0000 7f7980fff700 1 -- 172.21.15.124:0/4102659177 shutdown_connections 2023-10-06T04:57:20.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.031+0000 7f7980fff700 1 -- 172.21.15.124:0/4102659177 wait complete. 2023-10-06T04:57:20.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.032+0000 7f7980fff700 1 Processor -- start 2023-10-06T04:57:20.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.033+0000 7f7980fff700 1 -- start start 2023-10-06T04:57:20.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.033+0000 7f7980fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 0x7f797c146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.033+0000 7f7980fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f797c0a7930 0x7f797c06e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.033+0000 7f7980fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f797c0a7d00 0x7f797c06e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.033+0000 7f7980fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0aff00 con 0x7f797c0a7d00 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.033+0000 7f7980fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0b04c0 con 0x7f797c0a7930 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.033+0000 7f7980fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c15d880 con 0x7f797c067d00 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f797ad9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f797c0a7d00 0x7f797c06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f797ad9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f797c0a7d00 0x7f797c06e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60484/0 (socket says 172.21.15.124:60484) 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f797ad9d700 1 -- 172.21.15.124:0/4109283356 learned_addr learned my addr 172.21.15.124:0/4109283356 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f797a59c700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 0x7f797c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f7979d9b700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f797c0a7930 0x7f797c06e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:20.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f797ad9d700 1 -- 172.21.15.124:0/4109283356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 msgr2=0x7f797c146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:20.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f797ad9d700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 0x7f797c146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:20.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f797ad9d700 1 -- 172.21.15.124:0/4109283356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f797c0a7930 msgr2=0x7f797c06e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:20.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f797ad9d700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f797c0a7930 0x7f797c06e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:20.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f797ad9d700 1 -- 172.21.15.124:0/4109283356 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974009a20 con 0x7f797c0a7d00 2023-10-06T04:57:20.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.034+0000 7f797ad9d700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f797c0a7d00 0x7f797c06e970 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7974013000 tx=0x7f7974019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:20.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.035+0000 7f796a7fc700 1 -- 172.21.15.124:0/4109283356 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974027470 con 0x7f797c0a7d00 2023-10-06T04:57:20.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.035+0000 7f796a7fc700 1 -- 172.21.15.124:0/4109283356 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79740275f0 con 0x7f797c0a7d00 2023-10-06T04:57:20.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.035+0000 7f7980fff700 1 -- 172.21.15.124:0/4109283356 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c15db60 con 0x7f797c0a7d00 2023-10-06T04:57:20.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.035+0000 7f796a7fc700 1 -- 172.21.15.124:0/4109283356 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740279b0 con 0x7f797c0a7d00 2023-10-06T04:57:20.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.035+0000 7f7980fff700 1 -- 172.21.15.124:0/4109283356 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c1469d0 con 0x7f797c0a7d00 2023-10-06T04:57:20.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.036+0000 7f7980fff700 1 -- 172.21.15.124:0/4109283356 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c0b0630 con 0x7f797c0a7d00 2023-10-06T04:57:20.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.037+0000 7f796a7fc700 1 -- 172.21.15.124:0/4109283356 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7974024070 con 0x7f797c0a7d00 2023-10-06T04:57:20.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.038+0000 7f796a7fc700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f795c066f30 0x7f795c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:20.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.038+0000 7f796a7fc700 1 -- 172.21.15.124:0/4109283356 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f7974086e90 con 0x7f797c0a7d00 2023-10-06T04:57:20.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.038+0000 7f797a59c700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f795c066f30 0x7f795c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:20.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.039+0000 7f797a59c700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f795c066f30 0x7f795c0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f796c007fd0 tx=0x7f796c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:20.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.042+0000 7f796a7fc700 1 -- 172.21.15.124:0/4109283356 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7974053ec0 con 0x7f797c0a7d00 2023-10-06T04:57:20.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.279+0000 7f7980fff700 1 -- 172.21.15.124:0/4109283356 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f797c0717a0 con 0x7f797c0a7d00 2023-10-06T04:57:20.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.279+0000 7f796a7fc700 1 -- 172.21.15.124:0/4109283356 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f797402c090 con 0x7f797c0a7d00 2023-10-06T04:57:20.283 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:20.283 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/267826992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":267826992},{"type":"v1","addr":"172.21.15.158:6835","nonce":267826992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/361532770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":361532770},{"type":"v1","addr":"172.21.15.124:6835","nonce":361532770}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1150240645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6836","nonce":1150240645},{"type":"v1","addr":"172.21.15.124:6837","nonce":1150240645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:58.847255+0000","modified":"2023-10-06T04:46:02.379103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6834/1553392288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1553392288},{"type":"v1","addr":"172.21.15.158:6834","nonce":1553392288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:57:20.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 -- 172.21.15.124:0/4109283356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f795c066f30 msgr2=0x7f795c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:20.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f795c066f30 0x7f795c0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f796c007fd0 tx=0x7f796c009040 comp rx=0 tx=0).stop 2023-10-06T04:57:20.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 -- 172.21.15.124:0/4109283356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f797c0a7d00 msgr2=0x7f797c06e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:20.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f797c0a7d00 0x7f797c06e970 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7974013000 tx=0x7f7974019000 comp rx=0 tx=0).stop 2023-10-06T04:57:20.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 -- 172.21.15.124:0/4109283356 shutdown_connections 2023-10-06T04:57:20.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f797c0a7d00 0x7f797c06e970 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:20.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f795c066f30 0x7f795c0693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:20.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f797c067d00 0x7f797c146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:20.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 --2- 172.21.15.124:0/4109283356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f797c0a7930 0x7f797c06e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:20.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 -- 172.21.15.124:0/4109283356 >> 172.21.15.124:0/4109283356 conn(0x7f797c0691d0 msgr2=0x7f797c0aead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:20.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 -- 172.21.15.124:0/4109283356 shutdown_connections 2023-10-06T04:57:20.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:20.282+0000 7f7980fff700 1 -- 172.21.15.124:0/4109283356 wait complete. 2023-10-06T04:57:20.286 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 25 2023-10-06T04:57:20.302 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump tree /ceph-qa-suite/suites/smoke/1node/tasks 1 2023-10-06T04:57:20.517 INFO:teuthology.orchestra.run.smithi158.stdout:[{"ino":1099511629505,"rdev":0,"ctime":"2023-10-06T04:46:19.562185+0000","btime":"2023-10-06T04:46:19.561185+0000","mode":33204,"uid":1000,"gid":1285,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":8,"pool_ns":""},"old_pools":[],"size":216,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2023-10-06T04:46:19.562185+0000","atime":"2023-10-06T04:46:19.561185+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2023-10-06T04:46:19.562185+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2023-10-06T04:46:19.562185+0000"},"version":4,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:cephfs_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"lock":0,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4973,"pending":"pAsLsXsFsc","issued":"pAsLsXsFsc","wanted":"-","last_sent":3}],"loner":4973,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[]},{"ino":1099511629504,"rdev":0,"ctime":"2023-10-06T04:46:19.561185+0000","btime":"2023-10-06T04:46:19.558185+0000","mode":16893,"uid":1000,"gid":1285,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2023-10-06T04:46:19.561185+0000","atime":"2023-10-06T04:46:19.558185+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2023-10-06T04:46:19.561185+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2023-10-06T04:46:19.562185+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2023-10-06T04:46:19.562185+0000"},"version":19,"file_data_version":0,"xattr_version":1,"backtrace_version":12,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:cephfs_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"waiter":0,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4973,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":7}],"loner":4973,"want_loner":4973,"mds_caps_wanted":[],"dirfrags":[{"path":"/ceph-qa-suite/suites/smoke/1node/tasks","dirfrag":"0x100000006c0","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629505,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}]}] 2023-10-06T04:57:20.519 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 216, "rctime": "2023-10-06T04:46:19.562185+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2023-10-06T04:46:19.561185+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2023-10-06T04:46:19.561185+0000", "change_attr": 1, "client_caps": [ { "client_id": 4973, "issued": "pAsLsXsFsc", "last_sent": 3, "pending": "pAsLsXsFsc", "wanted": "-" } ], "client_ranges": [], "ctime": "2023-10-06T04:46:19.562185+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1285, "ino": 1099511629505, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 8, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 4973, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33204, "mtime": "2023-10-06T04:46:19.562185+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "ptrwaiter": 0, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2023-10-06T04:46:19.562185+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 216, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:cephfs_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 216, "rctime": "2023-10-06T04:46:19.562185+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2023-10-06T04:46:19.558185+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 12, "btime": "2023-10-06T04:46:19.558185+0000", "change_attr": 1, "client_caps": [ { "client_id": 4973, "issued": "pAsLsXsFsx", "last_sent": 7, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2023-10-06T04:46:19.561185+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629505, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000006c0", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/ceph-qa-suite/suites/smoke/1node/tasks", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2023-10-06T04:46:19.561185+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 1285, "ino": 1099511629504, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4973, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2023-10-06T04:46:19.561185+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0, "waiter": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2023-10-06T04:46:19.562185+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 19, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 4973, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:cephfs_t:s0\u0000" } ] } ] 2023-10-06T04:57:20.519 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:57:20.520 DEBUG:teuthology.orchestra.run.smithi124:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:57:20.620 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:57:20.722 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:57:20.722 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:57:20.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:57:20.722 DEBUG:teuthology.orchestra.run.smithi124:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T04:57:20.869 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:57:20.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:20.869 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:57:20.916 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:57:21.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.104+0000 7f2e51dff700 1 Processor -- start 2023-10-06T04:57:21.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.104+0000 7f2e51dff700 1 -- start start 2023-10-06T04:57:21.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.105+0000 7f2e51dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2e4c0ccd30 0x7f2e4c099610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.105+0000 7f2e51dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2e4c0690b0 0x7f2e4c0abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.105+0000 7f2e51dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c0acc40 con 0x7f2e4c0abb60 2023-10-06T04:57:21.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.105+0000 7f2e51dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c0ad0d0 con 0x7f2e4c0ccd30 2023-10-06T04:57:21.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.105+0000 7f2e51dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c06ae30 con 0x7f2e4c0690b0 2023-10-06T04:57:21.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4b7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2e4c0abb60 0x7f2e4c098f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:50994/0 (socket says 172.21.15.124:50994) 2023-10-06T04:57:21.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4b7fe700 1 -- 172.21.15.124:0/1011297083 learned_addr learned my addr 172.21.15.124:0/1011297083 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4affd700 1 --2- 172.21.15.124:0/1011297083 >> v2:172.21.15.124:3300/0 conn(0x7f2e4c0ccd30 0x7f2e4c099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4bfff700 1 --2- 172.21.15.124:0/1011297083 >> v2:172.21.15.158:3300/0 conn(0x7f2e4c0690b0 0x7f2e4c0abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4a7fc700 1 -- 172.21.15.124:0/1011297083 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432067974 0 0) 0x7f2e4c0acc40 con 0x7f2e4c0abb60 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4a7fc700 1 -- 172.21.15.124:0/1011297083 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e34003570 con 0x7f2e4c0abb60 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4affd700 1 -- 172.21.15.124:0/1011297083 >> v2:172.21.15.158:3300/0 conn(0x7f2e4c0690b0 msgr2=0x7f2e4c0abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4affd700 1 --2- 172.21.15.124:0/1011297083 >> v2:172.21.15.158:3300/0 conn(0x7f2e4c0690b0 0x7f2e4c0abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4affd700 1 -- 172.21.15.124:0/1011297083 >> v1:172.21.15.124:6789/0 conn(0x7f2e4c0abb60 legacy=0x7f2e4c098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4affd700 1 -- 172.21.15.124:0/1011297083 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0ac5f0 con 0x7f2e4c0ccd30 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.106+0000 7f2e4affd700 1 --2- 172.21.15.124:0/1011297083 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0ccd30 0x7f2e4c099610 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c06c750 tx=0x7f2e400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8cfaeed12a3991 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e4a7fc700 1 -- 172.21.15.124:0/1011297083 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000f6b0 con 0x7f2e4c0ccd30 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e4a7fc700 1 -- 172.21.15.124:0/1011297083 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4000f810 con 0x7f2e4c0ccd30 2023-10-06T04:57:21.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e4a7fc700 1 -- 172.21.15.124:0/1011297083 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000fbb0 con 0x7f2e4c0ccd30 2023-10-06T04:57:21.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e51dff700 1 -- 172.21.15.124:0/1011297083 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0ccd30 msgr2=0x7f2e4c099610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e51dff700 1 --2- 172.21.15.124:0/1011297083 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0ccd30 0x7f2e4c099610 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c06c750 tx=0x7f2e400091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e51dff700 1 -- 172.21.15.124:0/1011297083 shutdown_connections 2023-10-06T04:57:21.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e51dff700 1 --2- 172.21.15.124:0/1011297083 >> v2:172.21.15.158:3300/0 conn(0x7f2e4c0690b0 0x7f2e4c0abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e51dff700 1 --2- 172.21.15.124:0/1011297083 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0ccd30 0x7f2e4c099610 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e51dff700 1 -- 172.21.15.124:0/1011297083 >> 172.21.15.124:0/1011297083 conn(0x7f2e4c0cc050 msgr2=0x7f2e4c0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:21.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e51dff700 1 -- 172.21.15.124:0/1011297083 shutdown_connections 2023-10-06T04:57:21.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.107+0000 7f2e51dff700 1 -- 172.21.15.124:0/1011297083 wait complete. 2023-10-06T04:57:21.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.109+0000 7f2e51dff700 1 Processor -- start 2023-10-06T04:57:21.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.109+0000 7f2e51dff700 1 -- start start 2023-10-06T04:57:21.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e51dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e4c0690b0 0x7f2e4c0a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e51dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0abb60 0x7f2e4c0aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e51dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e4c0ccd30 0x7f2e4c0c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e51dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0a8c10 con 0x7f2e4c0abb60 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e51dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0a8ef0 con 0x7f2e4c0690b0 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e51dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0a91d0 con 0x7f2e4c0ccd30 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e4affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0abb60 0x7f2e4c0aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e4affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0abb60 0x7f2e4c0aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60498/0 (socket says 172.21.15.124:60498) 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e4affd700 1 -- 172.21.15.124:0/2079400469 learned_addr learned my addr 172.21.15.124:0/2079400469 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e4b7fe700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e4c0690b0 0x7f2e4c0a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e4bfff700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e4c0ccd30 0x7f2e4c0c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e4affd700 1 -- 172.21.15.124:0/2079400469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e4c0ccd30 msgr2=0x7f2e4c0c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e4affd700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e4c0ccd30 0x7f2e4c0c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e4affd700 1 -- 172.21.15.124:0/2079400469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e4c0690b0 msgr2=0x7f2e4c0a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e4affd700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e4c0690b0 0x7f2e4c0a9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.110+0000 7f2e4affd700 1 -- 172.21.15.124:0/2079400469 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40009420 con 0x7f2e4c0abb60 2023-10-06T04:57:21.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.111+0000 7f2e4affd700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0abb60 0x7f2e4c0aa970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c06c840 tx=0x7f2e40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:21.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.111+0000 7f2e337fe700 1 -- 172.21.15.124:0/2079400469 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000fb90 con 0x7f2e4c0abb60 2023-10-06T04:57:21.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.111+0000 7f2e337fe700 1 -- 172.21.15.124:0/2079400469 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e40000c90 con 0x7f2e4c0abb60 2023-10-06T04:57:21.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.111+0000 7f2e337fe700 1 -- 172.21.15.124:0/2079400469 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e400106c0 con 0x7f2e4c0abb60 2023-10-06T04:57:21.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.111+0000 7f2e51dff700 1 -- 172.21.15.124:0/2079400469 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c0a94b0 con 0x7f2e4c0abb60 2023-10-06T04:57:21.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.111+0000 7f2e51dff700 1 -- 172.21.15.124:0/2079400469 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c0aa1f0 con 0x7f2e4c0abb60 2023-10-06T04:57:21.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.112+0000 7f2e51dff700 1 -- 172.21.15.124:0/2079400469 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c0a99b0 con 0x7f2e4c0abb60 2023-10-06T04:57:21.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.113+0000 7f2e337fe700 1 -- 172.21.15.124:0/2079400469 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e400183e0 con 0x7f2e4c0abb60 2023-10-06T04:57:21.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.114+0000 7f2e337fe700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e38066f30 0x7f2e380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.114+0000 7f2e337fe700 1 -- 172.21.15.124:0/2079400469 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f2e40014070 con 0x7f2e4c0abb60 2023-10-06T04:57:21.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.114+0000 7f2e4b7fe700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e38066f30 0x7f2e380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.115+0000 7f2e4b7fe700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e38066f30 0x7f2e380693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c007fd0 tx=0x7f2e3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:21.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.118+0000 7f2e337fe700 1 -- 172.21.15.124:0/2079400469 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e400528c0 con 0x7f2e4c0abb60 2023-10-06T04:57:21.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.351+0000 7f2e51dff700 1 -- 172.21.15.124:0/2079400469 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e4c0717a0 con 0x7f2e4c0abb60 2023-10-06T04:57:21.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.352+0000 7f2e337fe700 1 -- 172.21.15.124:0/2079400469 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f2e40055ee0 con 0x7f2e4c0abb60 2023-10-06T04:57:21.354 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:21.355 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/267826992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":267826992},{"type":"v1","addr":"172.21.15.158:6835","nonce":267826992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/361532770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":361532770},{"type":"v1","addr":"172.21.15.124:6835","nonce":361532770}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1150240645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6836","nonce":1150240645},{"type":"v1","addr":"172.21.15.124:6837","nonce":1150240645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:58.847255+0000","modified":"2023-10-06T04:46:02.379103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6834/1553392288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1553392288},{"type":"v1","addr":"172.21.15.158:6834","nonce":1553392288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:57:21.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 -- 172.21.15.124:0/2079400469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e38066f30 msgr2=0x7f2e380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e38066f30 0x7f2e380693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c007fd0 tx=0x7f2e3c009040 comp rx=0 tx=0).stop 2023-10-06T04:57:21.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 -- 172.21.15.124:0/2079400469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0abb60 msgr2=0x7f2e4c0aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0abb60 0x7f2e4c0aa970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c06c840 tx=0x7f2e40019000 comp rx=0 tx=0).stop 2023-10-06T04:57:21.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 -- 172.21.15.124:0/2079400469 shutdown_connections 2023-10-06T04:57:21.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2e38066f30 0x7f2e380693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e4c0ccd30 0x7f2e4c0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e4c0690b0 0x7f2e4c0a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 --2- 172.21.15.124:0/2079400469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e4c0abb60 0x7f2e4c0aa970 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 -- 172.21.15.124:0/2079400469 >> 172.21.15.124:0/2079400469 conn(0x7f2e4c0cc050 msgr2=0x7f2e4c06d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:21.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 -- 172.21.15.124:0/2079400469 shutdown_connections 2023-10-06T04:57:21.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.355+0000 7f2e51dff700 1 -- 172.21.15.124:0/2079400469 wait complete. 2023-10-06T04:57:21.358 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 25 2023-10-06T04:57:21.376 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:57:21.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.562+0000 7f8f8b1ff700 1 Processor -- start 2023-10-06T04:57:21.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.563+0000 7f8f8b1ff700 1 -- start start 2023-10-06T04:57:21.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.564+0000 7f8f8b1ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8f840cae80 0x7f8f840cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.564+0000 7f8f8b1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f840ccec0 0x7f8f841591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.564+0000 7f8f8b1ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f840c1d10 con 0x7f8f840cb250 2023-10-06T04:57:21.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.564+0000 7f8f8b1ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f840cd430 con 0x7f8f840cae80 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.564+0000 7f8f8b1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840688a0 con 0x7f8f840ccec0 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.564+0000 7f8f88f9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8f840cae80 0x7f8f840cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.564+0000 7f8f8979c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f8f840cb250 0x7f8f840afe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:51010/0 (socket says 172.21.15.124:51010) 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.564+0000 7f8f8979c700 1 -- 172.21.15.124:0/1635148969 learned_addr learned my addr 172.21.15.124:0/1635148969 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.564+0000 7f8f83fff700 1 --2- 172.21.15.124:0/1635148969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f840ccec0 0x7f8f841591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.565+0000 7f8f88f9b700 1 -- 172.21.15.124:0/1635148969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f840ccec0 msgr2=0x7f8f841591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.565+0000 7f8f88f9b700 1 --2- 172.21.15.124:0/1635148969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f840ccec0 0x7f8f841591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.565+0000 7f8f88f9b700 1 -- 172.21.15.124:0/1635148969 >> v1:172.21.15.124:6789/0 conn(0x7f8f840cb250 legacy=0x7f8f840afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.565+0000 7f8f88f9b700 1 -- 172.21.15.124:0/1635148969 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f84068b80 con 0x7f8f840cae80 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.565+0000 7f8f837fe700 1 -- 172.21.15.124:0/1635148969 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285827204 0 0) 0x7f8f840c1d10 con 0x7f8f840cb250 2023-10-06T04:57:21.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.565+0000 7f8f88f9b700 1 --2- 172.21.15.124:0/1635148969 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 0x7f8f840cc980 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8f780098e0 tx=0x7f8f780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad8d3f537275670 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:21.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.565+0000 7f8f837fe700 1 -- 172.21.15.124:0/1635148969 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78009e80 con 0x7f8f840cae80 2023-10-06T04:57:21.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.565+0000 7f8f837fe700 1 -- 172.21.15.124:0/1635148969 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7800b8f0 con 0x7f8f840cae80 2023-10-06T04:57:21.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.565+0000 7f8f837fe700 1 -- 172.21.15.124:0/1635148969 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800bc70 con 0x7f8f840cae80 2023-10-06T04:57:21.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.566+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/1635148969 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 msgr2=0x7f8f840cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.566+0000 7f8f8b1ff700 1 --2- 172.21.15.124:0/1635148969 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 0x7f8f840cc980 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8f780098e0 tx=0x7f8f780091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.566+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/1635148969 shutdown_connections 2023-10-06T04:57:21.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.566+0000 7f8f8b1ff700 1 --2- 172.21.15.124:0/1635148969 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 0x7f8f840cc980 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.566+0000 7f8f8b1ff700 1 --2- 172.21.15.124:0/1635148969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f840ccec0 0x7f8f841591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.566+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/1635148969 >> 172.21.15.124:0/1635148969 conn(0x7f8f840974f0 msgr2=0x7f8f840639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:21.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.566+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/1635148969 shutdown_connections 2023-10-06T04:57:21.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.566+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/1635148969 wait complete. 2023-10-06T04:57:21.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.567+0000 7f8f8b1ff700 1 Processor -- start 2023-10-06T04:57:21.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.567+0000 7f8f8b1ff700 1 -- start start 2023-10-06T04:57:21.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.568+0000 7f8f8b1ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 0x7f8f841586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.568+0000 7f8f8b1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f840cb250 0x7f8f840c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.568+0000 7f8f8b1ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8f840ccec0 0x7f8f840c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.568+0000 7f8f8b1ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840c6680 con 0x7f8f840cae80 2023-10-06T04:57:21.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.568+0000 7f8f8b1ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84169910 con 0x7f8f840ccec0 2023-10-06T04:57:21.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.568+0000 7f8f8b1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8415e8d0 con 0x7f8f840cb250 2023-10-06T04:57:21.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.568+0000 7f8f88f9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 0x7f8f841586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f88f9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 0x7f8f841586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60528/0 (socket says 172.21.15.124:60528) 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f88f9b700 1 -- 172.21.15.124:0/2337616840 learned_addr learned my addr 172.21.15.124:0/2337616840 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f83fff700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f840cb250 0x7f8f840c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f8979c700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8f840ccec0 0x7f8f840c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f88f9b700 1 -- 172.21.15.124:0/2337616840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f840cb250 msgr2=0x7f8f840c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f88f9b700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f840cb250 0x7f8f840c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f88f9b700 1 -- 172.21.15.124:0/2337616840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8f840ccec0 msgr2=0x7f8f840c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f88f9b700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8f840ccec0 0x7f8f840c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f88f9b700 1 -- 172.21.15.124:0/2337616840 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f78009420 con 0x7f8f840cae80 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f88f9b700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 0x7f8f841586a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800b3c0 tx=0x7f8f78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f80ff9700 1 -- 172.21.15.124:0/2337616840 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800bc70 con 0x7f8f840cae80 2023-10-06T04:57:21.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.569+0000 7f8f80ff9700 1 -- 172.21.15.124:0/2337616840 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f78011420 con 0x7f8f840cae80 2023-10-06T04:57:21.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.570+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/2337616840 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f84169bb0 con 0x7f8f840cae80 2023-10-06T04:57:21.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.570+0000 7f8f80ff9700 1 -- 172.21.15.124:0/2337616840 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780117c0 con 0x7f8f840cae80 2023-10-06T04:57:21.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.570+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/2337616840 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8415ebb0 con 0x7f8f840cae80 2023-10-06T04:57:21.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.571+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/2337616840 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f840717a0 con 0x7f8f840cae80 2023-10-06T04:57:21.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.571+0000 7f8f80ff9700 1 -- 172.21.15.124:0/2337616840 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f78011b70 con 0x7f8f840cae80 2023-10-06T04:57:21.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.573+0000 7f8f80ff9700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f68066f30 0x7f8f680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.573+0000 7f8f80ff9700 1 -- 172.21.15.124:0/2337616840 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f8f78086070 con 0x7f8f840cae80 2023-10-06T04:57:21.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.573+0000 7f8f83fff700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f68066f30 0x7f8f680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.573+0000 7f8f83fff700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f68066f30 0x7f8f680693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8f84098010 tx=0x7f8f70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:21.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.577+0000 7f8f80ff9700 1 -- 172.21.15.124:0/2337616840 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f78053120 con 0x7f8f840cae80 2023-10-06T04:57:21.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.771+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/2337616840 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f84068e60 con 0x7f8f840cae80 2023-10-06T04:57:21.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.772+0000 7f8f80ff9700 1 -- 172.21.15.124:0/2337616840 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17106 (secure 0 0 0) 0x7f8f78056740 con 0x7f8f840cae80 2023-10-06T04:57:21.775 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:21.775 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":47,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:46:16.043178+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:56.420552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:57.820429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:57:21.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/2337616840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f68066f30 msgr2=0x7f8f680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f68066f30 0x7f8f680693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8f84098010 tx=0x7f8f70008040 comp rx=0 tx=0).stop 2023-10-06T04:57:21.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/2337616840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 msgr2=0x7f8f841586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 0x7f8f841586a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800b3c0 tx=0x7f8f78017000 comp rx=0 tx=0).stop 2023-10-06T04:57:21.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/2337616840 shutdown_connections 2023-10-06T04:57:21.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8f840ccec0 0x7f8f840c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f840cae80 0x7f8f841586a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8f68066f30 0x7f8f680693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 --2- 172.21.15.124:0/2337616840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f840cb250 0x7f8f840c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/2337616840 >> 172.21.15.124:0/2337616840 conn(0x7f8f840974f0 msgr2=0x7f8f8406c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:21.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/2337616840 shutdown_connections 2023-10-06T04:57:21.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.774+0000 7f8f8b1ff700 1 -- 172.21.15.124:0/2337616840 wait complete. 2023-10-06T04:57:21.795 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:44:19.842795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:44:19.965191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:45:56.420552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:45:57.820429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:57:21.795 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:57:21.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.987+0000 7fa4f4dff700 1 Processor -- start 2023-10-06T04:57:21.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.988+0000 7fa4f4dff700 1 -- start start 2023-10-06T04:57:21.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4f4dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa4f01595f0 0x7fa4f006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4f4dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f01599c0 0x7fa4f006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4f4dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa4f00675f0 0x7fa4f0067a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4f4dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f00cdf40 con 0x7fa4f01595f0 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4f4dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f0067f90 con 0x7fa4f00675f0 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4f4dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00b0540 con 0x7fa4f01599c0 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4ee59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa4f01595f0 0x7fa4f006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4ee59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa4f01595f0 0x7fa4f006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60536/0 (socket says 172.21.15.124:60536) 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4ee59c700 1 -- 172.21.15.124:0/1320072239 learned_addr learned my addr 172.21.15.124:0/1320072239 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4eed9d700 1 --2- 172.21.15.124:0/1320072239 >> v2:172.21.15.158:3300/0 conn(0x7fa4f00675f0 0x7fa4f0067a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4edd9b700 1 --2- 172.21.15.124:0/1320072239 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f01599c0 0x7fa4f006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4ee59c700 1 -- 172.21.15.124:0/1320072239 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f01599c0 msgr2=0x7fa4f006e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4ee59c700 1 --2- 172.21.15.124:0/1320072239 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f01599c0 0x7fa4f006e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4ee59c700 1 -- 172.21.15.124:0/1320072239 >> v2:172.21.15.158:3300/0 conn(0x7fa4f00675f0 msgr2=0x7fa4f0067a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:21.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4ee59c700 1 --2- 172.21.15.124:0/1320072239 >> v2:172.21.15.158:3300/0 conn(0x7fa4f00675f0 0x7fa4f0067a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.989+0000 7fa4ee59c700 1 -- 172.21.15.124:0/1320072239 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f006efd0 con 0x7fa4f01595f0 2023-10-06T04:57:21.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.990+0000 7fa4ee59c700 1 --2- 172.21.15.124:0/1320072239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f01595f0 0x7fa4f006e3f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00686b0 tx=0x7fa4e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7553e90f5a860d93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:21.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.990+0000 7fa4ed59a700 1 -- 172.21.15.124:0/1320072239 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e000b860 con 0x7fa4f01595f0 2023-10-06T04:57:21.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.990+0000 7fa4ed59a700 1 -- 172.21.15.124:0/1320072239 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e000b9c0 con 0x7fa4f01595f0 2023-10-06T04:57:21.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.990+0000 7fa4ed59a700 1 -- 172.21.15.124:0/1320072239 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e000bd60 con 0x7fa4f01595f0 2023-10-06T04:57:21.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.991+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1320072239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f01595f0 msgr2=0x7fa4f006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:21.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.991+0000 7fa4f4dff700 1 --2- 172.21.15.124:0/1320072239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f01595f0 0x7fa4f006e3f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00686b0 tx=0x7fa4e0009250 comp rx=0 tx=0).stop 2023-10-06T04:57:21.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.991+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1320072239 shutdown_connections 2023-10-06T04:57:21.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.991+0000 7fa4f4dff700 1 --2- 172.21.15.124:0/1320072239 >> v2:172.21.15.158:3300/0 conn(0x7fa4f00675f0 0x7fa4f0067a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.991+0000 7fa4f4dff700 1 --2- 172.21.15.124:0/1320072239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f01595f0 0x7fa4f006e3f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.991+0000 7fa4f4dff700 1 --2- 172.21.15.124:0/1320072239 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f01599c0 0x7fa4f006e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:21.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.991+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1320072239 >> 172.21.15.124:0/1320072239 conn(0x7fa4f0069180 msgr2=0x7fa4f00cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:21.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.991+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1320072239 shutdown_connections 2023-10-06T04:57:21.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.991+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1320072239 wait complete. 2023-10-06T04:57:21.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.992+0000 7fa4f4dff700 1 Processor -- start 2023-10-06T04:57:21.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.992+0000 7fa4f4dff700 1 -- start start 2023-10-06T04:57:21.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.993+0000 7fa4f4dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f00675f0 0x7fa4f0152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.993+0000 7fa4f4dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f01595f0 0x7fa4f014d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.993+0000 7fa4f4dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4f01599c0 0x7fa4f0153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:21.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.993+0000 7fa4f4dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f0151040 con 0x7fa4f00675f0 2023-10-06T04:57:21.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.993+0000 7fa4f4dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f01507a0 con 0x7fa4f01599c0 2023-10-06T04:57:21.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.993+0000 7fa4f4dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f0150a80 con 0x7fa4f01595f0 2023-10-06T04:57:21.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4ee59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f00675f0 0x7fa4f0152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4ee59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f00675f0 0x7fa4f0152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60542/0 (socket says 172.21.15.124:60542) 2023-10-06T04:57:21.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4ee59c700 1 -- 172.21.15.124:0/1963359885 learned_addr learned my addr 172.21.15.124:0/1963359885 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:21.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4edd9b700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f01595f0 0x7fa4f014d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:21.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4eed9d700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4f01599c0 0x7fa4f0153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4ee59c700 1 -- 172.21.15.124:0/1963359885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f01595f0 msgr2=0x7fa4f014d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4ee59c700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f01595f0 0x7fa4f014d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4ee59c700 1 -- 172.21.15.124:0/1963359885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4f01599c0 msgr2=0x7fa4f0153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4ee59c700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4f01599c0 0x7fa4f0153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4ee59c700 1 -- 172.21.15.124:0/1963359885 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00094f0 con 0x7fa4f00675f0 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4eed9d700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4f01599c0 0x7fa4f0153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4ee59c700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f00675f0 0x7fa4f0152a20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa4f006d0a0 tx=0x7fa4e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.994+0000 7fa4de7fc700 1 -- 172.21.15.124:0/1963359885 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0011e70 con 0x7fa4f00675f0 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.995+0000 7fa4de7fc700 1 -- 172.21.15.124:0/1963359885 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e0024440 con 0x7fa4f00675f0 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.995+0000 7fa4de7fc700 1 -- 172.21.15.124:0/1963359885 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0024800 con 0x7fa4f00675f0 2023-10-06T04:57:22.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.995+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1963359885 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f0150d60 con 0x7fa4f00675f0 2023-10-06T04:57:22.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.995+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1963359885 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f0152f60 con 0x7fa4f00675f0 2023-10-06T04:57:22.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.996+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1963359885 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f0064850 con 0x7fa4f00675f0 2023-10-06T04:57:22.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.996+0000 7fa4de7fc700 1 -- 172.21.15.124:0/1963359885 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4e001a420 con 0x7fa4f00675f0 2023-10-06T04:57:22.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.998+0000 7fa4de7fc700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa4d0066f30 0x7fa4d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.998+0000 7fa4de7fc700 1 -- 172.21.15.124:0/1963359885 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa4e0086710 con 0x7fa4f00675f0 2023-10-06T04:57:22.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.998+0000 7fa4edd9b700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa4d0066f30 0x7fa4d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:21.998+0000 7fa4edd9b700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa4d0066f30 0x7fa4d00693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa4f006a230 tx=0x7fa4e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:22.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.002+0000 7fa4de7fc700 1 -- 172.21.15.124:0/1963359885 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4e0053740 con 0x7fa4f00675f0 2023-10-06T04:57:22.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.195+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1963359885 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa4f004c380 con 0x7fa4f00675f0 2023-10-06T04:57:22.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.196+0000 7fa4de7fc700 1 -- 172.21.15.124:0/1963359885 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa4e0056d60 con 0x7fa4f00675f0 2023-10-06T04:57:22.198 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 8 2023-10-06T04:57:22.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1963359885 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa4d0066f30 msgr2=0x7fa4d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa4d0066f30 0x7fa4d00693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa4f006a230 tx=0x7fa4e4008040 comp rx=0 tx=0).stop 2023-10-06T04:57:22.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1963359885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f00675f0 msgr2=0x7fa4f0152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f00675f0 0x7fa4f0152a20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa4f006d0a0 tx=0x7fa4e0017000 comp rx=0 tx=0).stop 2023-10-06T04:57:22.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1963359885 shutdown_connections 2023-10-06T04:57:22.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4f01599c0 0x7fa4f0153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4f00675f0 0x7fa4f0152a20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fa4d0066f30 0x7fa4d00693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 --2- 172.21.15.124:0/1963359885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f01595f0 0x7fa4f014d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1963359885 >> 172.21.15.124:0/1963359885 conn(0x7fa4f0069180 msgr2=0x7fa4f01585c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:22.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1963359885 shutdown_connections 2023-10-06T04:57:22.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.198+0000 7fa4f4dff700 1 -- 172.21.15.124:0/1963359885 wait complete. 2023-10-06T04:57:22.219 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:57:22.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.411+0000 7fe8903ff700 1 Processor -- start 2023-10-06T04:57:22.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.411+0000 7fe8903ff700 1 -- start start 2023-10-06T04:57:22.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.412+0000 7fe8903ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8881592b0 0x7fe8880b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.412+0000 7fe8903ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe8880cc780 0x7fe8880ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.412+0000 7fe8903ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88815d620 con 0x7fe888159680 2023-10-06T04:57:22.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.412+0000 7fe8903ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88815d0d0 con 0x7fe8880cc780 2023-10-06T04:57:22.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.412+0000 7fe8903ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8880b2ed0 con 0x7fe8881592b0 2023-10-06T04:57:22.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.413+0000 7fe88e19b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8881592b0 0x7fe8880b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.413+0000 7fe88e99c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe8880cc780 0x7fe8880ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.413+0000 7fe88d99a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe888159680 0x7fe88815dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:53900/0 (socket says 172.21.15.124:53900) 2023-10-06T04:57:22.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.413+0000 7fe88d99a700 1 -- 172.21.15.124:0/705248252 learned_addr learned my addr 172.21.15.124:0/705248252 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:22.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.413+0000 7fe88e19b700 1 -- 172.21.15.124:0/705248252 >> v2:172.21.15.158:3300/0 conn(0x7fe8880cc780 msgr2=0x7fe8880ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:22.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.413+0000 7fe88e19b700 1 --2- 172.21.15.124:0/705248252 >> v2:172.21.15.158:3300/0 conn(0x7fe8880cc780 0x7fe8880ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.413+0000 7fe88e19b700 1 -- 172.21.15.124:0/705248252 >> v1:172.21.15.158:6789/0 conn(0x7fe888159680 legacy=0x7fe88815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.413+0000 7fe88e19b700 1 -- 172.21.15.124:0/705248252 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8880ccc20 con 0x7fe8881592b0 2023-10-06T04:57:22.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.413+0000 7fe88e99c700 1 --2- 172.21.15.124:0/705248252 >> v2:172.21.15.158:3300/0 conn(0x7fe8880cc780 0x7fe8880ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:57:22.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.413+0000 7fe88d199700 1 -- 172.21.15.124:0/705248252 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858327932 0 0) 0x7fe88815d620 con 0x7fe888159680 2023-10-06T04:57:22.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.414+0000 7fe88e19b700 1 --2- 172.21.15.124:0/705248252 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8881592b0 0x7fe8880b0080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8840098e0 tx=0x7fe8840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66365d185d5be206 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:22.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.414+0000 7fe88d199700 1 -- 172.21.15.124:0/705248252 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400b640 con 0x7fe8881592b0 2023-10-06T04:57:22.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.414+0000 7fe88d199700 1 -- 172.21.15.124:0/705248252 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88400b7a0 con 0x7fe8881592b0 2023-10-06T04:57:22.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.414+0000 7fe88d199700 1 -- 172.21.15.124:0/705248252 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400bb40 con 0x7fe8881592b0 2023-10-06T04:57:22.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.414+0000 7fe8903ff700 1 -- 172.21.15.124:0/705248252 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8881592b0 msgr2=0x7fe8880b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.414+0000 7fe8903ff700 1 --2- 172.21.15.124:0/705248252 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8881592b0 0x7fe8880b0080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8840098e0 tx=0x7fe8840091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.415+0000 7fe8903ff700 1 -- 172.21.15.124:0/705248252 shutdown_connections 2023-10-06T04:57:22.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.415+0000 7fe8903ff700 1 --2- 172.21.15.124:0/705248252 >> v2:172.21.15.158:3300/0 conn(0x7fe8880cc780 0x7fe8880ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.415+0000 7fe8903ff700 1 --2- 172.21.15.124:0/705248252 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8881592b0 0x7fe8880b0080 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.415+0000 7fe8903ff700 1 -- 172.21.15.124:0/705248252 >> 172.21.15.124:0/705248252 conn(0x7fe88806ed20 msgr2=0x7fe88806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:22.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.415+0000 7fe8903ff700 1 -- 172.21.15.124:0/705248252 shutdown_connections 2023-10-06T04:57:22.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.415+0000 7fe8903ff700 1 -- 172.21.15.124:0/705248252 wait complete. 2023-10-06T04:57:22.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.416+0000 7fe8903ff700 1 Processor -- start 2023-10-06T04:57:22.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.416+0000 7fe8903ff700 1 -- start start 2023-10-06T04:57:22.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.417+0000 7fe8903ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8880cc780 0x7fe8880c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.417+0000 7fe8903ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8881592b0 0x7fe888157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.417+0000 7fe8903ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe888159680 0x7fe888158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.417+0000 7fe8903ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8880c8280 con 0x7fe888159680 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.417+0000 7fe8903ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8880c6e20 con 0x7fe8881592b0 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.417+0000 7fe8903ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe888169c30 con 0x7fe8880cc780 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.417+0000 7fe88e99c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe888159680 0x7fe888158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.417+0000 7fe88e99c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe888159680 0x7fe888158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60546/0 (socket says 172.21.15.124:60546) 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.417+0000 7fe88e99c700 1 -- 172.21.15.124:0/362352094 learned_addr learned my addr 172.21.15.124:0/362352094 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe88e19b700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8880cc780 0x7fe8880c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe88d99a700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8881592b0 0x7fe888157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe88e99c700 1 -- 172.21.15.124:0/362352094 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8880cc780 msgr2=0x7fe8880c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe88e99c700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8880cc780 0x7fe8880c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe88e99c700 1 -- 172.21.15.124:0/362352094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8881592b0 msgr2=0x7fe888157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe88e99c700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8881592b0 0x7fe888157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe88e99c700 1 -- 172.21.15.124:0/362352094 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe880009a20 con 0x7fe888159680 2023-10-06T04:57:22.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe88e19b700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8880cc780 0x7fe8880c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:22.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe88d99a700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8881592b0 0x7fe888157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:22.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe88e99c700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe888159680 0x7fe888158270 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe880009fc0 tx=0x7fe88000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:22.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe87e7fc700 1 -- 172.21.15.124:0/362352094 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88000cd30 con 0x7fe888159680 2023-10-06T04:57:22.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe87e7fc700 1 -- 172.21.15.124:0/362352094 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88000f040 con 0x7fe888159680 2023-10-06T04:57:22.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe8903ff700 1 -- 172.21.15.124:0/362352094 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe884009420 con 0x7fe888159680 2023-10-06T04:57:22.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.418+0000 7fe87e7fc700 1 -- 172.21.15.124:0/362352094 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8800146d0 con 0x7fe888159680 2023-10-06T04:57:22.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.419+0000 7fe8903ff700 1 -- 172.21.15.124:0/362352094 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88816a1f0 con 0x7fe888159680 2023-10-06T04:57:22.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.419+0000 7fe8903ff700 1 -- 172.21.15.124:0/362352094 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8880b5260 con 0x7fe888159680 2023-10-06T04:57:22.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.420+0000 7fe87e7fc700 1 -- 172.21.15.124:0/362352094 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe880003020 con 0x7fe888159680 2023-10-06T04:57:22.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.421+0000 7fe87e7fc700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe86c066f30 0x7fe86c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.421+0000 7fe87e7fc700 1 -- 172.21.15.124:0/362352094 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe880085200 con 0x7fe888159680 2023-10-06T04:57:22.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.421+0000 7fe88e19b700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe86c066f30 0x7fe86c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.422+0000 7fe88e19b700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe86c066f30 0x7fe86c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8840091e0 tx=0x7fe884017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:22.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.426+0000 7fe87e7fc700 1 -- 172.21.15.124:0/362352094 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe880052230 con 0x7fe888159680 2023-10-06T04:57:22.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.615+0000 7fe8903ff700 1 -- 172.21.15.124:0/362352094 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe88804c380 con 0x7fe888159680 2023-10-06T04:57:22.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.615+0000 7fe87e7fc700 1 -- 172.21.15.124:0/362352094 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe880055850 con 0x7fe888159680 2023-10-06T04:57:22.618 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-06T04:57:22.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 -- 172.21.15.124:0/362352094 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe86c066f30 msgr2=0x7fe86c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe86c066f30 0x7fe86c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8840091e0 tx=0x7fe884017000 comp rx=0 tx=0).stop 2023-10-06T04:57:22.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 -- 172.21.15.124:0/362352094 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe888159680 msgr2=0x7fe888158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe888159680 0x7fe888158270 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe880009fc0 tx=0x7fe88000b040 comp rx=0 tx=0).stop 2023-10-06T04:57:22.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 -- 172.21.15.124:0/362352094 shutdown_connections 2023-10-06T04:57:22.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe888159680 0x7fe888158270 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe86c066f30 0x7fe86c0693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8880cc780 0x7fe8880c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 --2- 172.21.15.124:0/362352094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8881592b0 0x7fe888157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 -- 172.21.15.124:0/362352094 >> 172.21.15.124:0/362352094 conn(0x7fe88806ed20 msgr2=0x7fe8881507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:22.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 -- 172.21.15.124:0/362352094 shutdown_connections 2023-10-06T04:57:22.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.618+0000 7fe8903ff700 1 -- 172.21.15.124:0/362352094 wait complete. 2023-10-06T04:57:22.638 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:57:22.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.828+0000 7f839d9ff700 1 Processor -- start 2023-10-06T04:57:22.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.828+0000 7f839d9ff700 1 -- start start 2023-10-06T04:57:22.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.829+0000 7f839d9ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8398155800 0x7f83980694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.829+0000 7f839d9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83980ae6f0 0x7f8398156be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.829+0000 7f839d9ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839806e240 con 0x7f83981596c0 2023-10-06T04:57:22.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.829+0000 7f839d9ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839806d630 con 0x7f8398155800 2023-10-06T04:57:22.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.829+0000 7f839d9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839806d910 con 0x7f83980ae6f0 2023-10-06T04:57:22.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f8396ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8398155800 0x7f83980694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f8396ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8398155800 0x7f83980694c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60548/0 (socket says 172.21.15.124:60548) 2023-10-06T04:57:22.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f83967fc700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f83981596c0 0x7f8398157290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:51024/0 (socket says 172.21.15.124:51024) 2023-10-06T04:57:22.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f8396ffd700 1 -- 172.21.15.124:0/3778201196 learned_addr learned my addr 172.21.15.124:0/3778201196 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:22.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f83977fe700 1 --2- 172.21.15.124:0/3778201196 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83980ae6f0 0x7f8398156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f8396ffd700 1 -- 172.21.15.124:0/3778201196 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83980ae6f0 msgr2=0x7f8398156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:22.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f8396ffd700 1 --2- 172.21.15.124:0/3778201196 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83980ae6f0 0x7f8398156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f8396ffd700 1 -- 172.21.15.124:0/3778201196 >> v1:172.21.15.124:6789/0 conn(0x7f83981596c0 legacy=0x7f8398157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f8396ffd700 1 -- 172.21.15.124:0/3778201196 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839806dbf0 con 0x7f8398155800 2023-10-06T04:57:22.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f8395ffb700 1 -- 172.21.15.124:0/3778201196 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067839377 0 0) 0x7f839806e240 con 0x7f83981596c0 2023-10-06T04:57:22.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f8396ffd700 1 --2- 172.21.15.124:0/3778201196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8398155800 0x7f83980694c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f838800ab50 tx=0x7f838800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc888224da1262de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:22.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.830+0000 7f8395ffb700 1 -- 172.21.15.124:0/3778201196 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838800ca60 con 0x7f8398155800 2023-10-06T04:57:22.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.831+0000 7f8395ffb700 1 -- 172.21.15.124:0/3778201196 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838800cbc0 con 0x7f8398155800 2023-10-06T04:57:22.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.831+0000 7f8395ffb700 1 -- 172.21.15.124:0/3778201196 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388018400 con 0x7f8398155800 2023-10-06T04:57:22.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.831+0000 7f839d9ff700 1 -- 172.21.15.124:0/3778201196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8398155800 msgr2=0x7f83980694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.831+0000 7f839d9ff700 1 --2- 172.21.15.124:0/3778201196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8398155800 0x7f83980694c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f838800ab50 tx=0x7f838800a3f0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.831+0000 7f839d9ff700 1 -- 172.21.15.124:0/3778201196 shutdown_connections 2023-10-06T04:57:22.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.831+0000 7f839d9ff700 1 --2- 172.21.15.124:0/3778201196 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83980ae6f0 0x7f8398156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.831+0000 7f839d9ff700 1 --2- 172.21.15.124:0/3778201196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8398155800 0x7f83980694c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.831+0000 7f839d9ff700 1 -- 172.21.15.124:0/3778201196 >> 172.21.15.124:0/3778201196 conn(0x7f83980680c0 msgr2=0x7f83980cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:22.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.831+0000 7f839d9ff700 1 -- 172.21.15.124:0/3778201196 shutdown_connections 2023-10-06T04:57:22.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.831+0000 7f839d9ff700 1 -- 172.21.15.124:0/3778201196 wait complete. 2023-10-06T04:57:22.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.833+0000 7f839d9ff700 1 Processor -- start 2023-10-06T04:57:22.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.833+0000 7f839d9ff700 1 -- start start 2023-10-06T04:57:22.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f839d9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83980ae6f0 0x7f83980b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f839d9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8398155800 0x7f839814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f839d9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83981596c0 0x7f839814b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f839d9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839814b8e0 con 0x7f83980ae6f0 2023-10-06T04:57:22.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f839d9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839814bbc0 con 0x7f83981596c0 2023-10-06T04:57:22.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f839d9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839814bea0 con 0x7f8398155800 2023-10-06T04:57:22.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f8396ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83980ae6f0 0x7f83980b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f8396ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83980ae6f0 0x7f83980b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60564/0 (socket says 172.21.15.124:60564) 2023-10-06T04:57:22.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f8396ffd700 1 -- 172.21.15.124:0/1095279461 learned_addr learned my addr 172.21.15.124:0/1095279461 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:22.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f8396ffd700 1 -- 172.21.15.124:0/1095279461 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8398155800 msgr2=0x7f839814ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f83967fc700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8398155800 0x7f839814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f8396ffd700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8398155800 0x7f839814ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f8396ffd700 1 -- 172.21.15.124:0/1095279461 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83981596c0 msgr2=0x7f839814b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:22.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f8396ffd700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83981596c0 0x7f839814b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:22.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f8396ffd700 1 -- 172.21.15.124:0/1095279461 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838800a690 con 0x7f83980ae6f0 2023-10-06T04:57:22.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.834+0000 7f8396ffd700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83980ae6f0 0x7f83980b0550 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f838800a660 tx=0x7f838801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:22.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.835+0000 7f837effd700 1 -- 172.21.15.124:0/1095279461 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388010600 con 0x7f83980ae6f0 2023-10-06T04:57:22.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.835+0000 7f837effd700 1 -- 172.21.15.124:0/1095279461 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388010760 con 0x7f83980ae6f0 2023-10-06T04:57:22.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.835+0000 7f839d9ff700 1 -- 172.21.15.124:0/1095279461 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83980c3020 con 0x7f83980ae6f0 2023-10-06T04:57:22.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.835+0000 7f837effd700 1 -- 172.21.15.124:0/1095279461 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388010ae0 con 0x7f83980ae6f0 2023-10-06T04:57:22.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.835+0000 7f839d9ff700 1 -- 172.21.15.124:0/1095279461 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839814b5f0 con 0x7f83980ae6f0 2023-10-06T04:57:22.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.836+0000 7f839d9ff700 1 -- 172.21.15.124:0/1095279461 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8398064850 con 0x7f83980ae6f0 2023-10-06T04:57:22.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.837+0000 7f837effd700 1 -- 172.21.15.124:0/1095279461 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83880233f0 con 0x7f83980ae6f0 2023-10-06T04:57:22.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.837+0000 7f837effd700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8384066f30 0x7f83840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:22.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.838+0000 7f837effd700 1 -- 172.21.15.124:0/1095279461 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f8388086320 con 0x7f83980ae6f0 2023-10-06T04:57:22.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.838+0000 7f83967fc700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8384066f30 0x7f83840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:22.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.838+0000 7f83967fc700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8384066f30 0x7f83840693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f839816ce70 tx=0x7f838c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:22.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:22.842+0000 7f837effd700 1 -- 172.21.15.124:0/1095279461 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83880533d0 con 0x7f83980ae6f0 2023-10-06T04:57:23.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.036+0000 7f839d9ff700 1 -- 172.21.15.124:0/1095279461 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f839804c380 con 0x7f83980ae6f0 2023-10-06T04:57:23.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.037+0000 7f837effd700 1 -- 172.21.15.124:0/1095279461 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f83880569f0 con 0x7f83980ae6f0 2023-10-06T04:57:23.039 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-06T04:57:23.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 -- 172.21.15.124:0/1095279461 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8384066f30 msgr2=0x7f83840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8384066f30 0x7f83840693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f839816ce70 tx=0x7f838c009040 comp rx=0 tx=0).stop 2023-10-06T04:57:23.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 -- 172.21.15.124:0/1095279461 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83980ae6f0 msgr2=0x7f83980b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83980ae6f0 0x7f83980b0550 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f838800a660 tx=0x7f838801a000 comp rx=0 tx=0).stop 2023-10-06T04:57:23.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 -- 172.21.15.124:0/1095279461 shutdown_connections 2023-10-06T04:57:23.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83981596c0 0x7f839814b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83980ae6f0 0x7f83980b0550 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8384066f30 0x7f83840693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 --2- 172.21.15.124:0/1095279461 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8398155800 0x7f839814ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 -- 172.21.15.124:0/1095279461 >> 172.21.15.124:0/1095279461 conn(0x7f83980680c0 msgr2=0x7f83980cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:23.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 -- 172.21.15.124:0/1095279461 shutdown_connections 2023-10-06T04:57:23.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.039+0000 7f839d9ff700 1 -- 172.21.15.124:0/1095279461 wait complete. 2023-10-06T04:57:23.059 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:57:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.248+0000 7fd4ab1ff700 1 Processor -- start 2023-10-06T04:57:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.249+0000 7fd4ab1ff700 1 -- start start 2023-10-06T04:57:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.250+0000 7fd4ab1ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd4a4159480 0x7fd4a415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.250+0000 7fd4ab1ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a4068700 con 0x7fd4a40c8840 2023-10-06T04:57:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.250+0000 7fd4ab1ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a40c9030 con 0x7fd4a406d770 2023-10-06T04:57:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.250+0000 7fd4ab1ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a4068950 con 0x7fd4a4159480 2023-10-06T04:57:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.250+0000 7fd4a3fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd4a40c8840 0x7fd4a406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47628/0 (socket says 172.21.15.124:47628) 2023-10-06T04:57:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.250+0000 7fd4a3fff700 1 -- 172.21.15.124:0/2881357016 learned_addr learned my addr 172.21.15.124:0/2881357016 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.250+0000 7fd4a8f9b700 1 --2- 172.21.15.124:0/2881357016 >> v2:172.21.15.158:3300/0 conn(0x7fd4a4159480 0x7fd4a415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.250+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307693217 0 0) 0x7fd4a4068700 con 0x7fd4a40c8840 2023-10-06T04:57:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd494003570 con 0x7fd4a40c8840 2023-10-06T04:57:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2558081862 0 0) 0x7fd494003570 con 0x7fd4a40c8840 2023-10-06T04:57:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 >> v2:172.21.15.158:3300/0 conn(0x7fd4a4159480 msgr2=0x7fd4a415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 --2- 172.21.15.124:0/2881357016 >> v2:172.21.15.158:3300/0 conn(0x7fd4a4159480 0x7fd4a415dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 >> v1:172.21.15.158:6789/0 conn(0x7fd4a406d770 legacy=0x7fd4a4069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4068c30 con 0x7fd4a40c8840 2023-10-06T04:57:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fd490001470 con 0x7fd4a40c8840 2023-10-06T04:57:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 >> v1:172.21.15.124:6789/0 conn(0x7fd4a40c8840 legacy=0x7fd4a406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd494003a60 0x7fd494003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd494004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4940051c0 0x7fd49400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4068950 con 0x7fd494004810 2023-10-06T04:57:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49400c0b0 con 0x7fd4940051c0 2023-10-06T04:57:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49400c270 con 0x7fd494003a60 2023-10-06T04:57:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a3fff700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd494004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a8f9b700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd494003a60 0x7fd494003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.251+0000 7fd4a979c700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4940051c0 0x7fd49400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a3fff700 1 -- 172.21.15.124:0/2881357016 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd494003a60 msgr2=0x7fd494003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a3fff700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd494003a60 0x7fd494003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a3fff700 1 -- 172.21.15.124:0/2881357016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4940051c0 msgr2=0x7fd49400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a3fff700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4940051c0 0x7fd49400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a3fff700 1 -- 172.21.15.124:0/2881357016 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494003570 con 0x7fd494004810 2023-10-06T04:57:23.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a8f9b700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd494003a60 0x7fd494003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:23.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a979c700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4940051c0 0x7fd49400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:23.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a979c700 1 -- 172.21.15.124:0/2881357016 reap_dead start 2023-10-06T04:57:23.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a3fff700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd494004c80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c2d0 tx=0x7fd490001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e0f2b3053a97f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:23.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000cba0 con 0x7fd494004810 2023-10-06T04:57:23.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000cd20 con 0x7fd494004810 2023-10-06T04:57:23.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4a37fe700 1 -- 172.21.15.124:0/2881357016 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490005b70 con 0x7fd494004810 2023-10-06T04:57:23.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/2881357016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 msgr2=0x7fd494004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.252+0000 7fd4ab1ff700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd494004c80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c2d0 tx=0x7fd490001da0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.253+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/2881357016 shutdown_connections 2023-10-06T04:57:23.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.253+0000 7fd4ab1ff700 1 --2- 172.21.15.124:0/2881357016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd494004c80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.253+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/2881357016 >> 172.21.15.124:0/2881357016 conn(0x7fd4a4063cc0 msgr2=0x7fd4a40ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:23.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.253+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/2881357016 shutdown_connections 2023-10-06T04:57:23.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.253+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/2881357016 wait complete. 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.254+0000 7fd4ab1ff700 1 Processor -- start 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.254+0000 7fd4ab1ff700 1 -- start start 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.255+0000 7fd4ab1ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd4a416acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.255+0000 7fd4ab1ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4a415c040 0x7fd4a415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.255+0000 7fd4ab1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd4a4169b40 0x7fd4a4169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.255+0000 7fd4ab1ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a416a520 con 0x7fd494004810 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.255+0000 7fd4ab1ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40c2700 con 0x7fd4a415c040 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.255+0000 7fd4ab1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a415ca90 con 0x7fd4a4169b40 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.255+0000 7fd4a8f9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd4a416acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.255+0000 7fd4a8f9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd4a416acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55376/0 (socket says 172.21.15.124:55376) 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.255+0000 7fd4a8f9b700 1 -- 172.21.15.124:0/4080149311 learned_addr learned my addr 172.21.15.124:0/4080149311 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:23.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.255+0000 7fd4a3fff700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4a415c040 0x7fd4a415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a979c700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd4a4169b40 0x7fd4a4169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a8f9b700 1 -- 172.21.15.124:0/4080149311 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd4a4169b40 msgr2=0x7fd4a4169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a8f9b700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd4a4169b40 0x7fd4a4169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a8f9b700 1 -- 172.21.15.124:0/4080149311 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4a415c040 msgr2=0x7fd4a415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a8f9b700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4a415c040 0x7fd4a415c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a8f9b700 1 -- 172.21.15.124:0/4080149311 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40c29c0 con 0x7fd494004810 2023-10-06T04:57:23.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a3fff700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4a415c040 0x7fd4a415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:23.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a8f9b700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd4a416acd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd498011700 tx=0x7fd498008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a0ff9700 1 -- 172.21.15.124:0/4080149311 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498015670 con 0x7fd494004810 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a0ff9700 1 -- 172.21.15.124:0/4080149311 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980157d0 con 0x7fd494004810 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/4080149311 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a40c2ca0 con 0x7fd494004810 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4a0ff9700 1 -- 172.21.15.124:0/4080149311 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498015b90 con 0x7fd494004810 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.256+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/4080149311 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a416a8d0 con 0x7fd494004810 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.257+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/4080149311 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a40c3140 con 0x7fd494004810 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.258+0000 7fd4a0ff9700 1 -- 172.21.15.124:0/4080149311 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd498013410 con 0x7fd494004810 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.259+0000 7fd4a0ff9700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd488066f60 0x7fd488069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.259+0000 7fd4a0ff9700 1 -- 172.21.15.124:0/4080149311 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd498084e80 con 0x7fd494004810 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.259+0000 7fd4a3fff700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd488066f60 0x7fd488069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.260+0000 7fd4a3fff700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd488066f60 0x7fd488069410 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd490007c20 tx=0x7fd490015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:23.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.263+0000 7fd4a0ff9700 1 -- 172.21.15.124:0/4080149311 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd498051f60 con 0x7fd494004810 2023-10-06T04:57:23.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.454+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/4080149311 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4a404c380 con 0x7fd494004810 2023-10-06T04:57:23.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.455+0000 7fd4a0ff9700 1 -- 172.21.15.124:0/4080149311 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd498055580 con 0x7fd494004810 2023-10-06T04:57:23.457 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-06T04:57:23.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/4080149311 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd488066f60 msgr2=0x7fd488069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd488066f60 0x7fd488069410 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd490007c20 tx=0x7fd490015000 comp rx=0 tx=0).stop 2023-10-06T04:57:23.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/4080149311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 msgr2=0x7fd4a416acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd4a416acd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd498011700 tx=0x7fd498008040 comp rx=0 tx=0).stop 2023-10-06T04:57:23.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/4080149311 shutdown_connections 2023-10-06T04:57:23.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fd488066f60 0x7fd488069410 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd4a4169b40 0x7fd4a4169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd494004810 0x7fd4a416acd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 --2- 172.21.15.124:0/4080149311 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4a415c040 0x7fd4a415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/4080149311 >> 172.21.15.124:0/4080149311 conn(0x7fd4a4063cc0 msgr2=0x7fd4a40b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:23.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/4080149311 shutdown_connections 2023-10-06T04:57:23.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.457+0000 7fd4ab1ff700 1 -- 172.21.15.124:0/4080149311 wait complete. 2023-10-06T04:57:23.478 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:57:23.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.664+0000 7ff7727ff700 1 Processor -- start 2023-10-06T04:57:23.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.664+0000 7ff7727ff700 1 -- start start 2023-10-06T04:57:23.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.665+0000 7ff7727ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff76c0ccbb0 0x7ff76c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.665+0000 7ff7727ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff76c0cdfe0 0x7ff76c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.665+0000 7ff7727ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff76c0ccf80 0x7ff76c0cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.665+0000 7ff7727ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c0cf6b0 con 0x7ff76c0ccbb0 2023-10-06T04:57:23.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.665+0000 7ff7727ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c0ceaa0 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.665+0000 7ff7727ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0ced80 con 0x7ff76c0ccf80 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff76bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff76c0ccbb0 0x7ff76c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff76bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff76c0ccbb0 0x7ff76c0cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55382/0 (socket says 172.21.15.124:55382) 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff76bfff700 1 -- 172.21.15.124:0/4203329537 learned_addr learned my addr 172.21.15.124:0/4203329537 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff76b7fe700 1 --2- 172.21.15.124:0/4203329537 >> v2:172.21.15.158:3300/0 conn(0x7ff76c0cdfe0 0x7ff76c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff770d9c700 1 --2- 172.21.15.124:0/4203329537 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff76c0ccf80 0x7ff76c0cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff76bfff700 1 -- 172.21.15.124:0/4203329537 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff76c0ccf80 msgr2=0x7ff76c0cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff76bfff700 1 --2- 172.21.15.124:0/4203329537 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff76c0ccf80 0x7ff76c0cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff76bfff700 1 -- 172.21.15.124:0/4203329537 >> v2:172.21.15.158:3300/0 conn(0x7ff76c0cdfe0 msgr2=0x7ff76c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff76bfff700 1 --2- 172.21.15.124:0/4203329537 >> v2:172.21.15.158:3300/0 conn(0x7ff76c0cdfe0 0x7ff76c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff76bfff700 1 -- 172.21.15.124:0/4203329537 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c0cf060 con 0x7ff76c0ccbb0 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.666+0000 7ff76bfff700 1 --2- 172.21.15.124:0/4203329537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0ccbb0 0x7ff76c0cfb40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0cdf90 tx=0x7ff75c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f4a6f4a028ad81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:23.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff76affd700 1 -- 172.21.15.124:0/4203329537 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00b860 con 0x7ff76c0ccbb0 2023-10-06T04:57:23.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff76affd700 1 -- 172.21.15.124:0/4203329537 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c00b9c0 con 0x7ff76c0ccbb0 2023-10-06T04:57:23.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff76affd700 1 -- 172.21.15.124:0/4203329537 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00bd60 con 0x7ff76c0ccbb0 2023-10-06T04:57:23.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff7727ff700 1 -- 172.21.15.124:0/4203329537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0ccbb0 msgr2=0x7ff76c0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff7727ff700 1 --2- 172.21.15.124:0/4203329537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0ccbb0 0x7ff76c0cfb40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0cdf90 tx=0x7ff75c009250 comp rx=0 tx=0).stop 2023-10-06T04:57:23.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff7727ff700 1 -- 172.21.15.124:0/4203329537 shutdown_connections 2023-10-06T04:57:23.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff7727ff700 1 --2- 172.21.15.124:0/4203329537 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff76c0ccf80 0x7ff76c0cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff7727ff700 1 --2- 172.21.15.124:0/4203329537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0ccbb0 0x7ff76c0cfb40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff7727ff700 1 --2- 172.21.15.124:0/4203329537 >> v2:172.21.15.158:3300/0 conn(0x7ff76c0cdfe0 0x7ff76c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff7727ff700 1 -- 172.21.15.124:0/4203329537 >> 172.21.15.124:0/4203329537 conn(0x7ff76c099710 msgr2=0x7ff76c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:23.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.667+0000 7ff7727ff700 1 -- 172.21.15.124:0/4203329537 shutdown_connections 2023-10-06T04:57:23.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.668+0000 7ff7727ff700 1 -- 172.21.15.124:0/4203329537 wait complete. 2023-10-06T04:57:23.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.669+0000 7ff7727ff700 1 Processor -- start 2023-10-06T04:57:23.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.670+0000 7ff7727ff700 1 -- start start 2023-10-06T04:57:23.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.671+0000 7ff7727ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff76c0ccbb0 0x7ff76c156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.671+0000 7ff7727ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff76c0ccf80 0x7ff76c0b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.671+0000 7ff7727ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0cdfe0 0x7ff76c09d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.671+0000 7ff7727ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c169e50 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.671+0000 7ff7727ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c16a130 con 0x7ff76c0ccbb0 2023-10-06T04:57:23.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.671+0000 7ff7727ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c16a410 con 0x7ff76c0ccf80 2023-10-06T04:57:23.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.671+0000 7ff770d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0cdfe0 0x7ff76c09d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.671+0000 7ff770d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0cdfe0 0x7ff76c09d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55390/0 (socket says 172.21.15.124:55390) 2023-10-06T04:57:23.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.671+0000 7ff770d9c700 1 -- 172.21.15.124:0/2210879458 learned_addr learned my addr 172.21.15.124:0/2210879458 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:23.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.671+0000 7ff76bfff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff76c0ccbb0 0x7ff76c156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff76b7fe700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff76c0ccf80 0x7ff76c0b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff770d9c700 1 -- 172.21.15.124:0/2210879458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff76c0ccf80 msgr2=0x7ff76c0b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff770d9c700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff76c0ccf80 0x7ff76c0b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff770d9c700 1 -- 172.21.15.124:0/2210879458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff76c0ccbb0 msgr2=0x7ff76c156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff770d9c700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff76c0ccbb0 0x7ff76c156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff770d9c700 1 -- 172.21.15.124:0/2210879458 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c0094f0 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff76bfff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff76c0ccbb0 0x7ff76c156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff770d9c700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0cdfe0 0x7ff76c09d7d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff764009fa0 tx=0x7ff764009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff753fff700 1 -- 172.21.15.124:0/2210879458 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400ed20 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff753fff700 1 -- 172.21.15.124:0/2210879458 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76400ee80 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff7727ff700 1 -- 172.21.15.124:0/2210879458 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76c16a6f0 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff753fff700 1 -- 172.21.15.124:0/2210879458 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764014670 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.672+0000 7ff7727ff700 1 -- 172.21.15.124:0/2210879458 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c0b60d0 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.673+0000 7ff7727ff700 1 -- 172.21.15.124:0/2210879458 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76c0b62f0 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.674+0000 7ff753fff700 1 -- 172.21.15.124:0/2210879458 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7640149e0 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.675+0000 7ff753fff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff758066f30 0x7ff7580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:23.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.675+0000 7ff753fff700 1 -- 172.21.15.124:0/2210879458 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ff764084f60 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.676+0000 7ff76bfff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff758066f30 0x7ff7580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:23.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.676+0000 7ff76bfff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff758066f30 0x7ff7580693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0cdf90 tx=0x7ff75c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:23.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.679+0000 7ff753fff700 1 -- 172.21.15.124:0/2210879458 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff764051f90 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.910+0000 7ff7727ff700 1 -- 172.21.15.124:0/2210879458 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff76c0717a0 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.911+0000 7ff753fff700 1 -- 172.21.15.124:0/2210879458 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7ff7640555b0 con 0x7ff76c0cdfe0 2023-10-06T04:57:23.914 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:23.914 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/267826992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":267826992},{"type":"v1","addr":"172.21.15.158:6835","nonce":267826992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/361532770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":361532770},{"type":"v1","addr":"172.21.15.124:6835","nonce":361532770}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1150240645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6836","nonce":1150240645},{"type":"v1","addr":"172.21.15.124:6837","nonce":1150240645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:58.847255+0000","modified":"2023-10-06T04:46:02.379103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6834/1553392288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1553392288},{"type":"v1","addr":"172.21.15.158:6834","nonce":1553392288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:57:23.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 -- 172.21.15.124:0/2210879458 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff758066f30 msgr2=0x7ff7580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff758066f30 0x7ff7580693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0cdf90 tx=0x7ff75c017000 comp rx=0 tx=0).stop 2023-10-06T04:57:23.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 -- 172.21.15.124:0/2210879458 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0cdfe0 msgr2=0x7ff76c09d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:23.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0cdfe0 0x7ff76c09d7d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff764009fa0 tx=0x7ff764009900 comp rx=0 tx=0).stop 2023-10-06T04:57:23.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 -- 172.21.15.124:0/2210879458 shutdown_connections 2023-10-06T04:57:23.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff76c0cdfe0 0x7ff76c09d7d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff76c0ccbb0 0x7ff76c156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.918 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff758066f30 0x7ff7580693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.918 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 --2- 172.21.15.124:0/2210879458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff76c0ccf80 0x7ff76c0b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:23.918 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 -- 172.21.15.124:0/2210879458 >> 172.21.15.124:0/2210879458 conn(0x7ff76c099710 msgr2=0x7ff76c158800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:23.918 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 -- 172.21.15.124:0/2210879458 shutdown_connections 2023-10-06T04:57:23.918 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:23.913+0000 7ff7727ff700 1 -- 172.21.15.124:0/2210879458 wait complete. 2023-10-06T04:57:23.918 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 25 2023-10-06T04:57:23.933 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:57:24.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.121+0000 7fe5277ff700 1 Processor -- start 2023-10-06T04:57:24.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.122+0000 7fe5277ff700 1 -- start start 2023-10-06T04:57:24.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe5277ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe5200ad600 0x7fe5200abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe5277ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200697d0 0x7fe520069c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe5277ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe5200ad9d0 0x7fe5200ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe5277ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52006aab0 con 0x7fe5200ad600 2023-10-06T04:57:24.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe5277ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52006d550 con 0x7fe5200ad9d0 2023-10-06T04:57:24.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe5277ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52006a210 con 0x7fe5200697d0 2023-10-06T04:57:24.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe52559b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe5200ad600 0x7fe5200abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe52559b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe5200ad600 0x7fe5200abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55404/0 (socket says 172.21.15.124:55404) 2023-10-06T04:57:24.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe52559b700 1 -- 172.21.15.124:0/2387461429 learned_addr learned my addr 172.21.15.124:0/2387461429 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:24.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe525d9c700 1 --2- 172.21.15.124:0/2387461429 >> v2:172.21.15.158:3300/0 conn(0x7fe5200ad9d0 0x7fe5200ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.123+0000 7fe524d9a700 1 --2- 172.21.15.124:0/2387461429 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200697d0 0x7fe520069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.124+0000 7fe52559b700 1 -- 172.21.15.124:0/2387461429 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200697d0 msgr2=0x7fe520069c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:24.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.124+0000 7fe52559b700 1 --2- 172.21.15.124:0/2387461429 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200697d0 0x7fe520069c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.124+0000 7fe52559b700 1 -- 172.21.15.124:0/2387461429 >> v2:172.21.15.158:3300/0 conn(0x7fe5200ad9d0 msgr2=0x7fe5200ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:24.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.124+0000 7fe52559b700 1 --2- 172.21.15.124:0/2387461429 >> v2:172.21.15.158:3300/0 conn(0x7fe5200ad9d0 0x7fe5200ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.124+0000 7fe52559b700 1 -- 172.21.15.124:0/2387461429 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52006a4f0 con 0x7fe5200ad600 2023-10-06T04:57:24.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.124+0000 7fe52559b700 1 --2- 172.21.15.124:0/2387461429 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad600 0x7fe5200abbb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe52006f7d0 tx=0x7fe51c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8cafe0e8ad56c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:24.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.124+0000 7fe517fff700 1 -- 172.21.15.124:0/2387461429 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00b640 con 0x7fe5200ad600 2023-10-06T04:57:24.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.124+0000 7fe517fff700 1 -- 172.21.15.124:0/2387461429 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c00b7a0 con 0x7fe5200ad600 2023-10-06T04:57:24.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.124+0000 7fe517fff700 1 -- 172.21.15.124:0/2387461429 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00bb60 con 0x7fe5200ad600 2023-10-06T04:57:24.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.125+0000 7fe5277ff700 1 -- 172.21.15.124:0/2387461429 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad600 msgr2=0x7fe5200abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.125+0000 7fe5277ff700 1 --2- 172.21.15.124:0/2387461429 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad600 0x7fe5200abbb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe52006f7d0 tx=0x7fe51c009250 comp rx=0 tx=0).stop 2023-10-06T04:57:24.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.125+0000 7fe5277ff700 1 -- 172.21.15.124:0/2387461429 shutdown_connections 2023-10-06T04:57:24.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.125+0000 7fe5277ff700 1 --2- 172.21.15.124:0/2387461429 >> v2:172.21.15.158:3300/0 conn(0x7fe5200ad9d0 0x7fe5200ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.125+0000 7fe5277ff700 1 --2- 172.21.15.124:0/2387461429 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad600 0x7fe5200abbb0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.125+0000 7fe5277ff700 1 --2- 172.21.15.124:0/2387461429 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200697d0 0x7fe520069c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.125+0000 7fe5277ff700 1 -- 172.21.15.124:0/2387461429 >> 172.21.15.124:0/2387461429 conn(0x7fe5200cc050 msgr2=0x7fe5200cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:24.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.125+0000 7fe5277ff700 1 -- 172.21.15.124:0/2387461429 shutdown_connections 2023-10-06T04:57:24.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.125+0000 7fe5277ff700 1 -- 172.21.15.124:0/2387461429 wait complete. 2023-10-06T04:57:24.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.127+0000 7fe5277ff700 1 Processor -- start 2023-10-06T04:57:24.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.127+0000 7fe5277ff700 1 -- start start 2023-10-06T04:57:24.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.128+0000 7fe5277ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5200697d0 0x7fe52016e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.128+0000 7fe5277ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200ad600 0x7fe52015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe5277ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad9d0 0x7fe52015e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe5277ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52015f820 con 0x7fe5200ad9d0 2023-10-06T04:57:24.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe5277ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52016e0e0 con 0x7fe5200697d0 2023-10-06T04:57:24.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe5277ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52015ec10 con 0x7fe5200ad600 2023-10-06T04:57:24.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe525d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad9d0 0x7fe52015e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe525d9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad9d0 0x7fe52015e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55410/0 (socket says 172.21.15.124:55410) 2023-10-06T04:57:24.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe525d9c700 1 -- 172.21.15.124:0/3216282977 learned_addr learned my addr 172.21.15.124:0/3216282977 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe524d9a700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200ad600 0x7fe52015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe52559b700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5200697d0 0x7fe52016e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe525d9c700 1 -- 172.21.15.124:0/3216282977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200ad600 msgr2=0x7fe52015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe525d9c700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200ad600 0x7fe52015e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe525d9c700 1 -- 172.21.15.124:0/3216282977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5200697d0 msgr2=0x7fe52016e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe525d9c700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5200697d0 0x7fe52016e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe525d9c700 1 -- 172.21.15.124:0/3216282977 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c0094f0 con 0x7fe5200ad9d0 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe524d9a700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200ad600 0x7fe52015e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.129+0000 7fe525d9c700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad9d0 0x7fe52015e5e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe518009e90 tx=0x7fe51800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.130+0000 7fe5157fa700 1 -- 172.21.15.124:0/3216282977 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51800cc20 con 0x7fe5200ad9d0 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.130+0000 7fe5157fa700 1 -- 172.21.15.124:0/3216282977 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51800f040 con 0x7fe5200ad9d0 2023-10-06T04:57:24.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.130+0000 7fe5157fa700 1 -- 172.21.15.124:0/3216282977 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518014480 con 0x7fe5200ad9d0 2023-10-06T04:57:24.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.130+0000 7fe5277ff700 1 -- 172.21.15.124:0/3216282977 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52015eef0 con 0x7fe5200ad9d0 2023-10-06T04:57:24.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.130+0000 7fe5277ff700 1 -- 172.21.15.124:0/3216282977 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52015f4b0 con 0x7fe5200ad9d0 2023-10-06T04:57:24.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.131+0000 7fe5277ff700 1 -- 172.21.15.124:0/3216282977 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52015f9d0 con 0x7fe5200ad9d0 2023-10-06T04:57:24.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.132+0000 7fe5157fa700 1 -- 172.21.15.124:0/3216282977 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe518014830 con 0x7fe5200ad9d0 2023-10-06T04:57:24.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.132+0000 7fe5157fa700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe504066f30 0x7fe5040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.132+0000 7fe5157fa700 1 -- 172.21.15.124:0/3216282977 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe518085470 con 0x7fe5200ad9d0 2023-10-06T04:57:24.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.133+0000 7fe52559b700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe504066f30 0x7fe5040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.133+0000 7fe52559b700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe504066f30 0x7fe5040693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe52006f7d0 tx=0x7fe51c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:24.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.137+0000 7fe5157fa700 1 -- 172.21.15.124:0/3216282977 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe52015f9d0 con 0x7fe5200ad9d0 2023-10-06T04:57:24.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.325+0000 7fe5277ff700 1 -- 172.21.15.124:0/3216282977 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5200717a0 con 0x7fe5200ad9d0 2023-10-06T04:57:24.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.326+0000 7fe5157fa700 1 -- 172.21.15.124:0/3216282977 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17106 (secure 0 0 0) 0x7fe518055f30 con 0x7fe5200ad9d0 2023-10-06T04:57:24.329 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:24.329 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":47,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:46:16.043178+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:56.420552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:57.820429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:57:24.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 -- 172.21.15.124:0/3216282977 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe504066f30 msgr2=0x7fe5040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe504066f30 0x7fe5040693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe52006f7d0 tx=0x7fe51c017000 comp rx=0 tx=0).stop 2023-10-06T04:57:24.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 -- 172.21.15.124:0/3216282977 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad9d0 msgr2=0x7fe52015e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad9d0 0x7fe52015e5e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe518009e90 tx=0x7fe51800b040 comp rx=0 tx=0).stop 2023-10-06T04:57:24.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 -- 172.21.15.124:0/3216282977 shutdown_connections 2023-10-06T04:57:24.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5200ad9d0 0x7fe52015e5e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5200697d0 0x7fe52016e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe504066f30 0x7fe5040693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 --2- 172.21.15.124:0/3216282977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5200ad600 0x7fe52015e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 -- 172.21.15.124:0/3216282977 >> 172.21.15.124:0/3216282977 conn(0x7fe5200cc050 msgr2=0x7fe5200aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:24.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 -- 172.21.15.124:0/3216282977 shutdown_connections 2023-10-06T04:57:24.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.328+0000 7fe5277ff700 1 -- 172.21.15.124:0/3216282977 wait complete. 2023-10-06T04:57:24.349 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:57:24.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:57:24.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.536+0000 7ff6277ff700 1 Processor -- start 2023-10-06T04:57:24.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.537+0000 7ff6277ff700 1 -- start start 2023-10-06T04:57:24.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.538+0000 7ff6277ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff6200cb250 0x7ff6201591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.538+0000 7ff6277ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6200c1d10 con 0x7ff6200cae80 2023-10-06T04:57:24.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.538+0000 7ff6277ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff620159b70 con 0x7ff620159710 2023-10-06T04:57:24.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.538+0000 7ff6277ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6200cd430 con 0x7ff6200cb250 2023-10-06T04:57:24.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.538+0000 7ff62559b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff6200cae80 0x7ff6200cc980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47642/0 (socket says 172.21.15.124:47642) 2023-10-06T04:57:24.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.538+0000 7ff62559b700 1 -- 172.21.15.124:0/3296864604 learned_addr learned my addr 172.21.15.124:0/3296864604 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:24.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff624d9a700 1 --2- 172.21.15.124:0/3296864604 >> v2:172.21.15.158:3300/0 conn(0x7ff6200cb250 0x7ff6201591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178345828 0 0) 0x7ff6200c1d10 con 0x7ff6200cae80 2023-10-06T04:57:24.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff60c003570 con 0x7ff6200cae80 2023-10-06T04:57:24.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871406255 0 0) 0x7ff60c003570 con 0x7ff6200cae80 2023-10-06T04:57:24.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 >> v2:172.21.15.158:3300/0 conn(0x7ff6200cb250 msgr2=0x7ff6201591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:24.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 --2- 172.21.15.124:0/3296864604 >> v2:172.21.15.158:3300/0 conn(0x7ff6200cb250 0x7ff6201591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 >> v1:172.21.15.158:6789/0 conn(0x7ff620159710 legacy=0x7ff6200afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6200688a0 con 0x7ff6200cae80 2023-10-06T04:57:24.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7ff61c001470 con 0x7ff6200cae80 2023-10-06T04:57:24.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 >> v1:172.21.15.124:6789/0 conn(0x7ff6200cae80 legacy=0x7ff6200cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff60c003ab0 0x7ff60c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff60c004810 0x7ff60c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff60c005210 0x7ff60c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200cd430 con 0x7ff60c003ab0 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c00c130 con 0x7ff60c004810 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c00c2f0 con 0x7ff60c005210 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.539+0000 7ff62559b700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff60c003ab0 0x7ff60c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff624d9a700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff60c004810 0x7ff60c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff625d9c700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff60c005210 0x7ff60c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff62559b700 1 -- 172.21.15.124:0/3296864604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff60c005210 msgr2=0x7ff60c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff62559b700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff60c005210 0x7ff60c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff62559b700 1 -- 172.21.15.124:0/3296864604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff60c004810 msgr2=0x7ff60c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff62559b700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff60c004810 0x7ff60c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff62559b700 1 -- 172.21.15.124:0/3296864604 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c003570 con 0x7ff60c003ab0 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff625d9c700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff60c005210 0x7ff60c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff625d9c700 1 -- 172.21.15.124:0/3296864604 reap_dead start 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff62559b700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff60c003ab0 0x7ff60c003ec0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff61c00c2d0 tx=0x7ff61c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bc1d50f961f3c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c00cba0 con 0x7ff60c003ab0 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c00cd20 con 0x7ff60c003ab0 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.540+0000 7ff617fff700 1 -- 172.21.15.124:0/3296864604 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c005b70 con 0x7ff60c003ab0 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.541+0000 7ff6277ff700 1 -- 172.21.15.124:0/3296864604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff60c003ab0 msgr2=0x7ff60c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.541+0000 7ff6277ff700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff60c003ab0 0x7ff60c003ec0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff61c00c2d0 tx=0x7ff61c001d80 comp rx=0 tx=0).stop 2023-10-06T04:57:24.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.541+0000 7ff6277ff700 1 -- 172.21.15.124:0/3296864604 shutdown_connections 2023-10-06T04:57:24.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.541+0000 7ff6277ff700 1 --2- 172.21.15.124:0/3296864604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff60c003ab0 0x7ff60c003ec0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.541+0000 7ff6277ff700 1 -- 172.21.15.124:0/3296864604 >> 172.21.15.124:0/3296864604 conn(0x7ff6200974f0 msgr2=0x7ff6200639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:24.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.541+0000 7ff6277ff700 1 -- 172.21.15.124:0/3296864604 shutdown_connections 2023-10-06T04:57:24.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.541+0000 7ff6277ff700 1 -- 172.21.15.124:0/3296864604 wait complete. 2023-10-06T04:57:24.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.542+0000 7ff6277ff700 1 Processor -- start 2023-10-06T04:57:24.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.542+0000 7ff6277ff700 1 -- start start 2023-10-06T04:57:24.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.543+0000 7ff6277ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff60c003ab0 0x7ff62016d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.543+0000 7ff6277ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff620158310 0x7ff6200c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.543+0000 7ff6277ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff620157c90 0x7ff620069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.543+0000 7ff6277ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62016dfa0 con 0x7ff620158310 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.543+0000 7ff6277ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200c6fe0 con 0x7ff620157c90 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.543+0000 7ff6277ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff620158100 con 0x7ff60c003ab0 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff624d9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff620158310 0x7ff6200c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff624d9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff620158310 0x7ff6200c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55432/0 (socket says 172.21.15.124:55432) 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff624d9a700 1 -- 172.21.15.124:0/1680980216 learned_addr learned my addr 172.21.15.124:0/1680980216 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff62559b700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff60c003ab0 0x7ff62016d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff625d9c700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff620157c90 0x7ff620069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff624d9a700 1 -- 172.21.15.124:0/1680980216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff60c003ab0 msgr2=0x7ff62016d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff624d9a700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff60c003ab0 0x7ff62016d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff624d9a700 1 -- 172.21.15.124:0/1680980216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff620157c90 msgr2=0x7ff620069500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff624d9a700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff620157c90 0x7ff620069500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff624d9a700 1 -- 172.21.15.124:0/1680980216 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff620158ba0 con 0x7ff620158310 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff625d9c700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff620157c90 0x7ff620069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff624d9a700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff620158310 0x7ff6200c52a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff610011d70 tx=0x7ff6100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff6157fa700 1 -- 172.21.15.124:0/1680980216 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61000fac0 con 0x7ff620158310 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff6157fa700 1 -- 172.21.15.124:0/1680980216 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61000fc20 con 0x7ff620158310 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff6277ff700 1 -- 172.21.15.124:0/1680980216 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62016d700 con 0x7ff620158310 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.544+0000 7ff6157fa700 1 -- 172.21.15.124:0/1680980216 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610014440 con 0x7ff620158310 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.545+0000 7ff6277ff700 1 -- 172.21.15.124:0/1680980216 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62016dcc0 con 0x7ff620158310 2023-10-06T04:57:24.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.546+0000 7ff6277ff700 1 -- 172.21.15.124:0/1680980216 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6200c6db0 con 0x7ff620158310 2023-10-06T04:57:24.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.546+0000 7ff6157fa700 1 -- 172.21.15.124:0/1680980216 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff610014870 con 0x7ff620158310 2023-10-06T04:57:24.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.547+0000 7ff6157fa700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff604066f30 0x7ff6040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.547+0000 7ff6157fa700 1 -- 172.21.15.124:0/1680980216 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ff610018030 con 0x7ff620158310 2023-10-06T04:57:24.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.548+0000 7ff62559b700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff604066f30 0x7ff6040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.548+0000 7ff62559b700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff604066f30 0x7ff6040693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff61c007c00 tx=0x7ff61c015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:24.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.551+0000 7ff6157fa700 1 -- 172.21.15.124:0/1680980216 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6200c6db0 con 0x7ff620158310 2023-10-06T04:57:24.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.783+0000 7ff6277ff700 1 -- 172.21.15.124:0/1680980216 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6200c6db0 con 0x7ff620158310 2023-10-06T04:57:24.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.783+0000 7ff6157fa700 1 -- 172.21.15.124:0/1680980216 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7ff610022090 con 0x7ff620158310 2023-10-06T04:57:24.786 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:24.786 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/267826992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":267826992},{"type":"v1","addr":"172.21.15.158:6835","nonce":267826992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/361532770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":361532770},{"type":"v1","addr":"172.21.15.124:6835","nonce":361532770}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1150240645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6836","nonce":1150240645},{"type":"v1","addr":"172.21.15.124:6837","nonce":1150240645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:58.847255+0000","modified":"2023-10-06T04:46:02.379103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6834/1553392288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1553392288},{"type":"v1","addr":"172.21.15.158:6834","nonce":1553392288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:57:24.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.785+0000 7ff6277ff700 1 -- 172.21.15.124:0/1680980216 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff604066f30 msgr2=0x7ff6040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.785+0000 7ff6277ff700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff604066f30 0x7ff6040693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff61c007c00 tx=0x7ff61c015000 comp rx=0 tx=0).stop 2023-10-06T04:57:24.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.785+0000 7ff6277ff700 1 -- 172.21.15.124:0/1680980216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff620158310 msgr2=0x7ff6200c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.785+0000 7ff6277ff700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff620158310 0x7ff6200c52a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff610011d70 tx=0x7ff6100091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.785+0000 7ff6277ff700 1 -- 172.21.15.124:0/1680980216 shutdown_connections 2023-10-06T04:57:24.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.785+0000 7ff6277ff700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff620157c90 0x7ff620069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.785+0000 7ff6277ff700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff604066f30 0x7ff6040693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.785+0000 7ff6277ff700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff60c003ab0 0x7ff62016d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.785+0000 7ff6277ff700 1 --2- 172.21.15.124:0/1680980216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff620158310 0x7ff6200c52a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.786+0000 7ff6277ff700 1 -- 172.21.15.124:0/1680980216 >> 172.21.15.124:0/1680980216 conn(0x7ff6200974f0 msgr2=0x7ff62006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:24.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.786+0000 7ff6277ff700 1 -- 172.21.15.124:0/1680980216 shutdown_connections 2023-10-06T04:57:24.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.786+0000 7ff6277ff700 1 -- 172.21.15.124:0/1680980216 wait complete. 2023-10-06T04:57:24.792 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 25 2023-10-06T04:57:24.806 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:57:24.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.993+0000 7fef5c5ff700 1 Processor -- start 2023-10-06T04:57:24.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.993+0000 7fef5c5ff700 1 -- start start 2023-10-06T04:57:24.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.994+0000 7fef5c5ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fef540cae80 0x7fef540cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.994+0000 7fef5c5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef540ccec0 0x7fef541591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:24.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.994+0000 7fef5c5ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540c1d10 con 0x7fef540cb250 2023-10-06T04:57:24.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.994+0000 7fef5c5ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef540cd430 con 0x7fef540cae80 2023-10-06T04:57:24.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.994+0000 7fef5c5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540688a0 con 0x7fef540ccec0 2023-10-06T04:57:24.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.995+0000 7fef5ab9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fef540cb250 0x7fef540afe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47658/0 (socket says 172.21.15.124:47658) 2023-10-06T04:57:24.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.995+0000 7fef5ab9c700 1 -- 172.21.15.124:0/3409744636 learned_addr learned my addr 172.21.15.124:0/3409744636 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:24.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.995+0000 7fef59b9a700 1 --2- 172.21.15.124:0/3409744636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef540ccec0 0x7fef541591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.995+0000 7fef5a39b700 1 --2- 172.21.15.124:0/3409744636 >> v2:172.21.15.158:3300/0 conn(0x7fef540cae80 0x7fef540cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:24.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.995+0000 7fef59399700 1 -- 172.21.15.124:0/3409744636 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004288549 0 0) 0x7fef540c1d10 con 0x7fef540cb250 2023-10-06T04:57:24.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.995+0000 7fef59399700 1 -- 172.21.15.124:0/3409744636 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef40003570 con 0x7fef540cb250 2023-10-06T04:57:24.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.995+0000 7fef59b9a700 1 -- 172.21.15.124:0/3409744636 >> v2:172.21.15.158:3300/0 conn(0x7fef540cae80 msgr2=0x7fef540cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:24.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.995+0000 7fef59b9a700 1 --2- 172.21.15.124:0/3409744636 >> v2:172.21.15.158:3300/0 conn(0x7fef540cae80 0x7fef540cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:24.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.995+0000 7fef59b9a700 1 -- 172.21.15.124:0/3409744636 >> v1:172.21.15.124:6789/0 conn(0x7fef540cb250 legacy=0x7fef540afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:24.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.995+0000 7fef59b9a700 1 -- 172.21.15.124:0/3409744636 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54068b80 con 0x7fef540ccec0 2023-10-06T04:57:25.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.996+0000 7fef59b9a700 1 --2- 172.21.15.124:0/3409744636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef540ccec0 0x7fef541591d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef440098e0 tx=0x7fef440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd306906f6074d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:25.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.996+0000 7fef59399700 1 -- 172.21.15.124:0/3409744636 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44011630 con 0x7fef540ccec0 2023-10-06T04:57:25.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.996+0000 7fef59399700 1 -- 172.21.15.124:0/3409744636 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef44011790 con 0x7fef540ccec0 2023-10-06T04:57:25.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.996+0000 7fef59399700 1 -- 172.21.15.124:0/3409744636 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44011b10 con 0x7fef540ccec0 2023-10-06T04:57:25.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.996+0000 7fef5c5ff700 1 -- 172.21.15.124:0/3409744636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef540ccec0 msgr2=0x7fef541591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.996+0000 7fef5c5ff700 1 --2- 172.21.15.124:0/3409744636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef540ccec0 0x7fef541591d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef440098e0 tx=0x7fef440091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.997+0000 7fef5c5ff700 1 -- 172.21.15.124:0/3409744636 shutdown_connections 2023-10-06T04:57:25.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.997+0000 7fef5c5ff700 1 --2- 172.21.15.124:0/3409744636 >> v2:172.21.15.158:3300/0 conn(0x7fef540cae80 0x7fef540cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.997+0000 7fef5c5ff700 1 --2- 172.21.15.124:0/3409744636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef540ccec0 0x7fef541591d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.997+0000 7fef5c5ff700 1 -- 172.21.15.124:0/3409744636 >> 172.21.15.124:0/3409744636 conn(0x7fef540974f0 msgr2=0x7fef540639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:25.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.997+0000 7fef5c5ff700 1 -- 172.21.15.124:0/3409744636 shutdown_connections 2023-10-06T04:57:25.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.997+0000 7fef5c5ff700 1 -- 172.21.15.124:0/3409744636 wait complete. 2023-10-06T04:57:25.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.998+0000 7fef5c5ff700 1 Processor -- start 2023-10-06T04:57:25.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.998+0000 7fef5c5ff700 1 -- start start 2023-10-06T04:57:25.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.999+0000 7fef5c5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef540cae80 0x7fef5416a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.999+0000 7fef5c5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef540cb250 0x7fef54159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.999+0000 7fef5c5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef540ccec0 0x7fef540b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.999+0000 7fef5c5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5415b200 con 0x7fef540cb250 2023-10-06T04:57:25.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.999+0000 7fef5c5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5415b460 con 0x7fef540cae80 2023-10-06T04:57:25.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.999+0000 7fef5c5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5415b740 con 0x7fef540ccec0 2023-10-06T04:57:25.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:24.999+0000 7fef59b9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef540cb250 0x7fef54159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef59b9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef540cb250 0x7fef54159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55446/0 (socket says 172.21.15.124:55446) 2023-10-06T04:57:25.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef59b9a700 1 -- 172.21.15.124:0/4195080230 learned_addr learned my addr 172.21.15.124:0/4195080230 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:25.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef59b9a700 1 -- 172.21.15.124:0/4195080230 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef540ccec0 msgr2=0x7fef540b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef59b9a700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef540ccec0 0x7fef540b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef59b9a700 1 -- 172.21.15.124:0/4195080230 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef540cae80 msgr2=0x7fef5416a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef59b9a700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef540cae80 0x7fef5416a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef59b9a700 1 -- 172.21.15.124:0/4195080230 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44009420 con 0x7fef540cb250 2023-10-06T04:57:25.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef59b9a700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef540cb250 0x7fef54159750 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fef540689e0 tx=0x7fef44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:25.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef4a7fc700 1 -- 172.21.15.124:0/4195080230 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44011b10 con 0x7fef540cb250 2023-10-06T04:57:25.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef4a7fc700 1 -- 172.21.15.124:0/4195080230 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef44000cc0 con 0x7fef540cb250 2023-10-06T04:57:25.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef4a7fc700 1 -- 172.21.15.124:0/4195080230 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4401a680 con 0x7fef540cb250 2023-10-06T04:57:25.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.000+0000 7fef5c5ff700 1 -- 172.21.15.124:0/4195080230 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5415ba20 con 0x7fef540cb250 2023-10-06T04:57:25.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.001+0000 7fef5c5ff700 1 -- 172.21.15.124:0/4195080230 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5416a990 con 0x7fef540cb250 2023-10-06T04:57:25.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.001+0000 7fef5c5ff700 1 -- 172.21.15.124:0/4195080230 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5415bf40 con 0x7fef540cb250 2023-10-06T04:57:25.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.002+0000 7fef4a7fc700 1 -- 172.21.15.124:0/4195080230 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef4401aa70 con 0x7fef540cb250 2023-10-06T04:57:25.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.003+0000 7fef4a7fc700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef38066f30 0x7fef380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.003+0000 7fef4a7fc700 1 -- 172.21.15.124:0/4195080230 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fef440864b0 con 0x7fef540cb250 2023-10-06T04:57:25.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.003+0000 7fef5a39b700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef38066f30 0x7fef380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.004+0000 7fef5a39b700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef38066f30 0x7fef380693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fef540ca050 tx=0x7fef500091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:25.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.007+0000 7fef4a7fc700 1 -- 172.21.15.124:0/4195080230 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef5415bf40 con 0x7fef540cb250 2023-10-06T04:57:25.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.238+0000 7fef5c5ff700 1 -- 172.21.15.124:0/4195080230 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef5415bf40 con 0x7fef540cb250 2023-10-06T04:57:25.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.238+0000 7fef4a7fc700 1 -- 172.21.15.124:0/4195080230 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fef5415bf40 con 0x7fef540cb250 2023-10-06T04:57:25.241 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:25.241 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/267826992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":267826992},{"type":"v1","addr":"172.21.15.158:6835","nonce":267826992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/361532770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":361532770},{"type":"v1","addr":"172.21.15.124:6835","nonce":361532770}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1150240645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6836","nonce":1150240645},{"type":"v1","addr":"172.21.15.124:6837","nonce":1150240645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:45:58.847255+0000","modified":"2023-10-06T04:46:02.379103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6834/1553392288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1553392288},{"type":"v1","addr":"172.21.15.158:6834","nonce":1553392288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:57:25.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.240+0000 7fef5c5ff700 1 -- 172.21.15.124:0/4195080230 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef38066f30 msgr2=0x7fef380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.240+0000 7fef5c5ff700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef38066f30 0x7fef380693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fef540ca050 tx=0x7fef500091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.241+0000 7fef5c5ff700 1 -- 172.21.15.124:0/4195080230 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef540cb250 msgr2=0x7fef54159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.241+0000 7fef5c5ff700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef540cb250 0x7fef54159750 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fef540689e0 tx=0x7fef44017000 comp rx=0 tx=0).stop 2023-10-06T04:57:25.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.241+0000 7fef5c5ff700 1 -- 172.21.15.124:0/4195080230 shutdown_connections 2023-10-06T04:57:25.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.241+0000 7fef5c5ff700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef38066f30 0x7fef380693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.241+0000 7fef5c5ff700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef540ccec0 0x7fef540b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.241+0000 7fef5c5ff700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef540cae80 0x7fef5416a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.241+0000 7fef5c5ff700 1 --2- 172.21.15.124:0/4195080230 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef540cb250 0x7fef54159750 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.241+0000 7fef5c5ff700 1 -- 172.21.15.124:0/4195080230 >> 172.21.15.124:0/4195080230 conn(0x7fef540974f0 msgr2=0x7fef5406bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:25.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.241+0000 7fef5c5ff700 1 -- 172.21.15.124:0/4195080230 shutdown_connections 2023-10-06T04:57:25.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.241+0000 7fef5c5ff700 1 -- 172.21.15.124:0/4195080230 wait complete. 2023-10-06T04:57:25.245 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 25 2023-10-06T04:57:25.261 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:57:25.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.452+0000 7fdafb5ff700 1 Processor -- start 2023-10-06T04:57:25.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.452+0000 7fdafb5ff700 1 -- start start 2023-10-06T04:57:25.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.453+0000 7fdafb5ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdaf40abb60 0x7fdaf40abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.453+0000 7fdafb5ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdaf40ccd30 0x7fdaf4098f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.453+0000 7fdafb5ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf40acc40 con 0x7fdaf40690b0 2023-10-06T04:57:25.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.453+0000 7fdafb5ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf40ad0d0 con 0x7fdaf40ccd30 2023-10-06T04:57:25.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.453+0000 7fdafb5ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf406ae30 con 0x7fdaf40abb60 2023-10-06T04:57:25.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.453+0000 7fdaf8b9a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdaf40ccd30 0x7fdaf4098f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.453+0000 7fdaf9b9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fdaf40690b0 0x7fdaf4099440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47674/0 (socket says 172.21.15.124:47674) 2023-10-06T04:57:25.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.454+0000 7fdaf9b9c700 1 -- 172.21.15.124:0/4255035771 learned_addr learned my addr 172.21.15.124:0/4255035771 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:25.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.454+0000 7fdaf939b700 1 --2- 172.21.15.124:0/4255035771 >> v2:172.21.15.158:3300/0 conn(0x7fdaf40abb60 0x7fdaf40abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.454+0000 7fdaebfff700 1 -- 172.21.15.124:0/4255035771 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441800505 0 0) 0x7fdaf40acc40 con 0x7fdaf40690b0 2023-10-06T04:57:25.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.454+0000 7fdaf8b9a700 1 -- 172.21.15.124:0/4255035771 >> v2:172.21.15.158:3300/0 conn(0x7fdaf40abb60 msgr2=0x7fdaf40abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:25.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.454+0000 7fdaf8b9a700 1 --2- 172.21.15.124:0/4255035771 >> v2:172.21.15.158:3300/0 conn(0x7fdaf40abb60 0x7fdaf40abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.454+0000 7fdaf8b9a700 1 -- 172.21.15.124:0/4255035771 >> v1:172.21.15.124:6789/0 conn(0x7fdaf40690b0 legacy=0x7fdaf4099440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.454+0000 7fdaf8b9a700 1 -- 172.21.15.124:0/4255035771 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40ac5f0 con 0x7fdaf40ccd30 2023-10-06T04:57:25.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.454+0000 7fdaf8b9a700 1 --2- 172.21.15.124:0/4255035771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40ccd30 0x7fdaf4098f00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdaf406cec0 tx=0x7fdae40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9a381ed95144f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:25.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.454+0000 7fdaebfff700 1 -- 172.21.15.124:0/4255035771 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4011630 con 0x7fdaf40ccd30 2023-10-06T04:57:25.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.455+0000 7fdaebfff700 1 -- 172.21.15.124:0/4255035771 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae4011790 con 0x7fdaf40ccd30 2023-10-06T04:57:25.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.455+0000 7fdaebfff700 1 -- 172.21.15.124:0/4255035771 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4011b30 con 0x7fdaf40ccd30 2023-10-06T04:57:25.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.455+0000 7fdafb5ff700 1 -- 172.21.15.124:0/4255035771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40ccd30 msgr2=0x7fdaf4098f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.455+0000 7fdafb5ff700 1 --2- 172.21.15.124:0/4255035771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40ccd30 0x7fdaf4098f00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdaf406cec0 tx=0x7fdae40091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.455+0000 7fdafb5ff700 1 -- 172.21.15.124:0/4255035771 shutdown_connections 2023-10-06T04:57:25.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.455+0000 7fdafb5ff700 1 --2- 172.21.15.124:0/4255035771 >> v2:172.21.15.158:3300/0 conn(0x7fdaf40abb60 0x7fdaf40abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.455+0000 7fdafb5ff700 1 --2- 172.21.15.124:0/4255035771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40ccd30 0x7fdaf4098f00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.455+0000 7fdafb5ff700 1 -- 172.21.15.124:0/4255035771 >> 172.21.15.124:0/4255035771 conn(0x7fdaf40cc050 msgr2=0x7fdaf40cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:25.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.455+0000 7fdafb5ff700 1 -- 172.21.15.124:0/4255035771 shutdown_connections 2023-10-06T04:57:25.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.455+0000 7fdafb5ff700 1 -- 172.21.15.124:0/4255035771 wait complete. 2023-10-06T04:57:25.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.457+0000 7fdafb5ff700 1 Processor -- start 2023-10-06T04:57:25.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.457+0000 7fdafb5ff700 1 -- start start 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdafb5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdaf40690b0 0x7fdaf4169680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdafb5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40abb60 0x7fdaf4096a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdafb5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdaf40ccd30 0x7fdaf416a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdafb5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4097d30 con 0x7fdaf40abb60 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdafb5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf416a630 con 0x7fdaf40ccd30 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdafb5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4097120 con 0x7fdaf40690b0 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf8b9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40abb60 0x7fdaf4096a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf8b9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40abb60 0x7fdaf4096a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55466/0 (socket says 172.21.15.124:55466) 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf8b9a700 1 -- 172.21.15.124:0/3024965587 learned_addr learned my addr 172.21.15.124:0/3024965587 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf8b9a700 1 -- 172.21.15.124:0/3024965587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdaf40690b0 msgr2=0x7fdaf4169680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf939b700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdaf40690b0 0x7fdaf4169680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf8b9a700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdaf40690b0 0x7fdaf4169680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf8b9a700 1 -- 172.21.15.124:0/3024965587 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdaf40ccd30 msgr2=0x7fdaf416a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf9b9c700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdaf40ccd30 0x7fdaf416a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf8b9a700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdaf40ccd30 0x7fdaf416a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf8b9a700 1 -- 172.21.15.124:0/3024965587 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae4009420 con 0x7fdaf40abb60 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf939b700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdaf40690b0 0x7fdaf4169680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.458+0000 7fdaf9b9c700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdaf40ccd30 0x7fdaf416a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.459+0000 7fdaf8b9a700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40abb60 0x7fdaf4096a20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdaf406c840 tx=0x7fdae4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.459+0000 7fdae97fa700 1 -- 172.21.15.124:0/3024965587 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4011900 con 0x7fdaf40abb60 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.459+0000 7fdae97fa700 1 -- 172.21.15.124:0/3024965587 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae4011a60 con 0x7fdaf40abb60 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.459+0000 7fdafb5ff700 1 -- 172.21.15.124:0/3024965587 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf4097400 con 0x7fdaf40abb60 2023-10-06T04:57:25.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.459+0000 7fdae97fa700 1 -- 172.21.15.124:0/3024965587 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4025670 con 0x7fdaf40abb60 2023-10-06T04:57:25.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.459+0000 7fdafb5ff700 1 -- 172.21.15.124:0/3024965587 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf40979c0 con 0x7fdaf40abb60 2023-10-06T04:57:25.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.460+0000 7fdafb5ff700 1 -- 172.21.15.124:0/3024965587 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf40ab1f0 con 0x7fdaf40abb60 2023-10-06T04:57:25.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.461+0000 7fdae97fa700 1 -- 172.21.15.124:0/3024965587 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdae4023070 con 0x7fdaf40abb60 2023-10-06T04:57:25.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.462+0000 7fdae97fa700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdad8066f30 0x7fdad80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.462+0000 7fdae97fa700 1 -- 172.21.15.124:0/3024965587 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fdae4085c20 con 0x7fdaf40abb60 2023-10-06T04:57:25.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.462+0000 7fdaf939b700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdad8066f30 0x7fdad80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.463+0000 7fdaf939b700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdad8066f30 0x7fdad80693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0006f00 tx=0x7fdaf0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:25.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.466+0000 7fdae97fa700 1 -- 172.21.15.124:0/3024965587 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdae4052cf0 con 0x7fdaf40abb60 2023-10-06T04:57:25.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.657+0000 7fdafb5ff700 1 -- 172.21.15.124:0/3024965587 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdaf40717a0 con 0x7fdaf40abb60 2023-10-06T04:57:25.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.658+0000 7fdae97fa700 1 -- 172.21.15.124:0/3024965587 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17106 (secure 0 0 0) 0x7fdae4015090 con 0x7fdaf40abb60 2023-10-06T04:57:25.661 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:25.661 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":47,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:46:16.043178+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:45:56.420552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T04:45:57.820429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:57:25.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 -- 172.21.15.124:0/3024965587 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdad8066f30 msgr2=0x7fdad80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdad8066f30 0x7fdad80693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0006f00 tx=0x7fdaf0008040 comp rx=0 tx=0).stop 2023-10-06T04:57:25.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 -- 172.21.15.124:0/3024965587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40abb60 msgr2=0x7fdaf4096a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40abb60 0x7fdaf4096a20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdaf406c840 tx=0x7fdae4017000 comp rx=0 tx=0).stop 2023-10-06T04:57:25.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 -- 172.21.15.124:0/3024965587 shutdown_connections 2023-10-06T04:57:25.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdaf40ccd30 0x7fdaf416a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fdad8066f30 0x7fdad80693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdaf40690b0 0x7fdaf4169680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 --2- 172.21.15.124:0/3024965587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdaf40abb60 0x7fdaf4096a20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 -- 172.21.15.124:0/3024965587 >> 172.21.15.124:0/3024965587 conn(0x7fdaf40cc050 msgr2=0x7fdaf40af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:25.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 -- 172.21.15.124:0/3024965587 shutdown_connections 2023-10-06T04:57:25.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.660+0000 7fdafb5ff700 1 -- 172.21.15.124:0/3024965587 wait complete. 2023-10-06T04:57:25.681 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:57:25.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.870+0000 7ff388fff700 1 Processor -- start 2023-10-06T04:57:25.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.870+0000 7ff388fff700 1 -- start start 2023-10-06T04:57:25.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.871+0000 7ff388fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff3840b3d30 0x7ff38415a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.871+0000 7ff388fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38415aac0 con 0x7ff3841594b0 2023-10-06T04:57:25.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.871+0000 7ff388fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3840b41b0 con 0x7ff3840b1ea0 2023-10-06T04:57:25.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.871+0000 7ff388fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3840b4410 con 0x7ff3840b3d30 2023-10-06T04:57:25.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.872+0000 7ff38259c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff3841594b0 0x7ff3840b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47684/0 (socket says 172.21.15.124:47684) 2023-10-06T04:57:25.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.872+0000 7ff38259c700 1 -- 172.21.15.124:0/1261124179 learned_addr learned my addr 172.21.15.124:0/1261124179 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:25.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.872+0000 7ff381d9b700 1 --2- 172.21.15.124:0/1261124179 >> v2:172.21.15.158:3300/0 conn(0x7ff3840b3d30 0x7ff38415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.872+0000 7ff38159a700 1 -- 172.21.15.124:0/1261124179 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112010426 0 0) 0x7ff38415aac0 con 0x7ff3841594b0 2023-10-06T04:57:25.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.872+0000 7ff38159a700 1 -- 172.21.15.124:0/1261124179 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff36c003570 con 0x7ff3841594b0 2023-10-06T04:57:25.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.872+0000 7ff38159a700 1 -- 172.21.15.124:0/1261124179 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112404845 0 0) 0x7ff3840b41b0 con 0x7ff3840b1ea0 2023-10-06T04:57:25.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.872+0000 7ff38159a700 1 -- 172.21.15.124:0/1261124179 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff38415aac0 con 0x7ff3840b1ea0 2023-10-06T04:57:25.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.872+0000 7ff381d9b700 1 -- 172.21.15.124:0/1261124179 >> v1:172.21.15.158:6789/0 conn(0x7ff3840b1ea0 legacy=0x7ff3840b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.872+0000 7ff381d9b700 1 -- 172.21.15.124:0/1261124179 >> v1:172.21.15.124:6789/0 conn(0x7ff3841594b0 legacy=0x7ff3840b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.872+0000 7ff381d9b700 1 -- 172.21.15.124:0/1261124179 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3840b46f0 con 0x7ff3840b3d30 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.873+0000 7ff381d9b700 1 --2- 172.21.15.124:0/1261124179 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3840b3d30 0x7ff38415a580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff3780098e0 tx=0x7ff3780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f3e08d2469751d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.873+0000 7ff38159a700 1 -- 172.21.15.124:0/1261124179 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378011630 con 0x7ff3840b3d30 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.873+0000 7ff38159a700 1 -- 172.21.15.124:0/1261124179 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378011790 con 0x7ff3840b3d30 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.873+0000 7ff38159a700 1 -- 172.21.15.124:0/1261124179 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378011b30 con 0x7ff3840b3d30 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.873+0000 7ff388fff700 1 -- 172.21.15.124:0/1261124179 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3840b3d30 msgr2=0x7ff38415a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.873+0000 7ff388fff700 1 --2- 172.21.15.124:0/1261124179 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3840b3d30 0x7ff38415a580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff3780098e0 tx=0x7ff3780091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.874+0000 7ff388fff700 1 -- 172.21.15.124:0/1261124179 shutdown_connections 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.874+0000 7ff388fff700 1 --2- 172.21.15.124:0/1261124179 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3840b3d30 0x7ff38415a580 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.874+0000 7ff388fff700 1 -- 172.21.15.124:0/1261124179 >> 172.21.15.124:0/1261124179 conn(0x7ff38406ed20 msgr2=0x7ff38406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:25.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.874+0000 7ff388fff700 1 -- 172.21.15.124:0/1261124179 shutdown_connections 2023-10-06T04:57:25.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.874+0000 7ff388fff700 1 -- 172.21.15.124:0/1261124179 wait complete. 2023-10-06T04:57:25.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.875+0000 7ff388fff700 1 Processor -- start 2023-10-06T04:57:25.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.875+0000 7ff388fff700 1 -- start start 2023-10-06T04:57:25.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff388fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3840b1ea0 0x7ff3840afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff388fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3840b3d30 0x7ff384155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff388fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3841594b0 0x7ff3841561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff388fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff384156710 con 0x7ff3841594b0 2023-10-06T04:57:25.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff388fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38416cf00 con 0x7ff3840b3d30 2023-10-06T04:57:25.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff388fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38416d1e0 con 0x7ff3840b1ea0 2023-10-06T04:57:25.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff382d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3841594b0 0x7ff3841561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff382d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3841594b0 0x7ff3841561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55478/0 (socket says 172.21.15.124:55478) 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff382d9d700 1 -- 172.21.15.124:0/4195207904 learned_addr learned my addr 172.21.15.124:0/4195207904 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff38259c700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3840b1ea0 0x7ff3840afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.876+0000 7ff381d9b700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3840b3d30 0x7ff384155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff382d9d700 1 -- 172.21.15.124:0/4195207904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3840b1ea0 msgr2=0x7ff3840afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff382d9d700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3840b1ea0 0x7ff3840afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff382d9d700 1 -- 172.21.15.124:0/4195207904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3840b3d30 msgr2=0x7ff384155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff382d9d700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3840b3d30 0x7ff384155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff382d9d700 1 -- 172.21.15.124:0/4195207904 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378009420 con 0x7ff3841594b0 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff382d9d700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3841594b0 0x7ff3841561d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00c910 tx=0x7ff37c0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff3727fc700 1 -- 172.21.15.124:0/4195207904 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c012630 con 0x7ff3841594b0 2023-10-06T04:57:25.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff3727fc700 1 -- 172.21.15.124:0/4195207904 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c0127b0 con 0x7ff3841594b0 2023-10-06T04:57:25.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff3727fc700 1 -- 172.21.15.124:0/4195207904 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c012b70 con 0x7ff3841594b0 2023-10-06T04:57:25.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff388fff700 1 -- 172.21.15.124:0/4195207904 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38416d4c0 con 0x7ff3841594b0 2023-10-06T04:57:25.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.877+0000 7ff388fff700 1 -- 172.21.15.124:0/4195207904 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38416da80 con 0x7ff3841594b0 2023-10-06T04:57:25.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.878+0000 7ff388fff700 1 -- 172.21.15.124:0/4195207904 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3840717a0 con 0x7ff3841594b0 2023-10-06T04:57:25.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.879+0000 7ff3727fc700 1 -- 172.21.15.124:0/4195207904 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff37c01b400 con 0x7ff3841594b0 2023-10-06T04:57:25.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.880+0000 7ff3727fc700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff364066f30 0x7ff3640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:25.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.880+0000 7ff3727fc700 1 -- 172.21.15.124:0/4195207904 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ff37c084b10 con 0x7ff3841594b0 2023-10-06T04:57:25.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.880+0000 7ff38259c700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff364066f30 0x7ff3640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:25.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.881+0000 7ff38259c700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff364066f30 0x7ff3640693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff374007fd0 tx=0x7ff374009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:25.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:25.884+0000 7ff3727fc700 1 -- 172.21.15.124:0/4195207904 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff37c051b40 con 0x7ff3841594b0 2023-10-06T04:57:26.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.116+0000 7ff388fff700 1 -- 172.21.15.124:0/4195207904 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff3840b49d0 con 0x7ff3841594b0 2023-10-06T04:57:26.119 INFO:tasks.ceph.mon.a.smithi124.stderr:2023-10-06T04:57:26.117+0000 7fc5395f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:57:26.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.122+0000 7ff3727fc700 1 -- 172.21.15.124:0/4195207904 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff37c016020 con 0x7ff3841594b0 2023-10-06T04:57:26.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 -- 172.21.15.124:0/4195207904 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff364066f30 msgr2=0x7ff3640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:26.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff364066f30 0x7ff3640693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff374007fd0 tx=0x7ff374009040 comp rx=0 tx=0).stop 2023-10-06T04:57:26.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 -- 172.21.15.124:0/4195207904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3841594b0 msgr2=0x7ff3841561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:26.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3841594b0 0x7ff3841561d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00c910 tx=0x7ff37c0027a0 comp rx=0 tx=0).stop 2023-10-06T04:57:26.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 -- 172.21.15.124:0/4195207904 shutdown_connections 2023-10-06T04:57:26.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3841594b0 0x7ff3841561d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:26.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff364066f30 0x7ff3640693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:26.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3840b1ea0 0x7ff3840afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:26.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 --2- 172.21.15.124:0/4195207904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3840b3d30 0x7ff384155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:26.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 -- 172.21.15.124:0/4195207904 >> 172.21.15.124:0/4195207904 conn(0x7ff38406ed20 msgr2=0x7ff38414d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:26.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 -- 172.21.15.124:0/4195207904 shutdown_connections 2023-10-06T04:57:26.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.124+0000 7ff388fff700 1 -- 172.21.15.124:0/4195207904 wait complete. 2023-10-06T04:57:26.128 INFO:teuthology.orchestra.run.smithi124.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:57:26.145 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:57:26.191 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-06T04:57:26.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.334+0000 7f95a71ff700 1 Processor -- start 2023-10-06T04:57:26.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.334+0000 7f95a71ff700 1 -- start start 2023-10-06T04:57:26.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.335+0000 7f95a71ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f95a00cca10 0x7f95a00c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:26.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.335+0000 7f95a71ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a00ad790 con 0x7f95a01562b0 2023-10-06T04:57:26.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.335+0000 7f95a71ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a00acb80 con 0x7f95a00c6af0 2023-10-06T04:57:26.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.335+0000 7f95a71ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a00ace60 con 0x7f95a00cca10 2023-10-06T04:57:26.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.335+0000 7f95a4f9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f95a01562b0 0x7f95a015aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47698/0 (socket says 172.21.15.124:47698) 2023-10-06T04:57:26.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.335+0000 7f95a4f9b700 1 -- 172.21.15.124:0/1558625686 learned_addr learned my addr 172.21.15.124:0/1558625686 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:26.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.335+0000 7f959ffff700 1 --2- 172.21.15.124:0/1558625686 >> v2:172.21.15.158:3300/0 conn(0x7f95a00cca10 0x7f95a00c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:26.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959f7fe700 1 -- 172.21.15.124:0/1558625686 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706651430 0 0) 0x7f95a00ad790 con 0x7f95a01562b0 2023-10-06T04:57:26.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959f7fe700 1 -- 172.21.15.124:0/1558625686 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9590003570 con 0x7f95a01562b0 2023-10-06T04:57:26.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959f7fe700 1 -- 172.21.15.124:0/1558625686 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932917664 0 0) 0x7f95a00acb80 con 0x7f95a00c6af0 2023-10-06T04:57:26.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959f7fe700 1 -- 172.21.15.124:0/1558625686 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a00ad790 con 0x7f95a00c6af0 2023-10-06T04:57:26.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959ffff700 1 -- 172.21.15.124:0/1558625686 >> v1:172.21.15.158:6789/0 conn(0x7f95a00c6af0 legacy=0x7f95a00adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:26.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959ffff700 1 -- 172.21.15.124:0/1558625686 >> v1:172.21.15.124:6789/0 conn(0x7f95a01562b0 legacy=0x7f95a015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:26.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959ffff700 1 -- 172.21.15.124:0/1558625686 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a00ad140 con 0x7f95a00cca10 2023-10-06T04:57:26.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959ffff700 1 --2- 172.21.15.124:0/1558625686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95a00cca10 0x7f95a00c65b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f958c00bb90 tx=0x7f958c00b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c9316f307435a34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:26.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959f7fe700 1 -- 172.21.15.124:0/1558625686 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c00da70 con 0x7f95a00cca10 2023-10-06T04:57:26.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959f7fe700 1 -- 172.21.15.124:0/1558625686 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c00dbd0 con 0x7f95a00cca10 2023-10-06T04:57:26.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.336+0000 7f959f7fe700 1 -- 172.21.15.124:0/1558625686 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c019480 con 0x7f95a00cca10 2023-10-06T04:57:26.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.337+0000 7f95a71ff700 1 -- 172.21.15.124:0/1558625686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95a00cca10 msgr2=0x7f95a00c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:26.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.337+0000 7f95a71ff700 1 --2- 172.21.15.124:0/1558625686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95a00cca10 0x7f95a00c65b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f958c00bb90 tx=0x7f958c00b430 comp rx=0 tx=0).stop 2023-10-06T04:57:26.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.337+0000 7f95a71ff700 1 -- 172.21.15.124:0/1558625686 shutdown_connections 2023-10-06T04:57:26.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.337+0000 7f95a71ff700 1 --2- 172.21.15.124:0/1558625686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95a00cca10 0x7f95a00c65b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:26.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.337+0000 7f95a71ff700 1 -- 172.21.15.124:0/1558625686 >> 172.21.15.124:0/1558625686 conn(0x7f95a00680c0 msgr2=0x7f95a00cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:26.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.337+0000 7f95a71ff700 1 -- 172.21.15.124:0/1558625686 shutdown_connections 2023-10-06T04:57:26.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.337+0000 7f95a71ff700 1 -- 172.21.15.124:0/1558625686 wait complete. 2023-10-06T04:57:26.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.339+0000 7f95a71ff700 1 Processor -- start 2023-10-06T04:57:26.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.339+0000 7f95a71ff700 1 -- start start 2023-10-06T04:57:26.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a71ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f95a00c6af0 0x7f95a014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:26.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a71ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95a00cca10 0x7f95a00aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:26.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a71ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95a01562b0 0x7f95a00ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:26.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a71ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00b07d0 con 0x7f95a00c6af0 2023-10-06T04:57:26.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a71ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00afc00 con 0x7f95a01562b0 2023-10-06T04:57:26.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a71ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00afea0 con 0x7f95a00cca10 2023-10-06T04:57:26.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a4f9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f95a00c6af0 0x7f95a014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:26.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a4f9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f95a00c6af0 0x7f95a014d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55492/0 (socket says 172.21.15.124:55492) 2023-10-06T04:57:26.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a4f9b700 1 -- 172.21.15.124:0/626131938 learned_addr learned my addr 172.21.15.124:0/626131938 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:26.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a579c700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95a01562b0 0x7f95a00ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:26.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f959ffff700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95a00cca10 0x7f95a00aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:26.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a4f9b700 1 -- 172.21.15.124:0/626131938 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95a00cca10 msgr2=0x7f95a00aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:26.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a4f9b700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95a00cca10 0x7f95a00aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:26.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a4f9b700 1 -- 172.21.15.124:0/626131938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95a01562b0 msgr2=0x7f95a00ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:26.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a4f9b700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95a01562b0 0x7f95a00ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:26.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f95a4f9b700 1 -- 172.21.15.124:0/626131938 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c00b6d0 con 0x7f95a00c6af0 2023-10-06T04:57:26.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.340+0000 7f959ffff700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95a00cca10 0x7f95a00aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:26.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.341+0000 7f95a4f9b700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f95a00c6af0 0x7f95a014d550 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f959400c790 tx=0x7f9594007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:26.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.341+0000 7f959cff9700 1 -- 172.21.15.124:0/626131938 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594005c00 con 0x7f95a00c6af0 2023-10-06T04:57:26.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.341+0000 7f959cff9700 1 -- 172.21.15.124:0/626131938 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9594005d60 con 0x7f95a00c6af0 2023-10-06T04:57:26.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.341+0000 7f959cff9700 1 -- 172.21.15.124:0/626131938 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594007300 con 0x7f95a00c6af0 2023-10-06T04:57:26.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.341+0000 7f95a71ff700 1 -- 172.21.15.124:0/626131938 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a00b0180 con 0x7f95a00c6af0 2023-10-06T04:57:26.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.341+0000 7f95a71ff700 1 -- 172.21.15.124:0/626131938 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a014da90 con 0x7f95a00c6af0 2023-10-06T04:57:26.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.342+0000 7f95a71ff700 1 -- 172.21.15.124:0/626131938 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a0064850 con 0x7f95a00c6af0 2023-10-06T04:57:26.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.343+0000 7f959cff9700 1 -- 172.21.15.124:0/626131938 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f959401b3b0 con 0x7f95a00c6af0 2023-10-06T04:57:26.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.344+0000 7f959cff9700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9584066f30 0x7f95840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:26.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.344+0000 7f959cff9700 1 -- 172.21.15.124:0/626131938 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f9594083dc0 con 0x7f95a00c6af0 2023-10-06T04:57:26.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.344+0000 7f959ffff700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9584066f30 0x7f95840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:26.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.345+0000 7f959ffff700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9584066f30 0x7f95840693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f95a00ccde0 tx=0x7f958c01b000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:26.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.348+0000 7f959cff9700 1 -- 172.21.15.124:0/626131938 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9594050da0 con 0x7f95a00c6af0 2023-10-06T04:57:26.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:26.583+0000 7f95a71ff700 1 -- 172.21.15.124:0/626131938 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f95a004c380 con 0x7f95a00c6af0 2023-10-06T04:57:27.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.123+0000 7f959cff9700 1 -- 172.21.15.124:0/626131938 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9594017020 con 0x7f95a00c6af0 2023-10-06T04:57:27.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.125+0000 7f95a71ff700 1 -- 172.21.15.124:0/626131938 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9584066f30 msgr2=0x7f95840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:27.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.125+0000 7f95a71ff700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9584066f30 0x7f95840693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f95a00ccde0 tx=0x7f958c01b000 comp rx=0 tx=0).stop 2023-10-06T04:57:27.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.125+0000 7f95a71ff700 1 -- 172.21.15.124:0/626131938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f95a00c6af0 msgr2=0x7f95a014d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:27.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.125+0000 7f95a71ff700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f95a00c6af0 0x7f95a014d550 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f959400c790 tx=0x7f9594007ea0 comp rx=0 tx=0).stop 2023-10-06T04:57:27.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.126+0000 7f95a71ff700 1 -- 172.21.15.124:0/626131938 shutdown_connections 2023-10-06T04:57:27.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.126+0000 7f95a71ff700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95a01562b0 0x7f95a00ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:27.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.126+0000 7f95a71ff700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f95a00c6af0 0x7f95a014d550 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:27.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.126+0000 7f95a71ff700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9584066f30 0x7f95840693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:27.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.126+0000 7f95a71ff700 1 --2- 172.21.15.124:0/626131938 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95a00cca10 0x7f95a00aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:27.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.126+0000 7f95a71ff700 1 -- 172.21.15.124:0/626131938 >> 172.21.15.124:0/626131938 conn(0x7f95a00680c0 msgr2=0x7f95a0154180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:27.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.126+0000 7f95a71ff700 1 -- 172.21.15.124:0/626131938 shutdown_connections 2023-10-06T04:57:27.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.126+0000 7f95a71ff700 1 -- 172.21.15.124:0/626131938 wait complete. 2023-10-06T04:57:27.147 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:57:27.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.339+0000 7f17c6bff700 1 Processor -- start 2023-10-06T04:57:27.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.339+0000 7f17c6bff700 1 -- start start 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c6bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17c015d4d0 0x7f17c00a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c6bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f17c01598d0 0x7f17c00cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c6bff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c00cc770 con 0x7f17c015d8a0 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c6bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c0067690 con 0x7f17c01598d0 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c6bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c0067970 con 0x7f17c015d4d0 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c519c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f17c01598d0 0x7f17c00cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c519c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f17c01598d0 0x7f17c00cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55500/0 (socket says 172.21.15.124:55500) 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c519c700 1 -- 172.21.15.124:0/3174747968 learned_addr learned my addr 172.21.15.124:0/3174747968 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c499b700 1 --2- 172.21.15.124:0/3174747968 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17c015d4d0 0x7f17c00a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c519c700 1 -- 172.21.15.124:0/3174747968 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17c015d4d0 msgr2=0x7f17c00a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:27.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c519c700 1 --2- 172.21.15.124:0/3174747968 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17c015d4d0 0x7f17c00a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:27.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c519c700 1 -- 172.21.15.124:0/3174747968 >> v1:172.21.15.158:6789/0 conn(0x7f17c015d8a0 legacy=0x7f17c01591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:27.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.341+0000 7f17c519c700 1 -- 172.21.15.124:0/3174747968 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0067c50 con 0x7f17c01598d0 2023-10-06T04:57:27.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.342+0000 7f17c519c700 1 --2- 172.21.15.124:0/3174747968 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c01598d0 0x7f17c00cbe00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009f20 tx=0x7f17b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76215484b3e43edd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.342+0000 7f17bf7fe700 1 -- 172.21.15.124:0/3174747968 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b800e070 con 0x7f17c01598d0 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.342+0000 7f17bf7fe700 1 -- 172.21.15.124:0/3174747968 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b800ba80 con 0x7f17c01598d0 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.342+0000 7f17bf7fe700 1 -- 172.21.15.124:0/3174747968 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80092e0 con 0x7f17c01598d0 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.342+0000 7f17c6bff700 1 -- 172.21.15.124:0/3174747968 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c01598d0 msgr2=0x7f17c00cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.342+0000 7f17c6bff700 1 --2- 172.21.15.124:0/3174747968 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c01598d0 0x7f17c00cbe00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009f20 tx=0x7f17b8009840 comp rx=0 tx=0).stop 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.342+0000 7f17c6bff700 1 -- 172.21.15.124:0/3174747968 shutdown_connections 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.342+0000 7f17c6bff700 1 --2- 172.21.15.124:0/3174747968 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c01598d0 0x7f17c00cbe00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.342+0000 7f17c6bff700 1 --2- 172.21.15.124:0/3174747968 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17c015d4d0 0x7f17c00a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.342+0000 7f17c6bff700 1 -- 172.21.15.124:0/3174747968 >> 172.21.15.124:0/3174747968 conn(0x7f17c00c94c0 msgr2=0x7f17c00c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.343+0000 7f17c6bff700 1 -- 172.21.15.124:0/3174747968 shutdown_connections 2023-10-06T04:57:27.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.343+0000 7f17c6bff700 1 -- 172.21.15.124:0/3174747968 wait complete. 2023-10-06T04:57:27.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.344+0000 7f17c6bff700 1 Processor -- start 2023-10-06T04:57:27.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.344+0000 7f17c6bff700 1 -- start start 2023-10-06T04:57:27.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.345+0000 7f17c6bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17c01598d0 0x7f17c015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:27.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.345+0000 7f17c6bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c015d4d0 0x7f17c00b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:27.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.345+0000 7f17c6bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17c015d8a0 0x7f17c00c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:27.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.345+0000 7f17c6bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00b0d20 con 0x7f17c015d4d0 2023-10-06T04:57:27.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.345+0000 7f17c6bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00b0f70 con 0x7f17c01598d0 2023-10-06T04:57:27.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.345+0000 7f17c6bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00b1250 con 0x7f17c015d8a0 2023-10-06T04:57:27.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.345+0000 7f17bffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c015d4d0 0x7f17c00b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:27.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.345+0000 7f17bffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c015d4d0 0x7f17c00b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55514/0 (socket says 172.21.15.124:55514) 2023-10-06T04:57:27.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.345+0000 7f17bffff700 1 -- 172.21.15.124:0/1583675555 learned_addr learned my addr 172.21.15.124:0/1583675555 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:27.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17c499b700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17c01598d0 0x7f17c015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:27.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17bffff700 1 -- 172.21.15.124:0/1583675555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17c015d8a0 msgr2=0x7f17c00c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:27.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17bffff700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17c015d8a0 0x7f17c00c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:27.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17bffff700 1 -- 172.21.15.124:0/1583675555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17c01598d0 msgr2=0x7f17c015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:27.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17bffff700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17c01598d0 0x7f17c015b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:27.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17bffff700 1 -- 172.21.15.124:0/1583675555 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8009ae0 con 0x7f17c015d4d0 2023-10-06T04:57:27.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17c499b700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17c01598d0 0x7f17c015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:57:27.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17bffff700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c015d4d0 0x7f17c00b2010 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00c4e0 tx=0x7f17ac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:27.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17bcff9700 1 -- 172.21.15.124:0/1583675555 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac011590 con 0x7f17c015d4d0 2023-10-06T04:57:27.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17bcff9700 1 -- 172.21.15.124:0/1583675555 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac011710 con 0x7f17c015d4d0 2023-10-06T04:57:27.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17c6bff700 1 -- 172.21.15.124:0/1583675555 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c00b1530 con 0x7f17c015d4d0 2023-10-06T04:57:27.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17bcff9700 1 -- 172.21.15.124:0/1583675555 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac011ad0 con 0x7f17c015d4d0 2023-10-06T04:57:27.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.346+0000 7f17c6bff700 1 -- 172.21.15.124:0/1583675555 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c00b1af0 con 0x7f17c015d4d0 2023-10-06T04:57:27.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.347+0000 7f17c6bff700 1 -- 172.21.15.124:0/1583675555 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c00718b0 con 0x7f17c015d4d0 2023-10-06T04:57:27.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.348+0000 7f17bcff9700 1 -- 172.21.15.124:0/1583675555 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17ac01b3b0 con 0x7f17c015d4d0 2023-10-06T04:57:27.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.349+0000 7f17bcff9700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f17a4066f30 0x7f17a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:27.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.349+0000 7f17bcff9700 1 -- 172.21.15.124:0/1583675555 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f17ac083d00 con 0x7f17c015d4d0 2023-10-06T04:57:27.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.349+0000 7f17c499b700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f17a4066f30 0x7f17a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:27.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.350+0000 7f17c499b700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f17a4066f30 0x7f17a40693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f17b4006fd0 tx=0x7f17b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:27.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.353+0000 7f17bcff9700 1 -- 172.21.15.124:0/1583675555 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17ac050ce0 con 0x7f17c015d4d0 2023-10-06T04:57:27.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:27.548+0000 7f17c6bff700 1 -- 172.21.15.124:0/1583675555 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f17c0067f30 con 0x7f17c015d4d0 2023-10-06T04:57:28.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.379+0000 7f17bcff9700 1 -- 172.21.15.124:0/1583675555 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) v1 ==== 181+0+0 (secure 0 0 0) 0x7f17ac017070 con 0x7f17c015d4d0 2023-10-06T04:57:28.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.384+0000 7f17c6bff700 1 -- 172.21.15.124:0/1583675555 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f17a4066f30 msgr2=0x7f17a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:28.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.384+0000 7f17c6bff700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f17a4066f30 0x7f17a40693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f17b4006fd0 tx=0x7f17b4008040 comp rx=0 tx=0).stop 2023-10-06T04:57:28.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.384+0000 7f17c6bff700 1 -- 172.21.15.124:0/1583675555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c015d4d0 msgr2=0x7f17c00b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:28.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.384+0000 7f17c6bff700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c015d4d0 0x7f17c00b2010 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00c4e0 tx=0x7f17ac00c8a0 comp rx=0 tx=0).stop 2023-10-06T04:57:28.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.385+0000 7f17c6bff700 1 -- 172.21.15.124:0/1583675555 shutdown_connections 2023-10-06T04:57:28.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.385+0000 7f17c6bff700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f17a4066f30 0x7f17a40693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:28.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.385+0000 7f17c6bff700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17c015d8a0 0x7f17c00c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:28.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.385+0000 7f17c6bff700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17c01598d0 0x7f17c015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:28.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.385+0000 7f17c6bff700 1 --2- 172.21.15.124:0/1583675555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17c015d4d0 0x7f17c00b2010 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:28.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.385+0000 7f17c6bff700 1 -- 172.21.15.124:0/1583675555 >> 172.21.15.124:0/1583675555 conn(0x7f17c00c94c0 msgr2=0x7f17c00c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:28.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.385+0000 7f17c6bff700 1 -- 172.21.15.124:0/1583675555 shutdown_connections 2023-10-06T04:57:28.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.385+0000 7f17c6bff700 1 -- 172.21.15.124:0/1583675555 wait complete. 2023-10-06T04:57:28.390 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:57:28.410 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:57:28.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.605+0000 7f79745ff700 1 Processor -- start 2023-10-06T04:57:28.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.605+0000 7f79745ff700 1 -- start start 2023-10-06T04:57:28.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f79745ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f796c1562e0 0x7f796c0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:28.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f79745ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796c1566b0 0x7f796c0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:28.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f79745ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0ccfe0 con 0x7f796c0af990 2023-10-06T04:57:28.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f79745ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c0b0a30 con 0x7f796c1562e0 2023-10-06T04:57:28.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f79745ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0afe20 con 0x7f796c1566b0 2023-10-06T04:57:28.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f797239b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f796c1562e0 0x7f796c0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:28.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f797239b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f796c1562e0 0x7f796c0b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55526/0 (socket says 172.21.15.124:55526) 2023-10-06T04:57:28.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f797239b700 1 -- 172.21.15.124:0/1640221330 learned_addr learned my addr 172.21.15.124:0/1640221330 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:28.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f797239b700 1 -- 172.21.15.124:0/1640221330 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796c1566b0 msgr2=0x7f796c0accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:28.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f797239b700 1 --2- 172.21.15.124:0/1640221330 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796c1566b0 0x7f796c0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:28.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f797239b700 1 -- 172.21.15.124:0/1640221330 >> v1:172.21.15.158:6789/0 conn(0x7f796c0af990 legacy=0x7f796c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:28.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.607+0000 7f797239b700 1 -- 172.21.15.124:0/1640221330 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0b0100 con 0x7f796c1562e0 2023-10-06T04:57:28.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.608+0000 7f797239b700 1 --2- 172.21.15.124:0/1640221330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c1562e0 0x7f796c0b0ec0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f79680099b0 tx=0x7f7968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e83a1f1adec06e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:28.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.608+0000 7f7971399700 1 -- 172.21.15.124:0/1640221330 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800b820 con 0x7f796c1562e0 2023-10-06T04:57:28.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.608+0000 7f7971399700 1 -- 172.21.15.124:0/1640221330 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796800b980 con 0x7f796c1562e0 2023-10-06T04:57:28.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.608+0000 7f7971399700 1 -- 172.21.15.124:0/1640221330 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800bd20 con 0x7f796c1562e0 2023-10-06T04:57:28.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.608+0000 7f79745ff700 1 -- 172.21.15.124:0/1640221330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c1562e0 msgr2=0x7f796c0b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:28.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.608+0000 7f79745ff700 1 --2- 172.21.15.124:0/1640221330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c1562e0 0x7f796c0b0ec0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f79680099b0 tx=0x7f7968009250 comp rx=0 tx=0).stop 2023-10-06T04:57:28.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.609+0000 7f79745ff700 1 -- 172.21.15.124:0/1640221330 shutdown_connections 2023-10-06T04:57:28.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.609+0000 7f79745ff700 1 --2- 172.21.15.124:0/1640221330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c1562e0 0x7f796c0b0ec0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:28.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.609+0000 7f79745ff700 1 --2- 172.21.15.124:0/1640221330 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796c1566b0 0x7f796c0accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:28.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.609+0000 7f79745ff700 1 -- 172.21.15.124:0/1640221330 >> 172.21.15.124:0/1640221330 conn(0x7f796c068080 msgr2=0x7f796c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:28.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.609+0000 7f79745ff700 1 -- 172.21.15.124:0/1640221330 shutdown_connections 2023-10-06T04:57:28.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.609+0000 7f79745ff700 1 -- 172.21.15.124:0/1640221330 wait complete. 2023-10-06T04:57:28.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.610+0000 7f79745ff700 1 Processor -- start 2023-10-06T04:57:28.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.610+0000 7f79745ff700 1 -- start start 2023-10-06T04:57:28.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.611+0000 7f79745ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c0af990 0x7f796c14c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:28.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.611+0000 7f79745ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796c1562e0 0x7f796c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:28.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.611+0000 7f79745ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796c1566b0 0x7f796c14abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:28.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.611+0000 7f79745ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c16d2b0 con 0x7f796c0af990 2023-10-06T04:57:28.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.611+0000 7f79745ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c16d590 con 0x7f796c1562e0 2023-10-06T04:57:28.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.611+0000 7f79745ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c16d870 con 0x7f796c1566b0 2023-10-06T04:57:28.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.611+0000 7f797239b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c0af990 0x7f796c14c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:28.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.611+0000 7f797239b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c0af990 0x7f796c14c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55532/0 (socket says 172.21.15.124:55532) 2023-10-06T04:57:28.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.611+0000 7f797239b700 1 -- 172.21.15.124:0/2559233771 learned_addr learned my addr 172.21.15.124:0/2559233771 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:28.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f797239b700 1 -- 172.21.15.124:0/2559233771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796c1566b0 msgr2=0x7f796c14abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:28.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f7972b9c700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796c1566b0 0x7f796c14abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:28.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f7971b9a700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796c1562e0 0x7f796c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:28.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f797239b700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796c1566b0 0x7f796c14abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:28.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f797239b700 1 -- 172.21.15.124:0/2559233771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796c1562e0 msgr2=0x7f796c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:28.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f797239b700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796c1562e0 0x7f796c0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:28.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f797239b700 1 -- 172.21.15.124:0/2559233771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680094f0 con 0x7f796c0af990 2023-10-06T04:57:28.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f7972b9c700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796c1566b0 0x7f796c14abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:57:28.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f7971b9a700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796c1562e0 0x7f796c0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:57:28.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f797239b700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c0af990 0x7f796c14c370 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7968009290 tx=0x7f7968016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:28.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f79627fc700 1 -- 172.21.15.124:0/2559233771 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796801a460 con 0x7f796c0af990 2023-10-06T04:57:28.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f79627fc700 1 -- 172.21.15.124:0/2559233771 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796801a5e0 con 0x7f796c0af990 2023-10-06T04:57:28.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f79745ff700 1 -- 172.21.15.124:0/2559233771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c16db50 con 0x7f796c0af990 2023-10-06T04:57:28.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f79627fc700 1 -- 172.21.15.124:0/2559233771 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796801a9a0 con 0x7f796c0af990 2023-10-06T04:57:28.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.612+0000 7f79745ff700 1 -- 172.21.15.124:0/2559233771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c0cc950 con 0x7f796c0af990 2023-10-06T04:57:28.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.613+0000 7f79745ff700 1 -- 172.21.15.124:0/2559233771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c158110 con 0x7f796c0af990 2023-10-06T04:57:28.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.614+0000 7f79627fc700 1 -- 172.21.15.124:0/2559233771 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f796801ad50 con 0x7f796c0af990 2023-10-06T04:57:28.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.615+0000 7f79627fc700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7950066f30 0x7f79500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:28.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.615+0000 7f79627fc700 1 -- 172.21.15.124:0/2559233771 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f7968085ff0 con 0x7f796c0af990 2023-10-06T04:57:28.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.615+0000 7f7971b9a700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7950066f30 0x7f79500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:28.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.616+0000 7f7971b9a700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7950066f30 0x7f79500693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f795c006fd0 tx=0x7f795c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:28.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.619+0000 7f79627fc700 1 -- 172.21.15.124:0/2559233771 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f796c158110 con 0x7f796c0af990 2023-10-06T04:57:28.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:28.812+0000 7f79745ff700 1 -- 172.21.15.124:0/2559233771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f796c158110 con 0x7f796c0af990 2023-10-06T04:57:29.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.384+0000 7f79627fc700 1 -- 172.21.15.124:0/2559233771 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) v1 ==== 169+0+0 (secure 0 0 0) 0x7f79680531e0 con 0x7f796c0af990 2023-10-06T04:57:29.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.391+0000 7f79745ff700 1 -- 172.21.15.124:0/2559233771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7950066f30 msgr2=0x7f79500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:29.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.391+0000 7f79745ff700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7950066f30 0x7f79500693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f795c006fd0 tx=0x7f795c008040 comp rx=0 tx=0).stop 2023-10-06T04:57:29.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.391+0000 7f79745ff700 1 -- 172.21.15.124:0/2559233771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c0af990 msgr2=0x7f796c14c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:29.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.391+0000 7f79745ff700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c0af990 0x7f796c14c370 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7968009290 tx=0x7f7968016000 comp rx=0 tx=0).stop 2023-10-06T04:57:29.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.392+0000 7f79745ff700 1 -- 172.21.15.124:0/2559233771 shutdown_connections 2023-10-06T04:57:29.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.392+0000 7f79745ff700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f7950066f30 0x7f79500693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.392+0000 7f79745ff700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796c1566b0 0x7f796c14abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.392+0000 7f79745ff700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f796c0af990 0x7f796c14c370 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.392+0000 7f79745ff700 1 --2- 172.21.15.124:0/2559233771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796c1562e0 0x7f796c0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.392+0000 7f79745ff700 1 -- 172.21.15.124:0/2559233771 >> 172.21.15.124:0/2559233771 conn(0x7f796c068080 msgr2=0x7f796c1511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:29.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.392+0000 7f79745ff700 1 -- 172.21.15.124:0/2559233771 shutdown_connections 2023-10-06T04:57:29.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.393+0000 7f79745ff700 1 -- 172.21.15.124:0/2559233771 wait complete. 2023-10-06T04:57:29.399 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' removed 2023-10-06T04:57:29.419 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T04:57:29.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.608+0000 7fb6935ff700 1 Processor -- start 2023-10-06T04:57:29.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.609+0000 7fb6935ff700 1 -- start start 2023-10-06T04:57:29.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.610+0000 7fb6935ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb68c159480 0x7fb68c15dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:29.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.610+0000 7fb6935ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c068700 con 0x7fb68c0c8840 2023-10-06T04:57:29.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.610+0000 7fb6935ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c0c9030 con 0x7fb68c06d770 2023-10-06T04:57:29.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.610+0000 7fb6935ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c068950 con 0x7fb68c159480 2023-10-06T04:57:29.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.610+0000 7fb690b9a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb68c0c8840 0x7fb68c06d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47700/0 (socket says 172.21.15.124:47700) 2023-10-06T04:57:29.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.610+0000 7fb690b9a700 1 -- 172.21.15.124:0/3629841227 learned_addr learned my addr 172.21.15.124:0/3629841227 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:29.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.610+0000 7fb69139b700 1 --2- 172.21.15.124:0/3629841227 >> v2:172.21.15.124:3300/0 conn(0x7fb68c159480 0x7fb68c15dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:29.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.611+0000 7fb683fff700 1 -- 172.21.15.124:0/3629841227 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786689277 0 0) 0x7fb68c068700 con 0x7fb68c0c8840 2023-10-06T04:57:29.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.611+0000 7fb683fff700 1 -- 172.21.15.124:0/3629841227 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb678003570 con 0x7fb68c0c8840 2023-10-06T04:57:29.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.611+0000 7fb69139b700 1 -- 172.21.15.124:0/3629841227 >> v1:172.21.15.158:6789/0 conn(0x7fb68c06d770 legacy=0x7fb68c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:29.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.611+0000 7fb69139b700 1 -- 172.21.15.124:0/3629841227 >> v1:172.21.15.124:6789/0 conn(0x7fb68c0c8840 legacy=0x7fb68c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:29.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.611+0000 7fb69139b700 1 -- 172.21.15.124:0/3629841227 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c068c30 con 0x7fb68c159480 2023-10-06T04:57:29.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.611+0000 7fb69139b700 1 --2- 172.21.15.124:0/3629841227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c159480 0x7fb68c15dce0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb6880098e0 tx=0x7fb6880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a8db1d28f0e0fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:29.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.611+0000 7fb683fff700 1 -- 172.21.15.124:0/3629841227 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800b640 con 0x7fb68c159480 2023-10-06T04:57:29.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.611+0000 7fb683fff700 1 -- 172.21.15.124:0/3629841227 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68800b7a0 con 0x7fb68c159480 2023-10-06T04:57:29.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.611+0000 7fb683fff700 1 -- 172.21.15.124:0/3629841227 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800bb40 con 0x7fb68c159480 2023-10-06T04:57:29.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.612+0000 7fb6935ff700 1 -- 172.21.15.124:0/3629841227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c159480 msgr2=0x7fb68c15dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:29.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.612+0000 7fb6935ff700 1 --2- 172.21.15.124:0/3629841227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c159480 0x7fb68c15dce0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb6880098e0 tx=0x7fb6880091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.612+0000 7fb6935ff700 1 -- 172.21.15.124:0/3629841227 shutdown_connections 2023-10-06T04:57:29.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.612+0000 7fb6935ff700 1 --2- 172.21.15.124:0/3629841227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c159480 0x7fb68c15dce0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.612+0000 7fb6935ff700 1 -- 172.21.15.124:0/3629841227 >> 172.21.15.124:0/3629841227 conn(0x7fb68c063cc0 msgr2=0x7fb68c0ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:29.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.612+0000 7fb6935ff700 1 -- 172.21.15.124:0/3629841227 shutdown_connections 2023-10-06T04:57:29.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.612+0000 7fb6935ff700 1 -- 172.21.15.124:0/3629841227 wait complete. 2023-10-06T04:57:29.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.613+0000 7fb6935ff700 1 Processor -- start 2023-10-06T04:57:29.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.613+0000 7fb6935ff700 1 -- start start 2023-10-06T04:57:29.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.614+0000 7fb6935ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb68c06d770 0x7fb68c15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:29.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.614+0000 7fb6935ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c0c8840 0x7fb68c153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:29.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.614+0000 7fb6935ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb68c159480 0x7fb68c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.614+0000 7fb6935ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c169df0 con 0x7fb68c0c8840 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.614+0000 7fb6935ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c15c2d0 con 0x7fb68c06d770 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.614+0000 7fb6935ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c16d790 con 0x7fb68c159480 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb690b9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c0c8840 0x7fb68c153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb690b9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c0c8840 0x7fb68c153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55550/0 (socket says 172.21.15.124:55550) 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb690b9a700 1 -- 172.21.15.124:0/1143516142 learned_addr learned my addr 172.21.15.124:0/1143516142 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb69139b700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb68c06d770 0x7fb68c15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb691b9c700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb68c159480 0x7fb68c156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb690b9a700 1 -- 172.21.15.124:0/1143516142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb68c159480 msgr2=0x7fb68c156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb690b9a700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb68c159480 0x7fb68c156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb690b9a700 1 -- 172.21.15.124:0/1143516142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb68c06d770 msgr2=0x7fb68c15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:29.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb690b9a700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb68c06d770 0x7fb68c15bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb690b9a700 1 -- 172.21.15.124:0/1143516142 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb688009420 con 0x7fb68c0c8840 2023-10-06T04:57:29.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.615+0000 7fb690b9a700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c0c8840 0x7fb68c153a90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00c7c0 tx=0x7fb67c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:29.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.616+0000 7fb6817fa700 1 -- 172.21.15.124:0/1143516142 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c005b30 con 0x7fb68c0c8840 2023-10-06T04:57:29.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.616+0000 7fb6817fa700 1 -- 172.21.15.124:0/1143516142 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c005cb0 con 0x7fb68c0c8840 2023-10-06T04:57:29.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.616+0000 7fb6817fa700 1 -- 172.21.15.124:0/1143516142 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c007320 con 0x7fb68c0c8840 2023-10-06T04:57:29.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.616+0000 7fb6935ff700 1 -- 172.21.15.124:0/1143516142 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c16da70 con 0x7fb68c0c8840 2023-10-06T04:57:29.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.616+0000 7fb6935ff700 1 -- 172.21.15.124:0/1143516142 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c16e030 con 0x7fb68c0c8840 2023-10-06T04:57:29.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.617+0000 7fb6935ff700 1 -- 172.21.15.124:0/1143516142 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c04c380 con 0x7fb68c0c8840 2023-10-06T04:57:29.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.618+0000 7fb6817fa700 1 -- 172.21.15.124:0/1143516142 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb67c01b3b0 con 0x7fb68c0c8840 2023-10-06T04:57:29.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.619+0000 7fb6817fa700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb670066f30 0x7fb6700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:29.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.619+0000 7fb6817fa700 1 -- 172.21.15.124:0/1143516142 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb67c083930 con 0x7fb68c0c8840 2023-10-06T04:57:29.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.619+0000 7fb69139b700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb670066f30 0x7fb6700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:29.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.619+0000 7fb69139b700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb670066f30 0x7fb6700693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb6880093f0 tx=0x7fb688017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:29.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.623+0000 7fb6817fa700 1 -- 172.21.15.124:0/1143516142 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb67c050ca0 con 0x7fb68c0c8840 2023-10-06T04:57:29.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.815+0000 7fb6935ff700 1 -- 172.21.15.124:0/1143516142 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb68c068f10 con 0x7fb68c0c8840 2023-10-06T04:57:29.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.819+0000 7fb6817fa700 1 -- 172.21.15.124:0/1143516142 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb67c0170a0 con 0x7fb68c0c8840 2023-10-06T04:57:29.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 -- 172.21.15.124:0/1143516142 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb670066f30 msgr2=0x7fb6700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb670066f30 0x7fb6700693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb6880093f0 tx=0x7fb688017000 comp rx=0 tx=0).stop 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 -- 172.21.15.124:0/1143516142 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c0c8840 msgr2=0x7fb68c153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c0c8840 0x7fb68c153a90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00c7c0 tx=0x7fb67c007e00 comp rx=0 tx=0).stop 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 -- 172.21.15.124:0/1143516142 shutdown_connections 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb670066f30 0x7fb6700693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb68c159480 0x7fb68c156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb68c06d770 0x7fb68c15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 --2- 172.21.15.124:0/1143516142 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb68c0c8840 0x7fb68c153a90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 -- 172.21.15.124:0/1143516142 >> 172.21.15.124:0/1143516142 conn(0x7fb68c063cc0 msgr2=0x7fb68c0b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 -- 172.21.15.124:0/1143516142 shutdown_connections 2023-10-06T04:57:29.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:29.822+0000 7fb6935ff700 1 -- 172.21.15.124:0/1143516142 wait complete. 2023-10-06T04:57:29.842 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_random' 2023-10-06T04:57:30.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.030+0000 7f18ce9ff700 1 Processor -- start 2023-10-06T04:57:30.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.030+0000 7f18ce9ff700 1 -- start start 2023-10-06T04:57:30.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.031+0000 7f18ce9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18c80cae80 0x7f18c80cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:30.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.031+0000 7f18ce9ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f18c80ccec0 0x7f18c81591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:30.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.031+0000 7f18ce9ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f18c80cb250 0x7f18c8159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:30.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.031+0000 7f18ce9ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c80cd430 con 0x7f18c80ccec0 2023-10-06T04:57:30.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.031+0000 7f18ce9ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c8159c50 con 0x7f18c80cb250 2023-10-06T04:57:30.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.031+0000 7f18ce9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c80c1d10 con 0x7f18c80cae80 2023-10-06T04:57:30.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.031+0000 7f18c77fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f18c80ccec0 0x7f18c81591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.031+0000 7f18c77fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f18c80ccec0 0x7f18c81591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55552/0 (socket says 172.21.15.124:55552) 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.031+0000 7f18c77fe700 1 -- 172.21.15.124:0/2791120112 learned_addr learned my addr 172.21.15.124:0/2791120112 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.032+0000 7f18ccf9c700 1 --2- 172.21.15.124:0/2791120112 >> v2:172.21.15.158:3300/0 conn(0x7f18c80cb250 0x7f18c8159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.032+0000 7f18c7fff700 1 --2- 172.21.15.124:0/2791120112 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18c80cae80 0x7f18c80cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.032+0000 7f18c77fe700 1 -- 172.21.15.124:0/2791120112 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18c80cae80 msgr2=0x7f18c80cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.032+0000 7f18c77fe700 1 --2- 172.21.15.124:0/2791120112 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18c80cae80 0x7f18c80cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.032+0000 7f18c77fe700 1 -- 172.21.15.124:0/2791120112 >> v2:172.21.15.158:3300/0 conn(0x7f18c80cb250 msgr2=0x7f18c8159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.032+0000 7f18c77fe700 1 --2- 172.21.15.124:0/2791120112 >> v2:172.21.15.158:3300/0 conn(0x7f18c80cb250 0x7f18c8159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.032+0000 7f18c77fe700 1 -- 172.21.15.124:0/2791120112 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c80688a0 con 0x7f18c80ccec0 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.032+0000 7f18c7fff700 1 --2- 172.21.15.124:0/2791120112 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18c80cae80 0x7f18c80cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:30.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.032+0000 7f18c77fe700 1 --2- 172.21.15.124:0/2791120112 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80ccec0 0x7f18c81591d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f18c806fa70 tx=0x7f18bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c36b1200473e806 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:30.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.032+0000 7f18c6ffd700 1 -- 172.21.15.124:0/2791120112 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc009ea0 con 0x7f18c80ccec0 2023-10-06T04:57:30.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.033+0000 7f18c6ffd700 1 -- 172.21.15.124:0/2791120112 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc00b8b0 con 0x7f18c80ccec0 2023-10-06T04:57:30.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.033+0000 7f18c6ffd700 1 -- 172.21.15.124:0/2791120112 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc00bc50 con 0x7f18c80ccec0 2023-10-06T04:57:30.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.033+0000 7f18ce9ff700 1 -- 172.21.15.124:0/2791120112 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80ccec0 msgr2=0x7f18c81591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:30.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.033+0000 7f18ce9ff700 1 --2- 172.21.15.124:0/2791120112 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80ccec0 0x7f18c81591d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f18c806fa70 tx=0x7f18bc009250 comp rx=0 tx=0).stop 2023-10-06T04:57:30.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.033+0000 7f18ce9ff700 1 -- 172.21.15.124:0/2791120112 shutdown_connections 2023-10-06T04:57:30.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.033+0000 7f18ce9ff700 1 --2- 172.21.15.124:0/2791120112 >> v2:172.21.15.158:3300/0 conn(0x7f18c80cb250 0x7f18c8159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.033+0000 7f18ce9ff700 1 --2- 172.21.15.124:0/2791120112 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18c80cae80 0x7f18c80cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.033+0000 7f18ce9ff700 1 --2- 172.21.15.124:0/2791120112 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80ccec0 0x7f18c81591d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.033+0000 7f18ce9ff700 1 -- 172.21.15.124:0/2791120112 >> 172.21.15.124:0/2791120112 conn(0x7f18c80974f0 msgr2=0x7f18c80639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:30.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.033+0000 7f18ce9ff700 1 -- 172.21.15.124:0/2791120112 shutdown_connections 2023-10-06T04:57:30.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.034+0000 7f18ce9ff700 1 -- 172.21.15.124:0/2791120112 wait complete. 2023-10-06T04:57:30.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.036+0000 7f18ce9ff700 1 Processor -- start 2023-10-06T04:57:30.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.037+0000 7f18ce9ff700 1 -- start start 2023-10-06T04:57:30.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.038+0000 7f18ce9ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80cae80 0x7f18c815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:30.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.038+0000 7f18ce9ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18c80cb250 0x7f18c815a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:30.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.038+0000 7f18ce9ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18c80ccec0 0x7f18c816d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:30.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.038+0000 7f18ce9ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c815b850 con 0x7f18c80cae80 2023-10-06T04:57:30.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.038+0000 7f18ce9ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c80b3b90 con 0x7f18c80ccec0 2023-10-06T04:57:30.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.038+0000 7f18ce9ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c816e5f0 con 0x7f18c80cb250 2023-10-06T04:57:30.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.039+0000 7f18c7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80cae80 0x7f18c815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:30.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.039+0000 7f18c7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80cae80 0x7f18c815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55566/0 (socket says 172.21.15.124:55566) 2023-10-06T04:57:30.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.039+0000 7f18c7fff700 1 -- 172.21.15.124:0/1626681573 learned_addr learned my addr 172.21.15.124:0/1626681573 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:30.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.040+0000 7f18c7fff700 1 -- 172.21.15.124:0/1626681573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18c80cb250 msgr2=0x7f18c815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:30.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.040+0000 7f18c7fff700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18c80cb250 0x7f18c815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.040+0000 7f18c7fff700 1 -- 172.21.15.124:0/1626681573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18c80ccec0 msgr2=0x7f18c816d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:30.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.040+0000 7f18c7fff700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18c80ccec0 0x7f18c816d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.040+0000 7f18c7fff700 1 -- 172.21.15.124:0/1626681573 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0094f0 con 0x7f18c80cae80 2023-10-06T04:57:30.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.040+0000 7f18c7fff700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80cae80 0x7f18c815c9b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f18b800e8d0 tx=0x7f18b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:30.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.041+0000 7f18affff700 1 -- 172.21.15.124:0/1626681573 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b800ee70 con 0x7f18c80cae80 2023-10-06T04:57:30.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.041+0000 7f18affff700 1 -- 172.21.15.124:0/1626681573 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b800c5e0 con 0x7f18c80cae80 2023-10-06T04:57:30.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.041+0000 7f18affff700 1 -- 172.21.15.124:0/1626681573 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b800c980 con 0x7f18c80cae80 2023-10-06T04:57:30.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.041+0000 7f18ce9ff700 1 -- 172.21.15.124:0/1626681573 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c816e310 con 0x7f18c80cae80 2023-10-06T04:57:30.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.041+0000 7f18ce9ff700 1 -- 172.21.15.124:0/1626681573 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c815c1b0 con 0x7f18c80cae80 2023-10-06T04:57:30.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.044+0000 7f18ce9ff700 1 -- 172.21.15.124:0/1626681573 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a80052b0 con 0x7f18c80cae80 2023-10-06T04:57:30.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.045+0000 7f18affff700 1 -- 172.21.15.124:0/1626681573 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18b8013410 con 0x7f18c80cae80 2023-10-06T04:57:30.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.046+0000 7f18affff700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b4067000 0x7f18b40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:30.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.047+0000 7f18affff700 1 -- 172.21.15.124:0/1626681573 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f18b80841e0 con 0x7f18c80cae80 2023-10-06T04:57:30.050 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.048+0000 7f18c77fe700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b4067000 0x7f18b40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:30.051 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.049+0000 7f18c77fe700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b4067000 0x7f18b40694b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f18c806fa70 tx=0x7f18bc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:30.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.054+0000 7f18affff700 1 -- 172.21.15.124:0/1626681573 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18b8055060 con 0x7f18c80cae80 2023-10-06T04:57:30.325 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.323+0000 7f18ce9ff700 1 -- 172.21.15.124:0/1626681573 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]} v 0) v1 -- 0x7f18a8005ae0 con 0x7f18c80cae80 2023-10-06T04:57:30.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.391+0000 7f18affff700 1 -- 172.21.15.124:0/1626681573 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]}]=0 v462) v1 ==== 131+0+0 (secure 0 0 0) 0x7f18b8054bf0 con 0x7f18c80cae80 2023-10-06T04:57:30.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 -- 172.21.15.124:0/1626681573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b4067000 msgr2=0x7f18b40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:30.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b4067000 0x7f18b40694b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f18c806fa70 tx=0x7f18bc017000 comp rx=0 tx=0).stop 2023-10-06T04:57:30.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 -- 172.21.15.124:0/1626681573 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80cae80 msgr2=0x7f18c815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:30.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80cae80 0x7f18c815c9b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f18b800e8d0 tx=0x7f18b8008040 comp rx=0 tx=0).stop 2023-10-06T04:57:30.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 -- 172.21.15.124:0/1626681573 shutdown_connections 2023-10-06T04:57:30.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18c80ccec0 0x7f18c816d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18c80cae80 0x7f18c815c9b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b4067000 0x7f18b40694b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 --2- 172.21.15.124:0/1626681573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18c80cb250 0x7f18c815a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 -- 172.21.15.124:0/1626681573 >> 172.21.15.124:0/1626681573 conn(0x7f18c80974f0 msgr2=0x7f18c806b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 -- 172.21.15.124:0/1626681573 shutdown_connections 2023-10-06T04:57:30.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:30.393+0000 7f18ce9ff700 1 -- 172.21.15.124:0/1626681573 wait complete. 2023-10-06T04:57:30.413 INFO:tasks.cephfs_test_runner:test_random (tasks.cephfs.test_dump_tree.TestDumpTree) ... ok 2023-10-06T04:57:30.414 INFO:tasks.cephfs_test_runner: 2023-10-06T04:57:30.414 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T04:57:30.414 INFO:tasks.cephfs_test_runner:Ran 2 tests in 744.916s 2023-10-06T04:57:30.414 INFO:tasks.cephfs_test_runner: 2023-10-06T04:57:30.414 INFO:tasks.cephfs_test_runner:OK 2023-10-06T04:57:30.414 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T04:57:30.424 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T04:57:30.511 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T04:57:30.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:30.512 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T04:57:30.558 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:57:30.558 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:57:30.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:30.559 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:57:30.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:30.630 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:57:30.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:30.704 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link delete ceph-brx 2023-10-06T04:57:30.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:30.814 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T04:57:30.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:30.864 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link delete ceph-brx 2023-10-06T04:57:30.939 INFO:teuthology.orchestra.run.smithi124.stderr:Cannot find device "ceph-brx" 2023-10-06T04:57:30.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:57:30.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:30.942 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-06T04:57:30.994 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T04:57:30.995 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:57:30.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:30.995 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:57:31.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:31.069 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:57:31.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:31.141 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-06T04:57:31.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:31.247 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-06T04:57:31.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:57:31.296 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-06T04:57:31.370 INFO:teuthology.orchestra.run.smithi158.stderr:Cannot find device "ceph-brx" 2023-10-06T04:57:31.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:57:31.374 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T04:57:31.384 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T04:57:31.384 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:57:31.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.572+0000 7f4ff0dff700 1 Processor -- start 2023-10-06T04:57:31.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.572+0000 7f4ff0dff700 1 -- start start 2023-10-06T04:57:31.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.573+0000 7f4ff0dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0b1a70 0x7f4fec06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:31.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.573+0000 7f4ff0dff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4fec06a140 0x7f4fec06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:31.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.573+0000 7f4ff0dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fec06e870 con 0x7f4fec0ac3d0 2023-10-06T04:57:31.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.573+0000 7f4ff0dff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fec069cb0 con 0x7f4fec06a140 2023-10-06T04:57:31.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.573+0000 7f4ff0dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec156110 con 0x7f4fec0b1a70 2023-10-06T04:57:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.574+0000 7f4fead9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4fec06a140 0x7f4fec06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.574+0000 7f4fead9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4fec06a140 0x7f4fec06a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55570/0 (socket says 172.21.15.124:55570) 2023-10-06T04:57:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.574+0000 7f4fead9d700 1 -- 172.21.15.124:0/1421711978 learned_addr learned my addr 172.21.15.124:0/1421711978 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.574+0000 7f4fe9d9b700 1 --2- 172.21.15.124:0/1421711978 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0b1a70 0x7f4fec06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.574+0000 7f4fead9d700 1 -- 172.21.15.124:0/1421711978 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0b1a70 msgr2=0x7f4fec06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.574+0000 7f4fead9d700 1 --2- 172.21.15.124:0/1421711978 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0b1a70 0x7f4fec06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.574+0000 7f4fead9d700 1 -- 172.21.15.124:0/1421711978 >> v1:172.21.15.158:6789/0 conn(0x7f4fec0ac3d0 legacy=0x7f4fec0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.574+0000 7f4fead9d700 1 -- 172.21.15.124:0/1421711978 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec06aac0 con 0x7f4fec06a140 2023-10-06T04:57:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.574+0000 7f4fe9d9b700 1 --2- 172.21.15.124:0/1421711978 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0b1a70 0x7f4fec06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.574+0000 7f4fead9d700 1 --2- 172.21.15.124:0/1421711978 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec06a140 0x7f4fec06a580 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009f20 tx=0x7f4fe4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ea5e82621feaaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4fe959a700 1 -- 172.21.15.124:0/1421711978 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40092e0 con 0x7f4fec06a140 2023-10-06T04:57:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4fe959a700 1 -- 172.21.15.124:0/1421711978 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe400bb10 con 0x7f4fec06a140 2023-10-06T04:57:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4fe959a700 1 -- 172.21.15.124:0/1421711978 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4011400 con 0x7f4fec06a140 2023-10-06T04:57:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1421711978 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec06a140 msgr2=0x7f4fec06a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4ff0dff700 1 --2- 172.21.15.124:0/1421711978 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec06a140 0x7f4fec06a580 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009f20 tx=0x7f4fe4009840 comp rx=0 tx=0).stop 2023-10-06T04:57:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1421711978 shutdown_connections 2023-10-06T04:57:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4ff0dff700 1 --2- 172.21.15.124:0/1421711978 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec06a140 0x7f4fec06a580 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4ff0dff700 1 --2- 172.21.15.124:0/1421711978 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0b1a70 0x7f4fec06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1421711978 >> 172.21.15.124:0/1421711978 conn(0x7f4fec0cc050 msgr2=0x7f4fec0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:31.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1421711978 shutdown_connections 2023-10-06T04:57:31.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.575+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1421711978 wait complete. 2023-10-06T04:57:31.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.577+0000 7f4ff0dff700 1 Processor -- start 2023-10-06T04:57:31.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.577+0000 7f4ff0dff700 1 -- start start 2023-10-06T04:57:31.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.578+0000 7f4ff0dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fec06a140 0x7f4fec1474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:31.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.578+0000 7f4ff0dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0ac3d0 0x7f4fec169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:31.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.578+0000 7f4ff0dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec0b1a70 0x7f4fec169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:31.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.578+0000 7f4ff0dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec096a20 con 0x7f4fec0b1a70 2023-10-06T04:57:31.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.578+0000 7f4ff0dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec1479e0 con 0x7f4fec06a140 2023-10-06T04:57:31.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.578+0000 7f4ff0dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec16a5d0 con 0x7f4fec0ac3d0 2023-10-06T04:57:31.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.578+0000 7f4fead9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec0b1a70 0x7f4fec169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:31.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fead9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec0b1a70 0x7f4fec169940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55582/0 (socket says 172.21.15.124:55582) 2023-10-06T04:57:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fead9d700 1 -- 172.21.15.124:0/1982862159 learned_addr learned my addr 172.21.15.124:0/1982862159 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fea59c700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fec06a140 0x7f4fec1474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fe9d9b700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0ac3d0 0x7f4fec169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fead9d700 1 -- 172.21.15.124:0/1982862159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0ac3d0 msgr2=0x7f4fec169400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fead9d700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0ac3d0 0x7f4fec169400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fead9d700 1 -- 172.21.15.124:0/1982862159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fec06a140 msgr2=0x7f4fec1474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fead9d700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fec06a140 0x7f4fec1474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fead9d700 1 -- 172.21.15.124:0/1982862159 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe4009ae0 con 0x7f4fec0b1a70 2023-10-06T04:57:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fead9d700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec0b1a70 0x7f4fec169940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400b6c0 tx=0x7f4fe4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fda7fc700 1 -- 172.21.15.124:0/1982862159 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40032f0 con 0x7f4fec0b1a70 2023-10-06T04:57:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fda7fc700 1 -- 172.21.15.124:0/1982862159 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe401a630 con 0x7f4fec0b1a70 2023-10-06T04:57:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1982862159 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fec169f30 con 0x7f4fec0b1a70 2023-10-06T04:57:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.579+0000 7f4fda7fc700 1 -- 172.21.15.124:0/1982862159 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe401a9d0 con 0x7f4fec0b1a70 2023-10-06T04:57:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.580+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1982862159 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fec096c70 con 0x7f4fec0b1a70 2023-10-06T04:57:31.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.580+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1982862159 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fec0717a0 con 0x7f4fec0b1a70 2023-10-06T04:57:31.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.581+0000 7f4fda7fc700 1 -- 172.21.15.124:0/1982862159 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fe4003040 con 0x7f4fec0b1a70 2023-10-06T04:57:31.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.583+0000 7f4fda7fc700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fcc066f30 0x7f4fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:31.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.583+0000 7f4fda7fc700 1 -- 172.21.15.124:0/1982862159 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4fe4085ed0 con 0x7f4fec0b1a70 2023-10-06T04:57:31.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.583+0000 7f4fea59c700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fcc066f30 0x7f4fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:31.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.584+0000 7f4fea59c700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fcc066f30 0x7f4fcc0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc003a80 tx=0x7f4fdc007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:31.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.587+0000 7f4fda7fc700 1 -- 172.21.15.124:0/1982862159 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fe4053240 con 0x7f4fec0b1a70 2023-10-06T04:57:31.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.779+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1982862159 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fec06ae80 con 0x7f4fec0b1a70 2023-10-06T04:57:31.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.780+0000 7f4fda7fc700 1 -- 172.21.15.124:0/1982862159 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13925 (secure 0 0 0) 0x7f4fe4056860 con 0x7f4fec0b1a70 2023-10-06T04:57:31.782 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:31.783 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":50,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:57:29.379287+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.158:6834/1553392288":"2023-10-07T04:57:26.118440+0000","172.21.15.158:6832/1553392288":"2023-10-07T04:57:26.118440+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:57:31.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1982862159 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fcc066f30 msgr2=0x7f4fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:31.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fcc066f30 0x7f4fcc0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc003a80 tx=0x7f4fdc007ec0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1982862159 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec0b1a70 msgr2=0x7f4fec169940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:31.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec0b1a70 0x7f4fec169940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400b6c0 tx=0x7f4fe4019000 comp rx=0 tx=0).stop 2023-10-06T04:57:31.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1982862159 shutdown_connections 2023-10-06T04:57:31.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fec0b1a70 0x7f4fec169940 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fec06a140 0x7f4fec1474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fcc066f30 0x7f4fcc0693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 --2- 172.21.15.124:0/1982862159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fec0ac3d0 0x7f4fec169400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1982862159 >> 172.21.15.124:0/1982862159 conn(0x7f4fec0cc050 msgr2=0x7f4fec0cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:31.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1982862159 shutdown_connections 2023-10-06T04:57:31.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.782+0000 7f4ff0dff700 1 -- 172.21.15.124:0/1982862159 wait complete. 2023-10-06T04:57:31.802 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:57:31.803 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:57:31.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.991+0000 7ff4cafff700 1 Processor -- start 2023-10-06T04:57:31.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.991+0000 7ff4cafff700 1 -- start start 2023-10-06T04:57:31.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.992+0000 7ff4cafff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff4c40ccd30 0x7ff4c4099610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:31.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.992+0000 7ff4cafff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 0x7ff4c40abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:31.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.992+0000 7ff4cafff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40acc40 con 0x7ff4c40abb60 2023-10-06T04:57:31.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.992+0000 7ff4cafff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c40ad0d0 con 0x7ff4c40ccd30 2023-10-06T04:57:31.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.992+0000 7ff4cafff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c406ae30 con 0x7ff4c40690b0 2023-10-06T04:57:31.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.993+0000 7ff4c959c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 0x7ff4c40abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:31.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.993+0000 7ff4c959c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 0x7ff4c40abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.124:45736/0 (socket says 172.21.15.124:45736) 2023-10-06T04:57:31.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.993+0000 7ff4c959c700 1 -- 172.21.15.124:0/2317321819 learned_addr learned my addr 172.21.15.124:0/2317321819 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:31.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.993+0000 7ff4c3fff700 1 --2- 172.21.15.124:0/2317321819 >> v2:172.21.15.158:3300/0 conn(0x7ff4c40ccd30 0x7ff4c4099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:31.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.993+0000 7ff4c959c700 1 -- 172.21.15.124:0/2317321819 >> v2:172.21.15.158:3300/0 conn(0x7ff4c40ccd30 msgr2=0x7ff4c4099610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:31.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.993+0000 7ff4c959c700 1 --2- 172.21.15.124:0/2317321819 >> v2:172.21.15.158:3300/0 conn(0x7ff4c40ccd30 0x7ff4c4099610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.993+0000 7ff4c959c700 1 -- 172.21.15.124:0/2317321819 >> v1:172.21.15.158:6789/0 conn(0x7ff4c40abb60 legacy=0x7ff4c4098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:31.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.993+0000 7ff4c959c700 1 -- 172.21.15.124:0/2317321819 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40ac5f0 con 0x7ff4c40690b0 2023-10-06T04:57:31.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.993+0000 7ff4c3fff700 1 --2- 172.21.15.124:0/2317321819 >> v2:172.21.15.158:3300/0 conn(0x7ff4c40ccd30 0x7ff4c4099610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:57:31.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.994+0000 7ff4c959c700 1 --2- 172.21.15.124:0/2317321819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 0x7ff4c40abf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00d1a0 tx=0x7ff4bc00ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=343f952ca3b79d41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:31.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.994+0000 7ff4c37fe700 1 -- 172.21.15.124:0/2317321819 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc010070 con 0x7ff4c40690b0 2023-10-06T04:57:31.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.994+0000 7ff4c37fe700 1 -- 172.21.15.124:0/2317321819 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc00b0d0 con 0x7ff4c40690b0 2023-10-06T04:57:31.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.994+0000 7ff4c37fe700 1 -- 172.21.15.124:0/2317321819 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00b490 con 0x7ff4c40690b0 2023-10-06T04:57:31.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.994+0000 7ff4cafff700 1 -- 172.21.15.124:0/2317321819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 msgr2=0x7ff4c40abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:31.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.994+0000 7ff4cafff700 1 --2- 172.21.15.124:0/2317321819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 0x7ff4c40abf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00d1a0 tx=0x7ff4bc00ba50 comp rx=0 tx=0).stop 2023-10-06T04:57:31.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.995+0000 7ff4cafff700 1 -- 172.21.15.124:0/2317321819 shutdown_connections 2023-10-06T04:57:31.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.995+0000 7ff4cafff700 1 --2- 172.21.15.124:0/2317321819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 0x7ff4c40abf30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.995+0000 7ff4cafff700 1 --2- 172.21.15.124:0/2317321819 >> v2:172.21.15.158:3300/0 conn(0x7ff4c40ccd30 0x7ff4c4099610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:31.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.995+0000 7ff4cafff700 1 -- 172.21.15.124:0/2317321819 >> 172.21.15.124:0/2317321819 conn(0x7ff4c40cc050 msgr2=0x7ff4c40cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:31.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.995+0000 7ff4cafff700 1 -- 172.21.15.124:0/2317321819 shutdown_connections 2023-10-06T04:57:31.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.995+0000 7ff4cafff700 1 -- 172.21.15.124:0/2317321819 wait complete. 2023-10-06T04:57:32.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.996+0000 7ff4cafff700 1 Processor -- start 2023-10-06T04:57:32.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.996+0000 7ff4cafff700 1 -- start start 2023-10-06T04:57:32.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.997+0000 7ff4cafff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 0x7ff4c4157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.997+0000 7ff4cafff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4c40abb60 0x7ff4c4156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.997+0000 7ff4cafff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4c40ccd30 0x7ff4c40a72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.997+0000 7ff4cafff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4158090 con 0x7ff4c40ccd30 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.997+0000 7ff4cafff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4166210 con 0x7ff4c40abb60 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.997+0000 7ff4cafff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41576c0 con 0x7ff4c40690b0 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.997+0000 7ff4c959c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4c40ccd30 0x7ff4c40a72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.997+0000 7ff4c959c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4c40ccd30 0x7ff4c40a72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55594/0 (socket says 172.21.15.124:55594) 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.997+0000 7ff4c959c700 1 -- 172.21.15.124:0/2879766207 learned_addr learned my addr 172.21.15.124:0/2879766207 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c3fff700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4c40abb60 0x7ff4c4156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c8d9b700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 0x7ff4c4157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c959c700 1 -- 172.21.15.124:0/2879766207 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 msgr2=0x7ff4c4157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c959c700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 0x7ff4c4157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c959c700 1 -- 172.21.15.124:0/2879766207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4c40abb60 msgr2=0x7ff4c4156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c959c700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4c40abb60 0x7ff4c4156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c959c700 1 -- 172.21.15.124:0/2879766207 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc00bcf0 con 0x7ff4c40ccd30 2023-10-06T04:57:32.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c3fff700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4c40abb60 0x7ff4c4156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:57:32.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c959c700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4c40ccd30 0x7ff4c40a72a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00d8f0 tx=0x7ff4bc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:32.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c0ff9700 1 -- 172.21.15.124:0/2879766207 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00dec0 con 0x7ff4c40ccd30 2023-10-06T04:57:32.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.998+0000 7ff4c0ff9700 1 -- 172.21.15.124:0/2879766207 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc007170 con 0x7ff4c40ccd30 2023-10-06T04:57:32.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.999+0000 7ff4cafff700 1 -- 172.21.15.124:0/2879766207 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c4156d90 con 0x7ff4c40ccd30 2023-10-06T04:57:32.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.999+0000 7ff4c0ff9700 1 -- 172.21.15.124:0/2879766207 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc027690 con 0x7ff4c40ccd30 2023-10-06T04:57:32.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:31.999+0000 7ff4cafff700 1 -- 172.21.15.124:0/2879766207 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c4157120 con 0x7ff4c40ccd30 2023-10-06T04:57:32.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.000+0000 7ff4cafff700 1 -- 172.21.15.124:0/2879766207 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c40717a0 con 0x7ff4c40ccd30 2023-10-06T04:57:32.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.000+0000 7ff4c0ff9700 1 -- 172.21.15.124:0/2879766207 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4bc003040 con 0x7ff4c40ccd30 2023-10-06T04:57:32.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.002+0000 7ff4c0ff9700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff4a8066f30 0x7ff4a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.002+0000 7ff4c0ff9700 1 -- 172.21.15.124:0/2879766207 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff4bc088280 con 0x7ff4c40ccd30 2023-10-06T04:57:32.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.002+0000 7ff4c8d9b700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff4a8066f30 0x7ff4a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.002+0000 7ff4c8d9b700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff4a8066f30 0x7ff4a80693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80039e0 tx=0x7ff4b8007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:32.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.006+0000 7ff4c0ff9700 1 -- 172.21.15.124:0/2879766207 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4bc0555f0 con 0x7ff4c40ccd30 2023-10-06T04:57:32.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.197+0000 7ff4cafff700 1 -- 172.21.15.124:0/2879766207 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4c4157800 con 0x7ff4a8066f30 2023-10-06T04:57:32.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.200+0000 7ff4c0ff9700 1 -- 172.21.15.124:0/2879766207 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73277 (secure 0 0 0) 0x7ff4c4157800 con 0x7ff4a8066f30 2023-10-06T04:57:32.203 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:32.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.202+0000 7ff4cafff700 1 -- 172.21.15.124:0/2879766207 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff4a8066f30 msgr2=0x7ff4a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.202+0000 7ff4cafff700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff4a8066f30 0x7ff4a80693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80039e0 tx=0x7ff4b8007ec0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.202+0000 7ff4cafff700 1 -- 172.21.15.124:0/2879766207 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4c40ccd30 msgr2=0x7ff4c40a72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.202+0000 7ff4cafff700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4c40ccd30 0x7ff4c40a72a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00d8f0 tx=0x7ff4bc01a000 comp rx=0 tx=0).stop 2023-10-06T04:57:32.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.202+0000 7ff4cafff700 1 -- 172.21.15.124:0/2879766207 shutdown_connections 2023-10-06T04:57:32.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.203+0000 7ff4cafff700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4c40ccd30 0x7ff4c40a72a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.203+0000 7ff4cafff700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff4a8066f30 0x7ff4a80693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.203+0000 7ff4cafff700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4c40690b0 0x7ff4c4157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.203+0000 7ff4cafff700 1 --2- 172.21.15.124:0/2879766207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4c40abb60 0x7ff4c4156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.203+0000 7ff4cafff700 1 -- 172.21.15.124:0/2879766207 >> 172.21.15.124:0/2879766207 conn(0x7ff4c40cc050 msgr2=0x7ff4c40b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:32.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.203+0000 7ff4cafff700 1 -- 172.21.15.124:0/2879766207 shutdown_connections 2023-10-06T04:57:32.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.203+0000 7ff4cafff700 1 -- 172.21.15.124:0/2879766207 wait complete. 2023-10-06T04:57:32.206 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:57:32.223 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2023-10-06T04:57:32.081302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419504,"kb_used_data":41200,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752555216,"statfs":{"total":773094113280,"available":770616541184,"internally_reserved":0,"allocated":42188800,"data_stored":32609314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19632369,"num_objects":-992,"num_object_clones":0,"num_object_copies":-1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-992,"num_whiteouts":0,"num_read":-6,"num_read_kb":-7399,"num_write":-1492,"num_write_kb":-20288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001144"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.091485+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:46:16.091485+0000","last_peered":"2023-10-06T04:46:16.091485+0000","last_clean":"2023-10-06T04:46:16.091485+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:46:16.091485+0000","last_undegraded":"2023-10-06T04:46:16.091485+0000","last_fullsized":"2023-10-06T04:46:16.091485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.058290+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:46:16.058290+0000","last_peered":"2023-10-06T04:46:16.058290+0000","last_clean":"2023-10-06T04:46:16.058290+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:46:16.058290+0000","last_undegraded":"2023-10-06T04:46:16.058290+0000","last_fullsized":"2023-10-06T04:46:16.058290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T04:57:26.899583+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:57:26.899583+0000","last_peered":"2023-10-06T04:57:26.899583+0000","last_clean":"2023-10-06T04:57:26.899583+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:57:26.899583+0000","last_undegraded":"2023-10-06T04:57:26.899583+0000","last_fullsized":"2023-10-06T04:57:26.899583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":186,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.052328+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:46:16.052328+0000","last_peered":"2023-10-06T04:46:16.052328+0000","last_clean":"2023-10-06T04:46:16.052328+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:46:16.052328+0000","last_undegraded":"2023-10-06T04:46:16.052328+0000","last_fullsized":"2023-10-06T04:46:16.052328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.051872+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:46:16.051872+0000","last_peered":"2023-10-06T04:46:16.051872+0000","last_clean":"2023-10-06T04:46:16.051872+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:46:16.051872+0000","last_undegraded":"2023-10-06T04:46:16.051872+0000","last_fullsized":"2023-10-06T04:46:16.051872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.052230+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:46:16.052230+0000","last_peered":"2023-10-06T04:46:16.052230+0000","last_clean":"2023-10-06T04:46:16.052230+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:46:16.052230+0000","last_undegraded":"2023-10-06T04:46:16.052230+0000","last_fullsized":"2023-10-06T04:46:16.052230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T04:57:26.126072+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:57:26.126072+0000","last_peered":"2023-10-06T04:57:26.126072+0000","last_clean":"2023-10-06T04:57:26.126072+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:57:26.126072+0000","last_undegraded":"2023-10-06T04:57:26.126072+0000","last_fullsized":"2023-10-06T04:57:26.126072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.092043+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:46:16.092043+0000","last_peered":"2023-10-06T04:46:16.092043+0000","last_clean":"2023-10-06T04:46:16.092043+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:46:16.092043+0000","last_undegraded":"2023-10-06T04:46:16.092043+0000","last_fullsized":"2023-10-06T04:46:16.092043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.091743+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:46:16.091743+0000","last_peered":"2023-10-06T04:46:16.091743+0000","last_clean":"2023-10-06T04:46:16.091743+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:46:16.091743+0000","last_undegraded":"2023-10-06T04:46:16.091743+0000","last_fullsized":"2023-10-06T04:46:16.091743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542304,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307284,"kb_used_data":9996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94064556,"statfs":{"total":96636764160,"available":96322105344,"internally_reserved":0,"allocated":10235904,"data_stored":8925039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.33200000000000002},"max":{"1min":0.88100000000000001,"5min":1.044,"15min":8.7720000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.77800000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0089999999999999,"15min":8.8339999999999996},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66500000000000004,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40500000000000003},"max":{"1min":0.997,"5min":0.997,"15min":9.3070000000000004},"last":0.628},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67300000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.86599999999999999,"5min":0.93100000000000005,"15min":9.2129999999999992},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.54900000000000004,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":2.6709999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.79000000000000004},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.439},"max":{"1min":0.80200000000000005,"5min":0.95599999999999996,"15min":8.9179999999999993},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69799999999999995,"15min":0.80800000000000005},"min":{"1min":0.52200000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96699999999999997,"5min":1.087,"15min":9.0850000000000009},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":0.83599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":9.0969999999999995},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.018,"15min":1.018},"last":0.753},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.629,"15min":0.64500000000000002},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.371},"max":{"1min":0.77600000000000002,"5min":0.94899999999999995,"15min":0.95899999999999996},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.41499999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.82899999999999996,"5min":0.97199999999999998,"15min":1.0269999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90200000000000002,"5min":1.02,"15min":1.091},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.748},"min":{"1min":0.46200000000000002,"5min":0.46000000000000002,"15min":0.44400000000000001},"max":{"1min":0.93400000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.85399999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542305,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304208,"kb_used_data":6920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94067632,"statfs":{"total":96636764160,"available":96325255168,"internally_reserved":0,"allocated":7086080,"data_stored":6078665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.45500000000000002,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.98999999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.3779999999999999},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.46600000000000003,"15min":0.40500000000000003},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89300000000000002,"5min":0.95499999999999996,"15min":0.96299999999999997},"last":0.621}]},{"osd":2,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69299999999999995,"15min":0.68799999999999994},"min":{"1min":0.54500000000000004,"5min":0.45000000000000001,"15min":0.40300000000000002},"max":{"1min":0.89200000000000002,"5min":0.98199999999999998,"15min":1.1100000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93000000000000005,"5min":1.2529999999999999,"15min":1.3580000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":1.2689999999999999,"15min":1.337},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.496,"5min":0.48299999999999998,"15min":0.46100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1659999999999999},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67900000000000005,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.38300000000000001},"max":{"1min":0.86099999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.503},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.39200000000000002},"max":{"1min":0.85599999999999998,"5min":0.995,"15min":1.778},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.442,"15min":0.42299999999999999},"max":{"1min":0.85299999999999998,"5min":0.97799999999999998,"15min":1.1140000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.51000000000000001,"5min":0.47999999999999998,"15min":0.47299999999999998},"max":{"1min":0.879,"5min":1.071,"15min":1.071},"last":0.56000000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.97299999999999998,"15min":1.8500000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.876,"5min":1.006,"15min":1.351},"last":0.749}]}]},{"osd":1,"up_from":14,"seq":60129542305,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":5424,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":5554176,"data_stored":4461691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39700000000000002,"15min":0.51300000000000001},"min":{"1min":0.26700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.60299999999999998,"15min":6.508},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.622,"15min":2.4500000000000002},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41099999999999998,"15min":0.59099999999999997},"min":{"1min":0.31,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.51300000000000001,"5min":0.59199999999999997,"15min":9.2509999999999994},"last":0.375},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58699999999999997,"5min":0.60399999999999998,"15min":7.1100000000000003},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49299999999999999,"15min":0.60499999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":6.4000000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.45500000000000002,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":2.4889999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72599999999999998,"15min":1.0720000000000001},"min":{"1min":0.52300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0049999999999999,"5min":1.2829999999999999,"15min":19.911000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.83799999999999997},"min":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.93000000000000005,"5min":1.1599999999999999,"15min":6.4450000000000003},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94799999999999995,"5min":1.22,"15min":2.552},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73899999999999999,"15min":1.089},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0669999999999999,"5min":1.361,"15min":19.992999999999999},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75,"15min":0.85199999999999998},"min":{"1min":0.53200000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.1870000000000001,"15min":6.476},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0389999999999999,"5min":1.252,"15min":6.9050000000000002},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.51800000000000002},"max":{"1min":1.0429999999999999,"5min":1.329,"15min":2.5230000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76400000000000001,"15min":1.113},"min":{"1min":0.59299999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92300000000000004,"5min":1.1739999999999999,"15min":19.960999999999999},"last":0.69699999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542307,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":6352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":6504448,"data_stored":5081856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.59299999999999997,"15min":0.69499999999999995},"last":0.441},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42299999999999999,"15min":0.437},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.67800000000000005},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.439,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63400000000000001,"5min":0.66100000000000003,"15min":0.67400000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.58699999999999997,"5min":0.63800000000000001,"15min":0.81000000000000005},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.38},{"interface":"front","average":{"1min":0.5,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.78500000000000003},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.52300000000000002,"5min":0.48599999999999999,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":1.1779999999999999,"15min":1.254},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93700000000000006,"5min":1.0289999999999999,"15min":1.3600000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.502},"max":{"1min":0.98199999999999998,"5min":1.0660000000000001,"15min":1.2749999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.48599999999999999},"max":{"1min":0.92800000000000005,"5min":1.139,"15min":1.139},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.2929999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48399999999999999},"max":{"1min":0.95999999999999996,"5min":1.089,"15min":1.169},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.181,"15min":1.4019999999999999},"last":0.68000000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542304,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298964,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072876,"statfs":{"total":96636764160,"available":96330625024,"internally_reserved":0,"allocated":1716224,"data_stored":567188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":0.51800000000000002,"5min":0.55400000000000005,"15min":1.139},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.432,"15min":0.58799999999999997},"min":{"1min":0.33800000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59199999999999997,"5min":0.60699999999999998,"15min":11.241},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":0.52900000000000003,"5min":0.58599999999999997,"15min":1.028},"last":0.373},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44400000000000001,"15min":0.60999999999999999},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":11.273},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":0.59799999999999998,"5min":0.72599999999999998,"15min":0.995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.49199999999999999},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":1.1699999999999999},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71699999999999997,"15min":0.73099999999999998},"min":{"1min":0.56000000000000005,"5min":0.47799999999999998,"15min":0.42699999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.2889999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.88},"min":{"1min":0.54500000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":11.125999999999999},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71799999999999997,"15min":0.89200000000000002},"min":{"1min":0.57399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":11.208},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.56699999999999995,"5min":0.45100000000000001,"15min":0.44},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.5089999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.60699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.466},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.53500000000000003,"15min":0.51700000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":5.327},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72799999999999998,"15min":0.89800000000000002},"min":{"1min":0.51200000000000001,"5min":0.50600000000000001,"15min":0.496},"max":{"1min":1.121,"5min":1.121,"15min":11.173},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52100000000000002},"max":{"1min":1.0840000000000001,"5min":1.1399999999999999,"15min":1.3180000000000001},"last":0.82099999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542305,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303372,"kb_used_data":6084,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94068468,"statfs":{"total":96636764160,"available":96326111232,"internally_reserved":0,"allocated":6230016,"data_stored":4851487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.29999999999999999,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.439},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.51300000000000001,"5min":0.60199999999999998,"15min":0.80700000000000005},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.60999999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.95699999999999996},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.79300000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.42999999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.389},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.53500000000000003,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.202},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73899999999999999,"15min":0.73199999999999998},"min":{"1min":0.54400000000000004,"5min":0.502,"15min":0.41499999999999998},"max":{"1min":1.1499999999999999,"5min":1.2649999999999999,"15min":1.3160000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.54800000000000004,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.0600000000000001,"5min":1.109,"15min":1.5},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.52400000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.1100000000000001,"5min":1.1970000000000001,"15min":1.341},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.552},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.127,"5min":1.407,"15min":1.752},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.59099999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2070000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80700000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542304,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300304,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071536,"statfs":{"total":96636764160,"available":96329252864,"internally_reserved":0,"allocated":3088384,"data_stored":1985930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.33700000000000002,"15min":0.318},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":1.1299999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.54100000000000004,"5min":0.45300000000000001,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.94999999999999996,"15min":1.079},"last":0.94799999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.65600000000000003},"min":{"1min":0.54100000000000004,"5min":0.39800000000000002,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.95099999999999996,"15min":1.1819999999999999},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.46000000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":1.042},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.44700000000000001},"max":{"1min":0.84899999999999998,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.81899999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68100000000000005,"15min":0.67200000000000004},"min":{"1min":0.52800000000000002,"5min":0.45700000000000002,"15min":0.40899999999999997},"max":{"1min":0.873,"5min":0.94499999999999995,"15min":1.137},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":0.92200000000000004,"15min":1.177},"last":0.754}]},{"osd":5,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.876,"15min":1.1080000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":0.97399999999999998,"15min":1.4399999999999999},"last":0.40300000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.51900000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":0.94799999999999995,"15min":1.22},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54700000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.92900000000000005,"5min":0.97399999999999998,"15min":1.159},"last":0.99299999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.46400000000000002},"max":{"1min":0.94399999999999995,"5min":0.95599999999999996,"15min":1.49},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.60499999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.92900000000000005,"15min":1.2849999999999999},"last":0.53900000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542304,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299020,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072820,"statfs":{"total":96636764160,"available":96330567680,"internally_reserved":0,"allocated":1773568,"data_stored":657458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.38300000000000001,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.98099999999999998,"15min":1.05},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.61799999999999999},"min":{"1min":0.50800000000000001,"5min":0.42199999999999999,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":0.90800000000000003,"15min":0.93500000000000005},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.53100000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.95099999999999996,"15min":0.97899999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.69099999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.97099999999999997,"15min":1.0489999999999999},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.625},"min":{"1min":0.51800000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.90100000000000002,"15min":1.0309999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68700000000000006,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.38700000000000001},"max":{"1min":0.85999999999999999,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.504,"5min":0.45300000000000001,"15min":0.40300000000000002},"max":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.95399999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.88600000000000001,"5min":0.89600000000000002,"15min":0.95999999999999996},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.63700000000000001},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.34300000000000003},"max":{"1min":0.94699999999999995,"5min":0.97699999999999998,"15min":1.1060000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.38400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.038},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.66700000000000004},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0820000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.45300000000000001,"15min":0.39700000000000002},"max":{"1min":1.02,"5min":1.022,"15min":1.1339999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.3080000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.71799999999999997},"min":{"1min":0.50700000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.552},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:57:32.225 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:57:32.359 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:57:32.364 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:57:32.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.417+0000 7f4696bff700 1 Processor -- start 2023-10-06T04:57:32.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.418+0000 7f4696bff700 1 -- start start 2023-10-06T04:57:32.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.419+0000 7f4696bff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f46900a6c60 0x7f46901577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.419+0000 7f4696bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46900ad770 0x7f46900adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.419+0000 7f4696bff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46900ab910 con 0x7f46901573e0 2023-10-06T04:57:32.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.419+0000 7f4696bff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46900abbf0 con 0x7f46900a6c60 2023-10-06T04:57:32.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.419+0000 7f4696bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46900ae110 con 0x7f46900ad770 2023-10-06T04:57:32.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.419+0000 7f469499b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f46901573e0 0x7f4690069a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47702/0 (socket says 172.21.15.124:47702) 2023-10-06T04:57:32.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.419+0000 7f469499b700 1 -- 172.21.15.124:0/4057820266 learned_addr learned my addr 172.21.15.124:0/4057820266 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:32.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.419+0000 7f468ffff700 1 --2- 172.21.15.124:0/4057820266 >> v2:172.21.15.124:3300/0 conn(0x7f46900a6c60 0x7f46901577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.419+0000 7f469519c700 1 --2- 172.21.15.124:0/4057820266 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46900ad770 0x7f46900adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.420+0000 7f468f7fe700 1 -- 172.21.15.124:0/4057820266 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193281919 0 0) 0x7f46900ab910 con 0x7f46901573e0 2023-10-06T04:57:32.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.420+0000 7f468f7fe700 1 -- 172.21.15.124:0/4057820266 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4680003570 con 0x7f46901573e0 2023-10-06T04:57:32.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.420+0000 7f468ffff700 1 -- 172.21.15.124:0/4057820266 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46900ad770 msgr2=0x7f46900adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:32.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.420+0000 7f468ffff700 1 --2- 172.21.15.124:0/4057820266 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46900ad770 0x7f46900adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.420+0000 7f468ffff700 1 -- 172.21.15.124:0/4057820266 >> v1:172.21.15.124:6789/0 conn(0x7f46901573e0 legacy=0x7f4690069a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.420+0000 7f468ffff700 1 -- 172.21.15.124:0/4057820266 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469006a4a0 con 0x7f46900a6c60 2023-10-06T04:57:32.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.420+0000 7f468ffff700 1 --2- 172.21.15.124:0/4057820266 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900a6c60 0x7f46901577b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f467c0098e0 tx=0x7f467c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3574cbd8384f305 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:32.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.420+0000 7f468f7fe700 1 -- 172.21.15.124:0/4057820266 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c011630 con 0x7f46900a6c60 2023-10-06T04:57:32.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.420+0000 7f468f7fe700 1 -- 172.21.15.124:0/4057820266 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c011790 con 0x7f46900a6c60 2023-10-06T04:57:32.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.420+0000 7f468f7fe700 1 -- 172.21.15.124:0/4057820266 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c011b30 con 0x7f46900a6c60 2023-10-06T04:57:32.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.421+0000 7f4696bff700 1 -- 172.21.15.124:0/4057820266 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900a6c60 msgr2=0x7f46901577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.421+0000 7f4696bff700 1 --2- 172.21.15.124:0/4057820266 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900a6c60 0x7f46901577b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f467c0098e0 tx=0x7f467c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.421+0000 7f4696bff700 1 -- 172.21.15.124:0/4057820266 shutdown_connections 2023-10-06T04:57:32.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.421+0000 7f4696bff700 1 --2- 172.21.15.124:0/4057820266 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46900ad770 0x7f46900adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.421+0000 7f4696bff700 1 --2- 172.21.15.124:0/4057820266 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900a6c60 0x7f46901577b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.421+0000 7f4696bff700 1 -- 172.21.15.124:0/4057820266 >> 172.21.15.124:0/4057820266 conn(0x7f46900cc050 msgr2=0x7f46900cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:32.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.421+0000 7f4696bff700 1 -- 172.21.15.124:0/4057820266 shutdown_connections 2023-10-06T04:57:32.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.421+0000 7f4696bff700 1 -- 172.21.15.124:0/4057820266 wait complete. 2023-10-06T04:57:32.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.423+0000 7f4696bff700 1 Processor -- start 2023-10-06T04:57:32.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.423+0000 7f4696bff700 1 -- start start 2023-10-06T04:57:32.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.424+0000 7f4696bff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900ad770 0x7f4690156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.424+0000 7f4696bff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46901573e0 0x7f469015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.424+0000 7f4696bff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4690099bb0 0x7f469015b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.424+0000 7f4696bff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46900aaf80 con 0x7f46900ad770 2023-10-06T04:57:32.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.424+0000 7f4696bff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46900aa370 con 0x7f46901573e0 2023-10-06T04:57:32.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.424+0000 7f4696bff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46900aa650 con 0x7f4690099bb0 2023-10-06T04:57:32.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f469499b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900ad770 0x7f4690156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f469499b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900ad770 0x7f4690156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55626/0 (socket says 172.21.15.124:55626) 2023-10-06T04:57:32.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f469499b700 1 -- 172.21.15.124:0/2649242067 learned_addr learned my addr 172.21.15.124:0/2649242067 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:32.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f468ffff700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46901573e0 0x7f469015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f469519c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4690099bb0 0x7f469015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f469499b700 1 -- 172.21.15.124:0/2649242067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4690099bb0 msgr2=0x7f469015b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f469499b700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4690099bb0 0x7f469015b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f469499b700 1 -- 172.21.15.124:0/2649242067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46901573e0 msgr2=0x7f469015aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f469499b700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46901573e0 0x7f469015aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f469499b700 1 -- 172.21.15.124:0/2649242067 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c009420 con 0x7f46900ad770 2023-10-06T04:57:32.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.425+0000 7f469519c700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4690099bb0 0x7f469015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:57:32.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.426+0000 7f469499b700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900ad770 0x7f4690156470 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f468400c590 tx=0x7f4684007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:32.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.426+0000 7f468cff9700 1 -- 172.21.15.124:0/2649242067 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684005b30 con 0x7f46900ad770 2023-10-06T04:57:32.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.426+0000 7f468cff9700 1 -- 172.21.15.124:0/2649242067 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4684005cb0 con 0x7f46900ad770 2023-10-06T04:57:32.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.426+0000 7f4696bff700 1 -- 172.21.15.124:0/2649242067 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46900aa930 con 0x7f46900ad770 2023-10-06T04:57:32.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.426+0000 7f468cff9700 1 -- 172.21.15.124:0/2649242067 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684007320 con 0x7f46900ad770 2023-10-06T04:57:32.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.426+0000 7f4696bff700 1 -- 172.21.15.124:0/2649242067 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46901569b0 con 0x7f46900ad770 2023-10-06T04:57:32.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.427+0000 7f4696bff700 1 -- 172.21.15.124:0/2649242067 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46900717a0 con 0x7f46900ad770 2023-10-06T04:57:32.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.428+0000 7f468cff9700 1 -- 172.21.15.124:0/2649242067 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f468401b3b0 con 0x7f46900ad770 2023-10-06T04:57:32.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.429+0000 7f468cff9700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4674066f30 0x7f46740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.429+0000 7f468cff9700 1 -- 172.21.15.124:0/2649242067 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f46840838b0 con 0x7f46900ad770 2023-10-06T04:57:32.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.429+0000 7f468ffff700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4674066f30 0x7f46740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.430+0000 7f468ffff700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4674066f30 0x7f46740693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f467c0091e0 tx=0x7f467c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:32.436 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.434+0000 7f468cff9700 1 -- 172.21.15.124:0/2649242067 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4684050c20 con 0x7f46900ad770 2023-10-06T04:57:32.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.621+0000 7f4696bff700 1 -- 172.21.15.124:0/2649242067 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46900ab0c0 con 0x7f4674066f30 2023-10-06T04:57:32.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.624+0000 7f468cff9700 1 -- 172.21.15.124:0/2649242067 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73277 (secure 0 0 0) 0x7f467c011900 con 0x7f4674066f30 2023-10-06T04:57:32.627 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:32.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 -- 172.21.15.124:0/2649242067 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4674066f30 msgr2=0x7f46740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4674066f30 0x7f46740693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f467c0091e0 tx=0x7f467c017000 comp rx=0 tx=0).stop 2023-10-06T04:57:32.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 -- 172.21.15.124:0/2649242067 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900ad770 msgr2=0x7f4690156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900ad770 0x7f4690156470 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f468400c590 tx=0x7f4684007e00 comp rx=0 tx=0).stop 2023-10-06T04:57:32.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 -- 172.21.15.124:0/2649242067 shutdown_connections 2023-10-06T04:57:32.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4674066f30 0x7f46740693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4690099bb0 0x7f469015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46900ad770 0x7f4690156470 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 --2- 172.21.15.124:0/2649242067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46901573e0 0x7f469015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 -- 172.21.15.124:0/2649242067 >> 172.21.15.124:0/2649242067 conn(0x7f46900cc050 msgr2=0x7f469006d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:32.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 -- 172.21.15.124:0/2649242067 shutdown_connections 2023-10-06T04:57:32.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.626+0000 7f4696bff700 1 -- 172.21.15.124:0/2649242067 wait complete. 2023-10-06T04:57:32.630 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:57:32.646 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2023-10-06T04:57:32.081302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419504,"kb_used_data":41200,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752555216,"statfs":{"total":773094113280,"available":770616541184,"internally_reserved":0,"allocated":42188800,"data_stored":32609314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19632369,"num_objects":-992,"num_object_clones":0,"num_object_copies":-1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-992,"num_whiteouts":0,"num_read":-6,"num_read_kb":-7399,"num_write":-1492,"num_write_kb":-20288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001144"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.091485+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:46:16.091485+0000","last_peered":"2023-10-06T04:46:16.091485+0000","last_clean":"2023-10-06T04:46:16.091485+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:46:16.091485+0000","last_undegraded":"2023-10-06T04:46:16.091485+0000","last_fullsized":"2023-10-06T04:46:16.091485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.058290+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:46:16.058290+0000","last_peered":"2023-10-06T04:46:16.058290+0000","last_clean":"2023-10-06T04:46:16.058290+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:46:16.058290+0000","last_undegraded":"2023-10-06T04:46:16.058290+0000","last_fullsized":"2023-10-06T04:46:16.058290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T04:57:26.899583+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:57:26.899583+0000","last_peered":"2023-10-06T04:57:26.899583+0000","last_clean":"2023-10-06T04:57:26.899583+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:57:26.899583+0000","last_undegraded":"2023-10-06T04:57:26.899583+0000","last_fullsized":"2023-10-06T04:57:26.899583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":186,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.052328+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:46:16.052328+0000","last_peered":"2023-10-06T04:46:16.052328+0000","last_clean":"2023-10-06T04:46:16.052328+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:46:16.052328+0000","last_undegraded":"2023-10-06T04:46:16.052328+0000","last_fullsized":"2023-10-06T04:46:16.052328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.051872+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:46:16.051872+0000","last_peered":"2023-10-06T04:46:16.051872+0000","last_clean":"2023-10-06T04:46:16.051872+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:46:16.051872+0000","last_undegraded":"2023-10-06T04:46:16.051872+0000","last_fullsized":"2023-10-06T04:46:16.051872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.052230+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:46:16.052230+0000","last_peered":"2023-10-06T04:46:16.052230+0000","last_clean":"2023-10-06T04:46:16.052230+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:46:16.052230+0000","last_undegraded":"2023-10-06T04:46:16.052230+0000","last_fullsized":"2023-10-06T04:46:16.052230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T04:57:26.126072+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:57:26.126072+0000","last_peered":"2023-10-06T04:57:26.126072+0000","last_clean":"2023-10-06T04:57:26.126072+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:57:26.126072+0000","last_undegraded":"2023-10-06T04:57:26.126072+0000","last_fullsized":"2023-10-06T04:57:26.126072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.092043+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:46:16.092043+0000","last_peered":"2023-10-06T04:46:16.092043+0000","last_clean":"2023-10-06T04:46:16.092043+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:46:16.092043+0000","last_undegraded":"2023-10-06T04:46:16.092043+0000","last_fullsized":"2023-10-06T04:46:16.092043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.091743+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:46:16.091743+0000","last_peered":"2023-10-06T04:46:16.091743+0000","last_clean":"2023-10-06T04:46:16.091743+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:46:16.091743+0000","last_undegraded":"2023-10-06T04:46:16.091743+0000","last_fullsized":"2023-10-06T04:46:16.091743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542304,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307284,"kb_used_data":9996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94064556,"statfs":{"total":96636764160,"available":96322105344,"internally_reserved":0,"allocated":10235904,"data_stored":8925039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.33200000000000002},"max":{"1min":0.88100000000000001,"5min":1.044,"15min":8.7720000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.77800000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0089999999999999,"15min":8.8339999999999996},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66500000000000004,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40500000000000003},"max":{"1min":0.997,"5min":0.997,"15min":9.3070000000000004},"last":0.628},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67300000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.86599999999999999,"5min":0.93100000000000005,"15min":9.2129999999999992},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.54900000000000004,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":2.6709999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.79000000000000004},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.439},"max":{"1min":0.80200000000000005,"5min":0.95599999999999996,"15min":8.9179999999999993},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69799999999999995,"15min":0.80800000000000005},"min":{"1min":0.52200000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96699999999999997,"5min":1.087,"15min":9.0850000000000009},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":0.83599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":9.0969999999999995},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.018,"15min":1.018},"last":0.753},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.629,"15min":0.64500000000000002},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.371},"max":{"1min":0.77600000000000002,"5min":0.94899999999999995,"15min":0.95899999999999996},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.41499999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.82899999999999996,"5min":0.97199999999999998,"15min":1.0269999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90200000000000002,"5min":1.02,"15min":1.091},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.748},"min":{"1min":0.46200000000000002,"5min":0.46000000000000002,"15min":0.44400000000000001},"max":{"1min":0.93400000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.85399999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542305,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304208,"kb_used_data":6920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94067632,"statfs":{"total":96636764160,"available":96325255168,"internally_reserved":0,"allocated":7086080,"data_stored":6078665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.45500000000000002,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.98999999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.3779999999999999},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.46600000000000003,"15min":0.40500000000000003},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89300000000000002,"5min":0.95499999999999996,"15min":0.96299999999999997},"last":0.621}]},{"osd":2,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69299999999999995,"15min":0.68799999999999994},"min":{"1min":0.54500000000000004,"5min":0.45000000000000001,"15min":0.40300000000000002},"max":{"1min":0.89200000000000002,"5min":0.98199999999999998,"15min":1.1100000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93000000000000005,"5min":1.2529999999999999,"15min":1.3580000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":1.2689999999999999,"15min":1.337},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.496,"5min":0.48299999999999998,"15min":0.46100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1659999999999999},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67900000000000005,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.38300000000000001},"max":{"1min":0.86099999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.503},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.39200000000000002},"max":{"1min":0.85599999999999998,"5min":0.995,"15min":1.778},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.442,"15min":0.42299999999999999},"max":{"1min":0.85299999999999998,"5min":0.97799999999999998,"15min":1.1140000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.51000000000000001,"5min":0.47999999999999998,"15min":0.47299999999999998},"max":{"1min":0.879,"5min":1.071,"15min":1.071},"last":0.56000000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.97299999999999998,"15min":1.8500000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.876,"5min":1.006,"15min":1.351},"last":0.749}]}]},{"osd":1,"up_from":14,"seq":60129542305,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":5424,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":5554176,"data_stored":4461691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39700000000000002,"15min":0.51300000000000001},"min":{"1min":0.26700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.60299999999999998,"15min":6.508},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.622,"15min":2.4500000000000002},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41099999999999998,"15min":0.59099999999999997},"min":{"1min":0.31,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.51300000000000001,"5min":0.59199999999999997,"15min":9.2509999999999994},"last":0.375},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58699999999999997,"5min":0.60399999999999998,"15min":7.1100000000000003},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49299999999999999,"15min":0.60499999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":6.4000000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.45500000000000002,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":2.4889999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72599999999999998,"15min":1.0720000000000001},"min":{"1min":0.52300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0049999999999999,"5min":1.2829999999999999,"15min":19.911000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.83799999999999997},"min":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.93000000000000005,"5min":1.1599999999999999,"15min":6.4450000000000003},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94799999999999995,"5min":1.22,"15min":2.552},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73899999999999999,"15min":1.089},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0669999999999999,"5min":1.361,"15min":19.992999999999999},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75,"15min":0.85199999999999998},"min":{"1min":0.53200000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.1870000000000001,"15min":6.476},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0389999999999999,"5min":1.252,"15min":6.9050000000000002},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.51800000000000002},"max":{"1min":1.0429999999999999,"5min":1.329,"15min":2.5230000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76400000000000001,"15min":1.113},"min":{"1min":0.59299999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92300000000000004,"5min":1.1739999999999999,"15min":19.960999999999999},"last":0.69699999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542307,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":6352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":6504448,"data_stored":5081856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.59299999999999997,"15min":0.69499999999999995},"last":0.441},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42299999999999999,"15min":0.437},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.67800000000000005},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.439,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63400000000000001,"5min":0.66100000000000003,"15min":0.67400000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.58699999999999997,"5min":0.63800000000000001,"15min":0.81000000000000005},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.38},{"interface":"front","average":{"1min":0.5,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.78500000000000003},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.52300000000000002,"5min":0.48599999999999999,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":1.1779999999999999,"15min":1.254},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93700000000000006,"5min":1.0289999999999999,"15min":1.3600000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.502},"max":{"1min":0.98199999999999998,"5min":1.0660000000000001,"15min":1.2749999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.48599999999999999},"max":{"1min":0.92800000000000005,"5min":1.139,"15min":1.139},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.2929999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48399999999999999},"max":{"1min":0.95999999999999996,"5min":1.089,"15min":1.169},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.181,"15min":1.4019999999999999},"last":0.68000000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542304,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298964,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072876,"statfs":{"total":96636764160,"available":96330625024,"internally_reserved":0,"allocated":1716224,"data_stored":567188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":0.51800000000000002,"5min":0.55400000000000005,"15min":1.139},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.432,"15min":0.58799999999999997},"min":{"1min":0.33800000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59199999999999997,"5min":0.60699999999999998,"15min":11.241},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":0.52900000000000003,"5min":0.58599999999999997,"15min":1.028},"last":0.373},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44400000000000001,"15min":0.60999999999999999},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":11.273},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":0.59799999999999998,"5min":0.72599999999999998,"15min":0.995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.49199999999999999},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":1.1699999999999999},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71699999999999997,"15min":0.73099999999999998},"min":{"1min":0.56000000000000005,"5min":0.47799999999999998,"15min":0.42699999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.2889999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.88},"min":{"1min":0.54500000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":11.125999999999999},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71799999999999997,"15min":0.89200000000000002},"min":{"1min":0.57399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":11.208},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.56699999999999995,"5min":0.45100000000000001,"15min":0.44},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.5089999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.60699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.466},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.53500000000000003,"15min":0.51700000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":5.327},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72799999999999998,"15min":0.89800000000000002},"min":{"1min":0.51200000000000001,"5min":0.50600000000000001,"15min":0.496},"max":{"1min":1.121,"5min":1.121,"15min":11.173},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52100000000000002},"max":{"1min":1.0840000000000001,"5min":1.1399999999999999,"15min":1.3180000000000001},"last":0.82099999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542305,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303372,"kb_used_data":6084,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94068468,"statfs":{"total":96636764160,"available":96326111232,"internally_reserved":0,"allocated":6230016,"data_stored":4851487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.29999999999999999,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.439},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.51300000000000001,"5min":0.60199999999999998,"15min":0.80700000000000005},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.60999999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.95699999999999996},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.79300000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.42999999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.389},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.53500000000000003,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.202},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73899999999999999,"15min":0.73199999999999998},"min":{"1min":0.54400000000000004,"5min":0.502,"15min":0.41499999999999998},"max":{"1min":1.1499999999999999,"5min":1.2649999999999999,"15min":1.3160000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.54800000000000004,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.0600000000000001,"5min":1.109,"15min":1.5},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.52400000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.1100000000000001,"5min":1.1970000000000001,"15min":1.341},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.552},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.127,"5min":1.407,"15min":1.752},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.59099999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2070000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80700000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542304,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300304,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071536,"statfs":{"total":96636764160,"available":96329252864,"internally_reserved":0,"allocated":3088384,"data_stored":1985930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.33700000000000002,"15min":0.318},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":1.1299999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.54100000000000004,"5min":0.45300000000000001,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.94999999999999996,"15min":1.079},"last":0.94799999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.65600000000000003},"min":{"1min":0.54100000000000004,"5min":0.39800000000000002,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.95099999999999996,"15min":1.1819999999999999},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.46000000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":1.042},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.44700000000000001},"max":{"1min":0.84899999999999998,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.81899999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68100000000000005,"15min":0.67200000000000004},"min":{"1min":0.52800000000000002,"5min":0.45700000000000002,"15min":0.40899999999999997},"max":{"1min":0.873,"5min":0.94499999999999995,"15min":1.137},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":0.92200000000000004,"15min":1.177},"last":0.754}]},{"osd":5,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.876,"15min":1.1080000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":0.97399999999999998,"15min":1.4399999999999999},"last":0.40300000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.51900000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":0.94799999999999995,"15min":1.22},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54700000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.92900000000000005,"5min":0.97399999999999998,"15min":1.159},"last":0.99299999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.46400000000000002},"max":{"1min":0.94399999999999995,"5min":0.95599999999999996,"15min":1.49},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.60499999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.92900000000000005,"15min":1.2849999999999999},"last":0.53900000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542304,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299020,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072820,"statfs":{"total":96636764160,"available":96330567680,"internally_reserved":0,"allocated":1773568,"data_stored":657458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.38300000000000001,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.98099999999999998,"15min":1.05},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.61799999999999999},"min":{"1min":0.50800000000000001,"5min":0.42199999999999999,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":0.90800000000000003,"15min":0.93500000000000005},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.53100000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.95099999999999996,"15min":0.97899999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.69099999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.97099999999999997,"15min":1.0489999999999999},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.625},"min":{"1min":0.51800000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.90100000000000002,"15min":1.0309999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68700000000000006,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.38700000000000001},"max":{"1min":0.85999999999999999,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.504,"5min":0.45300000000000001,"15min":0.40300000000000002},"max":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.95399999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.88600000000000001,"5min":0.89600000000000002,"15min":0.95999999999999996},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.63700000000000001},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.34300000000000003},"max":{"1min":0.94699999999999995,"5min":0.97699999999999998,"15min":1.1060000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.38400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.038},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.66700000000000004},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0820000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.45300000000000001,"15min":0.39700000000000002},"max":{"1min":1.02,"5min":1.022,"15min":1.1339999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.3080000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.71799999999999997},"min":{"1min":0.50700000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.552},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:57:32.649 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:57:32.649 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:57:32.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.837+0000 7fb272fff700 1 Processor -- start 2023-10-06T04:57:32.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.837+0000 7fb272fff700 1 -- start start 2023-10-06T04:57:32.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.838+0000 7fb272fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb26c0abb60 0x7fb26c0abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.838+0000 7fb272fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c0acc40 con 0x7fb26c0690b0 2023-10-06T04:57:32.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.838+0000 7fb272fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c0ad0d0 con 0x7fb26c0ccd30 2023-10-06T04:57:32.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.838+0000 7fb272fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c06ae30 con 0x7fb26c0abb60 2023-10-06T04:57:32.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.838+0000 7fb27159c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb26c0690b0 0x7fb26c096a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47708/0 (socket says 172.21.15.124:47708) 2023-10-06T04:57:32.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.838+0000 7fb27159c700 1 -- 172.21.15.124:0/887007257 learned_addr learned my addr 172.21.15.124:0/887007257 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:32.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213209352 0 0) 0x7fb26c0acc40 con 0x7fb26c0690b0 2023-10-06T04:57:32.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb270d9b700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb26c0abb60 0x7fb26c0abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb25c003570 con 0x7fb26c0690b0 2023-10-06T04:57:32.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972339998 0 0) 0x7fb25c003570 con 0x7fb26c0690b0 2023-10-06T04:57:32.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb26c0abb60 msgr2=0x7fb26c0abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:32.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb26c0abb60 0x7fb26c0abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 >> v1:172.21.15.158:6789/0 conn(0x7fb26c0ccd30 legacy=0x7fb26c098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0ac5f0 con 0x7fb26c0690b0 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fb2640017f0 con 0x7fb26c0690b0 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 >> v1:172.21.15.124:6789/0 conn(0x7fb26c0690b0 legacy=0x7fb26c096a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb26c0abb60 0x7fb25c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb25c004010 0x7fb25c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb25c004d50 0x7fb25c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c06ae30 con 0x7fb25c004010 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c00de00 con 0x7fb25c004d50 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.839+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c00dfc0 con 0x7fb26c0abb60 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb26bfff700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb25c004010 0x7fb25c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb270d9b700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb26c0abb60 0x7fb25c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb27159c700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb25c004d50 0x7fb25c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb26bfff700 1 -- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb26c0abb60 msgr2=0x7fb25c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb26bfff700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb26c0abb60 0x7fb25c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb26bfff700 1 -- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb25c004d50 msgr2=0x7fb25c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb26bfff700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb25c004d50 0x7fb25c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb26bfff700 1 -- 172.21.15.124:0/887007257 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c003570 con 0x7fb25c004010 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb270d9b700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb26c0abb60 0x7fb25c003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb26bfff700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb25c004010 0x7fb25c004810 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb258001880 tx=0x7fb258007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4b17774eb9af04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258012420 con 0x7fb25c004010 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb258012580 con 0x7fb25c004010 2023-10-06T04:57:32.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.840+0000 7fb26b7fe700 1 -- 172.21.15.124:0/887007257 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258012920 con 0x7fb25c004010 2023-10-06T04:57:32.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.841+0000 7fb272fff700 1 -- 172.21.15.124:0/887007257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb25c004010 msgr2=0x7fb25c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.841+0000 7fb272fff700 1 --2- 172.21.15.124:0/887007257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb25c004010 0x7fb25c004810 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb258001880 tx=0x7fb258007d30 comp rx=0 tx=0).stop 2023-10-06T04:57:32.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.841+0000 7fb27159c700 1 -- 172.21.15.124:0/887007257 reap_dead start 2023-10-06T04:57:32.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.841+0000 7fb272fff700 1 -- 172.21.15.124:0/887007257 shutdown_connections 2023-10-06T04:57:32.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.841+0000 7fb272fff700 1 -- 172.21.15.124:0/887007257 >> 172.21.15.124:0/887007257 conn(0x7fb26c0cc050 msgr2=0x7fb26c0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:32.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.841+0000 7fb272fff700 1 -- 172.21.15.124:0/887007257 shutdown_connections 2023-10-06T04:57:32.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.841+0000 7fb272fff700 1 -- 172.21.15.124:0/887007257 wait complete. 2023-10-06T04:57:32.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.843+0000 7fb272fff700 1 Processor -- start 2023-10-06T04:57:32.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.843+0000 7fb272fff700 1 -- start start 2023-10-06T04:57:32.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb272fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb25c004010 0x7fb26c1524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb272fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb26c0c5200 0x7fb26c0c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb272fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb26c0aa350 0x7fb26c0aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb272fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0aad30 con 0x7fb26c0c5200 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb272fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0c6680 con 0x7fb26c0aa350 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb272fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c15bf70 con 0x7fb25c004010 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb26bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb26c0c5200 0x7fb26c0c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb26bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb26c0c5200 0x7fb26c0c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55654/0 (socket says 172.21.15.124:55654) 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb26bfff700 1 -- 172.21.15.124:0/3888881423 learned_addr learned my addr 172.21.15.124:0/3888881423 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb270d9b700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb25c004010 0x7fb26c1524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb27159c700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb26c0aa350 0x7fb26c0aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb26bfff700 1 -- 172.21.15.124:0/3888881423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb25c004010 msgr2=0x7fb26c1524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb26bfff700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb25c004010 0x7fb26c1524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb26bfff700 1 -- 172.21.15.124:0/3888881423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb26c0aa350 msgr2=0x7fb26c0aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:32.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb26bfff700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb26c0aa350 0x7fb26c0aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:32.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb26bfff700 1 -- 172.21.15.124:0/3888881423 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0c5bb0 con 0x7fb26c0c5200 2023-10-06T04:57:32.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.844+0000 7fb27159c700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb26c0aa350 0x7fb26c0aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:32.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.845+0000 7fb26bfff700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb26c0c5200 0x7fb26c0c5670 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb258001e70 tx=0x7fb258015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:32.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.845+0000 7fb268ff9700 1 -- 172.21.15.124:0/3888881423 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258012420 con 0x7fb26c0c5200 2023-10-06T04:57:32.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.845+0000 7fb268ff9700 1 -- 172.21.15.124:0/3888881423 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb258001200 con 0x7fb26c0c5200 2023-10-06T04:57:32.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.845+0000 7fb272fff700 1 -- 172.21.15.124:0/3888881423 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c0a8060 con 0x7fb26c0c5200 2023-10-06T04:57:32.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.845+0000 7fb268ff9700 1 -- 172.21.15.124:0/3888881423 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258012ea0 con 0x7fb26c0c5200 2023-10-06T04:57:32.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.845+0000 7fb272fff700 1 -- 172.21.15.124:0/3888881423 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c0c60c0 con 0x7fb26c0c5200 2023-10-06T04:57:32.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.846+0000 7fb272fff700 1 -- 172.21.15.124:0/3888881423 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c0a7ec0 con 0x7fb26c0c5200 2023-10-06T04:57:32.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.847+0000 7fb268ff9700 1 -- 172.21.15.124:0/3888881423 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb258019030 con 0x7fb26c0c5200 2023-10-06T04:57:32.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.847+0000 7fb268ff9700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb250066f30 0x7fb2500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:32.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.848+0000 7fb268ff9700 1 -- 172.21.15.124:0/3888881423 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb258085a70 con 0x7fb26c0c5200 2023-10-06T04:57:32.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.848+0000 7fb270d9b700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb250066f30 0x7fb2500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:32.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.848+0000 7fb270d9b700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb250066f30 0x7fb2500693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb260006f00 tx=0x7fb2600091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:32.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:32.852+0000 7fb268ff9700 1 -- 172.21.15.124:0/3888881423 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb26c0a7ec0 con 0x7fb26c0c5200 2023-10-06T04:57:33.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.039+0000 7fb272fff700 1 -- 172.21.15.124:0/3888881423 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb26c0a81f0 con 0x7fb250066f30 2023-10-06T04:57:33.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.042+0000 7fb268ff9700 1 -- 172.21.15.124:0/3888881423 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73277 (secure 0 0 0) 0x7fb260019070 con 0x7fb250066f30 2023-10-06T04:57:33.045 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:33.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.044+0000 7fb272fff700 1 -- 172.21.15.124:0/3888881423 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb250066f30 msgr2=0x7fb2500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:33.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.044+0000 7fb272fff700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb250066f30 0x7fb2500693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb260006f00 tx=0x7fb2600091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.044+0000 7fb272fff700 1 -- 172.21.15.124:0/3888881423 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb26c0c5200 msgr2=0x7fb26c0c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:33.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.044+0000 7fb272fff700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb26c0c5200 0x7fb26c0c5670 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb258001e70 tx=0x7fb258015000 comp rx=0 tx=0).stop 2023-10-06T04:57:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.044+0000 7fb272fff700 1 -- 172.21.15.124:0/3888881423 shutdown_connections 2023-10-06T04:57:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.044+0000 7fb272fff700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb26c0aa350 0x7fb26c0aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.044+0000 7fb272fff700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb250066f30 0x7fb2500693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.044+0000 7fb272fff700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb25c004010 0x7fb26c1524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.044+0000 7fb272fff700 1 --2- 172.21.15.124:0/3888881423 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb26c0c5200 0x7fb26c0c5670 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.044+0000 7fb272fff700 1 -- 172.21.15.124:0/3888881423 >> 172.21.15.124:0/3888881423 conn(0x7fb26c0cc050 msgr2=0x7fb26c0af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.045+0000 7fb272fff700 1 -- 172.21.15.124:0/3888881423 shutdown_connections 2023-10-06T04:57:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.045+0000 7fb272fff700 1 -- 172.21.15.124:0/3888881423 wait complete. 2023-10-06T04:57:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:57:33.064 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2023-10-06T04:57:32.081302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419504,"kb_used_data":41200,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752555216,"statfs":{"total":773094113280,"available":770616541184,"internally_reserved":0,"allocated":42188800,"data_stored":32609314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19632369,"num_objects":-992,"num_object_clones":0,"num_object_copies":-1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-992,"num_whiteouts":0,"num_read":-6,"num_read_kb":-7399,"num_write":-1492,"num_write_kb":-20288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001144"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.091485+0000","last_change":"2023-10-06T04:44:21.802827+0000","last_active":"2023-10-06T04:46:16.091485+0000","last_peered":"2023-10-06T04:46:16.091485+0000","last_clean":"2023-10-06T04:46:16.091485+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:46:16.091485+0000","last_undegraded":"2023-10-06T04:46:16.091485+0000","last_fullsized":"2023-10-06T04:46:16.091485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.058290+0000","last_change":"2023-10-06T04:44:21.802488+0000","last_active":"2023-10-06T04:46:16.058290+0000","last_peered":"2023-10-06T04:46:16.058290+0000","last_clean":"2023-10-06T04:46:16.058290+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:46:16.058290+0000","last_undegraded":"2023-10-06T04:46:16.058290+0000","last_fullsized":"2023-10-06T04:46:16.058290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T04:57:26.899583+0000","last_change":"2023-10-06T04:44:21.802228+0000","last_active":"2023-10-06T04:57:26.899583+0000","last_peered":"2023-10-06T04:57:26.899583+0000","last_clean":"2023-10-06T04:57:26.899583+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:57:26.899583+0000","last_undegraded":"2023-10-06T04:57:26.899583+0000","last_fullsized":"2023-10-06T04:57:26.899583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:13.082389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":186,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.052328+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:46:16.052328+0000","last_peered":"2023-10-06T04:46:16.052328+0000","last_clean":"2023-10-06T04:46:16.052328+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:46:16.052328+0000","last_undegraded":"2023-10-06T04:46:16.052328+0000","last_fullsized":"2023-10-06T04:46:16.052328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.051872+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:46:16.051872+0000","last_peered":"2023-10-06T04:46:16.051872+0000","last_clean":"2023-10-06T04:46:16.051872+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:46:16.051872+0000","last_undegraded":"2023-10-06T04:46:16.051872+0000","last_fullsized":"2023-10-06T04:46:16.051872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.052230+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:46:16.052230+0000","last_peered":"2023-10-06T04:46:16.052230+0000","last_clean":"2023-10-06T04:46:16.052230+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:46:16.052230+0000","last_undegraded":"2023-10-06T04:46:16.052230+0000","last_fullsized":"2023-10-06T04:46:16.052230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T04:57:26.126072+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:57:26.126072+0000","last_peered":"2023-10-06T04:57:26.126072+0000","last_clean":"2023-10-06T04:57:26.126072+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:57:26.126072+0000","last_undegraded":"2023-10-06T04:57:26.126072+0000","last_fullsized":"2023-10-06T04:57:26.126072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:44.713735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.092043+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:46:16.092043+0000","last_peered":"2023-10-06T04:46:16.092043+0000","last_clean":"2023-10-06T04:46:16.092043+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:46:16.092043+0000","last_undegraded":"2023-10-06T04:46:16.092043+0000","last_fullsized":"2023-10-06T04:46:16.092043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:46:16.091743+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:46:16.091743+0000","last_peered":"2023-10-06T04:46:16.091743+0000","last_clean":"2023-10-06T04:46:16.091743+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:46:16.091743+0000","last_undegraded":"2023-10-06T04:46:16.091743+0000","last_fullsized":"2023-10-06T04:46:16.091743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:24.168844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542304,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307284,"kb_used_data":9996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94064556,"statfs":{"total":96636764160,"available":96322105344,"internally_reserved":0,"allocated":10235904,"data_stored":8925039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.33200000000000002},"max":{"1min":0.88100000000000001,"5min":1.044,"15min":8.7720000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.77800000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0089999999999999,"15min":8.8339999999999996},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66500000000000004,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40500000000000003},"max":{"1min":0.997,"5min":0.997,"15min":9.3070000000000004},"last":0.628},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67300000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.86599999999999999,"5min":0.93100000000000005,"15min":9.2129999999999992},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.54900000000000004,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":2.6709999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.79000000000000004},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.439},"max":{"1min":0.80200000000000005,"5min":0.95599999999999996,"15min":8.9179999999999993},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69799999999999995,"15min":0.80800000000000005},"min":{"1min":0.52200000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96699999999999997,"5min":1.087,"15min":9.0850000000000009},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":0.83599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":9.0969999999999995},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.018,"15min":1.018},"last":0.753},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.629,"15min":0.64500000000000002},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.371},"max":{"1min":0.77600000000000002,"5min":0.94899999999999995,"15min":0.95899999999999996},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.41499999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.82899999999999996,"5min":0.97199999999999998,"15min":1.0269999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90200000000000002,"5min":1.02,"15min":1.091},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.748},"min":{"1min":0.46200000000000002,"5min":0.46000000000000002,"15min":0.44400000000000001},"max":{"1min":0.93400000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.85399999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542305,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304208,"kb_used_data":6920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94067632,"statfs":{"total":96636764160,"available":96325255168,"internally_reserved":0,"allocated":7086080,"data_stored":6078665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.45500000000000002,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.98999999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.3779999999999999},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.46600000000000003,"15min":0.40500000000000003},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89300000000000002,"5min":0.95499999999999996,"15min":0.96299999999999997},"last":0.621}]},{"osd":2,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69299999999999995,"15min":0.68799999999999994},"min":{"1min":0.54500000000000004,"5min":0.45000000000000001,"15min":0.40300000000000002},"max":{"1min":0.89200000000000002,"5min":0.98199999999999998,"15min":1.1100000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93000000000000005,"5min":1.2529999999999999,"15min":1.3580000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":1.2689999999999999,"15min":1.337},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.496,"5min":0.48299999999999998,"15min":0.46100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1659999999999999},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67900000000000005,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.38300000000000001},"max":{"1min":0.86099999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.503},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.39200000000000002},"max":{"1min":0.85599999999999998,"5min":0.995,"15min":1.778},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.442,"15min":0.42299999999999999},"max":{"1min":0.85299999999999998,"5min":0.97799999999999998,"15min":1.1140000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.51000000000000001,"5min":0.47999999999999998,"15min":0.47299999999999998},"max":{"1min":0.879,"5min":1.071,"15min":1.071},"last":0.56000000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.97299999999999998,"15min":1.8500000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.876,"5min":1.006,"15min":1.351},"last":0.749}]}]},{"osd":1,"up_from":14,"seq":60129542305,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":5424,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":5554176,"data_stored":4461691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39700000000000002,"15min":0.51300000000000001},"min":{"1min":0.26700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.60299999999999998,"15min":6.508},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.622,"15min":2.4500000000000002},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41099999999999998,"15min":0.59099999999999997},"min":{"1min":0.31,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.51300000000000001,"5min":0.59199999999999997,"15min":9.2509999999999994},"last":0.375},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58699999999999997,"5min":0.60399999999999998,"15min":7.1100000000000003},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49299999999999999,"15min":0.60499999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":6.4000000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.45500000000000002,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":2.4889999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72599999999999998,"15min":1.0720000000000001},"min":{"1min":0.52300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0049999999999999,"5min":1.2829999999999999,"15min":19.911000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.83799999999999997},"min":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.93000000000000005,"5min":1.1599999999999999,"15min":6.4450000000000003},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94799999999999995,"5min":1.22,"15min":2.552},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73899999999999999,"15min":1.089},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0669999999999999,"5min":1.361,"15min":19.992999999999999},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75,"15min":0.85199999999999998},"min":{"1min":0.53200000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.1870000000000001,"15min":6.476},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0389999999999999,"5min":1.252,"15min":6.9050000000000002},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.51800000000000002},"max":{"1min":1.0429999999999999,"5min":1.329,"15min":2.5230000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76400000000000001,"15min":1.113},"min":{"1min":0.59299999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92300000000000004,"5min":1.1739999999999999,"15min":19.960999999999999},"last":0.69699999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542307,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":6352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":6504448,"data_stored":5081856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.59299999999999997,"15min":0.69499999999999995},"last":0.441},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42299999999999999,"15min":0.437},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.67800000000000005},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.439,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63400000000000001,"5min":0.66100000000000003,"15min":0.67400000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.58699999999999997,"5min":0.63800000000000001,"15min":0.81000000000000005},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.38},{"interface":"front","average":{"1min":0.5,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.78500000000000003},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.52300000000000002,"5min":0.48599999999999999,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":1.1779999999999999,"15min":1.254},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93700000000000006,"5min":1.0289999999999999,"15min":1.3600000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.502},"max":{"1min":0.98199999999999998,"5min":1.0660000000000001,"15min":1.2749999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.48599999999999999},"max":{"1min":0.92800000000000005,"5min":1.139,"15min":1.139},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.2929999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48399999999999999},"max":{"1min":0.95999999999999996,"5min":1.089,"15min":1.169},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.181,"15min":1.4019999999999999},"last":0.68000000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542304,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298964,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072876,"statfs":{"total":96636764160,"available":96330625024,"internally_reserved":0,"allocated":1716224,"data_stored":567188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":0.51800000000000002,"5min":0.55400000000000005,"15min":1.139},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.432,"15min":0.58799999999999997},"min":{"1min":0.33800000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59199999999999997,"5min":0.60699999999999998,"15min":11.241},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":0.52900000000000003,"5min":0.58599999999999997,"15min":1.028},"last":0.373},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44400000000000001,"15min":0.60999999999999999},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":11.273},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":0.59799999999999998,"5min":0.72599999999999998,"15min":0.995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.49199999999999999},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":1.1699999999999999},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71699999999999997,"15min":0.73099999999999998},"min":{"1min":0.56000000000000005,"5min":0.47799999999999998,"15min":0.42699999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.2889999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.88},"min":{"1min":0.54500000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":11.125999999999999},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71799999999999997,"15min":0.89200000000000002},"min":{"1min":0.57399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":11.208},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.56699999999999995,"5min":0.45100000000000001,"15min":0.44},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.5089999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.60699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.466},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.53500000000000003,"15min":0.51700000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":5.327},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72799999999999998,"15min":0.89800000000000002},"min":{"1min":0.51200000000000001,"5min":0.50600000000000001,"15min":0.496},"max":{"1min":1.121,"5min":1.121,"15min":11.173},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52100000000000002},"max":{"1min":1.0840000000000001,"5min":1.1399999999999999,"15min":1.3180000000000001},"last":0.82099999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542305,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303372,"kb_used_data":6084,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94068468,"statfs":{"total":96636764160,"available":96326111232,"internally_reserved":0,"allocated":6230016,"data_stored":4851487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.29999999999999999,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.439},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.51300000000000001,"5min":0.60199999999999998,"15min":0.80700000000000005},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.60999999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.95699999999999996},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.79300000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.42999999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.389},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.53500000000000003,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.202},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73899999999999999,"15min":0.73199999999999998},"min":{"1min":0.54400000000000004,"5min":0.502,"15min":0.41499999999999998},"max":{"1min":1.1499999999999999,"5min":1.2649999999999999,"15min":1.3160000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.54800000000000004,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.0600000000000001,"5min":1.109,"15min":1.5},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.52400000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.1100000000000001,"5min":1.1970000000000001,"15min":1.341},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.552},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.127,"5min":1.407,"15min":1.752},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.59099999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2070000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80700000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542304,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300304,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071536,"statfs":{"total":96636764160,"available":96329252864,"internally_reserved":0,"allocated":3088384,"data_stored":1985930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.33700000000000002,"15min":0.318},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":1.1299999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.54100000000000004,"5min":0.45300000000000001,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.94999999999999996,"15min":1.079},"last":0.94799999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.65600000000000003},"min":{"1min":0.54100000000000004,"5min":0.39800000000000002,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.95099999999999996,"15min":1.1819999999999999},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.46000000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":1.042},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.44700000000000001},"max":{"1min":0.84899999999999998,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.81899999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68100000000000005,"15min":0.67200000000000004},"min":{"1min":0.52800000000000002,"5min":0.45700000000000002,"15min":0.40899999999999997},"max":{"1min":0.873,"5min":0.94499999999999995,"15min":1.137},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":0.92200000000000004,"15min":1.177},"last":0.754}]},{"osd":5,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.876,"15min":1.1080000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":0.97399999999999998,"15min":1.4399999999999999},"last":0.40300000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.51900000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":0.94799999999999995,"15min":1.22},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54700000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.92900000000000005,"5min":0.97399999999999998,"15min":1.159},"last":0.99299999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.46400000000000002},"max":{"1min":0.94399999999999995,"5min":0.95599999999999996,"15min":1.49},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.60499999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.92900000000000005,"15min":1.2849999999999999},"last":0.53900000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542304,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299020,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072820,"statfs":{"total":96636764160,"available":96330567680,"internally_reserved":0,"allocated":1773568,"data_stored":657458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.38300000000000001,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.98099999999999998,"15min":1.05},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.61799999999999999},"min":{"1min":0.50800000000000001,"5min":0.42199999999999999,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":0.90800000000000003,"15min":0.93500000000000005},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.53100000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.95099999999999996,"15min":0.97899999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.69099999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.97099999999999997,"15min":1.0489999999999999},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.625},"min":{"1min":0.51800000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.90100000000000002,"15min":1.0309999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68700000000000006,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.38700000000000001},"max":{"1min":0.85999999999999999,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.504,"5min":0.45300000000000001,"15min":0.40300000000000002},"max":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.95399999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.88600000000000001,"5min":0.89600000000000002,"15min":0.95999999999999996},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.63700000000000001},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.34300000000000003},"max":{"1min":0.94699999999999995,"5min":0.97699999999999998,"15min":1.1060000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.38400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.038},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.66700000000000004},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0820000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.45300000000000001,"15min":0.39700000000000002},"max":{"1min":1.02,"5min":1.022,"15min":1.1339999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.3080000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.71799999999999997},"min":{"1min":0.50700000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.552},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:57:33.067 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:57:33.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.253+0000 7f2cb19ff700 1 Processor -- start 2023-10-06T04:57:33.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.253+0000 7f2cb19ff700 1 -- start start 2023-10-06T04:57:33.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.254+0000 7f2cb19ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2cac0cae80 0x7f2cac0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:33.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.254+0000 7f2cb19ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2cac0ccec0 0x7f2cac1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:33.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.254+0000 7f2cb19ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac0c1d10 con 0x7f2cac0cb250 2023-10-06T04:57:33.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.254+0000 7f2cb19ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac0cd430 con 0x7f2cac0ccec0 2023-10-06T04:57:33.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.254+0000 7f2cb19ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac0688a0 con 0x7f2cac0cae80 2023-10-06T04:57:33.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.255+0000 7f2caa7fc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2cac0ccec0 0x7f2cac1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.255+0000 7f2caa7fc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2cac0ccec0 0x7f2cac1591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57222/0 (socket says 172.21.15.124:57222) 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.255+0000 7f2caa7fc700 1 -- 172.21.15.124:0/1481894902 learned_addr learned my addr 172.21.15.124:0/1481894902 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.255+0000 7f2caaffd700 1 --2- 172.21.15.124:0/1481894902 >> v2:172.21.15.158:3300/0 conn(0x7f2cac0cae80 0x7f2cac0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.255+0000 7f2caa7fc700 1 -- 172.21.15.124:0/1481894902 >> v2:172.21.15.158:3300/0 conn(0x7f2cac0cae80 msgr2=0x7f2cac0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.255+0000 7f2caa7fc700 1 --2- 172.21.15.124:0/1481894902 >> v2:172.21.15.158:3300/0 conn(0x7f2cac0cae80 0x7f2cac0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.255+0000 7f2caa7fc700 1 -- 172.21.15.124:0/1481894902 >> v1:172.21.15.158:6789/0 conn(0x7f2cac0cb250 legacy=0x7f2cac0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.255+0000 7f2caa7fc700 1 -- 172.21.15.124:0/1481894902 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac068b80 con 0x7f2cac0ccec0 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.255+0000 7f2caaffd700 1 --2- 172.21.15.124:0/1481894902 >> v2:172.21.15.158:3300/0 conn(0x7f2cac0cae80 0x7f2cac0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.255+0000 7f2caa7fc700 1 --2- 172.21.15.124:0/1481894902 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0ccec0 0x7f2cac1591d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2cac06efb0 tx=0x7f2ca0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cd6336c5242dfe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2ca9ffb700 1 -- 172.21.15.124:0/1481894902 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000b860 con 0x7f2cac0ccec0 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2ca9ffb700 1 -- 172.21.15.124:0/1481894902 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca000b9c0 con 0x7f2cac0ccec0 2023-10-06T04:57:33.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2ca9ffb700 1 -- 172.21.15.124:0/1481894902 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000bd60 con 0x7f2cac0ccec0 2023-10-06T04:57:33.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1481894902 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0ccec0 msgr2=0x7f2cac1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:33.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2cb19ff700 1 --2- 172.21.15.124:0/1481894902 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0ccec0 0x7f2cac1591d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2cac06efb0 tx=0x7f2ca0009250 comp rx=0 tx=0).stop 2023-10-06T04:57:33.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1481894902 shutdown_connections 2023-10-06T04:57:33.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2cb19ff700 1 --2- 172.21.15.124:0/1481894902 >> v2:172.21.15.158:3300/0 conn(0x7f2cac0cae80 0x7f2cac0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2cb19ff700 1 --2- 172.21.15.124:0/1481894902 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0ccec0 0x7f2cac1591d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1481894902 >> 172.21.15.124:0/1481894902 conn(0x7f2cac0974f0 msgr2=0x7f2cac0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:33.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1481894902 shutdown_connections 2023-10-06T04:57:33.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.256+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1481894902 wait complete. 2023-10-06T04:57:33.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.258+0000 7f2cb19ff700 1 Processor -- start 2023-10-06T04:57:33.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.258+0000 7f2cb19ff700 1 -- start start 2023-10-06T04:57:33.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.259+0000 7f2cb19ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cac0cae80 0x7f2cac0c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:33.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.259+0000 7f2cb19ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0cb250 0x7f2cac169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:33.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.259+0000 7f2cb19ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cac0ccec0 0x7f2cac16ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:33.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.259+0000 7f2cb19ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac16d2d0 con 0x7f2cac0cb250 2023-10-06T04:57:33.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.259+0000 7f2cb19ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac16d5b0 con 0x7f2cac0ccec0 2023-10-06T04:57:33.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.259+0000 7f2cb19ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac16d890 con 0x7f2cac0cae80 2023-10-06T04:57:33.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.259+0000 7f2caa7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0cb250 0x7f2cac169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:33.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.259+0000 7f2caa7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0cb250 0x7f2cac169d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57224/0 (socket says 172.21.15.124:57224) 2023-10-06T04:57:33.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.259+0000 7f2caa7fc700 1 -- 172.21.15.124:0/1230999155 learned_addr learned my addr 172.21.15.124:0/1230999155 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:33.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.259+0000 7f2caaffd700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cac0cae80 0x7f2cac0c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:33.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2cab7fe700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cac0ccec0 0x7f2cac16ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:33.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2caa7fc700 1 -- 172.21.15.124:0/1230999155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cac0cae80 msgr2=0x7f2cac0c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:33.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2caa7fc700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cac0cae80 0x7f2cac0c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2caa7fc700 1 -- 172.21.15.124:0/1230999155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cac0ccec0 msgr2=0x7f2cac16ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:33.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2caa7fc700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cac0ccec0 0x7f2cac16ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2caa7fc700 1 -- 172.21.15.124:0/1230999155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00094f0 con 0x7f2cac0cb250 2023-10-06T04:57:33.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2caa7fc700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0cb250 0x7f2cac169d90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009290 tx=0x7f2ca0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:33.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2c92ffd700 1 -- 172.21.15.124:0/1230999155 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0026480 con 0x7f2cac0cb250 2023-10-06T04:57:33.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2c92ffd700 1 -- 172.21.15.124:0/1230999155 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca001f070 con 0x7f2cac0cb250 2023-10-06T04:57:33.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2c92ffd700 1 -- 172.21.15.124:0/1230999155 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0026850 con 0x7f2cac0cb250 2023-10-06T04:57:33.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1230999155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac169590 con 0x7f2cac0cb250 2023-10-06T04:57:33.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.260+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1230999155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac16a2d0 con 0x7f2cac0cb250 2023-10-06T04:57:33.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.261+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1230999155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac0c4880 con 0x7f2cac0cb250 2023-10-06T04:57:33.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.262+0000 7f2c92ffd700 1 -- 172.21.15.124:0/1230999155 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ca001a430 con 0x7f2cac0cb250 2023-10-06T04:57:33.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.263+0000 7f2c92ffd700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2c98066f30 0x7f2c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:33.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.263+0000 7f2c92ffd700 1 -- 172.21.15.124:0/1230999155 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2ca0021070 con 0x7f2cac0cb250 2023-10-06T04:57:33.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.263+0000 7f2caaffd700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2c98066f30 0x7f2c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:33.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.264+0000 7f2caaffd700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2c98066f30 0x7f2c980693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c006f00 tx=0x7f2c9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:33.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.267+0000 7f2c92ffd700 1 -- 172.21.15.124:0/1230999155 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ca0053660 con 0x7f2cac0cb250 2023-10-06T04:57:33.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.459+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1230999155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cac0717a0 con 0x7f2cac0cb250 2023-10-06T04:57:33.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.459+0000 7f2c92ffd700 1 -- 172.21.15.124:0/1230999155 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13925 (secure 0 0 0) 0x7f2ca0056c80 con 0x7f2cac0cb250 2023-10-06T04:57:33.462 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:33.462 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":50,"fsid":"8703c690-5fd4-410f-8b5d-95264116cbcb","created":"2023-10-06T04:44:07.202980+0000","modified":"2023-10-06T04:57:29.379287+0000","last_up_change":"2023-10-06T04:44:18.779865+0000","last_in_change":"2023-10-06T04:44:10.705153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:44:19.842795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:44:19.965191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"807ce8ea-baf2-43be-89e4-37b356e735e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":114868},{"type":"v1","addr":"172.21.15.124:6809","nonce":114868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":114868},{"type":"v1","addr":"172.21.15.124:6811","nonce":114868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":114868},{"type":"v1","addr":"172.21.15.124:6815","nonce":114868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":114868},{"type":"v1","addr":"172.21.15.124:6813","nonce":114868}]},"public_addr":"172.21.15.124:6809/114868","cluster_addr":"172.21.15.124:6811/114868","heartbeat_back_addr":"172.21.15.124:6815/114868","heartbeat_front_addr":"172.21.15.124:6813/114868","state":["exists","up"]},{"osd":1,"uuid":"c75a4623-8fcc-4936-9425-87f83d2c27c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":114871},{"type":"v1","addr":"172.21.15.124:6801","nonce":114871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":114871},{"type":"v1","addr":"172.21.15.124:6803","nonce":114871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":114871},{"type":"v1","addr":"172.21.15.124:6807","nonce":114871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":114871},{"type":"v1","addr":"172.21.15.124:6805","nonce":114871}]},"public_addr":"172.21.15.124:6801/114871","cluster_addr":"172.21.15.124:6803/114871","heartbeat_back_addr":"172.21.15.124:6807/114871","heartbeat_front_addr":"172.21.15.124:6805/114871","state":["exists","up"]},{"osd":2,"uuid":"d9bef997-67c1-4421-861f-d44964c1db74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":114869},{"type":"v1","addr":"172.21.15.124:6817","nonce":114869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":114869},{"type":"v1","addr":"172.21.15.124:6819","nonce":114869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":114869},{"type":"v1","addr":"172.21.15.124:6823","nonce":114869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":114869},{"type":"v1","addr":"172.21.15.124:6821","nonce":114869}]},"public_addr":"172.21.15.124:6817/114869","cluster_addr":"172.21.15.124:6819/114869","heartbeat_back_addr":"172.21.15.124:6823/114869","heartbeat_front_addr":"172.21.15.124:6821/114869","state":["exists","up"]},{"osd":3,"uuid":"ce6bd5e6-d951-4bad-8bfa-f3fd731c9d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":114900},{"type":"v1","addr":"172.21.15.124:6825","nonce":114900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":114900},{"type":"v1","addr":"172.21.15.124:6827","nonce":114900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":114900},{"type":"v1","addr":"172.21.15.124:6831","nonce":114900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":114900},{"type":"v1","addr":"172.21.15.124:6829","nonce":114900}]},"public_addr":"172.21.15.124:6825/114900","cluster_addr":"172.21.15.124:6827/114900","heartbeat_back_addr":"172.21.15.124:6831/114900","heartbeat_front_addr":"172.21.15.124:6829/114900","state":["exists","up"]},{"osd":4,"uuid":"127d525e-e2e9-4e9f-afcb-d240e6b59712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":115098},{"type":"v1","addr":"172.21.15.158:6801","nonce":115098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":115098},{"type":"v1","addr":"172.21.15.158:6803","nonce":115098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":115098},{"type":"v1","addr":"172.21.15.158:6807","nonce":115098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":115098},{"type":"v1","addr":"172.21.15.158:6805","nonce":115098}]},"public_addr":"172.21.15.158:6801/115098","cluster_addr":"172.21.15.158:6803/115098","heartbeat_back_addr":"172.21.15.158:6807/115098","heartbeat_front_addr":"172.21.15.158:6805/115098","state":["exists","up"]},{"osd":5,"uuid":"556394bc-73d7-43c2-a456-377c3f140fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":115099},{"type":"v1","addr":"172.21.15.158:6809","nonce":115099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":115099},{"type":"v1","addr":"172.21.15.158:6811","nonce":115099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":115099},{"type":"v1","addr":"172.21.15.158:6815","nonce":115099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":115099},{"type":"v1","addr":"172.21.15.158:6813","nonce":115099}]},"public_addr":"172.21.15.158:6809/115099","cluster_addr":"172.21.15.158:6811/115099","heartbeat_back_addr":"172.21.15.158:6815/115099","heartbeat_front_addr":"172.21.15.158:6813/115099","state":["exists","up"]},{"osd":6,"uuid":"59060e72-05b9-45fb-bc86-1d35db63d75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":115109},{"type":"v1","addr":"172.21.15.158:6817","nonce":115109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":115109},{"type":"v1","addr":"172.21.15.158:6819","nonce":115109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":115109},{"type":"v1","addr":"172.21.15.158:6823","nonce":115109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":115109},{"type":"v1","addr":"172.21.15.158:6821","nonce":115109}]},"public_addr":"172.21.15.158:6817/115109","cluster_addr":"172.21.15.158:6819/115109","heartbeat_back_addr":"172.21.15.158:6823/115109","heartbeat_front_addr":"172.21.15.158:6821/115109","state":["exists","up"]},{"osd":7,"uuid":"2107313e-ce80-4983-9c73-1056a0fafc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":115130},{"type":"v1","addr":"172.21.15.158:6825","nonce":115130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":115130},{"type":"v1","addr":"172.21.15.158:6827","nonce":115130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":115130},{"type":"v1","addr":"172.21.15.158:6831","nonce":115130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":115130},{"type":"v1","addr":"172.21.15.158:6829","nonce":115130}]},"public_addr":"172.21.15.158:6825/115130","cluster_addr":"172.21.15.158:6827/115130","heartbeat_back_addr":"172.21.15.158:6831/115130","heartbeat_front_addr":"172.21.15.158:6829/115130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.717509+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.756823+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:15.955491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.099218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.267977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.287947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038132+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:44:16.038061+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.158:6834/1553392288":"2023-10-07T04:57:26.118440+0000","172.21.15.158:6832/1553392288":"2023-10-07T04:57:26.118440+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:57:33.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1230999155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2c98066f30 msgr2=0x7f2c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:33.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2c98066f30 0x7f2c980693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c006f00 tx=0x7f2c9c008040 comp rx=0 tx=0).stop 2023-10-06T04:57:33.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1230999155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0cb250 msgr2=0x7f2cac169d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:33.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0cb250 0x7f2cac169d90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009290 tx=0x7f2ca0017000 comp rx=0 tx=0).stop 2023-10-06T04:57:33.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1230999155 shutdown_connections 2023-10-06T04:57:33.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2cac0ccec0 0x7f2cac16ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f2c98066f30 0x7f2c980693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2cac0cae80 0x7f2cac0c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 --2- 172.21.15.124:0/1230999155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cac0cb250 0x7f2cac169d90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:33.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1230999155 >> 172.21.15.124:0/1230999155 conn(0x7f2cac0974f0 msgr2=0x7f2cac0c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:33.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1230999155 shutdown_connections 2023-10-06T04:57:33.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:33.462+0000 7f2cb19ff700 1 -- 172.21.15.124:0/1230999155 wait complete. 2023-10-06T04:57:34.482 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T04:57:34.483 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:57:34.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.695+0000 7f8e451ff700 1 Processor -- start 2023-10-06T04:57:34.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.695+0000 7f8e451ff700 1 -- start start 2023-10-06T04:57:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.697+0000 7f8e451ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e400b19a0 0x7f8e400ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.697+0000 7f8e451ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e40157ae0 con 0x7f8e400c8a90 2023-10-06T04:57:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.697+0000 7f8e451ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e400cab60 con 0x7f8e400c86c0 2023-10-06T04:57:34.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.697+0000 7f8e451ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400cae40 con 0x7f8e400b19a0 2023-10-06T04:57:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.697+0000 7f8e3e59c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f8e400c8a90 0x7f8e400b1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47604/0 (socket says 172.21.15.124:47604) 2023-10-06T04:57:34.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.697+0000 7f8e3e59c700 1 -- 172.21.15.124:0/3173078014 learned_addr learned my addr 172.21.15.124:0/3173078014 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:34.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.697+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493695926 0 0) 0x7f8e40157ae0 con 0x7f8e400c8a90 2023-10-06T04:57:34.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.697+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e28003570 con 0x7f8e400c8a90 2023-10-06T04:57:34.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3f59e700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e400b19a0 0x7f8e400ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3989932835 0 0) 0x7f8e28003570 con 0x7f8e400c8a90 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e400b19a0 msgr2=0x7f8e400ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e400b19a0 0x7f8e400ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 >> v1:172.21.15.158:6789/0 conn(0x7f8e400c86c0 legacy=0x7f8e400ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400cb120 con 0x7f8e400c8a90 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f8e34001470 con 0x7f8e400c8a90 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 >> v1:172.21.15.124:6789/0 conn(0x7f8e400c8a90 legacy=0x7f8e400b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e28003a90 0x7f8e28003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e400b19a0 0x7f8e28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e28004e70 0x7f8e280052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400cae40 con 0x7f8e28004e70 2023-10-06T04:57:34.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2800bc70 con 0x7f8e28003a90 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2800be30 con 0x7f8e400b19a0 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3f59e700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e28004e70 0x7f8e280052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3e59c700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e400b19a0 0x7f8e28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.698+0000 7f8e3ed9d700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e28003a90 0x7f8e28003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.699+0000 7f8e3f59e700 1 -- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e400b19a0 msgr2=0x7f8e28004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.699+0000 7f8e3f59e700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e400b19a0 0x7f8e28004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.699+0000 7f8e3f59e700 1 -- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e28003a90 msgr2=0x7f8e28003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.699+0000 7f8e3f59e700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e28003a90 0x7f8e28003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.699+0000 7f8e3f59e700 1 -- 172.21.15.124:0/3173078014 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e28003570 con 0x7f8e28004e70 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.699+0000 7f8e3f59e700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e28004e70 0x7f8e280052e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8e400b1da0 tx=0x7f8e38009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3600c10fff2f519 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.699+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38009a40 con 0x7f8e28004e70 2023-10-06T04:57:34.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.699+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38007c90 con 0x7f8e28004e70 2023-10-06T04:57:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.699+0000 7f8e3dd9b700 1 -- 172.21.15.124:0/3173078014 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38014630 con 0x7f8e28004e70 2023-10-06T04:57:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.700+0000 7f8e451ff700 1 -- 172.21.15.124:0/3173078014 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e28004e70 msgr2=0x7f8e280052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.700+0000 7f8e451ff700 1 --2- 172.21.15.124:0/3173078014 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e28004e70 0x7f8e280052e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8e400b1da0 tx=0x7f8e38009710 comp rx=0 tx=0).stop 2023-10-06T04:57:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.700+0000 7f8e3f59e700 1 -- 172.21.15.124:0/3173078014 reap_dead start 2023-10-06T04:57:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.700+0000 7f8e451ff700 1 -- 172.21.15.124:0/3173078014 shutdown_connections 2023-10-06T04:57:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.700+0000 7f8e451ff700 1 -- 172.21.15.124:0/3173078014 >> 172.21.15.124:0/3173078014 conn(0x7f8e40068080 msgr2=0x7f8e400cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.700+0000 7f8e451ff700 1 -- 172.21.15.124:0/3173078014 shutdown_connections 2023-10-06T04:57:34.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.700+0000 7f8e451ff700 1 -- 172.21.15.124:0/3173078014 wait complete. 2023-10-06T04:57:34.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.701+0000 7f8e451ff700 1 Processor -- start 2023-10-06T04:57:34.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.701+0000 7f8e451ff700 1 -- start start 2023-10-06T04:57:34.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.702+0000 7f8e451ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e28004e70 0x7f8e400b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.702+0000 7f8e451ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e400c5370 0x7f8e4014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.702+0000 7f8e451ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e4015a870 0x7f8e4015ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.702+0000 7f8e451ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4015b250 con 0x7f8e400c5370 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.702+0000 7f8e451ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4014cc20 con 0x7f8e4015a870 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.702+0000 7f8e451ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4014e3b0 con 0x7f8e28004e70 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.702+0000 7f8e3e59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e400c5370 0x7f8e4014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e3e59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e400c5370 0x7f8e4014b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57232/0 (socket says 172.21.15.124:57232) 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e3e59c700 1 -- 172.21.15.124:0/29572350 learned_addr learned my addr 172.21.15.124:0/29572350 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e3ed9d700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e28004e70 0x7f8e400b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e3f59e700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e4015a870 0x7f8e4015ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e3e59c700 1 -- 172.21.15.124:0/29572350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e28004e70 msgr2=0x7f8e400b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e3e59c700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e28004e70 0x7f8e400b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e3e59c700 1 -- 172.21.15.124:0/29572350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e4015a870 msgr2=0x7f8e4015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e3e59c700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e4015a870 0x7f8e4015ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e3e59c700 1 -- 172.21.15.124:0/29572350 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400c5800 con 0x7f8e400c5370 2023-10-06T04:57:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e3e59c700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e400c5370 0x7f8e4014b630 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8e34007110 tx=0x7f8e400cb6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e26ffd700 1 -- 172.21.15.124:0/29572350 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34018030 con 0x7f8e400c5370 2023-10-06T04:57:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e26ffd700 1 -- 172.21.15.124:0/29572350 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3400f670 con 0x7f8e400c5370 2023-10-06T04:57:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e26ffd700 1 -- 172.21.15.124:0/29572350 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400fa30 con 0x7f8e400c5370 2023-10-06T04:57:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e400c5ae0 con 0x7f8e400c5370 2023-10-06T04:57:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.703+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e400c60a0 con 0x7f8e400c5370 2023-10-06T04:57:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.704+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e400718b0 con 0x7f8e400c5370 2023-10-06T04:57:34.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.705+0000 7f8e26ffd700 1 -- 172.21.15.124:0/29572350 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e3401b070 con 0x7f8e400c5370 2023-10-06T04:57:34.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.706+0000 7f8e26ffd700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8e2c066f30 0x7f8e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.706+0000 7f8e26ffd700 1 -- 172.21.15.124:0/29572350 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8e34019070 con 0x7f8e400c5370 2023-10-06T04:57:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.707+0000 7f8e3ed9d700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8e2c066f30 0x7f8e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.707+0000 7f8e26ffd700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] conn(0x7f8e2c06d3a0 0x7f8e2c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.707+0000 7f8e26ffd700 1 -- 172.21.15.124:0/29572350 --> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e2c06fe80 con 0x7f8e2c06d3a0 2023-10-06T04:57:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.707+0000 7f8e26ffd700 1 -- 172.21.15.124:0/29572350 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e34086660 con 0x7f8e400c5370 2023-10-06T04:57:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.707+0000 7f8e3f59e700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] conn(0x7f8e2c06d3a0 0x7f8e2c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.707+0000 7f8e3ed9d700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8e2c066f30 0x7f8e2c0693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8e30007e40 tx=0x7f8e30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.708+0000 7f8e3f59e700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] conn(0x7f8e2c06d3a0 0x7f8e2c06f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:34.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.708+0000 7f8e26ffd700 1 -- 172.21.15.124:0/29572350 <== osd.0 v2:172.21.15.124:6808/114868 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8e2c06fe80 con 0x7f8e2c06d3a0 2023-10-06T04:57:34.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.723+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 --> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8e400c7fd0 con 0x7f8e2c06d3a0 2023-10-06T04:57:34.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.723+0000 7f8e26ffd700 1 -- 172.21.15.124:0/29572350 <== osd.0 v2:172.21.15.124:6808/114868 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8e400c7fd0 con 0x7f8e2c06d3a0 2023-10-06T04:57:34.726 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:57:34.726 INFO:teuthology.orchestra.run.smithi124.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:57:34.726 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:57:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.723+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] conn(0x7f8e2c06d3a0 msgr2=0x7f8e2c06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.723+0000 7f8e451ff700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:6808/114868,v1:172.21.15.124:6809/114868] conn(0x7f8e2c06d3a0 0x7f8e2c06f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.723+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8e2c066f30 msgr2=0x7f8e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.723+0000 7f8e451ff700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f8e2c066f30 0x7f8e2c0693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8e30007e40 tx=0x7f8e30009040 comp rx=0 tx=0).stop 2023-10-06T04:57:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.723+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e400c5370 msgr2=0x7f8e4014b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.723+0000 7f8e451ff700 1 --2- 172.21.15.124:0/29572350 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e400c5370 0x7f8e4014b630 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8e34007110 tx=0x7f8e400cb6e0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.724+0000 7f8e3f59e700 1 -- 172.21.15.124:0/29572350 reap_dead start 2023-10-06T04:57:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.724+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 shutdown_connections 2023-10-06T04:57:34.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.724+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 >> 172.21.15.124:0/29572350 conn(0x7f8e40068080 msgr2=0x7f8e40155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:34.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.724+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 shutdown_connections 2023-10-06T04:57:34.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.724+0000 7f8e451ff700 1 -- 172.21.15.124:0/29572350 wait complete. 2023-10-06T04:57:34.746 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T04:57:34.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.936+0000 7fef5f7ff700 1 Processor -- start 2023-10-06T04:57:34.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.936+0000 7fef5f7ff700 1 -- start start 2023-10-06T04:57:34.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.937+0000 7fef5f7ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fef5815c9d0 0x7fef580cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.937+0000 7fef5f7ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fef5815db70 0x7fef580cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.937+0000 7fef5f7ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef580cb4f0 con 0x7fef580cb090 2023-10-06T04:57:34.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.937+0000 7fef5f7ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef580cd800 con 0x7fef5815db70 2023-10-06T04:57:34.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.937+0000 7fef5f7ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef58063cd0 con 0x7fef5815c9d0 2023-10-06T04:57:34.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef5cd9a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fef5815db70 0x7fef580cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef5dd9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fef580cb090 0x7fef580c36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47612/0 (socket says 172.21.15.124:47612) 2023-10-06T04:57:34.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef5dd9c700 1 -- 172.21.15.124:0/2777631700 learned_addr learned my addr 172.21.15.124:0/2777631700 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:34.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef5d59b700 1 --2- 172.21.15.124:0/2777631700 >> v2:172.21.15.158:3300/0 conn(0x7fef5815c9d0 0x7fef580cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef5cd9a700 1 -- 172.21.15.124:0/2777631700 >> v2:172.21.15.158:3300/0 conn(0x7fef5815c9d0 msgr2=0x7fef580cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:34.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef5cd9a700 1 --2- 172.21.15.124:0/2777631700 >> v2:172.21.15.158:3300/0 conn(0x7fef5815c9d0 0x7fef580cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef5cd9a700 1 -- 172.21.15.124:0/2777631700 >> v1:172.21.15.124:6789/0 conn(0x7fef580cb090 legacy=0x7fef580c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef5cd9a700 1 -- 172.21.15.124:0/2777631700 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580cdc90 con 0x7fef5815db70 2023-10-06T04:57:34.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef4ffff700 1 -- 172.21.15.124:0/2777631700 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384309117 0 0) 0x7fef50001490 con 0x7fef580cb090 2023-10-06T04:57:34.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef5cd9a700 1 --2- 172.21.15.124:0/2777631700 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815db70 0x7fef580cab50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fef58088a40 tx=0x7fef480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8738fbe13f5f4849 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:34.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.938+0000 7fef4ffff700 1 -- 172.21.15.124:0/2777631700 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800b6b0 con 0x7fef5815db70 2023-10-06T04:57:34.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.939+0000 7fef4ffff700 1 -- 172.21.15.124:0/2777631700 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4800b810 con 0x7fef5815db70 2023-10-06T04:57:34.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.939+0000 7fef4ffff700 1 -- 172.21.15.124:0/2777631700 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800bbb0 con 0x7fef5815db70 2023-10-06T04:57:34.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.939+0000 7fef5f7ff700 1 -- 172.21.15.124:0/2777631700 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815db70 msgr2=0x7fef580cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.939+0000 7fef5f7ff700 1 --2- 172.21.15.124:0/2777631700 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815db70 0x7fef580cab50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fef58088a40 tx=0x7fef480091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.939+0000 7fef5f7ff700 1 -- 172.21.15.124:0/2777631700 shutdown_connections 2023-10-06T04:57:34.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.939+0000 7fef5f7ff700 1 --2- 172.21.15.124:0/2777631700 >> v2:172.21.15.158:3300/0 conn(0x7fef5815c9d0 0x7fef580cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.939+0000 7fef5f7ff700 1 --2- 172.21.15.124:0/2777631700 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815db70 0x7fef580cab50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.939+0000 7fef5f7ff700 1 -- 172.21.15.124:0/2777631700 >> 172.21.15.124:0/2777631700 conn(0x7fef58097520 msgr2=0x7fef58087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:34.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.939+0000 7fef5f7ff700 1 -- 172.21.15.124:0/2777631700 shutdown_connections 2023-10-06T04:57:34.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.939+0000 7fef5f7ff700 1 -- 172.21.15.124:0/2777631700 wait complete. 2023-10-06T04:57:34.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.941+0000 7fef5f7ff700 1 Processor -- start 2023-10-06T04:57:34.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.941+0000 7fef5f7ff700 1 -- start start 2023-10-06T04:57:34.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5f7ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef580cb090 0x7fef580af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5f7ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815c9d0 0x7fef5814b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5f7ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef5815db70 0x7fef58148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5f7ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580afe30 con 0x7fef5815c9d0 2023-10-06T04:57:34.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5f7ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef581491f0 con 0x7fef5815db70 2023-10-06T04:57:34.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5f7ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef581494d0 con 0x7fef580cb090 2023-10-06T04:57:34.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5cd9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815c9d0 0x7fef5814b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5cd9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815c9d0 0x7fef5814b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57248/0 (socket says 172.21.15.124:57248) 2023-10-06T04:57:34.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5cd9a700 1 -- 172.21.15.124:0/1181919184 learned_addr learned my addr 172.21.15.124:0/1181919184 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5dd9c700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef5815db70 0x7fef58148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5d59b700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef580cb090 0x7fef580af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5cd9a700 1 -- 172.21.15.124:0/1181919184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef580cb090 msgr2=0x7fef580af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5cd9a700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef580cb090 0x7fef580af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5cd9a700 1 -- 172.21.15.124:0/1181919184 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef5815db70 msgr2=0x7fef58148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5cd9a700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef5815db70 0x7fef58148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.942+0000 7fef5cd9a700 1 -- 172.21.15.124:0/1181919184 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009420 con 0x7fef5815c9d0 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.943+0000 7fef5cd9a700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815c9d0 0x7fef5814b300 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fef5806ec00 tx=0x7fef48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.943+0000 7fef4d7fa700 1 -- 172.21.15.124:0/1181919184 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48000d10 con 0x7fef5815c9d0 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.943+0000 7fef4d7fa700 1 -- 172.21.15.124:0/1181919184 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4800bb90 con 0x7fef5815c9d0 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.943+0000 7fef5f7ff700 1 -- 172.21.15.124:0/1181919184 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef581497b0 con 0x7fef5815c9d0 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.943+0000 7fef4d7fa700 1 -- 172.21.15.124:0/1181919184 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011670 con 0x7fef5815c9d0 2023-10-06T04:57:34.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.943+0000 7fef5f7ff700 1 -- 172.21.15.124:0/1181919184 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef58149d70 con 0x7fef5815c9d0 2023-10-06T04:57:34.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.944+0000 7fef5f7ff700 1 -- 172.21.15.124:0/1181919184 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef58149f60 con 0x7fef5815c9d0 2023-10-06T04:57:34.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.945+0000 7fef4d7fa700 1 -- 172.21.15.124:0/1181919184 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef48011aa0 con 0x7fef5815c9d0 2023-10-06T04:57:34.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.946+0000 7fef4d7fa700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef3c066f30 0x7fef3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:34.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.946+0000 7fef4d7fa700 1 -- 172.21.15.124:0/1181919184 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fef48085d60 con 0x7fef5815c9d0 2023-10-06T04:57:34.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.947+0000 7fef5d59b700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef3c066f30 0x7fef3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:34.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.947+0000 7fef5d59b700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef3c066f30 0x7fef3c0693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fef54006aa0 tx=0x7fef54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:34.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:34.951+0000 7fef4d7fa700 1 -- 172.21.15.124:0/1181919184 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef480530d0 con 0x7fef5815c9d0 2023-10-06T04:57:35.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.144+0000 7fef5f7ff700 1 -- 172.21.15.124:0/1181919184 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fef580717a0 con 0x7fef3c066f30 2023-10-06T04:57:35.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.144+0000 7fef4d7fa700 1 -- 172.21.15.124:0/1181919184 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fef580717a0 con 0x7fef3c066f30 2023-10-06T04:57:35.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.146+0000 7fef5f7ff700 1 -- 172.21.15.124:0/1181919184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef3c066f30 msgr2=0x7fef3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.146+0000 7fef5f7ff700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef3c066f30 0x7fef3c0693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fef54006aa0 tx=0x7fef54008040 comp rx=0 tx=0).stop 2023-10-06T04:57:35.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.146+0000 7fef5f7ff700 1 -- 172.21.15.124:0/1181919184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815c9d0 msgr2=0x7fef5814b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.146+0000 7fef5f7ff700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815c9d0 0x7fef5814b300 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fef5806ec00 tx=0x7fef48017000 comp rx=0 tx=0).stop 2023-10-06T04:57:35.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.146+0000 7fef5f7ff700 1 -- 172.21.15.124:0/1181919184 shutdown_connections 2023-10-06T04:57:35.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.146+0000 7fef5f7ff700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef5815db70 0x7fef58148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.146+0000 7fef5f7ff700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fef3c066f30 0x7fef3c0693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.146+0000 7fef5f7ff700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef580cb090 0x7fef580af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.146+0000 7fef5f7ff700 1 --2- 172.21.15.124:0/1181919184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef5815c9d0 0x7fef5814b300 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.147+0000 7fef5f7ff700 1 -- 172.21.15.124:0/1181919184 >> 172.21.15.124:0/1181919184 conn(0x7fef58097520 msgr2=0x7fef58159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:35.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.147+0000 7fef5f7ff700 1 -- 172.21.15.124:0/1181919184 shutdown_connections 2023-10-06T04:57:35.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.147+0000 7fef5f7ff700 1 -- 172.21.15.124:0/1181919184 wait complete. 2023-10-06T04:57:35.150 INFO:teuthology.orchestra.run.smithi124.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T04:57:35.167 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T04:57:35.167 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:57:35.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.359+0000 7f01701ff700 1 Processor -- start 2023-10-06T04:57:35.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.359+0000 7f01701ff700 1 -- start start 2023-10-06T04:57:35.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.360+0000 7f01701ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f01680af990 0x7f01680b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.360+0000 7f01701ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01681566b0 0x7f01680accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.360+0000 7f01701ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01680ccfe0 con 0x7f01681562e0 2023-10-06T04:57:35.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.360+0000 7f01701ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01680b0a30 con 0x7f01680af990 2023-10-06T04:57:35.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.360+0000 7f01701ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680afe20 con 0x7f01681566b0 2023-10-06T04:57:35.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.360+0000 7f016df9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f01681562e0 0x7f01680cc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47630/0 (socket says 172.21.15.124:47630) 2023-10-06T04:57:35.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.360+0000 7f016df9b700 1 -- 172.21.15.124:0/822654543 learned_addr learned my addr 172.21.15.124:0/822654543 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:35.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016e79c700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01681566b0 0x7f01680accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016d79a700 1 --2- 172.21.15.124:0/822654543 >> v2:172.21.15.158:3300/0 conn(0x7f01680af990 0x7f01680b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139370076 0 0) 0x7f01680ccfe0 con 0x7f01681562e0 2023-10-06T04:57:35.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0154003570 con 0x7f01681562e0 2023-10-06T04:57:35.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88987360 0 0) 0x7f0154003570 con 0x7f01681562e0 2023-10-06T04:57:35.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01681566b0 msgr2=0x7f01680accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:35.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01681566b0 0x7f01680accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 >> v2:172.21.15.158:3300/0 conn(0x7f01680af990 msgr2=0x7f01680b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:35.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 --2- 172.21.15.124:0/822654543 >> v2:172.21.15.158:3300/0 conn(0x7f01680af990 0x7f01680b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680b0100 con 0x7f01681562e0 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7f0164001470 con 0x7f01681562e0 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 >> v1:172.21.15.124:6789/0 conn(0x7f01681562e0 legacy=0x7f01680cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01681566b0 0x7f0154003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0154003fe0 0x7f0154004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 0x7f01540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680b0a30 con 0x7f0154004d50 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680afe20 con 0x7f0154003fe0 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015400dca0 con 0x7f01681566b0 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.361+0000 7f016d79a700 1 --2- 172.21.15.124:0/822654543 >> v2:172.21.15.158:3300/0 conn(0x7f01680af990 0x7f01680b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016e79c700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 0x7f01540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016df9b700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01681566b0 0x7f0154003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016d79a700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0154003fe0 0x7f0154004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016e79c700 1 -- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01681566b0 msgr2=0x7f0154003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016e79c700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01681566b0 0x7f0154003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016e79c700 1 -- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0154003fe0 msgr2=0x7f0154004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016e79c700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0154003fe0 0x7f0154004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016e79c700 1 -- 172.21.15.124:0/822654543 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0154003570 con 0x7f0154004d50 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016e79c700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 0x7f01540051c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f016000e210 tx=0x7f016000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be5288573fbbe02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016000ea60 con 0x7f0154004d50 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016000f040 con 0x7f0154004d50 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.362+0000 7f016cf99700 1 -- 172.21.15.124:0/822654543 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016000ee10 con 0x7f0154004d50 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.363+0000 7f01701ff700 1 -- 172.21.15.124:0/822654543 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 msgr2=0x7f01540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.363+0000 7f01701ff700 1 --2- 172.21.15.124:0/822654543 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 0x7f01540051c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f016000e210 tx=0x7f016000b040 comp rx=0 tx=0).stop 2023-10-06T04:57:35.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.363+0000 7f016e79c700 1 -- 172.21.15.124:0/822654543 reap_dead start 2023-10-06T04:57:35.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.363+0000 7f01701ff700 1 -- 172.21.15.124:0/822654543 shutdown_connections 2023-10-06T04:57:35.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.363+0000 7f01701ff700 1 -- 172.21.15.124:0/822654543 >> 172.21.15.124:0/822654543 conn(0x7f0168068080 msgr2=0x7f01680cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:35.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.363+0000 7f01701ff700 1 -- 172.21.15.124:0/822654543 shutdown_connections 2023-10-06T04:57:35.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.363+0000 7f01701ff700 1 -- 172.21.15.124:0/822654543 wait complete. 2023-10-06T04:57:35.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.364+0000 7f01701ff700 1 Processor -- start 2023-10-06T04:57:35.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.364+0000 7f01701ff700 1 -- start start 2023-10-06T04:57:35.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.365+0000 7f01701ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 0x7f01680ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.365+0000 7f01701ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01680abb50 0x7f0168166110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.365+0000 7f01701ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0168155580 0x7f0168157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.365+0000 7f01701ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680acd20 con 0x7f0154004d50 2023-10-06T04:57:35.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.365+0000 7f01701ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0168166650 con 0x7f01680abb50 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.365+0000 7f01701ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680ac110 con 0x7f0168155580 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016df9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 0x7f01680ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016df9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 0x7f01680ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57266/0 (socket says 172.21.15.124:57266) 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016df9b700 1 -- 172.21.15.124:0/2616225467 learned_addr learned my addr 172.21.15.124:0/2616225467 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016d79a700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01680abb50 0x7f0168166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016e79c700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0168155580 0x7f0168157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016df9b700 1 -- 172.21.15.124:0/2616225467 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0168155580 msgr2=0x7f0168157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016df9b700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0168155580 0x7f0168157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016df9b700 1 -- 172.21.15.124:0/2616225467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01680abb50 msgr2=0x7f0168166110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016df9b700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01680abb50 0x7f0168166110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016df9b700 1 -- 172.21.15.124:0/2616225467 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680ac3f0 con 0x7f0154004d50 2023-10-06T04:57:35.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f016df9b700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 0x7f01680ad1b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0164001d20 tx=0x7f0164001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:35.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f015dffb700 1 -- 172.21.15.124:0/2616225467 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164018030 con 0x7f0154004d50 2023-10-06T04:57:35.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.366+0000 7f015dffb700 1 -- 172.21.15.124:0/2616225467 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016400f8a0 con 0x7f0154004d50 2023-10-06T04:57:35.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.367+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01680ac6d0 con 0x7f0154004d50 2023-10-06T04:57:35.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.367+0000 7f015dffb700 1 -- 172.21.15.124:0/2616225467 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016400fc40 con 0x7f0154004d50 2023-10-06T04:57:35.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.367+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01681559f0 con 0x7f0154004d50 2023-10-06T04:57:35.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.367+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01680718b0 con 0x7f0154004d50 2023-10-06T04:57:35.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.369+0000 7f015dffb700 1 -- 172.21.15.124:0/2616225467 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f016401b070 con 0x7f0154004d50 2023-10-06T04:57:35.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.369+0000 7f015dffb700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f014c066f60 0x7f014c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.370+0000 7f015dffb700 1 -- 172.21.15.124:0/2616225467 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0164019070 con 0x7f0154004d50 2023-10-06T04:57:35.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.370+0000 7f016d79a700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f014c066f60 0x7f014c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.370+0000 7f015dffb700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] conn(0x7f014c06d3d0 0x7f014c06f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.370+0000 7f015dffb700 1 -- 172.21.15.124:0/2616225467 --> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f014c06feb0 con 0x7f014c06d3d0 2023-10-06T04:57:35.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.370+0000 7f015dffb700 1 -- 172.21.15.124:0/2616225467 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0164084f80 con 0x7f0154004d50 2023-10-06T04:57:35.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.370+0000 7f016e79c700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] conn(0x7f014c06d3d0 0x7f014c06f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.370+0000 7f016d79a700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f014c066f60 0x7f014c069410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f01580093f0 tx=0x7f0158008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:35.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.370+0000 7f016e79c700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] conn(0x7f014c06d3d0 0x7f014c06f7e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:35.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.371+0000 7f015dffb700 1 -- 172.21.15.124:0/2616225467 <== osd.1 v2:172.21.15.124:6800/114871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f014c06feb0 con 0x7f014c06d3d0 2023-10-06T04:57:35.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.385+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 --> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f01680b03e0 con 0x7f014c06d3d0 2023-10-06T04:57:35.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.386+0000 7f015dffb700 1 -- 172.21.15.124:0/2616225467 <== osd.1 v2:172.21.15.124:6800/114871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f01680b03e0 con 0x7f014c06d3d0 2023-10-06T04:57:35.388 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:57:35.389 INFO:teuthology.orchestra.run.smithi124.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:57:35.389 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:57:35.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.386+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] conn(0x7f014c06d3d0 msgr2=0x7f014c06f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.386+0000 7f01701ff700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:6800/114871,v1:172.21.15.124:6801/114871] conn(0x7f014c06d3d0 0x7f014c06f7e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.386+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f014c066f60 msgr2=0x7f014c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.386+0000 7f01701ff700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f014c066f60 0x7f014c069410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f01580093f0 tx=0x7f0158008040 comp rx=0 tx=0).stop 2023-10-06T04:57:35.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.386+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 msgr2=0x7f01680ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.386+0000 7f01701ff700 1 --2- 172.21.15.124:0/2616225467 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0154004d50 0x7f01680ad1b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0164001d20 tx=0x7f0164001e90 comp rx=0 tx=0).stop 2023-10-06T04:57:35.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.386+0000 7f016e79c700 1 -- 172.21.15.124:0/2616225467 reap_dead start 2023-10-06T04:57:35.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.386+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 shutdown_connections 2023-10-06T04:57:35.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.386+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 >> 172.21.15.124:0/2616225467 conn(0x7f0168068080 msgr2=0x7f01680c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:35.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.387+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 shutdown_connections 2023-10-06T04:57:35.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.387+0000 7f01701ff700 1 -- 172.21.15.124:0/2616225467 wait complete. 2023-10-06T04:57:35.406 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T04:57:35.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.594+0000 7f9f07fff700 1 Processor -- start 2023-10-06T04:57:35.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.594+0000 7f9f07fff700 1 -- start start 2023-10-06T04:57:35.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.595+0000 7f9f07fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9f0015c9d0 0x7f9f000cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.595+0000 7f9f07fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f000cd800 con 0x7f9f0015db70 2023-10-06T04:57:35.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.595+0000 7f9f07fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f00063cd0 con 0x7f9f000cb260 2023-10-06T04:57:35.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.595+0000 7f9f07fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f000cdc90 con 0x7f9f0015c9d0 2023-10-06T04:57:35.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.595+0000 7f9f0559a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f9f0015db70 0x7f9f000cab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47642/0 (socket says 172.21.15.124:47642) 2023-10-06T04:57:35.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.595+0000 7f9f0559a700 1 -- 172.21.15.124:0/2581018648 learned_addr learned my addr 172.21.15.124:0/2581018648 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:35.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.595+0000 7f9f05d9b700 1 --2- 172.21.15.124:0/2581018648 >> v2:172.21.15.124:3300/0 conn(0x7f9f0015c9d0 0x7f9f000cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.596+0000 7f9f04d99700 1 -- 172.21.15.124:0/2581018648 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101305219 0 0) 0x7f9f000cd800 con 0x7f9f0015db70 2023-10-06T04:57:35.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.596+0000 7f9f04d99700 1 -- 172.21.15.124:0/2581018648 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eec003570 con 0x7f9f0015db70 2023-10-06T04:57:35.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.596+0000 7f9f05d9b700 1 -- 172.21.15.124:0/2581018648 >> v1:172.21.15.158:6789/0 conn(0x7f9f000cb260 legacy=0x7f9f000c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.596+0000 7f9f05d9b700 1 -- 172.21.15.124:0/2581018648 >> v1:172.21.15.124:6789/0 conn(0x7f9f0015db70 legacy=0x7f9f000cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.596+0000 7f9f05d9b700 1 -- 172.21.15.124:0/2581018648 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0015e010 con 0x7f9f0015c9d0 2023-10-06T04:57:35.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.596+0000 7f9f05d9b700 1 --2- 172.21.15.124:0/2581018648 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 0x7f9f000cc610 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0098d0 tx=0x7f9efc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc96da82756f63fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:35.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.596+0000 7f9f04d99700 1 -- 172.21.15.124:0/2581018648 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc005c10 con 0x7f9f0015c9d0 2023-10-06T04:57:35.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.596+0000 7f9f04d99700 1 -- 172.21.15.124:0/2581018648 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc005d70 con 0x7f9f0015c9d0 2023-10-06T04:57:35.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.596+0000 7f9f04d99700 1 -- 172.21.15.124:0/2581018648 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc006280 con 0x7f9f0015c9d0 2023-10-06T04:57:35.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.597+0000 7f9f07fff700 1 -- 172.21.15.124:0/2581018648 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 msgr2=0x7f9f000cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.597+0000 7f9f07fff700 1 --2- 172.21.15.124:0/2581018648 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 0x7f9f000cc610 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0098d0 tx=0x7f9efc009120 comp rx=0 tx=0).stop 2023-10-06T04:57:35.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.597+0000 7f9f07fff700 1 -- 172.21.15.124:0/2581018648 shutdown_connections 2023-10-06T04:57:35.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.597+0000 7f9f07fff700 1 --2- 172.21.15.124:0/2581018648 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 0x7f9f000cc610 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.597+0000 7f9f07fff700 1 -- 172.21.15.124:0/2581018648 >> 172.21.15.124:0/2581018648 conn(0x7f9f00097520 msgr2=0x7f9f00087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:35.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.597+0000 7f9f07fff700 1 -- 172.21.15.124:0/2581018648 shutdown_connections 2023-10-06T04:57:35.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.597+0000 7f9f07fff700 1 -- 172.21.15.124:0/2581018648 wait complete. 2023-10-06T04:57:35.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.599+0000 7f9f07fff700 1 Processor -- start 2023-10-06T04:57:35.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.599+0000 7f9f07fff700 1 -- start start 2023-10-06T04:57:35.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f07fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f000cb260 0x7f9f00098da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f07fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 0x7f9f0009b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f07fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f0015db70 0x7f9f0009a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f07fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00099f90 con 0x7f9f0015c9d0 2023-10-06T04:57:35.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f07fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00099380 con 0x7f9f000cb260 2023-10-06T04:57:35.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f07fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00099660 con 0x7f9f0015db70 2023-10-06T04:57:35.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f0559a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 0x7f9f0009b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f0559a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 0x7f9f0009b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57282/0 (socket says 172.21.15.124:57282) 2023-10-06T04:57:35.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f0559a700 1 -- 172.21.15.124:0/2026821729 learned_addr learned my addr 172.21.15.124:0/2026821729 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:35.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f0659c700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f0015db70 0x7f9f0009a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f05d9b700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f000cb260 0x7f9f00098da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f0559a700 1 -- 172.21.15.124:0/2026821729 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f0015db70 msgr2=0x7f9f0009a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f0559a700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f0015db70 0x7f9f0009a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f0559a700 1 -- 172.21.15.124:0/2026821729 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f000cb260 msgr2=0x7f9f00098da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f0559a700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f000cb260 0x7f9f00098da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f0559a700 1 -- 172.21.15.124:0/2026821729 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc0093c0 con 0x7f9f0015c9d0 2023-10-06T04:57:35.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.600+0000 7f9f0559a700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 0x7f9f0009b910 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9ef000c590 tx=0x7f9ef0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:35.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.601+0000 7f9ef5ffb700 1 -- 172.21.15.124:0/2026821729 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0005b30 con 0x7f9f0015c9d0 2023-10-06T04:57:35.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.601+0000 7f9ef5ffb700 1 -- 172.21.15.124:0/2026821729 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef0005cb0 con 0x7f9f0015c9d0 2023-10-06T04:57:35.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.601+0000 7f9ef5ffb700 1 -- 172.21.15.124:0/2026821729 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0007320 con 0x7f9f0015c9d0 2023-10-06T04:57:35.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.601+0000 7f9f07fff700 1 -- 172.21.15.124:0/2026821729 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f00099940 con 0x7f9f0015c9d0 2023-10-06T04:57:35.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.601+0000 7f9f07fff700 1 -- 172.21.15.124:0/2026821729 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0009be50 con 0x7f9f0015c9d0 2023-10-06T04:57:35.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.602+0000 7f9f07fff700 1 -- 172.21.15.124:0/2026821729 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0009a140 con 0x7f9f0015c9d0 2023-10-06T04:57:35.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.603+0000 7f9ef5ffb700 1 -- 172.21.15.124:0/2026821729 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ef001b3b0 con 0x7f9f0015c9d0 2023-10-06T04:57:35.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.603+0000 7f9ef5ffb700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9ee4066f30 0x7f9ee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:35.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.604+0000 7f9ef5ffb700 1 -- 172.21.15.124:0/2026821729 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9ef0083a50 con 0x7f9f0015c9d0 2023-10-06T04:57:35.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.604+0000 7f9f05d9b700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9ee4066f30 0x7f9ee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:35.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.604+0000 7f9f05d9b700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9ee4066f30 0x7f9ee40693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009390 tx=0x7f9efc016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:35.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.607+0000 7f9ef5ffb700 1 -- 172.21.15.124:0/2026821729 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f0009a140 con 0x7f9f0015c9d0 2023-10-06T04:57:35.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.797+0000 7f9f07fff700 1 -- 172.21.15.124:0/2026821729 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f000717a0 con 0x7f9ee4066f30 2023-10-06T04:57:35.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.797+0000 7f9ef5ffb700 1 -- 172.21.15.124:0/2026821729 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9f000717a0 con 0x7f9ee4066f30 2023-10-06T04:57:35.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.799+0000 7f9f07fff700 1 -- 172.21.15.124:0/2026821729 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9ee4066f30 msgr2=0x7f9ee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.799+0000 7f9f07fff700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9ee4066f30 0x7f9ee40693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009390 tx=0x7f9efc016000 comp rx=0 tx=0).stop 2023-10-06T04:57:35.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.799+0000 7f9f07fff700 1 -- 172.21.15.124:0/2026821729 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 msgr2=0x7f9f0009b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:35.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.799+0000 7f9f07fff700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 0x7f9f0009b910 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9ef000c590 tx=0x7f9ef0007e00 comp rx=0 tx=0).stop 2023-10-06T04:57:35.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.799+0000 7f9f07fff700 1 -- 172.21.15.124:0/2026821729 shutdown_connections 2023-10-06T04:57:35.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.799+0000 7f9f07fff700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9ee4066f30 0x7f9ee40693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.799+0000 7f9f07fff700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f0015db70 0x7f9f0009a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.799+0000 7f9f07fff700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f000cb260 0x7f9f00098da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.799+0000 7f9f07fff700 1 --2- 172.21.15.124:0/2026821729 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9f0015c9d0 0x7f9f0009b910 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:35.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.799+0000 7f9f07fff700 1 -- 172.21.15.124:0/2026821729 >> 172.21.15.124:0/2026821729 conn(0x7f9f00097520 msgr2=0x7f9f00068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:35.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.800+0000 7f9f07fff700 1 -- 172.21.15.124:0/2026821729 shutdown_connections 2023-10-06T04:57:35.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:35.800+0000 7f9f07fff700 1 -- 172.21.15.124:0/2026821729 wait complete. 2023-10-06T04:57:35.803 INFO:teuthology.orchestra.run.smithi124.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T04:57:35.820 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T04:57:35.820 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:57:36.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.010+0000 7fe1dbdff700 1 Processor -- start 2023-10-06T04:57:36.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.011+0000 7fe1dbdff700 1 -- start start 2023-10-06T04:57:36.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.012+0000 7fe1dbdff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe1d40cd410 0x7fe1d40b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.012+0000 7fe1dbdff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d40b11a0 con 0x7fe1d40cd040 2023-10-06T04:57:36.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.012+0000 7fe1dbdff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d415d970 con 0x7fe1d4159b90 2023-10-06T04:57:36.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.012+0000 7fe1dbdff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d415dc50 con 0x7fe1d40cd410 2023-10-06T04:57:36.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.012+0000 7fe1d9b9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fe1d40cd040 0x7fe1d4159480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47650/0 (socket says 172.21.15.124:47650) 2023-10-06T04:57:36.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.012+0000 7fe1d9b9b700 1 -- 172.21.15.124:0/3569945917 learned_addr learned my addr 172.21.15.124:0/3569945917 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:36.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.012+0000 7fe1da39c700 1 --2- 172.21.15.124:0/3569945917 >> v2:172.21.15.158:3300/0 conn(0x7fe1d40cd410 0x7fe1d40b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.012+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047556169 0 0) 0x7fe1d40b11a0 con 0x7fe1d40cd040 2023-10-06T04:57:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.012+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1c0003570 con 0x7fe1d40cd040 2023-10-06T04:57:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726980062 0 0) 0x7fe1d415d970 con 0x7fe1d4159b90 2023-10-06T04:57:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d40b11a0 con 0x7fe1d4159b90 2023-10-06T04:57:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1371230766 0 0) 0x7fe1c0003570 con 0x7fe1d40cd040 2023-10-06T04:57:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 >> v2:172.21.15.158:3300/0 conn(0x7fe1d40cd410 msgr2=0x7fe1d40b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 --2- 172.21.15.124:0/3569945917 >> v2:172.21.15.158:3300/0 conn(0x7fe1d40cd410 0x7fe1d40b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 >> v1:172.21.15.158:6789/0 conn(0x7fe1d4159b90 legacy=0x7fe1d40cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d415df30 con 0x7fe1d40cd040 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fe1d0001470 con 0x7fe1d40cd040 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 >> v1:172.21.15.124:6789/0 conn(0x7fe1d40cd040 legacy=0x7fe1d4159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 0x7fe1c0004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1c0004810 0x7fe1c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1c0005210 0x7fe1c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d415dc50 con 0x7fe1c0003c40 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c000c130 con 0x7fe1c0004810 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c000c2f0 con 0x7fe1c0005210 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1da39c700 1 --2- 172.21.15.124:0/3569945917 >> v2:172.21.15.158:3300/0 conn(0x7fe1d40cd410 0x7fe1d40b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d9b9b700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 0x7fe1c0004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.013+0000 7fe1d939a700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1c0004810 0x7fe1c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1da39c700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1c0005210 0x7fe1c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1d9b9b700 1 -- 172.21.15.124:0/3569945917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1c0005210 msgr2=0x7fe1c000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1d9b9b700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1c0005210 0x7fe1c000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1d9b9b700 1 -- 172.21.15.124:0/3569945917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1c0004810 msgr2=0x7fe1c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1d9b9b700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1c0004810 0x7fe1c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1d9b9b700 1 -- 172.21.15.124:0/3569945917 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0003570 con 0x7fe1c0003c40 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1da39c700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1c0005210 0x7fe1c000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1da39c700 1 -- 172.21.15.124:0/3569945917 reap_dead start 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1d9b9b700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 0x7fe1c0004050 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c1e0 tx=0x7fe1d415e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d90cd63a4fcd77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000cb10 con 0x7fe1c0003c40 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d000cc90 con 0x7fe1c0003c40 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1d8b99700 1 -- 172.21.15.124:0/3569945917 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0005b70 con 0x7fe1c0003c40 2023-10-06T04:57:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1dbdff700 1 -- 172.21.15.124:0/3569945917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 msgr2=0x7fe1c0004050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.014+0000 7fe1dbdff700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 0x7fe1c0004050 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c1e0 tx=0x7fe1d415e4f0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.015+0000 7fe1dbdff700 1 -- 172.21.15.124:0/3569945917 shutdown_connections 2023-10-06T04:57:36.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.015+0000 7fe1dbdff700 1 --2- 172.21.15.124:0/3569945917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 0x7fe1c0004050 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.015+0000 7fe1dbdff700 1 -- 172.21.15.124:0/3569945917 >> 172.21.15.124:0/3569945917 conn(0x7fe1d406ed20 msgr2=0x7fe1d406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:36.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.015+0000 7fe1dbdff700 1 -- 172.21.15.124:0/3569945917 shutdown_connections 2023-10-06T04:57:36.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.015+0000 7fe1dbdff700 1 -- 172.21.15.124:0/3569945917 wait complete. 2023-10-06T04:57:36.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.016+0000 7fe1dbdff700 1 Processor -- start 2023-10-06T04:57:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.016+0000 7fe1dbdff700 1 -- start start 2023-10-06T04:57:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.017+0000 7fe1dbdff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 0x7fe1d4158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.017+0000 7fe1dbdff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1d40c8020 0x7fe1d40c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.017+0000 7fe1dbdff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1d416d4f0 0x7fe1d416d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.017+0000 7fe1dbdff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d40c94a0 con 0x7fe1c0003c40 2023-10-06T04:57:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.017+0000 7fe1dbdff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4167b30 con 0x7fe1d416d4f0 2023-10-06T04:57:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.017+0000 7fe1dbdff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d40c89d0 con 0x7fe1d40c8020 2023-10-06T04:57:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.017+0000 7fe1d9b9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 0x7fe1d4158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1d9b9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 0x7fe1d4158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57306/0 (socket says 172.21.15.124:57306) 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1d9b9b700 1 -- 172.21.15.124:0/692386746 learned_addr learned my addr 172.21.15.124:0/692386746 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1da39c700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1d416d4f0 0x7fe1d416d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1d939a700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1d40c8020 0x7fe1d40c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1d9b9b700 1 -- 172.21.15.124:0/692386746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1d40c8020 msgr2=0x7fe1d40c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1d9b9b700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1d40c8020 0x7fe1d40c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1d9b9b700 1 -- 172.21.15.124:0/692386746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1d416d4f0 msgr2=0x7fe1d416d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1d9b9b700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1d416d4f0 0x7fe1d416d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1d9b9b700 1 -- 172.21.15.124:0/692386746 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d415cde0 con 0x7fe1c0003c40 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1d9b9b700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 0x7fe1d4158240 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00057d0 tx=0x7fe1d0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1c9ffb700 1 -- 172.21.15.124:0/692386746 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0001720 con 0x7fe1c0003c40 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1c9ffb700 1 -- 172.21.15.124:0/692386746 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d00070d0 con 0x7fe1c0003c40 2023-10-06T04:57:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1c9ffb700 1 -- 172.21.15.124:0/692386746 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0007450 con 0x7fe1c0003c40 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.018+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d40c8c00 con 0x7fe1c0003c40 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.019+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d40c91c0 con 0x7fe1c0003c40 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.019+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1d40718b0 con 0x7fe1c0003c40 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.020+0000 7fe1c9ffb700 1 -- 172.21.15.124:0/692386746 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1d0019070 con 0x7fe1c0003c40 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.021+0000 7fe1c9ffb700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe1b8066f30 0x7fe1b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.021+0000 7fe1c9ffb700 1 -- 172.21.15.124:0/692386746 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fe1d00856e0 con 0x7fe1c0003c40 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.021+0000 7fe1d939a700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe1b8066f30 0x7fe1b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.021+0000 7fe1c9ffb700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] conn(0x7fe1b806d3a0 0x7fe1b806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.021+0000 7fe1c9ffb700 1 -- 172.21.15.124:0/692386746 --> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1b806fe80 con 0x7fe1b806d3a0 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.021+0000 7fe1c9ffb700 1 -- 172.21.15.124:0/692386746 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1d0087be0 con 0x7fe1c0003c40 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.022+0000 7fe1da39c700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] conn(0x7fe1b806d3a0 0x7fe1b806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.022+0000 7fe1d939a700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe1b8066f30 0x7fe1b80693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40cad10 tx=0x7fe1c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.022+0000 7fe1da39c700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] conn(0x7fe1b806d3a0 0x7fe1b806f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.023+0000 7fe1c9ffb700 1 -- 172.21.15.124:0/692386746 <== osd.2 v2:172.21.15.124:6816/114869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe1b806fe80 con 0x7fe1b806d3a0 2023-10-06T04:57:36.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.037+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 --> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe1d416dec0 con 0x7fe1b806d3a0 2023-10-06T04:57:36.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1c9ffb700 1 -- 172.21.15.124:0/692386746 <== osd.2 v2:172.21.15.124:6816/114869 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe1d416dec0 con 0x7fe1b806d3a0 2023-10-06T04:57:36.041 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:57:36.041 INFO:teuthology.orchestra.run.smithi124.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:57:36.041 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:57:36.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] conn(0x7fe1b806d3a0 msgr2=0x7fe1b806f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1dbdff700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:6816/114869,v1:172.21.15.124:6817/114869] conn(0x7fe1b806d3a0 0x7fe1b806f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe1b8066f30 msgr2=0x7fe1b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1dbdff700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fe1b8066f30 0x7fe1b80693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40cad10 tx=0x7fe1c4009040 comp rx=0 tx=0).stop 2023-10-06T04:57:36.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 msgr2=0x7fe1d4158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1dbdff700 1 --2- 172.21.15.124:0/692386746 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1c0003c40 0x7fe1d4158240 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00057d0 tx=0x7fe1d0015000 comp rx=0 tx=0).stop 2023-10-06T04:57:36.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1da39c700 1 -- 172.21.15.124:0/692386746 reap_dead start 2023-10-06T04:57:36.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 shutdown_connections 2023-10-06T04:57:36.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 >> 172.21.15.124:0/692386746 conn(0x7fe1d406ed20 msgr2=0x7fe1d4158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:36.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 shutdown_connections 2023-10-06T04:57:36.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.038+0000 7fe1dbdff700 1 -- 172.21.15.124:0/692386746 wait complete. 2023-10-06T04:57:36.058 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T04:57:36.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.248+0000 7f92723ff700 1 Processor -- start 2023-10-06T04:57:36.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.248+0000 7f92723ff700 1 -- start start 2023-10-06T04:57:36.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.249+0000 7f92723ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f926c15c9d0 0x7f926c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.249+0000 7f92723ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f926c15db70 0x7f926c0cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.249+0000 7f92723ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0cb4f0 con 0x7f926c0cb090 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.249+0000 7f92723ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926c0cd800 con 0x7f926c15c9d0 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.249+0000 7f92723ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926c063cd0 con 0x7f926c15db70 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.250+0000 7f927099c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f926c0cb090 0x7f926c0c36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47658/0 (socket says 172.21.15.124:47658) 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.250+0000 7f927099c700 1 -- 172.21.15.124:0/570487103 learned_addr learned my addr 172.21.15.124:0/570487103 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.250+0000 7f926bfff700 1 --2- 172.21.15.124:0/570487103 >> v2:172.21.15.124:3300/0 conn(0x7f926c15c9d0 0x7f926c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.250+0000 7f926b7fe700 1 --2- 172.21.15.124:0/570487103 >> v2:172.21.15.158:3300/0 conn(0x7f926c15db70 0x7f926c0cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.250+0000 7f926affd700 1 -- 172.21.15.124:0/570487103 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314370584 0 0) 0x7f9264001490 con 0x7f926c0cb090 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.250+0000 7f926affd700 1 -- 172.21.15.124:0/570487103 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9254003570 con 0x7f926c0cb090 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.250+0000 7f926bfff700 1 -- 172.21.15.124:0/570487103 >> v2:172.21.15.158:3300/0 conn(0x7f926c15db70 msgr2=0x7f926c0cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.250+0000 7f926bfff700 1 --2- 172.21.15.124:0/570487103 >> v2:172.21.15.158:3300/0 conn(0x7f926c15db70 0x7f926c0cab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.250+0000 7f926bfff700 1 -- 172.21.15.124:0/570487103 >> v1:172.21.15.124:6789/0 conn(0x7f926c0cb090 legacy=0x7f926c0c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.250+0000 7f926bfff700 1 -- 172.21.15.124:0/570487103 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c0cdc90 con 0x7f926c15c9d0 2023-10-06T04:57:36.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f926bfff700 1 --2- 172.21.15.124:0/570487103 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c15c9d0 0x7f926c0cc610 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f926c06f0a0 tx=0x7f925c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a29b3b64736623 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f926affd700 1 -- 172.21.15.124:0/570487103 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c005c10 con 0x7f926c15c9d0 2023-10-06T04:57:36.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f926affd700 1 -- 172.21.15.124:0/570487103 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c005d70 con 0x7f926c15c9d0 2023-10-06T04:57:36.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f926affd700 1 -- 172.21.15.124:0/570487103 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c006260 con 0x7f926c15c9d0 2023-10-06T04:57:36.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f92723ff700 1 -- 172.21.15.124:0/570487103 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c15c9d0 msgr2=0x7f926c0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f92723ff700 1 --2- 172.21.15.124:0/570487103 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c15c9d0 0x7f926c0cc610 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f926c06f0a0 tx=0x7f925c009120 comp rx=0 tx=0).stop 2023-10-06T04:57:36.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f92723ff700 1 -- 172.21.15.124:0/570487103 shutdown_connections 2023-10-06T04:57:36.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f92723ff700 1 --2- 172.21.15.124:0/570487103 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c15c9d0 0x7f926c0cc610 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f92723ff700 1 --2- 172.21.15.124:0/570487103 >> v2:172.21.15.158:3300/0 conn(0x7f926c15db70 0x7f926c0cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f92723ff700 1 -- 172.21.15.124:0/570487103 >> 172.21.15.124:0/570487103 conn(0x7f926c097520 msgr2=0x7f926c087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:36.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f92723ff700 1 -- 172.21.15.124:0/570487103 shutdown_connections 2023-10-06T04:57:36.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.251+0000 7f92723ff700 1 -- 172.21.15.124:0/570487103 wait complete. 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.253+0000 7f92723ff700 1 Processor -- start 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.253+0000 7f92723ff700 1 -- start start 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.254+0000 7f92723ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c0cb090 0x7f926c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.254+0000 7f92723ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f926c15c9d0 0x7f926c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.254+0000 7f92723ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f926c15db70 0x7f926c15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.254+0000 7f92723ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0b1ed0 con 0x7f926c0cb090 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.254+0000 7f92723ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0b3ed0 con 0x7f926c15db70 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.254+0000 7f92723ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0b3a40 con 0x7f926c15c9d0 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.254+0000 7f926bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c0cb090 0x7f926c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.254+0000 7f926bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c0cb090 0x7f926c1535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57326/0 (socket says 172.21.15.124:57326) 2023-10-06T04:57:36.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.254+0000 7f926bfff700 1 -- 172.21.15.124:0/3108604822 learned_addr learned my addr 172.21.15.124:0/3108604822 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.254+0000 7f926bfff700 1 -- 172.21.15.124:0/3108604822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f926c15c9d0 msgr2=0x7f926c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.255+0000 7f926bfff700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f926c15c9d0 0x7f926c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.255+0000 7f926bfff700 1 -- 172.21.15.124:0/3108604822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f926c15db70 msgr2=0x7f926c15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.255+0000 7f926bfff700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f926c15db70 0x7f926c15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.255+0000 7f926bfff700 1 -- 172.21.15.124:0/3108604822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0093c0 con 0x7f926c0cb090 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.255+0000 7f926bfff700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c0cb090 0x7f926c1535b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f926c06ec00 tx=0x7f925c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.255+0000 7f9253fff700 1 -- 172.21.15.124:0/3108604822 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c01d880 con 0x7f926c0cb090 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.255+0000 7f9253fff700 1 -- 172.21.15.124:0/3108604822 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c01d9e0 con 0x7f926c0cb090 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.255+0000 7f9253fff700 1 -- 172.21.15.124:0/3108604822 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c01dda0 con 0x7f926c0cb090 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.255+0000 7f92723ff700 1 -- 172.21.15.124:0/3108604822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c0b3110 con 0x7f926c0cb090 2023-10-06T04:57:36.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.255+0000 7f92723ff700 1 -- 172.21.15.124:0/3108604822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c0b36d0 con 0x7f926c0cb090 2023-10-06T04:57:36.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.256+0000 7f92723ff700 1 -- 172.21.15.124:0/3108604822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c0717a0 con 0x7f926c0cb090 2023-10-06T04:57:36.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.257+0000 7f9253fff700 1 -- 172.21.15.124:0/3108604822 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f925c01b690 con 0x7f926c0cb090 2023-10-06T04:57:36.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.258+0000 7f9253fff700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9258066f30 0x7f92580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.258+0000 7f9253fff700 1 -- 172.21.15.124:0/3108604822 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f925c086110 con 0x7f926c0cb090 2023-10-06T04:57:36.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.258+0000 7f926b7fe700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9258066f30 0x7f92580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.259+0000 7f926b7fe700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9258066f30 0x7f92580693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9260009b10 tx=0x7f92600091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.262+0000 7f9253fff700 1 -- 172.21.15.124:0/3108604822 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f925c053520 con 0x7f926c0cb090 2023-10-06T04:57:36.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.454+0000 7f92723ff700 1 -- 172.21.15.124:0/3108604822 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f926c0b3b80 con 0x7f9258066f30 2023-10-06T04:57:36.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.455+0000 7f9253fff700 1 -- 172.21.15.124:0/3108604822 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f926000e630 con 0x7f9258066f30 2023-10-06T04:57:36.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 -- 172.21.15.124:0/3108604822 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9258066f30 msgr2=0x7f92580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9258066f30 0x7f92580693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9260009b10 tx=0x7f92600091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 -- 172.21.15.124:0/3108604822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c0cb090 msgr2=0x7f926c1535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c0cb090 0x7f926c1535b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f926c06ec00 tx=0x7f925c016000 comp rx=0 tx=0).stop 2023-10-06T04:57:36.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 -- 172.21.15.124:0/3108604822 shutdown_connections 2023-10-06T04:57:36.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f926c15db70 0x7f926c15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f926c0cb090 0x7f926c1535b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f9258066f30 0x7f92580693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 --2- 172.21.15.124:0/3108604822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f926c15c9d0 0x7f926c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 -- 172.21.15.124:0/3108604822 >> 172.21.15.124:0/3108604822 conn(0x7f926c097520 msgr2=0x7f926c159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:36.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 -- 172.21.15.124:0/3108604822 shutdown_connections 2023-10-06T04:57:36.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.457+0000 7f92723ff700 1 -- 172.21.15.124:0/3108604822 wait complete. 2023-10-06T04:57:36.461 INFO:teuthology.orchestra.run.smithi124.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T04:57:36.477 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T04:57:36.477 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:57:36.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.667+0000 7fbf9a7ff700 1 Processor -- start 2023-10-06T04:57:36.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.667+0000 7fbf9a7ff700 1 -- start start 2023-10-06T04:57:36.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.668+0000 7fbf9a7ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbf9406c080 0x7fbf94159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.668+0000 7fbf9a7ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf940cc270 con 0x7fbf9415d260 2023-10-06T04:57:36.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.668+0000 7fbf9a7ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9415d740 con 0x7fbf940cc5e0 2023-10-06T04:57:36.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.668+0000 7fbf9a7ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9415da20 con 0x7fbf9406c080 2023-10-06T04:57:36.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.669+0000 7fbf98d9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fbf9415d260 0x7fbf9415a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47660/0 (socket says 172.21.15.124:47660) 2023-10-06T04:57:36.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.669+0000 7fbf98d9c700 1 -- 172.21.15.124:0/2673197508 learned_addr learned my addr 172.21.15.124:0/2673197508 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:36.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.669+0000 7fbf937fe700 1 --2- 172.21.15.124:0/2673197508 >> v2:172.21.15.124:3300/0 conn(0x7fbf9406c080 0x7fbf94159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.669+0000 7fbf92ffd700 1 -- 172.21.15.124:0/2673197508 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588509511 0 0) 0x7fbf940cc270 con 0x7fbf9415d260 2023-10-06T04:57:36.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.669+0000 7fbf92ffd700 1 -- 172.21.15.124:0/2673197508 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf7c003570 con 0x7fbf9415d260 2023-10-06T04:57:36.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.669+0000 7fbf937fe700 1 -- 172.21.15.124:0/2673197508 >> v1:172.21.15.158:6789/0 conn(0x7fbf940cc5e0 legacy=0x7fbf9406b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.669+0000 7fbf937fe700 1 -- 172.21.15.124:0/2673197508 >> v1:172.21.15.124:6789/0 conn(0x7fbf9415d260 legacy=0x7fbf9415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.669+0000 7fbf937fe700 1 -- 172.21.15.124:0/2673197508 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9415dd00 con 0x7fbf9406c080 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.669+0000 7fbf937fe700 1 --2- 172.21.15.124:0/2673197508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbf9406c080 0x7fbf94159c60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbf880098e0 tx=0x7fbf880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccff5d7feeef14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.670+0000 7fbf92ffd700 1 -- 172.21.15.124:0/2673197508 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8800b640 con 0x7fbf9406c080 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.670+0000 7fbf92ffd700 1 -- 172.21.15.124:0/2673197508 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8800b7a0 con 0x7fbf9406c080 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.670+0000 7fbf92ffd700 1 -- 172.21.15.124:0/2673197508 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8800bb40 con 0x7fbf9406c080 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.670+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/2673197508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbf9406c080 msgr2=0x7fbf94159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.670+0000 7fbf9a7ff700 1 --2- 172.21.15.124:0/2673197508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbf9406c080 0x7fbf94159c60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbf880098e0 tx=0x7fbf880091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.670+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/2673197508 shutdown_connections 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.670+0000 7fbf9a7ff700 1 --2- 172.21.15.124:0/2673197508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbf9406c080 0x7fbf94159c60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.670+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/2673197508 >> 172.21.15.124:0/2673197508 conn(0x7fbf940ce400 msgr2=0x7fbf940ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:36.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.670+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/2673197508 shutdown_connections 2023-10-06T04:57:36.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.670+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/2673197508 wait complete. 2023-10-06T04:57:36.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.672+0000 7fbf9a7ff700 1 Processor -- start 2023-10-06T04:57:36.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.672+0000 7fbf9a7ff700 1 -- start start 2023-10-06T04:57:36.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf9a7ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbf9406c080 0x7fbf940c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf9a7ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf940cc5e0 0x7fbf9413ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf9a7ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf9415d260 0x7fbf940c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf9a7ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940c7cc0 con 0x7fbf9406c080 2023-10-06T04:57:36.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf9a7ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9413b3d0 con 0x7fbf9415d260 2023-10-06T04:57:36.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf9a7ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940c70b0 con 0x7fbf940cc5e0 2023-10-06T04:57:36.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf93fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbf9406c080 0x7fbf940c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf93fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbf9406c080 0x7fbf940c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57350/0 (socket says 172.21.15.124:57350) 2023-10-06T04:57:36.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf93fff700 1 -- 172.21.15.124:0/24999650 learned_addr learned my addr 172.21.15.124:0/24999650 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf98d9c700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf9415d260 0x7fbf940c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.673+0000 7fbf937fe700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf940cc5e0 0x7fbf9413ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf93fff700 1 -- 172.21.15.124:0/24999650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf940cc5e0 msgr2=0x7fbf9413ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf93fff700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf940cc5e0 0x7fbf9413ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf93fff700 1 -- 172.21.15.124:0/24999650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf9415d260 msgr2=0x7fbf940c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf93fff700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf9415d260 0x7fbf940c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf93fff700 1 -- 172.21.15.124:0/24999650 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf88009420 con 0x7fbf9406c080 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf93fff700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbf9406c080 0x7fbf940c8150 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c7c0 tx=0x7fbf84007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf7bfff700 1 -- 172.21.15.124:0/24999650 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84011590 con 0x7fbf9406c080 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf7bfff700 1 -- 172.21.15.124:0/24999650 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84011710 con 0x7fbf9406c080 2023-10-06T04:57:36.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf7bfff700 1 -- 172.21.15.124:0/24999650 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84011ad0 con 0x7fbf9406c080 2023-10-06T04:57:36.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf940c7390 con 0x7fbf9406c080 2023-10-06T04:57:36.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.674+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf940c7950 con 0x7fbf9406c080 2023-10-06T04:57:36.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.675+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf940718b0 con 0x7fbf9406c080 2023-10-06T04:57:36.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.676+0000 7fbf7bfff700 1 -- 172.21.15.124:0/24999650 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf8401b3b0 con 0x7fbf9406c080 2023-10-06T04:57:36.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.677+0000 7fbf7bfff700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbf80066f30 0x7fbf800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.677+0000 7fbf7bfff700 1 -- 172.21.15.124:0/24999650 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fbf84083940 con 0x7fbf9406c080 2023-10-06T04:57:36.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.677+0000 7fbf937fe700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbf80066f30 0x7fbf800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.677+0000 7fbf7bfff700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] conn(0x7fbf8006d3a0 0x7fbf8006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.677+0000 7fbf7bfff700 1 -- 172.21.15.124:0/24999650 --> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf8006fe80 con 0x7fbf8006d3a0 2023-10-06T04:57:36.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.677+0000 7fbf7bfff700 1 -- 172.21.15.124:0/24999650 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf84088220 con 0x7fbf9406c080 2023-10-06T04:57:36.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.678+0000 7fbf98d9c700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] conn(0x7fbf8006d3a0 0x7fbf8006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.678+0000 7fbf937fe700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbf80066f30 0x7fbf800693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf880098e0 tx=0x7fbf88017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.678+0000 7fbf98d9c700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] conn(0x7fbf8006d3a0 0x7fbf8006f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.679+0000 7fbf7bfff700 1 -- 172.21.15.124:0/24999650 <== osd.3 v2:172.21.15.124:6824/114900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbf8006fe80 con 0x7fbf8006d3a0 2023-10-06T04:57:36.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.693+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 --> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbf9415dfe0 con 0x7fbf8006d3a0 2023-10-06T04:57:36.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.693+0000 7fbf7bfff700 1 -- 172.21.15.124:0/24999650 <== osd.3 v2:172.21.15.124:6824/114900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbf9415dfe0 con 0x7fbf8006d3a0 2023-10-06T04:57:36.696 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:57:36.696 INFO:teuthology.orchestra.run.smithi124.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:57:36.696 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:57:36.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] conn(0x7fbf8006d3a0 msgr2=0x7fbf8006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf9a7ff700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:6824/114900,v1:172.21.15.124:6825/114900] conn(0x7fbf8006d3a0 0x7fbf8006f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbf80066f30 msgr2=0x7fbf800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf9a7ff700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbf80066f30 0x7fbf800693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf880098e0 tx=0x7fbf88017000 comp rx=0 tx=0).stop 2023-10-06T04:57:36.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbf9406c080 msgr2=0x7fbf940c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf9a7ff700 1 --2- 172.21.15.124:0/24999650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbf9406c080 0x7fbf940c8150 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c7c0 tx=0x7fbf84007f70 comp rx=0 tx=0).stop 2023-10-06T04:57:36.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf98d9c700 1 -- 172.21.15.124:0/24999650 reap_dead start 2023-10-06T04:57:36.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 shutdown_connections 2023-10-06T04:57:36.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 >> 172.21.15.124:0/24999650 conn(0x7fbf940ce400 msgr2=0x7fbf940b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:36.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 shutdown_connections 2023-10-06T04:57:36.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.694+0000 7fbf9a7ff700 1 -- 172.21.15.124:0/24999650 wait complete. 2023-10-06T04:57:36.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T04:57:36.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.900+0000 7fbaa85ff700 1 Processor -- start 2023-10-06T04:57:36.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.900+0000 7fbaa85ff700 1 -- start start 2023-10-06T04:57:36.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.901+0000 7fbaa85ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbaa0159330 0x7fbaa015db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.901+0000 7fbaa85ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbaa00b3c20 0x7fbaa00b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.901+0000 7fbaa85ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa00b4f80 con 0x7fbaa0159700 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.901+0000 7fbaa85ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa00b5b20 con 0x7fbaa0159330 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.901+0000 7fbaa85ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa00b40a0 con 0x7fbaa00b3c20 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.902+0000 7fbaa639b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbaa0159330 0x7fbaa015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.902+0000 7fbaa639b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbaa0159330 0x7fbaa015db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57352/0 (socket says 172.21.15.124:57352) 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.902+0000 7fbaa639b700 1 -- 172.21.15.124:0/2961685116 learned_addr learned my addr 172.21.15.124:0/2961685116 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.902+0000 7fbaa6b9c700 1 --2- 172.21.15.124:0/2961685116 >> v2:172.21.15.158:3300/0 conn(0x7fbaa00b3c20 0x7fbaa00b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.902+0000 7fbaa639b700 1 -- 172.21.15.124:0/2961685116 >> v2:172.21.15.158:3300/0 conn(0x7fbaa00b3c20 msgr2=0x7fbaa00b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.902+0000 7fbaa639b700 1 --2- 172.21.15.124:0/2961685116 >> v2:172.21.15.158:3300/0 conn(0x7fbaa00b3c20 0x7fbaa00b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.902+0000 7fbaa639b700 1 -- 172.21.15.124:0/2961685116 >> v1:172.21.15.158:6789/0 conn(0x7fbaa0159700 legacy=0x7fbaa00b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.902+0000 7fbaa639b700 1 -- 172.21.15.124:0/2961685116 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00b4370 con 0x7fbaa0159330 2023-10-06T04:57:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.902+0000 7fbaa6b9c700 1 --2- 172.21.15.124:0/2961685116 >> v2:172.21.15.158:3300/0 conn(0x7fbaa00b3c20 0x7fbaa00b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.902+0000 7fbaa639b700 1 --2- 172.21.15.124:0/2961685116 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa0159330 0x7fbaa015db90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbaa006fd00 tx=0x7fba9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671ecf0a92dd748 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.903+0000 7fbaa5399700 1 -- 172.21.15.124:0/2961685116 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00b820 con 0x7fbaa0159330 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.903+0000 7fbaa5399700 1 -- 172.21.15.124:0/2961685116 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c00b980 con 0x7fbaa0159330 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.903+0000 7fbaa5399700 1 -- 172.21.15.124:0/2961685116 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00bd20 con 0x7fbaa0159330 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.903+0000 7fbaa85ff700 1 -- 172.21.15.124:0/2961685116 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa0159330 msgr2=0x7fbaa015db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.903+0000 7fbaa85ff700 1 --2- 172.21.15.124:0/2961685116 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa0159330 0x7fbaa015db90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbaa006fd00 tx=0x7fba9c009250 comp rx=0 tx=0).stop 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.903+0000 7fbaa85ff700 1 -- 172.21.15.124:0/2961685116 shutdown_connections 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.903+0000 7fbaa85ff700 1 --2- 172.21.15.124:0/2961685116 >> v2:172.21.15.158:3300/0 conn(0x7fbaa00b3c20 0x7fbaa00b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.903+0000 7fbaa85ff700 1 --2- 172.21.15.124:0/2961685116 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa0159330 0x7fbaa015db90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.903+0000 7fbaa85ff700 1 -- 172.21.15.124:0/2961685116 >> 172.21.15.124:0/2961685116 conn(0x7fbaa006ed20 msgr2=0x7fbaa006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.904+0000 7fbaa85ff700 1 -- 172.21.15.124:0/2961685116 shutdown_connections 2023-10-06T04:57:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.904+0000 7fbaa85ff700 1 -- 172.21.15.124:0/2961685116 wait complete. 2023-10-06T04:57:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.905+0000 7fbaa85ff700 1 Processor -- start 2023-10-06T04:57:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.905+0000 7fbaa85ff700 1 -- start start 2023-10-06T04:57:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.906+0000 7fbaa85ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa00b3c20 0x7fbaa0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.906+0000 7fbaa85ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbaa0159330 0x7fbaa0156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.906+0000 7fbaa85ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbaa0159700 0x7fbaa0157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.906+0000 7fbaa85ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0159ba0 con 0x7fbaa00b3c20 2023-10-06T04:57:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.906+0000 7fbaa85ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0150f70 con 0x7fbaa0159330 2023-10-06T04:57:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.906+0000 7fbaa85ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0159df0 con 0x7fbaa0159700 2023-10-06T04:57:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.906+0000 7fbaa639b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa00b3c20 0x7fbaa0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.906+0000 7fbaa639b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa00b3c20 0x7fbaa0150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57368/0 (socket says 172.21.15.124:57368) 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.906+0000 7fbaa639b700 1 -- 172.21.15.124:0/1021386879 learned_addr learned my addr 172.21.15.124:0/1021386879 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fbaa5b9a700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbaa0159330 0x7fbaa0156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fbaa6b9c700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbaa0159700 0x7fbaa0157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fbaa639b700 1 -- 172.21.15.124:0/1021386879 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbaa0159700 msgr2=0x7fbaa0157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fbaa639b700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbaa0159700 0x7fbaa0157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fbaa639b700 1 -- 172.21.15.124:0/1021386879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbaa0159330 msgr2=0x7fbaa0156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fbaa639b700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbaa0159330 0x7fbaa0156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fbaa639b700 1 -- 172.21.15.124:0/1021386879 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c0094f0 con 0x7fbaa00b3c20 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fbaa639b700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa00b3c20 0x7fbaa0150a30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0030c0 tx=0x7fba9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fba967fc700 1 -- 172.21.15.124:0/1021386879 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c011db0 con 0x7fbaa00b3c20 2023-10-06T04:57:36.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fba967fc700 1 -- 172.21.15.124:0/1021386879 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c020070 con 0x7fbaa00b3c20 2023-10-06T04:57:36.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fbaa85ff700 1 -- 172.21.15.124:0/1021386879 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa015a0d0 con 0x7fbaa00b3c20 2023-10-06T04:57:36.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.907+0000 7fba967fc700 1 -- 172.21.15.124:0/1021386879 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c01b6a0 con 0x7fbaa00b3c20 2023-10-06T04:57:36.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.908+0000 7fbaa85ff700 1 -- 172.21.15.124:0/1021386879 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa015a690 con 0x7fbaa00b3c20 2023-10-06T04:57:36.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.909+0000 7fbaa85ff700 1 -- 172.21.15.124:0/1021386879 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa004c380 con 0x7fbaa00b3c20 2023-10-06T04:57:36.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.910+0000 7fba967fc700 1 -- 172.21.15.124:0/1021386879 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba9c022030 con 0x7fbaa00b3c20 2023-10-06T04:57:36.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.910+0000 7fba967fc700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fba84066f30 0x7fba840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:36.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.910+0000 7fba967fc700 1 -- 172.21.15.124:0/1021386879 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fba9c0863b0 con 0x7fbaa00b3c20 2023-10-06T04:57:36.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.911+0000 7fbaa5b9a700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fba84066f30 0x7fba840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:36.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.911+0000 7fbaa5b9a700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fba84066f30 0x7fba840693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbaa01546b0 tx=0x7fba90009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:36.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:36.914+0000 7fba967fc700 1 -- 172.21.15.124:0/1021386879 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba9c053720 con 0x7fbaa00b3c20 2023-10-06T04:57:37.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.105+0000 7fbaa85ff700 1 -- 172.21.15.124:0/1021386879 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbaa004c380 con 0x7fba84066f30 2023-10-06T04:57:37.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.106+0000 7fba967fc700 1 -- 172.21.15.124:0/1021386879 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbaa004c380 con 0x7fba84066f30 2023-10-06T04:57:37.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 -- 172.21.15.124:0/1021386879 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fba84066f30 msgr2=0x7fba840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fba84066f30 0x7fba840693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbaa01546b0 tx=0x7fba90009060 comp rx=0 tx=0).stop 2023-10-06T04:57:37.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 -- 172.21.15.124:0/1021386879 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa00b3c20 msgr2=0x7fbaa0150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa00b3c20 0x7fbaa0150a30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0030c0 tx=0x7fba9c016000 comp rx=0 tx=0).stop 2023-10-06T04:57:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 -- 172.21.15.124:0/1021386879 shutdown_connections 2023-10-06T04:57:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fba84066f30 0x7fba840693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbaa0159700 0x7fbaa0157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbaa00b3c20 0x7fbaa0150a30 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 --2- 172.21.15.124:0/1021386879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbaa0159330 0x7fbaa0156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 -- 172.21.15.124:0/1021386879 >> 172.21.15.124:0/1021386879 conn(0x7fbaa006ed20 msgr2=0x7fbaa015e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 -- 172.21.15.124:0/1021386879 shutdown_connections 2023-10-06T04:57:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.108+0000 7fbaa85ff700 1 -- 172.21.15.124:0/1021386879 wait complete. 2023-10-06T04:57:37.144 INFO:teuthology.orchestra.run.smithi124.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T04:57:37.144 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T04:57:37.145 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:57:37.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.337+0000 7fde0a3ff700 1 Processor -- start 2023-10-06T04:57:37.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.338+0000 7fde0a3ff700 1 -- start start 2023-10-06T04:57:37.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde0a3ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fde040cd040 0x7fde040b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde0a3ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fde040cd410 0x7fde04159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde0a3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fde041599c0 0x7fde04068550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde0a3ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde040b11a0 con 0x7fde040cd410 2023-10-06T04:57:37.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde0a3ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0415d970 con 0x7fde040cd040 2023-10-06T04:57:37.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde0a3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0415dc50 con 0x7fde041599c0 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde037fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fde040cd410 0x7fde04159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde037fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fde040cd410 0x7fde04159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57370/0 (socket says 172.21.15.124:57370) 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde037fe700 1 -- 172.21.15.124:0/901530104 learned_addr learned my addr 172.21.15.124:0/901530104 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde03fff700 1 --2- 172.21.15.124:0/901530104 >> v2:172.21.15.158:3300/0 conn(0x7fde040cd040 0x7fde040b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde0899c700 1 --2- 172.21.15.124:0/901530104 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fde041599c0 0x7fde04068550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde037fe700 1 -- 172.21.15.124:0/901530104 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fde041599c0 msgr2=0x7fde04068550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.339+0000 7fde037fe700 1 --2- 172.21.15.124:0/901530104 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fde041599c0 0x7fde04068550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.340+0000 7fde037fe700 1 -- 172.21.15.124:0/901530104 >> v2:172.21.15.158:3300/0 conn(0x7fde040cd040 msgr2=0x7fde040b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.340+0000 7fde037fe700 1 --2- 172.21.15.124:0/901530104 >> v2:172.21.15.158:3300/0 conn(0x7fde040cd040 0x7fde040b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.340+0000 7fde037fe700 1 -- 172.21.15.124:0/901530104 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0415df30 con 0x7fde040cd410 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.340+0000 7fde037fe700 1 --2- 172.21.15.124:0/901530104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde040cd410 0x7fde04159480 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fde04067e20 tx=0x7fddf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e26400ac9dc364 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:37.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.340+0000 7fde02ffd700 1 -- 172.21.15.124:0/901530104 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800b860 con 0x7fde040cd410 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.340+0000 7fde02ffd700 1 -- 172.21.15.124:0/901530104 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf800b9c0 con 0x7fde040cd410 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.340+0000 7fde02ffd700 1 -- 172.21.15.124:0/901530104 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800bd60 con 0x7fde040cd410 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.340+0000 7fde0a3ff700 1 -- 172.21.15.124:0/901530104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde040cd410 msgr2=0x7fde04159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.340+0000 7fde0a3ff700 1 --2- 172.21.15.124:0/901530104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde040cd410 0x7fde04159480 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fde04067e20 tx=0x7fddf8009250 comp rx=0 tx=0).stop 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.341+0000 7fde0a3ff700 1 -- 172.21.15.124:0/901530104 shutdown_connections 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.341+0000 7fde0a3ff700 1 --2- 172.21.15.124:0/901530104 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fde041599c0 0x7fde04068550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.341+0000 7fde0a3ff700 1 --2- 172.21.15.124:0/901530104 >> v2:172.21.15.158:3300/0 conn(0x7fde040cd040 0x7fde040b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.341+0000 7fde0a3ff700 1 --2- 172.21.15.124:0/901530104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde040cd410 0x7fde04159480 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.341+0000 7fde0a3ff700 1 -- 172.21.15.124:0/901530104 >> 172.21.15.124:0/901530104 conn(0x7fde0406ed20 msgr2=0x7fde0406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.341+0000 7fde0a3ff700 1 -- 172.21.15.124:0/901530104 shutdown_connections 2023-10-06T04:57:37.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.341+0000 7fde0a3ff700 1 -- 172.21.15.124:0/901530104 wait complete. 2023-10-06T04:57:37.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.342+0000 7fde0a3ff700 1 Processor -- start 2023-10-06T04:57:37.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.342+0000 7fde0a3ff700 1 -- start start 2023-10-06T04:57:37.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.343+0000 7fde0a3ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde040cd040 0x7fde040b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.343+0000 7fde0a3ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fde040cd410 0x7fde040b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.343+0000 7fde0a3ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde041599c0 0x7fde040cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.343+0000 7fde0a3ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b4000 con 0x7fde040cd040 2023-10-06T04:57:37.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.343+0000 7fde0a3ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b42e0 con 0x7fde041599c0 2023-10-06T04:57:37.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.343+0000 7fde0a3ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b45c0 con 0x7fde040cd410 2023-10-06T04:57:37.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.343+0000 7fde03fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde040cd040 0x7fde040b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.343+0000 7fde03fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde040cd040 0x7fde040b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57376/0 (socket says 172.21.15.124:57376) 2023-10-06T04:57:37.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.343+0000 7fde03fff700 1 -- 172.21.15.124:0/1934869699 learned_addr learned my addr 172.21.15.124:0/1934869699 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:37.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fde037fe700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fde040cd410 0x7fde040b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fde0899c700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde041599c0 0x7fde040cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fde03fff700 1 -- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fde040cd410 msgr2=0x7fde040b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fde03fff700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fde040cd410 0x7fde040b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fde03fff700 1 -- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde041599c0 msgr2=0x7fde040cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fde03fff700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde041599c0 0x7fde040cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fde03fff700 1 -- 172.21.15.124:0/1934869699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80094f0 con 0x7fde040cd040 2023-10-06T04:57:37.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fde03fff700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde040cd040 0x7fde040b33b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fddf400d890 tx=0x7fddf4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:37.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fddebfff700 1 -- 172.21.15.124:0/1934869699 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40125f0 con 0x7fde040cd040 2023-10-06T04:57:37.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fddebfff700 1 -- 172.21.15.124:0/1934869699 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4012750 con 0x7fde040cd040 2023-10-06T04:57:37.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde040b48a0 con 0x7fde040cd040 2023-10-06T04:57:37.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fddebfff700 1 -- 172.21.15.124:0/1934869699 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4012af0 con 0x7fde040cd040 2023-10-06T04:57:37.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.344+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde040b50a0 con 0x7fde040cd040 2023-10-06T04:57:37.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.345+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde040718b0 con 0x7fde040cd040 2023-10-06T04:57:37.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.346+0000 7fddebfff700 1 -- 172.21.15.124:0/1934869699 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddf401e460 con 0x7fde040cd040 2023-10-06T04:57:37.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.347+0000 7fddebfff700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fddf0066f30 0x7fddf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.347+0000 7fddebfff700 1 -- 172.21.15.124:0/1934869699 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fddf40848c0 con 0x7fde040cd040 2023-10-06T04:57:37.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.347+0000 7fde037fe700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fddf0066f30 0x7fddf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.347+0000 7fddebfff700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] conn(0x7fddf006d3a0 0x7fddf006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.347+0000 7fddebfff700 1 -- 172.21.15.124:0/1934869699 --> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fddf006fe80 con 0x7fddf006d3a0 2023-10-06T04:57:37.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.347+0000 7fddebfff700 1 -- 172.21.15.124:0/1934869699 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddf4089240 con 0x7fde040cd040 2023-10-06T04:57:37.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.348+0000 7fde0899c700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] conn(0x7fddf006d3a0 0x7fddf006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.348+0000 7fde037fe700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fddf0066f30 0x7fddf00693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde04067e20 tx=0x7fddf8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:37.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.348+0000 7fde0899c700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] conn(0x7fddf006d3a0 0x7fddf006f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:37.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.349+0000 7fddebfff700 1 -- 172.21.15.124:0/1934869699 <== osd.4 v2:172.21.15.158:6800/115098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fddf006fe80 con 0x7fddf006d3a0 2023-10-06T04:57:37.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.363+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 --> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fde0415e210 con 0x7fddf006d3a0 2023-10-06T04:57:37.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.364+0000 7fddebfff700 1 -- 172.21.15.124:0/1934869699 <== osd.4 v2:172.21.15.158:6800/115098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fde0415e210 con 0x7fddf006d3a0 2023-10-06T04:57:37.367 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:57:37.367 INFO:teuthology.orchestra.run.smithi124.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:57:37.367 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:57:37.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.364+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] conn(0x7fddf006d3a0 msgr2=0x7fddf006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.364+0000 7fde0a3ff700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.158:6800/115098,v1:172.21.15.158:6801/115098] conn(0x7fddf006d3a0 0x7fddf006f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.365+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fddf0066f30 msgr2=0x7fddf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.365+0000 7fde0a3ff700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fddf0066f30 0x7fddf00693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde04067e20 tx=0x7fddf8017000 comp rx=0 tx=0).stop 2023-10-06T04:57:37.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.365+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde040cd040 msgr2=0x7fde040b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.365+0000 7fde0a3ff700 1 --2- 172.21.15.124:0/1934869699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde040cd040 0x7fde040b33b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fddf400d890 tx=0x7fddf4008040 comp rx=0 tx=0).stop 2023-10-06T04:57:37.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.365+0000 7fde0899c700 1 -- 172.21.15.124:0/1934869699 reap_dead start 2023-10-06T04:57:37.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.365+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 shutdown_connections 2023-10-06T04:57:37.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.365+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 >> 172.21.15.124:0/1934869699 conn(0x7fde0406ed20 msgr2=0x7fde04156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:37.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.365+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 shutdown_connections 2023-10-06T04:57:37.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.365+0000 7fde0a3ff700 1 -- 172.21.15.124:0/1934869699 wait complete. 2023-10-06T04:57:37.384 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T04:57:37.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.572+0000 7f377e5ff700 1 Processor -- start 2023-10-06T04:57:37.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.572+0000 7f377e5ff700 1 -- start start 2023-10-06T04:57:37.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.573+0000 7f377e5ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f37780b3d30 0x7f377815a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.574+0000 7f377e5ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377815aac0 con 0x7f37780b1ea0 2023-10-06T04:57:37.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.574+0000 7f377e5ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37780b41b0 con 0x7f37781594b0 2023-10-06T04:57:37.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.574+0000 7f377e5ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37780b4410 con 0x7f37780b3d30 2023-10-06T04:57:37.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.574+0000 7f377cb9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f37780b1ea0 0x7f37780b22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47668/0 (socket says 172.21.15.124:47668) 2023-10-06T04:57:37.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.574+0000 7f377cb9c700 1 -- 172.21.15.124:0/2125062236 learned_addr learned my addr 172.21.15.124:0/2125062236 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:37.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.574+0000 7f37777fe700 1 --2- 172.21.15.124:0/2125062236 >> v2:172.21.15.158:3300/0 conn(0x7f37780b3d30 0x7f377815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.574+0000 7f3776ffd700 1 -- 172.21.15.124:0/2125062236 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522330678 0 0) 0x7f377815aac0 con 0x7f37780b1ea0 2023-10-06T04:57:37.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.574+0000 7f3776ffd700 1 -- 172.21.15.124:0/2125062236 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3760003570 con 0x7f37780b1ea0 2023-10-06T04:57:37.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.575+0000 7f3776ffd700 1 -- 172.21.15.124:0/2125062236 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012874076 0 0) 0x7f37780b41b0 con 0x7f37781594b0 2023-10-06T04:57:37.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.575+0000 7f3776ffd700 1 -- 172.21.15.124:0/2125062236 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f377815aac0 con 0x7f37781594b0 2023-10-06T04:57:37.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.575+0000 7f37777fe700 1 -- 172.21.15.124:0/2125062236 >> v1:172.21.15.158:6789/0 conn(0x7f37781594b0 legacy=0x7f37780b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.575+0000 7f3776ffd700 1 -- 172.21.15.124:0/2125062236 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 324989614 0 0) 0x7f3760003570 con 0x7f37780b1ea0 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.575+0000 7f37777fe700 1 -- 172.21.15.124:0/2125062236 >> v1:172.21.15.124:6789/0 conn(0x7f37780b1ea0 legacy=0x7f37780b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.575+0000 7f37777fe700 1 -- 172.21.15.124:0/2125062236 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780b46f0 con 0x7f37780b3d30 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.575+0000 7f37777fe700 1 --2- 172.21.15.124:0/2125062236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37780b3d30 0x7f377815a580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f376c0098e0 tx=0x7f376c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd3c299f9cb4099d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.575+0000 7f3776ffd700 1 -- 172.21.15.124:0/2125062236 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700017f0 con 0x7f37780b3d30 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.575+0000 7f3776ffd700 1 -- 172.21.15.124:0/2125062236 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c011420 con 0x7f37780b3d30 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.575+0000 7f3776ffd700 1 -- 172.21.15.124:0/2125062236 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0117c0 con 0x7f37780b3d30 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.576+0000 7f377e5ff700 1 -- 172.21.15.124:0/2125062236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37780b3d30 msgr2=0x7f377815a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.576+0000 7f377e5ff700 1 --2- 172.21.15.124:0/2125062236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37780b3d30 0x7f377815a580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f376c0098e0 tx=0x7f376c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.576+0000 7f377e5ff700 1 -- 172.21.15.124:0/2125062236 shutdown_connections 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.576+0000 7f377e5ff700 1 --2- 172.21.15.124:0/2125062236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37780b3d30 0x7f377815a580 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.576+0000 7f377e5ff700 1 -- 172.21.15.124:0/2125062236 >> 172.21.15.124:0/2125062236 conn(0x7f377806ed20 msgr2=0x7f377806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:37.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.576+0000 7f377e5ff700 1 -- 172.21.15.124:0/2125062236 shutdown_connections 2023-10-06T04:57:37.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.576+0000 7f377e5ff700 1 -- 172.21.15.124:0/2125062236 wait complete. 2023-10-06T04:57:37.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.577+0000 7f377e5ff700 1 Processor -- start 2023-10-06T04:57:37.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.577+0000 7f377e5ff700 1 -- start start 2023-10-06T04:57:37.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.578+0000 7f377e5ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37780b1ea0 0x7f3778169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.578+0000 7f377e5ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37780b3d30 0x7f3778141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.578+0000 7f377e5ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37781594b0 0x7f3778154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.578+0000 7f377e5ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377816a130 con 0x7f37780b1ea0 2023-10-06T04:57:37.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.578+0000 7f377e5ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377816a410 con 0x7f37781594b0 2023-10-06T04:57:37.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.578+0000 7f377e5ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377816a6f0 con 0x7f37780b3d30 2023-10-06T04:57:37.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f3777fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37780b1ea0 0x7f3778169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f3777fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37780b1ea0 0x7f3778169b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57386/0 (socket says 172.21.15.124:57386) 2023-10-06T04:57:37.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f3777fff700 1 -- 172.21.15.124:0/489713213 learned_addr learned my addr 172.21.15.124:0/489713213 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:37.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f377cb9c700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37781594b0 0x7f3778154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f37777fe700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37780b3d30 0x7f3778141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f3777fff700 1 -- 172.21.15.124:0/489713213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37780b3d30 msgr2=0x7f3778141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f3777fff700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37780b3d30 0x7f3778141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f3777fff700 1 -- 172.21.15.124:0/489713213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37781594b0 msgr2=0x7f3778154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f3777fff700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37781594b0 0x7f3778154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f3777fff700 1 -- 172.21.15.124:0/489713213 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c009420 con 0x7f37780b1ea0 2023-10-06T04:57:37.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f3777fff700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37780b1ea0 0x7f3778169b00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f376800c580 tx=0x7f3768007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:37.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.579+0000 7f375ffff700 1 -- 172.21.15.124:0/489713213 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768010510 con 0x7f37780b1ea0 2023-10-06T04:57:37.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.580+0000 7f375ffff700 1 -- 172.21.15.124:0/489713213 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768010690 con 0x7f37780b1ea0 2023-10-06T04:57:37.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.580+0000 7f377e5ff700 1 -- 172.21.15.124:0/489713213 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3778152980 con 0x7f37780b1ea0 2023-10-06T04:57:37.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.580+0000 7f375ffff700 1 -- 172.21.15.124:0/489713213 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768010a50 con 0x7f37780b1ea0 2023-10-06T04:57:37.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.580+0000 7f377e5ff700 1 -- 172.21.15.124:0/489713213 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37781423c0 con 0x7f37780b1ea0 2023-10-06T04:57:37.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.581+0000 7f377e5ff700 1 -- 172.21.15.124:0/489713213 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37780af920 con 0x7f37780b1ea0 2023-10-06T04:57:37.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.581+0000 7f375ffff700 1 -- 172.21.15.124:0/489713213 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f376801b400 con 0x7f37780b1ea0 2023-10-06T04:57:37.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.582+0000 7f375ffff700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3764066f30 0x7f37640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.582+0000 7f375ffff700 1 -- 172.21.15.124:0/489713213 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3768083e40 con 0x7f37780b1ea0 2023-10-06T04:57:37.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.583+0000 7f37777fe700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3764066f30 0x7f37640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.583+0000 7f37777fe700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3764066f30 0x7f37640693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f376c0093f0 tx=0x7f376c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:37.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.587+0000 7f375ffff700 1 -- 172.21.15.124:0/489713213 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3768051250 con 0x7f37780b1ea0 2023-10-06T04:57:37.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.775+0000 7f377e5ff700 1 -- 172.21.15.124:0/489713213 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f37780717a0 con 0x7f3764066f30 2023-10-06T04:57:37.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.775+0000 7f375ffff700 1 -- 172.21.15.124:0/489713213 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f37780717a0 con 0x7f3764066f30 2023-10-06T04:57:37.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 -- 172.21.15.124:0/489713213 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3764066f30 msgr2=0x7f37640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3764066f30 0x7f37640693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f376c0093f0 tx=0x7f376c016000 comp rx=0 tx=0).stop 2023-10-06T04:57:37.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 -- 172.21.15.124:0/489713213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37780b1ea0 msgr2=0x7f3778169b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37780b1ea0 0x7f3778169b00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f376800c580 tx=0x7f3768007e10 comp rx=0 tx=0).stop 2023-10-06T04:57:37.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 -- 172.21.15.124:0/489713213 shutdown_connections 2023-10-06T04:57:37.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37781594b0 0x7f3778154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37780b1ea0 0x7f3778169b00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f3764066f30 0x7f37640693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 --2- 172.21.15.124:0/489713213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37780b3d30 0x7f3778141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 -- 172.21.15.124:0/489713213 >> 172.21.15.124:0/489713213 conn(0x7f377806ed20 msgr2=0x7f3778155190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:37.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 -- 172.21.15.124:0/489713213 shutdown_connections 2023-10-06T04:57:37.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.778+0000 7f377e5ff700 1 -- 172.21.15.124:0/489713213 wait complete. 2023-10-06T04:57:37.782 INFO:teuthology.orchestra.run.smithi124.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T04:57:37.798 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T04:57:37.798 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:57:37.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.988+0000 7f18d33ff700 1 Processor -- start 2023-10-06T04:57:37.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.988+0000 7f18d33ff700 1 -- start start 2023-10-06T04:57:37.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.989+0000 7f18d33ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f18cc1562e0 0x7f18cc0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.989+0000 7f18d33ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18cc1566b0 0x7f18cc0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.989+0000 7f18d33ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc0ccfe0 con 0x7f18cc0af990 2023-10-06T04:57:37.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.989+0000 7f18d33ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc0b0a30 con 0x7f18cc1562e0 2023-10-06T04:57:37.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.989+0000 7f18d33ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0afe20 con 0x7f18cc1566b0 2023-10-06T04:57:37.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.990+0000 7f18d119b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f18cc1562e0 0x7f18cc0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.990+0000 7f18d119b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f18cc1562e0 0x7f18cc0b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57392/0 (socket says 172.21.15.124:57392) 2023-10-06T04:57:37.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.990+0000 7f18d119b700 1 -- 172.21.15.124:0/1160747508 learned_addr learned my addr 172.21.15.124:0/1160747508 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:37.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.990+0000 7f18d199c700 1 --2- 172.21.15.124:0/1160747508 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18cc1566b0 0x7f18cc0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.990+0000 7f18d119b700 1 -- 172.21.15.124:0/1160747508 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18cc1566b0 msgr2=0x7f18cc0accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:37.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.990+0000 7f18d119b700 1 --2- 172.21.15.124:0/1160747508 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18cc1566b0 0x7f18cc0accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.990+0000 7f18d119b700 1 -- 172.21.15.124:0/1160747508 >> v1:172.21.15.158:6789/0 conn(0x7f18cc0af990 legacy=0x7f18cc0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.990+0000 7f18d119b700 1 -- 172.21.15.124:0/1160747508 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc0b0100 con 0x7f18cc1562e0 2023-10-06T04:57:37.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.990+0000 7f18d119b700 1 --2- 172.21.15.124:0/1160747508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18cc1562e0 0x7f18cc0b0ec0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f18c80099b0 tx=0x7f18c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2df5b9d4088b88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:37.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.990+0000 7f18c3fff700 1 -- 172.21.15.124:0/1160747508 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8009ea0 con 0x7f18cc1562e0 2023-10-06T04:57:37.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.991+0000 7f18c3fff700 1 -- 172.21.15.124:0/1160747508 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c800b860 con 0x7f18cc1562e0 2023-10-06T04:57:37.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.991+0000 7f18c3fff700 1 -- 172.21.15.124:0/1160747508 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800bc00 con 0x7f18cc1562e0 2023-10-06T04:57:37.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.991+0000 7f18d33ff700 1 -- 172.21.15.124:0/1160747508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18cc1562e0 msgr2=0x7f18cc0b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.991+0000 7f18d33ff700 1 --2- 172.21.15.124:0/1160747508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18cc1562e0 0x7f18cc0b0ec0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f18c80099b0 tx=0x7f18c8009250 comp rx=0 tx=0).stop 2023-10-06T04:57:37.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.991+0000 7f18d33ff700 1 -- 172.21.15.124:0/1160747508 shutdown_connections 2023-10-06T04:57:37.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.991+0000 7f18d33ff700 1 --2- 172.21.15.124:0/1160747508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18cc1562e0 0x7f18cc0b0ec0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.991+0000 7f18d33ff700 1 --2- 172.21.15.124:0/1160747508 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18cc1566b0 0x7f18cc0accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.991+0000 7f18d33ff700 1 -- 172.21.15.124:0/1160747508 >> 172.21.15.124:0/1160747508 conn(0x7f18cc068080 msgr2=0x7f18cc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:37.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.991+0000 7f18d33ff700 1 -- 172.21.15.124:0/1160747508 shutdown_connections 2023-10-06T04:57:37.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.991+0000 7f18d33ff700 1 -- 172.21.15.124:0/1160747508 wait complete. 2023-10-06T04:57:37.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.993+0000 7f18d33ff700 1 Processor -- start 2023-10-06T04:57:37.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.993+0000 7f18d33ff700 1 -- start start 2023-10-06T04:57:37.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d33ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18cc0af990 0x7f18cc16c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d33ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18cc1562e0 0x7f18cc0ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d33ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18cc1566b0 0x7f18cc0ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:37.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d33ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc159820 con 0x7f18cc1566b0 2023-10-06T04:57:37.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d33ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc158ca0 con 0x7f18cc1562e0 2023-10-06T04:57:37.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d33ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc158f80 con 0x7f18cc0af990 2023-10-06T04:57:37.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d199c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18cc1566b0 0x7f18cc0ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d119b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18cc0af990 0x7f18cc16c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d199c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18cc1566b0 0x7f18cc0ad9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57394/0 (socket says 172.21.15.124:57394) 2023-10-06T04:57:37.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d199c700 1 -- 172.21.15.124:0/1031188699 learned_addr learned my addr 172.21.15.124:0/1031188699 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:37.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d099a700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18cc1562e0 0x7f18cc0ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:37.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d199c700 1 -- 172.21.15.124:0/1031188699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18cc0af990 msgr2=0x7f18cc16c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d199c700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18cc0af990 0x7f18cc16c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d199c700 1 -- 172.21.15.124:0/1031188699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18cc1562e0 msgr2=0x7f18cc0ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:37.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d199c700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18cc1562e0 0x7f18cc0ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:37.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.995+0000 7f18d199c700 1 -- 172.21.15.124:0/1031188699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c80094f0 con 0x7f18cc1566b0 2023-10-06T04:57:37.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.996+0000 7f18d199c700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18cc1566b0 0x7f18cc0ad9f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009df0 tx=0x7f18c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.996+0000 7f18c17fa700 1 -- 172.21.15.124:0/1031188699 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400caa0 con 0x7f18cc1566b0 2023-10-06T04:57:38.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.996+0000 7f18c17fa700 1 -- 172.21.15.124:0/1031188699 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c400f040 con 0x7f18cc1566b0 2023-10-06T04:57:38.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.996+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc159260 con 0x7f18cc1566b0 2023-10-06T04:57:38.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.996+0000 7f18c17fa700 1 -- 172.21.15.124:0/1031188699 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400ce70 con 0x7f18cc1566b0 2023-10-06T04:57:38.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.996+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc1588e0 con 0x7f18cc1566b0 2023-10-06T04:57:38.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.997+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18cc0718b0 con 0x7f18cc1566b0 2023-10-06T04:57:38.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.998+0000 7f18c17fa700 1 -- 172.21.15.124:0/1031188699 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18c4014690 con 0x7f18cc1566b0 2023-10-06T04:57:38.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.999+0000 7f18c17fa700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b0066f30 0x7f18b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.999+0000 7f18c17fa700 1 -- 172.21.15.124:0/1031188699 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f18c4084c40 con 0x7f18cc1566b0 2023-10-06T04:57:38.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.999+0000 7f18d119b700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b0066f30 0x7f18b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.999+0000 7f18c17fa700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] conn(0x7f18b006d3a0 0x7f18b006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.999+0000 7f18c17fa700 1 -- 172.21.15.124:0/1031188699 --> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18b006fe80 con 0x7f18b006d3a0 2023-10-06T04:57:38.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:37.999+0000 7f18c17fa700 1 -- 172.21.15.124:0/1031188699 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18c40891c0 con 0x7f18cc1566b0 2023-10-06T04:57:38.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.000+0000 7f18d119b700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b0066f30 0x7f18b00693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f18c80099b0 tx=0x7f18c8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.000+0000 7f18d099a700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] conn(0x7f18b006d3a0 0x7f18b006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.000+0000 7f18d099a700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] conn(0x7f18b006d3a0 0x7f18b006f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.001+0000 7f18c17fa700 1 -- 172.21.15.124:0/1031188699 <== osd.5 v2:172.21.15.158:6808/115099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f18b006fe80 con 0x7f18b006d3a0 2023-10-06T04:57:38.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.015+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 --> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f18cc0b03e0 con 0x7f18b006d3a0 2023-10-06T04:57:38.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.016+0000 7f18c17fa700 1 -- 172.21.15.124:0/1031188699 <== osd.5 v2:172.21.15.158:6808/115099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f18cc0b03e0 con 0x7f18b006d3a0 2023-10-06T04:57:38.019 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:57:38.019 INFO:teuthology.orchestra.run.smithi124.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:57:38.019 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 >> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] conn(0x7f18b006d3a0 msgr2=0x7f18b006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d33ff700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.158:6808/115099,v1:172.21.15.158:6809/115099] conn(0x7f18b006d3a0 0x7f18b006f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b0066f30 msgr2=0x7f18b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d33ff700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f18b0066f30 0x7f18b00693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f18c80099b0 tx=0x7f18c8017000 comp rx=0 tx=0).stop 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18cc1566b0 msgr2=0x7f18cc0ad9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d33ff700 1 --2- 172.21.15.124:0/1031188699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18cc1566b0 0x7f18cc0ad9f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009df0 tx=0x7f18c400b040 comp rx=0 tx=0).stop 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d199c700 1 -- 172.21.15.124:0/1031188699 reap_dead start 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 shutdown_connections 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 >> 172.21.15.124:0/1031188699 conn(0x7f18cc068080 msgr2=0x7f18cc14d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 shutdown_connections 2023-10-06T04:57:38.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.017+0000 7f18d33ff700 1 -- 172.21.15.124:0/1031188699 wait complete. 2023-10-06T04:57:38.036 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T04:57:38.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.229+0000 7ff7b4dff700 1 Processor -- start 2023-10-06T04:57:38.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.229+0000 7ff7b4dff700 1 -- start start 2023-10-06T04:57:38.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.230+0000 7ff7b4dff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff7b00cb260 0x7ff7b00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.230+0000 7ff7b4dff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b00cd800 con 0x7ff7b015c9d0 2023-10-06T04:57:38.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.230+0000 7ff7b4dff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b0063cd0 con 0x7ff7b015db70 2023-10-06T04:57:38.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.230+0000 7ff7b4dff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b00cdc90 con 0x7ff7b00cb260 2023-10-06T04:57:38.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.230+0000 7ff7ae59c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff7b015c9d0 0x7ff7b00cab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47670/0 (socket says 172.21.15.124:47670) 2023-10-06T04:57:38.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.230+0000 7ff7ae59c700 1 -- 172.21.15.124:0/2055412173 learned_addr learned my addr 172.21.15.124:0/2055412173 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:38.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7add9b700 1 --2- 172.21.15.124:0/2055412173 >> v2:172.21.15.158:3300/0 conn(0x7ff7b00cb260 0x7ff7b00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116790452 0 0) 0x7ff7b00cd800 con 0x7ff7b015c9d0 2023-10-06T04:57:38.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff798003570 con 0x7ff7b015c9d0 2023-10-06T04:57:38.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4222551814 0 0) 0x7ff798003570 con 0x7ff7b015c9d0 2023-10-06T04:57:38.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 >> v2:172.21.15.158:3300/0 conn(0x7ff7b00cb260 msgr2=0x7ff7b00cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:38.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 --2- 172.21.15.124:0/2055412173 >> v2:172.21.15.158:3300/0 conn(0x7ff7b00cb260 0x7ff7b00cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 >> v1:172.21.15.158:6789/0 conn(0x7ff7b015db70 legacy=0x7ff7b00c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b00ccbf0 con 0x7ff7b015c9d0 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7ff7a00015f0 con 0x7ff7b015c9d0 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 >> v1:172.21.15.124:6789/0 conn(0x7ff7b015c9d0 legacy=0x7ff7b00cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff798003a60 0x7ff798003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff798004810 0x7ff798004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7980051c0 0x7ff79800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00cdc90 con 0x7ff7980051c0 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79800c0d0 con 0x7ff798004810 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79800c290 con 0x7ff798003a60 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7ae59c700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff798003a60 0x7ff798003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.231+0000 7ff7aed9d700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7980051c0 0x7ff79800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7add9b700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff798004810 0x7ff798004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7aed9d700 1 -- 172.21.15.124:0/2055412173 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff798003a60 msgr2=0x7ff798003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7aed9d700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff798003a60 0x7ff798003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7aed9d700 1 -- 172.21.15.124:0/2055412173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff798004810 msgr2=0x7ff798004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7aed9d700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff798004810 0x7ff798004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7aed9d700 1 -- 172.21.15.124:0/2055412173 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798003570 con 0x7ff7980051c0 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7aed9d700 1 -- 172.21.15.124:0/2055412173 reap_dead start 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7aed9d700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7980051c0 0x7ff79800ba60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8001fc0 tx=0x7ff7a8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d2b99659e3069c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8001950 con 0x7ff7980051c0 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a800c8b0 con 0x7ff7980051c0 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.232+0000 7ff7ad59a700 1 -- 172.21.15.124:0/2055412173 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800cc50 con 0x7ff7980051c0 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.233+0000 7ff7b4dff700 1 -- 172.21.15.124:0/2055412173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7980051c0 msgr2=0x7ff79800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.233+0000 7ff7b4dff700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7980051c0 0x7ff79800ba60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8001fc0 tx=0x7ff7a8001640 comp rx=0 tx=0).stop 2023-10-06T04:57:38.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.233+0000 7ff7b4dff700 1 -- 172.21.15.124:0/2055412173 shutdown_connections 2023-10-06T04:57:38.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.233+0000 7ff7b4dff700 1 --2- 172.21.15.124:0/2055412173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7980051c0 0x7ff79800ba60 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.233+0000 7ff7b4dff700 1 -- 172.21.15.124:0/2055412173 >> 172.21.15.124:0/2055412173 conn(0x7ff7b0097520 msgr2=0x7ff7b0087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:38.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.233+0000 7ff7b4dff700 1 -- 172.21.15.124:0/2055412173 shutdown_connections 2023-10-06T04:57:38.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.233+0000 7ff7b4dff700 1 -- 172.21.15.124:0/2055412173 wait complete. 2023-10-06T04:57:38.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.234+0000 7ff7b4dff700 1 Processor -- start 2023-10-06T04:57:38.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.235+0000 7ff7b4dff700 1 -- start start 2023-10-06T04:57:38.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.235+0000 7ff7b4dff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7980051c0 0x7ff7b009b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.235+0000 7ff7b4dff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7b009b750 0x7ff7b006bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.235+0000 7ff7b4dff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7b006c4a0 0x7ff7b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.235+0000 7ff7b4dff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b0099590 con 0x7ff7b009b750 2023-10-06T04:57:38.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.235+0000 7ff7b4dff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b009bbc0 con 0x7ff7b006c4a0 2023-10-06T04:57:38.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.235+0000 7ff7b4dff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00989c0 con 0x7ff7980051c0 2023-10-06T04:57:38.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7add9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7b009b750 0x7ff7b006bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7add9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7b009b750 0x7ff7b006bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57410/0 (socket says 172.21.15.124:57410) 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7add9b700 1 -- 172.21.15.124:0/4153278743 learned_addr learned my addr 172.21.15.124:0/4153278743 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7ae59c700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7980051c0 0x7ff7b009b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7aed9d700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7b006c4a0 0x7ff7b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7add9b700 1 -- 172.21.15.124:0/4153278743 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7980051c0 msgr2=0x7ff7b009b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7add9b700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7980051c0 0x7ff7b009b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7add9b700 1 -- 172.21.15.124:0/4153278743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7b006c4a0 msgr2=0x7ff7b006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7add9b700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7b006c4a0 0x7ff7b006c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7add9b700 1 -- 172.21.15.124:0/4153278743 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0098c60 con 0x7ff7b009b750 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff7add9b700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7b009b750 0x7ff7b006bf60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009fd0 tx=0x7ff7a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.236+0000 7ff79e7fc700 1 -- 172.21.15.124:0/4153278743 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400f790 con 0x7ff7b009b750 2023-10-06T04:57:38.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.237+0000 7ff79e7fc700 1 -- 172.21.15.124:0/4153278743 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a400f8f0 con 0x7ff7b009b750 2023-10-06T04:57:38.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.237+0000 7ff79e7fc700 1 -- 172.21.15.124:0/4153278743 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400fc70 con 0x7ff7b009b750 2023-10-06T04:57:38.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.237+0000 7ff7b4dff700 1 -- 172.21.15.124:0/4153278743 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b0098f40 con 0x7ff7b009b750 2023-10-06T04:57:38.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.237+0000 7ff7b4dff700 1 -- 172.21.15.124:0/4153278743 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b006ce30 con 0x7ff7b009b750 2023-10-06T04:57:38.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.238+0000 7ff7b4dff700 1 -- 172.21.15.124:0/4153278743 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b006d0b0 con 0x7ff7b009b750 2023-10-06T04:57:38.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.239+0000 7ff79e7fc700 1 -- 172.21.15.124:0/4153278743 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7a4014650 con 0x7ff7b009b750 2023-10-06T04:57:38.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.240+0000 7ff79e7fc700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff790066f30 0x7ff7900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.240+0000 7ff79e7fc700 1 -- 172.21.15.124:0/4153278743 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff7a4018030 con 0x7ff7b009b750 2023-10-06T04:57:38.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.241+0000 7ff7ae59c700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff790066f30 0x7ff7900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.241+0000 7ff7ae59c700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff790066f30 0x7ff7900693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0007a30 tx=0x7ff7a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.244+0000 7ff79e7fc700 1 -- 172.21.15.124:0/4153278743 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7b006d0b0 con 0x7ff7b009b750 2023-10-06T04:57:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.436+0000 7ff7b4dff700 1 -- 172.21.15.124:0/4153278743 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7b006d0b0 con 0x7ff790066f30 2023-10-06T04:57:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.437+0000 7ff79e7fc700 1 -- 172.21.15.124:0/4153278743 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff7b006d0b0 con 0x7ff790066f30 2023-10-06T04:57:38.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 -- 172.21.15.124:0/4153278743 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff790066f30 msgr2=0x7ff7900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff790066f30 0x7ff7900693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0007a30 tx=0x7ff7a0009040 comp rx=0 tx=0).stop 2023-10-06T04:57:38.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 -- 172.21.15.124:0/4153278743 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7b009b750 msgr2=0x7ff7b006bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7b009b750 0x7ff7b006bf60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009fd0 tx=0x7ff7a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 -- 172.21.15.124:0/4153278743 shutdown_connections 2023-10-06T04:57:38.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7b006c4a0 0x7ff7b006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7ff790066f30 0x7ff7900693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7980051c0 0x7ff7b009b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 --2- 172.21.15.124:0/4153278743 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff7b009b750 0x7ff7b006bf60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 -- 172.21.15.124:0/4153278743 >> 172.21.15.124:0/4153278743 conn(0x7ff7b0097520 msgr2=0x7ff7b0159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:38.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 -- 172.21.15.124:0/4153278743 shutdown_connections 2023-10-06T04:57:38.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.439+0000 7ff7b4dff700 1 -- 172.21.15.124:0/4153278743 wait complete. 2023-10-06T04:57:38.443 INFO:teuthology.orchestra.run.smithi124.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T04:57:38.459 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T04:57:38.459 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:57:38.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.651+0000 7f5d95fff700 1 Processor -- start 2023-10-06T04:57:38.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.651+0000 7f5d95fff700 1 -- start start 2023-10-06T04:57:38.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d95fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5d900ccf90 0x7f5d900cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d95fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5d900cff30 0x7f5d9015dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d95fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9015e240 con 0x7f5d901590b0 2023-10-06T04:57:38.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d95fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d900d03d0 con 0x7f5d900cff30 2023-10-06T04:57:38.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d95fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d90159c20 con 0x7f5d900ccf90 2023-10-06T04:57:38.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d8effd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5d900cff30 0x7f5d9015dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d8ffff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f5d901590b0 0x7f5d90159510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47678/0 (socket says 172.21.15.124:47678) 2023-10-06T04:57:38.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d8ffff700 1 -- 172.21.15.124:0/1400772002 learned_addr learned my addr 172.21.15.124:0/1400772002 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:38.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d8f7fe700 1 --2- 172.21.15.124:0/1400772002 >> v2:172.21.15.158:3300/0 conn(0x7f5d900ccf90 0x7f5d900cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d8effd700 1 -- 172.21.15.124:0/1400772002 >> v2:172.21.15.158:3300/0 conn(0x7f5d900ccf90 msgr2=0x7f5d900cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:38.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.653+0000 7f5d8effd700 1 --2- 172.21.15.124:0/1400772002 >> v2:172.21.15.158:3300/0 conn(0x7f5d900ccf90 0x7f5d900cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.654+0000 7f5d8effd700 1 -- 172.21.15.124:0/1400772002 >> v1:172.21.15.124:6789/0 conn(0x7f5d901590b0 legacy=0x7f5d90159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.654+0000 7f5d8effd700 1 -- 172.21.15.124:0/1400772002 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d900cee90 con 0x7f5d900cff30 2023-10-06T04:57:38.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.654+0000 7f5d8e7fc700 1 -- 172.21.15.124:0/1400772002 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839344362 0 0) 0x7f5d9015e240 con 0x7f5d901590b0 2023-10-06T04:57:38.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.654+0000 7f5d8effd700 1 --2- 172.21.15.124:0/1400772002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d900cff30 0x7f5d9015dd00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5d900893f0 tx=0x7f5d840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297c8514b618a347 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.654+0000 7f5d8e7fc700 1 -- 172.21.15.124:0/1400772002 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400b6b0 con 0x7f5d900cff30 2023-10-06T04:57:38.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.654+0000 7f5d8e7fc700 1 -- 172.21.15.124:0/1400772002 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8400b810 con 0x7f5d900cff30 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.654+0000 7f5d8e7fc700 1 -- 172.21.15.124:0/1400772002 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400bbb0 con 0x7f5d900cff30 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.654+0000 7f5d95fff700 1 -- 172.21.15.124:0/1400772002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d900cff30 msgr2=0x7f5d9015dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.654+0000 7f5d95fff700 1 --2- 172.21.15.124:0/1400772002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d900cff30 0x7f5d9015dd00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5d900893f0 tx=0x7f5d840091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.655+0000 7f5d95fff700 1 -- 172.21.15.124:0/1400772002 shutdown_connections 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.655+0000 7f5d95fff700 1 --2- 172.21.15.124:0/1400772002 >> v2:172.21.15.158:3300/0 conn(0x7f5d900ccf90 0x7f5d900cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.655+0000 7f5d95fff700 1 --2- 172.21.15.124:0/1400772002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d900cff30 0x7f5d9015dd00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.655+0000 7f5d95fff700 1 -- 172.21.15.124:0/1400772002 >> 172.21.15.124:0/1400772002 conn(0x7f5d9006ed20 msgr2=0x7f5d9006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.655+0000 7f5d95fff700 1 -- 172.21.15.124:0/1400772002 shutdown_connections 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.655+0000 7f5d95fff700 1 -- 172.21.15.124:0/1400772002 wait complete. 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.656+0000 7f5d95fff700 1 Processor -- start 2023-10-06T04:57:38.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.656+0000 7f5d95fff700 1 -- start start 2023-10-06T04:57:38.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.657+0000 7f5d95fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d900ccf90 0x7f5d90153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.657+0000 7f5d95fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d900cff30 0x7f5d90153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.657+0000 7f5d95fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d901590b0 0x7f5d90157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.657+0000 7f5d95fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900ca4c0 con 0x7f5d900cff30 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.657+0000 7f5d95fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d90154460 con 0x7f5d901590b0 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.657+0000 7f5d95fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900c98b0 con 0x7f5d900ccf90 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.657+0000 7f5d8effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d900cff30 0x7f5d90153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.657+0000 7f5d8effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d900cff30 0x7f5d90153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57426/0 (socket says 172.21.15.124:57426) 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d8effd700 1 -- 172.21.15.124:0/1344702211 learned_addr learned my addr 172.21.15.124:0/1344702211 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d8f7fe700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d900ccf90 0x7f5d90153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d8ffff700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d901590b0 0x7f5d90157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d8effd700 1 -- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d900ccf90 msgr2=0x7f5d90153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d8effd700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d900ccf90 0x7f5d90153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d8effd700 1 -- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d901590b0 msgr2=0x7f5d90157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d8effd700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d901590b0 0x7f5d90157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d8effd700 1 -- 172.21.15.124:0/1344702211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84009420 con 0x7f5d900cff30 2023-10-06T04:57:38.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d8effd700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d900cff30 0x7f5d90153f20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5d90089730 tx=0x7f5d84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d777fe700 1 -- 172.21.15.124:0/1344702211 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84011420 con 0x7f5d900cff30 2023-10-06T04:57:38.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d777fe700 1 -- 172.21.15.124:0/1344702211 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d84011580 con 0x7f5d900cff30 2023-10-06T04:57:38.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d777fe700 1 -- 172.21.15.124:0/1344702211 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84011940 con 0x7f5d900cff30 2023-10-06T04:57:38.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.658+0000 7f5d95fff700 1 -- 172.21.15.124:0/1344702211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d900c9b90 con 0x7f5d900cff30 2023-10-06T04:57:38.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.659+0000 7f5d95fff700 1 -- 172.21.15.124:0/1344702211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d900ca150 con 0x7f5d900cff30 2023-10-06T04:57:38.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.659+0000 7f5d757fa700 1 -- 172.21.15.124:0/1344702211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d68000fd0 con 0x7f5d900cff30 2023-10-06T04:57:38.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.660+0000 7f5d777fe700 1 -- 172.21.15.124:0/1344702211 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d84011d30 con 0x7f5d900cff30 2023-10-06T04:57:38.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.661+0000 7f5d777fe700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5d7c066f30 0x7f5d7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.661+0000 7f5d777fe700 1 -- 172.21.15.124:0/1344702211 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5d84085e90 con 0x7f5d900cff30 2023-10-06T04:57:38.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.662+0000 7f5d8f7fe700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5d7c066f30 0x7f5d7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.662+0000 7f5d777fe700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] conn(0x7f5d7c06d3a0 0x7f5d7c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.662+0000 7f5d777fe700 1 -- 172.21.15.124:0/1344702211 --> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d7c06fe80 con 0x7f5d7c06d3a0 2023-10-06T04:57:38.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.662+0000 7f5d777fe700 1 -- 172.21.15.124:0/1344702211 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d840883f0 con 0x7f5d900cff30 2023-10-06T04:57:38.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.662+0000 7f5d8ffff700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] conn(0x7f5d7c06d3a0 0x7f5d7c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.662+0000 7f5d8f7fe700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5d7c066f30 0x7f5d7c0693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d800074f0 tx=0x7f5d80009700 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.663+0000 7f5d8ffff700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] conn(0x7f5d7c06d3a0 0x7f5d7c06f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.664+0000 7f5d777fe700 1 -- 172.21.15.124:0/1344702211 <== osd.6 v2:172.21.15.158:6816/115109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5d7c06fe80 con 0x7f5d7c06d3a0 2023-10-06T04:57:38.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.678+0000 7f5d757fa700 1 -- 172.21.15.124:0/1344702211 --> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5d68002d50 con 0x7f5d7c06d3a0 2023-10-06T04:57:38.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.678+0000 7f5d777fe700 1 -- 172.21.15.124:0/1344702211 <== osd.6 v2:172.21.15.158:6816/115109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5d68002d50 con 0x7f5d7c06d3a0 2023-10-06T04:57:38.681 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:57:38.681 INFO:teuthology.orchestra.run.smithi124.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:57:38.681 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:57:38.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d757fa700 1 -- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] conn(0x7f5d7c06d3a0 msgr2=0x7f5d7c06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d757fa700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.158:6816/115109,v1:172.21.15.158:6817/115109] conn(0x7f5d7c06d3a0 0x7f5d7c06f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d757fa700 1 -- 172.21.15.124:0/1344702211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5d7c066f30 msgr2=0x7f5d7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d757fa700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f5d7c066f30 0x7f5d7c0693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d800074f0 tx=0x7f5d80009700 comp rx=0 tx=0).stop 2023-10-06T04:57:38.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d757fa700 1 -- 172.21.15.124:0/1344702211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d900cff30 msgr2=0x7f5d90153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d757fa700 1 --2- 172.21.15.124:0/1344702211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d900cff30 0x7f5d90153f20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5d90089730 tx=0x7f5d84017000 comp rx=0 tx=0).stop 2023-10-06T04:57:38.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d8ffff700 1 -- 172.21.15.124:0/1344702211 reap_dead start 2023-10-06T04:57:38.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d757fa700 1 -- 172.21.15.124:0/1344702211 shutdown_connections 2023-10-06T04:57:38.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d757fa700 1 -- 172.21.15.124:0/1344702211 >> 172.21.15.124:0/1344702211 conn(0x7f5d9006ed20 msgr2=0x7f5d900c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:38.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d757fa700 1 -- 172.21.15.124:0/1344702211 shutdown_connections 2023-10-06T04:57:38.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.679+0000 7f5d757fa700 1 -- 172.21.15.124:0/1344702211 wait complete. 2023-10-06T04:57:38.698 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T04:57:38.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.886+0000 7f605edff700 1 Processor -- start 2023-10-06T04:57:38.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.886+0000 7f605edff700 1 -- start start 2023-10-06T04:57:38.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.887+0000 7f605edff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60580b3d30 0x7f605815a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.887+0000 7f605edff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605815aac0 con 0x7f60580b1ea0 2023-10-06T04:57:38.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f605edff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60580b41b0 con 0x7f60581594b0 2023-10-06T04:57:38.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f605edff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60580b4410 con 0x7f60580b3d30 2023-10-06T04:57:38.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f605d39c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f60580b1ea0 0x7f605815acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47690/0 (socket says 172.21.15.124:47690) 2023-10-06T04:57:38.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f605d39c700 1 -- 172.21.15.124:0/768787243 learned_addr learned my addr 172.21.15.124:0/768787243 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:38.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f6057fff700 1 --2- 172.21.15.124:0/768787243 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60580b3d30 0x7f605815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f60577fe700 1 -- 172.21.15.124:0/768787243 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738577885 0 0) 0x7f605815aac0 con 0x7f60580b1ea0 2023-10-06T04:57:38.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f60577fe700 1 -- 172.21.15.124:0/768787243 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6048003570 con 0x7f60580b1ea0 2023-10-06T04:57:38.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f60577fe700 1 -- 172.21.15.124:0/768787243 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31019961 0 0) 0x7f60580b41b0 con 0x7f60581594b0 2023-10-06T04:57:38.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f60577fe700 1 -- 172.21.15.124:0/768787243 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f605815aac0 con 0x7f60581594b0 2023-10-06T04:57:38.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f60577fe700 1 -- 172.21.15.124:0/768787243 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2702940204 0 0) 0x7f6048003570 con 0x7f60580b1ea0 2023-10-06T04:57:38.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f6057fff700 1 -- 172.21.15.124:0/768787243 >> v1:172.21.15.158:6789/0 conn(0x7f60581594b0 legacy=0x7f60580b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.888+0000 7f6057fff700 1 -- 172.21.15.124:0/768787243 >> v1:172.21.15.124:6789/0 conn(0x7f60580b1ea0 legacy=0x7f605815acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.889+0000 7f6057fff700 1 -- 172.21.15.124:0/768787243 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60580b46f0 con 0x7f60580b3d30 2023-10-06T04:57:38.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.889+0000 7f6057fff700 1 --2- 172.21.15.124:0/768787243 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60580b3d30 0x7f605815a580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6044009910 tx=0x7f60440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27a26d2712cf2e3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.889+0000 7f60577fe700 1 -- 172.21.15.124:0/768787243 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60500017f0 con 0x7f60580b3d30 2023-10-06T04:57:38.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.889+0000 7f60577fe700 1 -- 172.21.15.124:0/768787243 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6044011420 con 0x7f60580b3d30 2023-10-06T04:57:38.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.889+0000 7f60577fe700 1 -- 172.21.15.124:0/768787243 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60440117a0 con 0x7f60580b3d30 2023-10-06T04:57:38.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.890+0000 7f605edff700 1 -- 172.21.15.124:0/768787243 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60580b3d30 msgr2=0x7f605815a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.890+0000 7f605edff700 1 --2- 172.21.15.124:0/768787243 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60580b3d30 0x7f605815a580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6044009910 tx=0x7f60440091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.890+0000 7f605edff700 1 -- 172.21.15.124:0/768787243 shutdown_connections 2023-10-06T04:57:38.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.890+0000 7f605edff700 1 --2- 172.21.15.124:0/768787243 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60580b3d30 0x7f605815a580 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.890+0000 7f605edff700 1 -- 172.21.15.124:0/768787243 >> 172.21.15.124:0/768787243 conn(0x7f605806ed20 msgr2=0x7f605806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:38.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.890+0000 7f605edff700 1 -- 172.21.15.124:0/768787243 shutdown_connections 2023-10-06T04:57:38.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.890+0000 7f605edff700 1 -- 172.21.15.124:0/768787243 wait complete. 2023-10-06T04:57:38.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.891+0000 7f605edff700 1 Processor -- start 2023-10-06T04:57:38.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.891+0000 7f605edff700 1 -- start start 2023-10-06T04:57:38.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.892+0000 7f605edff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60580b1ea0 0x7f6058145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.892+0000 7f605edff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60580b3d30 0x7f605815e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.892+0000 7f605edff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60581594b0 0x7f605815e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.892+0000 7f605edff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605815c9e0 con 0x7f60580b1ea0 2023-10-06T04:57:38.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.892+0000 7f605edff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605815ccc0 con 0x7f60581594b0 2023-10-06T04:57:38.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.892+0000 7f605edff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605815cfa0 con 0x7f60580b3d30 2023-10-06T04:57:38.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.892+0000 7f605cb9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60580b1ea0 0x7f6058145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f605cb9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60580b1ea0 0x7f6058145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57432/0 (socket says 172.21.15.124:57432) 2023-10-06T04:57:38.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f605cb9b700 1 -- 172.21.15.124:0/1912104588 learned_addr learned my addr 172.21.15.124:0/1912104588 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:38.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f605cb9b700 1 -- 172.21.15.124:0/1912104588 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60580b3d30 msgr2=0x7f605815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f605cb9b700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60580b3d30 0x7f605815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f605cb9b700 1 -- 172.21.15.124:0/1912104588 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60581594b0 msgr2=0x7f605815e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f605cb9b700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60581594b0 0x7f605815e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f605cb9b700 1 -- 172.21.15.124:0/1912104588 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044009420 con 0x7f60580b1ea0 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f605cb9b700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60580b1ea0 0x7f6058145d90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f604c00c590 tx=0x7f604c007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f6054ff9700 1 -- 172.21.15.124:0/1912104588 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c010510 con 0x7f60580b1ea0 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f6054ff9700 1 -- 172.21.15.124:0/1912104588 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c010670 con 0x7f60580b1ea0 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f605edff700 1 -- 172.21.15.124:0/1912104588 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605815d280 con 0x7f60580b1ea0 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.893+0000 7f6054ff9700 1 -- 172.21.15.124:0/1912104588 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c010a30 con 0x7f60580b1ea0 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.894+0000 7f605edff700 1 -- 172.21.15.124:0/1912104588 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60581462d0 con 0x7f60580b1ea0 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.895+0000 7f605edff700 1 -- 172.21.15.124:0/1912104588 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60580717a0 con 0x7f60580b1ea0 2023-10-06T04:57:38.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.896+0000 7f6054ff9700 1 -- 172.21.15.124:0/1912104588 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f604c01b400 con 0x7f60580b1ea0 2023-10-06T04:57:38.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.897+0000 7f6054ff9700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f603c066f30 0x7f603c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:38.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.897+0000 7f6054ff9700 1 -- 172.21.15.124:0/1912104588 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f604c083fc0 con 0x7f60580b1ea0 2023-10-06T04:57:38.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.897+0000 7f6057fff700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f603c066f30 0x7f603c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:38.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.898+0000 7f6057fff700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f603c066f30 0x7f603c0693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6058068970 tx=0x7f6044016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:38.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:38.901+0000 7f6054ff9700 1 -- 172.21.15.124:0/1912104588 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f604c0513d0 con 0x7f60580b1ea0 2023-10-06T04:57:39.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.093+0000 7f605edff700 1 -- 172.21.15.124:0/1912104588 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f60580b49d0 con 0x7f603c066f30 2023-10-06T04:57:39.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.093+0000 7f6054ff9700 1 -- 172.21.15.124:0/1912104588 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f60580b49d0 con 0x7f603c066f30 2023-10-06T04:57:39.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 -- 172.21.15.124:0/1912104588 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f603c066f30 msgr2=0x7f603c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f603c066f30 0x7f603c0693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6058068970 tx=0x7f6044016000 comp rx=0 tx=0).stop 2023-10-06T04:57:39.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 -- 172.21.15.124:0/1912104588 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60580b1ea0 msgr2=0x7f6058145d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60580b1ea0 0x7f6058145d90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f604c00c590 tx=0x7f604c007dc0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 -- 172.21.15.124:0/1912104588 shutdown_connections 2023-10-06T04:57:39.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60581594b0 0x7f605815e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60580b1ea0 0x7f6058145d90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f603c066f30 0x7f603c0693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 --2- 172.21.15.124:0/1912104588 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60580b3d30 0x7f605815e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 -- 172.21.15.124:0/1912104588 >> 172.21.15.124:0/1912104588 conn(0x7f605806ed20 msgr2=0x7f6058158150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:39.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 -- 172.21.15.124:0/1912104588 shutdown_connections 2023-10-06T04:57:39.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.096+0000 7f605edff700 1 -- 172.21.15.124:0/1912104588 wait complete. 2023-10-06T04:57:39.100 INFO:teuthology.orchestra.run.smithi124.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T04:57:39.116 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T04:57:39.116 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:57:39.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.307+0000 7fb220fff700 1 Processor -- start 2023-10-06T04:57:39.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.307+0000 7fb220fff700 1 -- start start 2023-10-06T04:57:39.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.308+0000 7fb220fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb21c159b90 0x7fb21c0b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.308+0000 7fb220fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb21c0cd410 0x7fb21c0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.308+0000 7fb220fff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21c0b11a0 con 0x7fb21c0cd040 2023-10-06T04:57:39.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.308+0000 7fb220fff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21c15d970 con 0x7fb21c0cd410 2023-10-06T04:57:39.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.308+0000 7fb220fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c15dc50 con 0x7fb21c159b90 2023-10-06T04:57:39.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb21ad9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb21c0cd410 0x7fb21c0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb21a59c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb21c0cd040 0x7fb21c159480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47704/0 (socket says 172.21.15.124:47704) 2023-10-06T04:57:39.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb21a59c700 1 -- 172.21.15.124:0/265589066 learned_addr learned my addr 172.21.15.124:0/265589066 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:39.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb219d9b700 1 --2- 172.21.15.124:0/265589066 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb21c159b90 0x7fb21c0b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb21ad9d700 1 -- 172.21.15.124:0/265589066 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb21c159b90 msgr2=0x7fb21c0b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:39.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb21ad9d700 1 --2- 172.21.15.124:0/265589066 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb21c159b90 0x7fb21c0b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb21ad9d700 1 -- 172.21.15.124:0/265589066 >> v1:172.21.15.124:6789/0 conn(0x7fb21c0cd040 legacy=0x7fb21c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb21ad9d700 1 -- 172.21.15.124:0/265589066 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c15df30 con 0x7fb21c0cd410 2023-10-06T04:57:39.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb21959a700 1 -- 172.21.15.124:0/265589066 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23600380 0 0) 0x7fb21c0b11a0 con 0x7fb21c0cd040 2023-10-06T04:57:39.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb21ad9d700 1 --2- 172.21.15.124:0/265589066 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb21c0cd410 0x7fb21c0cb570 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb214009e60 tx=0x7fb214009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1beaa5b3249f1ead server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:39.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.309+0000 7fb21959a700 1 -- 172.21.15.124:0/265589066 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400e070 con 0x7fb21c0cd410 2023-10-06T04:57:39.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.310+0000 7fb21959a700 1 -- 172.21.15.124:0/265589066 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21400bb60 con 0x7fb21c0cd410 2023-10-06T04:57:39.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.310+0000 7fb21959a700 1 -- 172.21.15.124:0/265589066 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214012430 con 0x7fb21c0cd410 2023-10-06T04:57:39.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.310+0000 7fb220fff700 1 -- 172.21.15.124:0/265589066 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb21c0cd410 msgr2=0x7fb21c0cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.310+0000 7fb220fff700 1 --2- 172.21.15.124:0/265589066 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb21c0cd410 0x7fb21c0cb570 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb214009e60 tx=0x7fb214009780 comp rx=0 tx=0).stop 2023-10-06T04:57:39.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.310+0000 7fb220fff700 1 -- 172.21.15.124:0/265589066 shutdown_connections 2023-10-06T04:57:39.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.310+0000 7fb220fff700 1 --2- 172.21.15.124:0/265589066 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb21c0cd410 0x7fb21c0cb570 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.310+0000 7fb220fff700 1 --2- 172.21.15.124:0/265589066 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb21c159b90 0x7fb21c0b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.310+0000 7fb220fff700 1 -- 172.21.15.124:0/265589066 >> 172.21.15.124:0/265589066 conn(0x7fb21c06ed20 msgr2=0x7fb21c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:39.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.310+0000 7fb220fff700 1 -- 172.21.15.124:0/265589066 shutdown_connections 2023-10-06T04:57:39.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.310+0000 7fb220fff700 1 -- 172.21.15.124:0/265589066 wait complete. 2023-10-06T04:57:39.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.312+0000 7fb220fff700 1 Processor -- start 2023-10-06T04:57:39.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.313+0000 7fb220fff700 1 -- start start 2023-10-06T04:57:39.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb220fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb21c0cd040 0x7fb21c156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb220fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb21c0cd410 0x7fb21c157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb220fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb21c159b90 0x7fb21c157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb220fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c15b6e0 con 0x7fb21c0cd040 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb220fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c157350 con 0x7fb21c0cd410 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb220fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0b6180 con 0x7fb21c159b90 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb21a59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb21c0cd040 0x7fb21c156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb21a59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb21c0cd040 0x7fb21c156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57446/0 (socket says 172.21.15.124:57446) 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb21a59c700 1 -- 172.21.15.124:0/2642166658 learned_addr learned my addr 172.21.15.124:0/2642166658 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb21a59c700 1 -- 172.21.15.124:0/2642166658 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb21c159b90 msgr2=0x7fb21c157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb21a59c700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb21c159b90 0x7fb21c157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb21a59c700 1 -- 172.21.15.124:0/2642166658 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb21c0cd410 msgr2=0x7fb21c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb21a59c700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb21c0cd410 0x7fb21c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.314+0000 7fb21a59c700 1 -- 172.21.15.124:0/2642166658 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214009a20 con 0x7fb21c0cd040 2023-10-06T04:57:39.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.315+0000 7fb21a59c700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb21c0cd040 0x7fb21c156e10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00c7e0 tx=0x7fb20c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:39.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.315+0000 7fb20a7fc700 1 -- 172.21.15.124:0/2642166658 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c005b30 con 0x7fb21c0cd040 2023-10-06T04:57:39.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.315+0000 7fb20a7fc700 1 -- 172.21.15.124:0/2642166658 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c005c90 con 0x7fb21c0cd040 2023-10-06T04:57:39.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.315+0000 7fb20a7fc700 1 -- 172.21.15.124:0/2642166658 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c007300 con 0x7fb21c0cd040 2023-10-06T04:57:39.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.315+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c15ab10 con 0x7fb21c0cd040 2023-10-06T04:57:39.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.315+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c15b090 con 0x7fb21c0cd040 2023-10-06T04:57:39.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.316+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb21c0718b0 con 0x7fb21c0cd040 2023-10-06T04:57:39.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.317+0000 7fb20a7fc700 1 -- 172.21.15.124:0/2642166658 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb20c01b400 con 0x7fb21c0cd040 2023-10-06T04:57:39.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.318+0000 7fb20a7fc700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb1fc066f30 0x7fb1fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.318+0000 7fb20a7fc700 1 -- 172.21.15.124:0/2642166658 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb20c083e60 con 0x7fb21c0cd040 2023-10-06T04:57:39.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.318+0000 7fb219d9b700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb1fc066f30 0x7fb1fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.318+0000 7fb20a7fc700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] conn(0x7fb1fc06d3a0 0x7fb1fc06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.318+0000 7fb20a7fc700 1 -- 172.21.15.124:0/2642166658 --> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1fc06fe80 con 0x7fb1fc06d3a0 2023-10-06T04:57:39.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.318+0000 7fb20a7fc700 1 -- 172.21.15.124:0/2642166658 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb20c086440 con 0x7fb21c0cd040 2023-10-06T04:57:39.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.318+0000 7fb21ad9d700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] conn(0x7fb1fc06d3a0 0x7fb1fc06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.318+0000 7fb219d9b700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb1fc066f30 0x7fb1fc0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0b5680 tx=0x7fb2100091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:39.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.319+0000 7fb21ad9d700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] conn(0x7fb1fc06d3a0 0x7fb1fc06f7b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:39.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.320+0000 7fb20a7fc700 1 -- 172.21.15.124:0/2642166658 <== osd.7 v2:172.21.15.158:6824/115130 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb1fc06fe80 con 0x7fb1fc06d3a0 2023-10-06T04:57:39.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.334+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 --> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb21c15e210 con 0x7fb1fc06d3a0 2023-10-06T04:57:39.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.335+0000 7fb20a7fc700 1 -- 172.21.15.124:0/2642166658 <== osd.7 v2:172.21.15.158:6824/115130 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb21c15e210 con 0x7fb1fc06d3a0 2023-10-06T04:57:39.337 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T04:57:39.338 INFO:teuthology.orchestra.run.smithi124.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:57:39.338 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.335+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 >> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] conn(0x7fb1fc06d3a0 msgr2=0x7fb1fc06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.335+0000 7fb220fff700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.158:6824/115130,v1:172.21.15.158:6825/115130] conn(0x7fb1fc06d3a0 0x7fb1fc06f7b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.336+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb1fc066f30 msgr2=0x7fb1fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.336+0000 7fb220fff700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fb1fc066f30 0x7fb1fc0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0b5680 tx=0x7fb2100091a0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.336+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb21c0cd040 msgr2=0x7fb21c156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.336+0000 7fb220fff700 1 --2- 172.21.15.124:0/2642166658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb21c0cd040 0x7fb21c156e10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00c7e0 tx=0x7fb20c007df0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.336+0000 7fb21ad9d700 1 -- 172.21.15.124:0/2642166658 reap_dead start 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.336+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 shutdown_connections 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.336+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 >> 172.21.15.124:0/2642166658 conn(0x7fb21c06ed20 msgr2=0x7fb21c0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.336+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 shutdown_connections 2023-10-06T04:57:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.336+0000 7fb220fff700 1 -- 172.21.15.124:0/2642166658 wait complete. 2023-10-06T04:57:39.355 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T04:57:39.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.542+0000 7fbae95ff700 1 Processor -- start 2023-10-06T04:57:39.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.542+0000 7fbae95ff700 1 -- start start 2023-10-06T04:57:39.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.543+0000 7fbae95ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbae406ede0 0x7fbae406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.543+0000 7fbae95ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae406f650 con 0x7fbae40ae320 2023-10-06T04:57:39.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.543+0000 7fbae95ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae406a090 con 0x7fbae40ae6f0 2023-10-06T04:57:39.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.543+0000 7fbae95ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae406f370 con 0x7fbae406ede0 2023-10-06T04:57:39.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae2ffd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fbae40ae320 0x7fbae40c66c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47714/0 (socket says 172.21.15.124:47714) 2023-10-06T04:57:39.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae2ffd700 1 -- 172.21.15.124:0/1177895622 learned_addr learned my addr 172.21.15.124:0/1177895622 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:57:39.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae37fe700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbae406ede0 0x7fbae406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644338013 0 0) 0x7fbad4001110 con 0x7fbae40ae320 2023-10-06T04:57:39.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbacc003570 con 0x7fbae40ae320 2023-10-06T04:57:39.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1373870323 0 0) 0x7fbacc003570 con 0x7fbae40ae320 2023-10-06T04:57:39.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbae406ede0 msgr2=0x7fbae406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:39.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae1ffb700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbae406ede0 0x7fbae406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 >> v1:172.21.15.158:6789/0 conn(0x7fbae40ae6f0 legacy=0x7fbae40c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae4069a40 con 0x7fbae40ae320 2023-10-06T04:57:39.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168819425 0 0) 0x7fbad4001600 con 0x7fbae40ae320 2023-10-06T04:57:39.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.544+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 >> v1:172.21.15.124:6789/0 conn(0x7fbae40ae320 legacy=0x7fbae40c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae1ffb700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbae406ede0 0x7fbacc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae1ffb700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbacc003fd0 0x7fbacc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae1ffb700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbacc004d50 0x7fbacc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae406f370 con 0x7fbacc003fd0 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc00dd50 con 0x7fbacc004d50 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc00df10 con 0x7fbae406ede0 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae27fc700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbacc003fd0 0x7fbacc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae37fe700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbacc004d50 0x7fbacc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae2ffd700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbae406ede0 0x7fbacc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae27fc700 1 -- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbae406ede0 msgr2=0x7fbacc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae27fc700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbae406ede0 0x7fbacc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae27fc700 1 -- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbacc004d50 msgr2=0x7fbacc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae27fc700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbacc004d50 0x7fbacc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.545+0000 7fbae27fc700 1 -- 172.21.15.124:0/1177895622 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc003570 con 0x7fbacc003fd0 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae27fc700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbacc003fd0 0x7fbacc004810 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbad80019a0 tx=0x7fbad8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0c4acdb9d8e046 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800c5d0 con 0x7fbacc003fd0 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800c750 con 0x7fbacc003fd0 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae1ffb700 1 -- 172.21.15.124:0/1177895622 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800cb10 con 0x7fbacc003fd0 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae95ff700 1 -- 172.21.15.124:0/1177895622 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbacc003fd0 msgr2=0x7fbacc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae95ff700 1 --2- 172.21.15.124:0/1177895622 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbacc003fd0 0x7fbacc004810 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbad80019a0 tx=0x7fbad8007d10 comp rx=0 tx=0).stop 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae37fe700 1 -- 172.21.15.124:0/1177895622 reap_dead start 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae95ff700 1 -- 172.21.15.124:0/1177895622 shutdown_connections 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae95ff700 1 -- 172.21.15.124:0/1177895622 >> 172.21.15.124:0/1177895622 conn(0x7fbae40cc080 msgr2=0x7fbae40cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae95ff700 1 -- 172.21.15.124:0/1177895622 shutdown_connections 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.546+0000 7fbae95ff700 1 -- 172.21.15.124:0/1177895622 wait complete. 2023-10-06T04:57:39.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.548+0000 7fbae95ff700 1 Processor -- start 2023-10-06T04:57:39.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.548+0000 7fbae95ff700 1 -- start start 2023-10-06T04:57:39.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae95ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbacc003fd0 0x7fbae4153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae95ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae4157070 0x7fbae4097650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae95ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbae4169730 0x7fbae40b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae95ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4097f50 con 0x7fbae4157070 2023-10-06T04:57:39.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae95ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4098230 con 0x7fbae4169730 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae95ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4098510 con 0x7fbacc003fd0 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae27fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae4157070 0x7fbae4097650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae27fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae4157070 0x7fbae4097650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57462/0 (socket says 172.21.15.124:57462) 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae27fc700 1 -- 172.21.15.124:0/848158465 learned_addr learned my addr 172.21.15.124:0/848158465 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae2ffd700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbacc003fd0 0x7fbae4153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.549+0000 7fbae37fe700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbae4169730 0x7fbae40b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbae27fc700 1 -- 172.21.15.124:0/848158465 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbacc003fd0 msgr2=0x7fbae4153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbae27fc700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbacc003fd0 0x7fbae4153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbae27fc700 1 -- 172.21.15.124:0/848158465 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbae4169730 msgr2=0x7fbae40b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbae27fc700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbae4169730 0x7fbae40b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbae27fc700 1 -- 172.21.15.124:0/848158465 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae40987f0 con 0x7fbae4157070 2023-10-06T04:57:39.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbae27fc700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae4157070 0x7fbae4097650 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00dd20 tx=0x7fbad8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbacaffd700 1 -- 172.21.15.124:0/848158465 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8007af0 con 0x7fbae4157070 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbacaffd700 1 -- 172.21.15.124:0/848158465 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800c5d0 con 0x7fbae4157070 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbae95ff700 1 -- 172.21.15.124:0/848158465 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae4098ad0 con 0x7fbae4157070 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbacaffd700 1 -- 172.21.15.124:0/848158465 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800cb10 con 0x7fbae4157070 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.550+0000 7fbae95ff700 1 -- 172.21.15.124:0/848158465 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae4097b90 con 0x7fbae4157070 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.551+0000 7fbae95ff700 1 -- 172.21.15.124:0/848158465 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae40717a0 con 0x7fbae4157070 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.552+0000 7fbacaffd700 1 -- 172.21.15.124:0/848158465 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbad8019030 con 0x7fbae4157070 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.553+0000 7fbacaffd700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbad0066f30 0x7fbad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.553+0000 7fbacaffd700 1 -- 172.21.15.124:0/848158465 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fbad8085850 con 0x7fbae4157070 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.553+0000 7fbae2ffd700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbad0066f30 0x7fbad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.554+0000 7fbae2ffd700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbad0066f30 0x7fbad00693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbad4000e50 tx=0x7fbad4007a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:39.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.557+0000 7fbacaffd700 1 -- 172.21.15.124:0/848158465 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbad8052c80 con 0x7fbae4157070 2023-10-06T04:57:39.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.746+0000 7fbae95ff700 1 -- 172.21.15.124:0/848158465 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fbae4097f50 con 0x7fbad0066f30 2023-10-06T04:57:39.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.747+0000 7fbacaffd700 1 -- 172.21.15.124:0/848158465 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbae4097f50 con 0x7fbad0066f30 2023-10-06T04:57:39.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 -- 172.21.15.124:0/848158465 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbad0066f30 msgr2=0x7fbad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbad0066f30 0x7fbad00693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbad4000e50 tx=0x7fbad4007a50 comp rx=0 tx=0).stop 2023-10-06T04:57:39.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 -- 172.21.15.124:0/848158465 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae4157070 msgr2=0x7fbae4097650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae4157070 0x7fbae4097650 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00dd20 tx=0x7fbad8015000 comp rx=0 tx=0).stop 2023-10-06T04:57:39.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 -- 172.21.15.124:0/848158465 shutdown_connections 2023-10-06T04:57:39.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbae4169730 0x7fbae40b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fbad0066f30 0x7fbad00693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbacc003fd0 0x7fbae4153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 --2- 172.21.15.124:0/848158465 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae4157070 0x7fbae4097650 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 -- 172.21.15.124:0/848158465 >> 172.21.15.124:0/848158465 conn(0x7fbae40cc080 msgr2=0x7fbae40ad160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:39.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 -- 172.21.15.124:0/848158465 shutdown_connections 2023-10-06T04:57:39.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.749+0000 7fbae95ff700 1 -- 172.21.15.124:0/848158465 wait complete. 2023-10-06T04:57:39.754 INFO:teuthology.orchestra.run.smithi124.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T04:57:39.769 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:57:39.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.956+0000 7f8a101ff700 1 Processor -- start 2023-10-06T04:57:39.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.956+0000 7f8a101ff700 1 -- start start 2023-10-06T04:57:39.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.957+0000 7f8a101ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8a080cae80 0x7f8a080cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.957+0000 7f8a101ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8a080ccec0 0x7f8a081591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a101ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a080cb250 0x7f8a08159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a101ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a080cd430 con 0x7f8a080cae80 2023-10-06T04:57:39.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a101ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a08159c50 con 0x7f8a080ccec0 2023-10-06T04:57:39.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a101ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080c1d10 con 0x7f8a080cb250 2023-10-06T04:57:39.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a0df9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8a080cae80 0x7f8a080cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a0df9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8a080cae80 0x7f8a080cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57466/0 (socket says 172.21.15.124:57466) 2023-10-06T04:57:39.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a0df9b700 1 -- 172.21.15.124:0/2755055024 learned_addr learned my addr 172.21.15.124:0/2755055024 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:39.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a0e79c700 1 --2- 172.21.15.124:0/2755055024 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a080cb250 0x7f8a08159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a0d79a700 1 --2- 172.21.15.124:0/2755055024 >> v2:172.21.15.158:3300/0 conn(0x7f8a080ccec0 0x7f8a081591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a0df9b700 1 -- 172.21.15.124:0/2755055024 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a080cb250 msgr2=0x7f8a08159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:39.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a0df9b700 1 --2- 172.21.15.124:0/2755055024 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a080cb250 0x7f8a08159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a0df9b700 1 -- 172.21.15.124:0/2755055024 >> v2:172.21.15.158:3300/0 conn(0x7f8a080ccec0 msgr2=0x7f8a081591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:57:39.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a0df9b700 1 --2- 172.21.15.124:0/2755055024 >> v2:172.21.15.158:3300/0 conn(0x7f8a080ccec0 0x7f8a081591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.958+0000 7f8a0df9b700 1 -- 172.21.15.124:0/2755055024 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a080688a0 con 0x7f8a080cae80 2023-10-06T04:57:39.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a0df9b700 1 --2- 172.21.15.124:0/2755055024 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080cae80 0x7f8a080cc980 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8a08088750 tx=0x7f8a04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a87366f3c0c45f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:39.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a0cf99700 1 -- 172.21.15.124:0/2755055024 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400b8b0 con 0x7f8a080cae80 2023-10-06T04:57:39.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a0cf99700 1 -- 172.21.15.124:0/2755055024 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0400ba10 con 0x7f8a080cae80 2023-10-06T04:57:39.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a0cf99700 1 -- 172.21.15.124:0/2755055024 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400bdb0 con 0x7f8a080cae80 2023-10-06T04:57:39.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a101ff700 1 -- 172.21.15.124:0/2755055024 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080cae80 msgr2=0x7f8a080cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a101ff700 1 --2- 172.21.15.124:0/2755055024 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080cae80 0x7f8a080cc980 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8a08088750 tx=0x7f8a04009250 comp rx=0 tx=0).stop 2023-10-06T04:57:39.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a101ff700 1 -- 172.21.15.124:0/2755055024 shutdown_connections 2023-10-06T04:57:39.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a101ff700 1 --2- 172.21.15.124:0/2755055024 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a080cb250 0x7f8a08159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a101ff700 1 --2- 172.21.15.124:0/2755055024 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080cae80 0x7f8a080cc980 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a101ff700 1 --2- 172.21.15.124:0/2755055024 >> v2:172.21.15.158:3300/0 conn(0x7f8a080ccec0 0x7f8a081591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.959+0000 7f8a101ff700 1 -- 172.21.15.124:0/2755055024 >> 172.21.15.124:0/2755055024 conn(0x7f8a080974f0 msgr2=0x7f8a080639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:39.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.960+0000 7f8a101ff700 1 -- 172.21.15.124:0/2755055024 shutdown_connections 2023-10-06T04:57:39.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.960+0000 7f8a101ff700 1 -- 172.21.15.124:0/2755055024 wait complete. 2023-10-06T04:57:39.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.961+0000 7f8a101ff700 1 Processor -- start 2023-10-06T04:57:39.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.961+0000 7f8a101ff700 1 -- start start 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.962+0000 7f8a101ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a080cae80 0x7f8a081588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.962+0000 7f8a101ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a080cb250 0x7f8a0815a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.962+0000 7f8a101ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080ccec0 0x7f8a0815fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.962+0000 7f8a101ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08158e10 con 0x7f8a080ccec0 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.962+0000 7f8a101ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080c53e0 con 0x7f8a080cb250 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.962+0000 7f8a101ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080b1570 con 0x7f8a080cae80 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.962+0000 7f8a0e79c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080ccec0 0x7f8a0815fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.962+0000 7f8a0e79c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080ccec0 0x7f8a0815fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57478/0 (socket says 172.21.15.124:57478) 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.962+0000 7f8a0e79c700 1 -- 172.21.15.124:0/1734627855 learned_addr learned my addr 172.21.15.124:0/1734627855 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f8a0df9b700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a080cae80 0x7f8a081588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f8a0d79a700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a080cb250 0x7f8a0815a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f8a0e79c700 1 -- 172.21.15.124:0/1734627855 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a080cae80 msgr2=0x7f8a081588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f8a0e79c700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a080cae80 0x7f8a081588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f8a0e79c700 1 -- 172.21.15.124:0/1734627855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a080cb250 msgr2=0x7f8a0815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:39.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f8a0e79c700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a080cb250 0x7f8a0815a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:39.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f8a0e79c700 1 -- 172.21.15.124:0/1734627855 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a040094f0 con 0x7f8a080ccec0 2023-10-06T04:57:39.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f8a0e79c700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080ccec0 0x7f8a0815fb70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009fa0 tx=0x7f8a00009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:39.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f89fdffb700 1 -- 172.21.15.124:0/1734627855 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000ebc0 con 0x7f8a080ccec0 2023-10-06T04:57:39.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f89fdffb700 1 -- 172.21.15.124:0/1734627855 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0000ed20 con 0x7f8a080ccec0 2023-10-06T04:57:39.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.963+0000 7f8a101ff700 1 -- 172.21.15.124:0/1734627855 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a080b1850 con 0x7f8a080ccec0 2023-10-06T04:57:39.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.964+0000 7f89fdffb700 1 -- 172.21.15.124:0/1734627855 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00014670 con 0x7f8a080ccec0 2023-10-06T04:57:39.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.964+0000 7f8a101ff700 1 -- 172.21.15.124:0/1734627855 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a080b1e10 con 0x7f8a080ccec0 2023-10-06T04:57:39.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.965+0000 7f8a101ff700 1 -- 172.21.15.124:0/1734627855 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a080c5520 con 0x7f8a080ccec0 2023-10-06T04:57:39.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.965+0000 7f89fdffb700 1 -- 172.21.15.124:0/1734627855 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a000149e0 con 0x7f8a080ccec0 2023-10-06T04:57:39.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.966+0000 7f89fdffb700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f89ec066f30 0x7f89ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:57:39.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.966+0000 7f89fdffb700 1 -- 172.21.15.124:0/1734627855 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8a00084b20 con 0x7f8a080ccec0 2023-10-06T04:57:39.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.966+0000 7f8a0df9b700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f89ec066f30 0x7f89ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:57:39.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.967+0000 7f8a0df9b700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f89ec066f30 0x7f89ec0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8a08088750 tx=0x7f8a04017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:57:39.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:39.970+0000 7f89fdffb700 1 -- 172.21.15.124:0/1734627855 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a00051e90 con 0x7f8a080ccec0 2023-10-06T04:57:40.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.157+0000 7f8a101ff700 1 -- 172.21.15.124:0/1734627855 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a080717a0 con 0x7f89ec066f30 2023-10-06T04:57:40.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.161+0000 7f89fdffb700 1 -- 172.21.15.124:0/1734627855 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72987 (secure 0 0 0) 0x7f8a080717a0 con 0x7f89ec066f30 2023-10-06T04:57:40.166 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:57:40.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 -- 172.21.15.124:0/1734627855 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f89ec066f30 msgr2=0x7f89ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:40.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f89ec066f30 0x7f89ec0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8a08088750 tx=0x7f8a04017000 comp rx=0 tx=0).stop 2023-10-06T04:57:40.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 -- 172.21.15.124:0/1734627855 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080ccec0 msgr2=0x7f8a0815fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:57:40.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080ccec0 0x7f8a0815fb70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009fa0 tx=0x7f8a00009900 comp rx=0 tx=0).stop 2023-10-06T04:57:40.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 -- 172.21.15.124:0/1734627855 shutdown_connections 2023-10-06T04:57:40.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8a080ccec0 0x7f8a0815fb70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:40.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f89ec066f30 0x7f89ec0693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:40.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a080cae80 0x7f8a081588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:40.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 --2- 172.21.15.124:0/1734627855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a080cb250 0x7f8a0815a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:57:40.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 -- 172.21.15.124:0/1734627855 >> 172.21.15.124:0/1734627855 conn(0x7f8a080974f0 msgr2=0x7f8a0806b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:57:40.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 -- 172.21.15.124:0/1734627855 shutdown_connections 2023-10-06T04:57:40.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:57:40.163+0000 7f8a101ff700 1 -- 172.21.15.124:0/1734627855 wait complete. 2023-10-06T04:57:40.168 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:57:40.184 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2023-10-06T04:57:40.082695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384104,"kb_used_data":5800,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590616,"statfs":{"total":773094113280,"available":770652790784,"internally_reserved":0,"allocated":5939200,"data_stored":3203440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.700140"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:38.085844+0000","last_change":"2023-10-06T04:57:38.085813+0000","last_active":"2023-10-06T04:57:38.085844+0000","last_peered":"2023-10-06T04:57:38.085844+0000","last_clean":"2023-10-06T04:57:38.085844+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:57:38.085844+0000","last_undegraded":"2023-10-06T04:57:38.085844+0000","last_fullsized":"2023-10-06T04:57:38.085844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:38.085701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:38.085701+0000","last_clean_scrub_stamp":"2023-10-06T04:57:38.085701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:05.067279+0000","scrub_duration":0.001771197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:37.247017+0000","last_change":"2023-10-06T04:57:37.246980+0000","last_active":"2023-10-06T04:57:37.247017+0000","last_peered":"2023-10-06T04:57:37.247017+0000","last_clean":"2023-10-06T04:57:37.247017+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:57:37.247017+0000","last_undegraded":"2023-10-06T04:57:37.247017+0000","last_fullsized":"2023-10-06T04:57:37.247017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:37.246825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:37.246825+0000","last_clean_scrub_stamp":"2023-10-06T04:57:37.246825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:01.074670+0000","scrub_duration":0.0025677930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:37.013695+0000","last_change":"2023-10-06T04:57:37.013668+0000","last_active":"2023-10-06T04:57:37.013695+0000","last_peered":"2023-10-06T04:57:37.013695+0000","last_clean":"2023-10-06T04:57:37.013695+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:57:37.013695+0000","last_undegraded":"2023-10-06T04:57:37.013695+0000","last_fullsized":"2023-10-06T04:57:37.013695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:37.013592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:37.013592+0000","last_clean_scrub_stamp":"2023-10-06T04:57:37.013592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.763905+0000","scrub_duration":0.0023837559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T04:57:29.141064+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:57:29.141064+0000","last_peered":"2023-10-06T04:57:29.141064+0000","last_clean":"2023-10-06T04:57:29.141064+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:57:29.141064+0000","last_undegraded":"2023-10-06T04:57:29.141064+0000","last_fullsized":"2023-10-06T04:57:29.141064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:37.914431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":38,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T04:57:29.141241+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:57:29.141241+0000","last_peered":"2023-10-06T04:57:29.141241+0000","last_clean":"2023-10-06T04:57:29.141241+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:57:29.141241+0000","last_undegraded":"2023-10-06T04:57:29.141241+0000","last_fullsized":"2023-10-06T04:57:29.141241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.895641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":38,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T04:57:29.140960+0000","last_change":"2023-10-06T04:44:22.075800+0000","last_active":"2023-10-06T04:57:29.140960+0000","last_peered":"2023-10-06T04:57:29.140960+0000","last_clean":"2023-10-06T04:57:29.140960+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:57:29.140960+0000","last_undegraded":"2023-10-06T04:57:29.140960+0000","last_fullsized":"2023-10-06T04:57:29.140960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:19.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:29.386909+0000","last_change":"2023-10-06T04:44:22.075829+0000","last_active":"2023-10-06T04:57:29.386909+0000","last_peered":"2023-10-06T04:57:29.386909+0000","last_clean":"2023-10-06T04:57:29.386909+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:57:29.386909+0000","last_undegraded":"2023-10-06T04:57:29.386909+0000","last_fullsized":"2023-10-06T04:57:29.386909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":38,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:30.037739+0000","last_change":"2023-10-06T04:44:22.078241+0000","last_active":"2023-10-06T04:57:30.037739+0000","last_peered":"2023-10-06T04:57:30.037739+0000","last_clean":"2023-10-06T04:57:30.037739+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:57:30.037739+0000","last_undegraded":"2023-10-06T04:57:30.037739+0000","last_fullsized":"2023-10-06T04:57:30.037739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":38,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:30.037219+0000","last_change":"2023-10-06T04:44:21.803532+0000","last_active":"2023-10-06T04:57:30.037219+0000","last_peered":"2023-10-06T04:57:30.037219+0000","last_clean":"2023-10-06T04:57:30.037219+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:57:30.037219+0000","last_undegraded":"2023-10-06T04:57:30.037219+0000","last_fullsized":"2023-10-06T04:57:30.037219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542306,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1187840,"data_stored":843206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.33200000000000002},"max":{"1min":0.88100000000000001,"5min":1.044,"15min":8.7720000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.77800000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0089999999999999,"15min":8.8339999999999996},"last":0.40500000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66500000000000004,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40500000000000003},"max":{"1min":0.997,"5min":0.997,"15min":9.3070000000000004},"last":0.62},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67300000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.86599999999999999,"5min":0.93100000000000005,"15min":9.2129999999999992},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.54900000000000004,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":2.6709999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.79000000000000004},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.439},"max":{"1min":0.80200000000000005,"5min":0.95599999999999996,"15min":8.9179999999999993},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69799999999999995,"15min":0.80800000000000005},"min":{"1min":0.52200000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96699999999999997,"5min":1.087,"15min":9.0850000000000009},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":0.83599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":9.0969999999999995},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.018,"15min":1.018},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.629,"15min":0.64500000000000002},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.371},"max":{"1min":0.77600000000000002,"5min":0.94899999999999995,"15min":0.95899999999999996},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.41499999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.75},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.82899999999999996,"5min":0.97199999999999998,"15min":1.0269999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90200000000000002,"5min":1.02,"15min":1.091},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.748},"min":{"1min":0.46200000000000002,"5min":0.46000000000000002,"15min":0.44400000000000001},"max":{"1min":0.93400000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.71599999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542307,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.45500000000000002,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.98999999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.3779999999999999},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.46600000000000003,"15min":0.40500000000000003},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89300000000000002,"5min":0.95499999999999996,"15min":0.96299999999999997},"last":0.77800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69299999999999995,"15min":0.68799999999999994},"min":{"1min":0.54500000000000004,"5min":0.45000000000000001,"15min":0.40300000000000002},"max":{"1min":0.89200000000000002,"5min":0.98199999999999998,"15min":1.1100000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93000000000000005,"5min":1.2529999999999999,"15min":1.3580000000000001},"last":0.629}]},{"osd":3,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":1.2689999999999999,"15min":1.337},"last":0.75},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.496,"5min":0.48299999999999998,"15min":0.46100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1659999999999999},"last":0.70099999999999996}]},{"osd":4,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67900000000000005,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.38300000000000001},"max":{"1min":0.86099999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.39200000000000002},"max":{"1min":0.85599999999999998,"5min":0.995,"15min":1.778},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.442,"15min":0.42299999999999999},"max":{"1min":0.85299999999999998,"5min":0.97799999999999998,"15min":1.1140000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.51000000000000001,"5min":0.47999999999999998,"15min":0.47299999999999998},"max":{"1min":0.879,"5min":1.071,"15min":1.071},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Oct 6 04:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.97299999999999998,"15min":1.8500000000000001},"last":0.502},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.876,"5min":1.006,"15min":1.351},"last":0.76600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542307,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1187840,"data_stored":843206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39700000000000002,"15min":0.51300000000000001},"min":{"1min":0.26700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.60299999999999998,"15min":6.508},"last":0.438},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.622,"15min":2.4500000000000002},"last":0.374}]},{"osd":2,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41099999999999998,"15min":0.59099999999999997},"min":{"1min":0.31,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.51300000000000001,"5min":0.59199999999999997,"15min":9.2509999999999994},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58699999999999997,"5min":0.60399999999999998,"15min":7.1100000000000003},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49299999999999999,"15min":0.60499999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":6.4000000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.45500000000000002,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":2.4889999999999999},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72599999999999998,"15min":1.0720000000000001},"min":{"1min":0.52300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0049999999999999,"5min":1.2829999999999999,"15min":19.911000000000001},"last":0.503},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.83799999999999997},"min":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.93000000000000005,"5min":1.1599999999999999,"15min":6.4450000000000003},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94799999999999995,"5min":1.22,"15min":2.552},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73899999999999999,"15min":1.089},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0669999999999999,"5min":1.361,"15min":19.992999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75,"15min":0.85199999999999998},"min":{"1min":0.53200000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.1870000000000001,"15min":6.476},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0389999999999999,"5min":1.252,"15min":6.9050000000000002},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.51800000000000002},"max":{"1min":1.0429999999999999,"5min":1.329,"15min":2.5230000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76400000000000001,"15min":1.113},"min":{"1min":0.59299999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92300000000000004,"5min":1.1739999999999999,"15min":19.960999999999999},"last":0.66500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542309,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.59299999999999997,"15min":0.69499999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42299999999999999,"15min":0.437},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.67800000000000005},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.439,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63400000000000001,"5min":0.66100000000000003,"15min":0.67400000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.58699999999999997,"5min":0.63800000000000001,"15min":0.81000000000000005},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.78500000000000003},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.52300000000000002,"5min":0.48599999999999999,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":1.1779999999999999,"15min":1.254},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93700000000000006,"5min":1.0289999999999999,"15min":1.3600000000000001},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.502},"max":{"1min":0.98199999999999998,"5min":1.0660000000000001,"15min":1.2749999999999999},"last":0.872}]},{"osd":6,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.48599999999999999},"max":{"1min":0.92800000000000005,"5min":1.139,"15min":1.139},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.2929999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48399999999999999},"max":{"1min":0.95999999999999996,"5min":1.089,"15min":1.169},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.181,"15min":1.4019999999999999},"last":0.85799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542306,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":0.51800000000000002,"5min":0.55400000000000005,"15min":1.139},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.432,"15min":0.58799999999999997},"min":{"1min":0.33800000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59199999999999997,"5min":0.60699999999999998,"15min":11.241},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":0.52900000000000003,"5min":0.58599999999999997,"15min":1.028},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44400000000000001,"15min":0.60999999999999999},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":11.273},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":0.59799999999999998,"5min":0.72599999999999998,"15min":0.995},"last":0.443},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.49199999999999999},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":1.1699999999999999},"last":0.437}]},{"osd":4,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71699999999999997,"15min":0.73099999999999998},"min":{"1min":0.56000000000000005,"5min":0.47799999999999998,"15min":0.42699999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.2889999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.88},"min":{"1min":0.54500000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":11.125999999999999},"last":0.89000000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71799999999999997,"15min":0.89200000000000002},"min":{"1min":0.57399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":11.208},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.56699999999999995,"5min":0.45100000000000001,"15min":0.44},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.5089999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.60699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.466},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.53500000000000003,"15min":0.51700000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":5.327},"last":0.879}]},{"osd":7,"last update":"Fri Oct 6 04:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72799999999999998,"15min":0.89800000000000002},"min":{"1min":0.51200000000000001,"5min":0.50600000000000001,"15min":0.496},"max":{"1min":1.121,"5min":1.121,"15min":11.173},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52100000000000002},"max":{"1min":1.0840000000000001,"5min":1.1399999999999999,"15min":1.3180000000000001},"last":0.754}]}]},{"osd":3,"up_from":14,"seq":60129542307,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.29999999999999999,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.439},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.51300000000000001,"5min":0.60199999999999998,"15min":0.80700000000000005},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.60999999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.95699999999999996},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.79300000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.622}]},{"osd":4,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.42999999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.389},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.53500000000000003,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.202},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73899999999999999,"15min":0.73199999999999998},"min":{"1min":0.54400000000000004,"5min":0.502,"15min":0.41499999999999998},"max":{"1min":1.1499999999999999,"5min":1.2649999999999999,"15min":1.3160000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.54800000000000004,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.0600000000000001,"5min":1.109,"15min":1.5},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.52400000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.1100000000000001,"5min":1.1970000000000001,"15min":1.341},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.552},"last":0.80300000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.127,"5min":1.407,"15min":1.752},"last":0.747},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.59099999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2070000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.67300000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542306,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.33700000000000002,"15min":0.318},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":1.1299999999999999},"last":0.751},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.54100000000000004,"5min":0.45300000000000001,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.94999999999999996,"15min":1.079},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.65600000000000003},"min":{"1min":0.54100000000000004,"5min":0.39800000000000002,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.95099999999999996,"15min":1.1819999999999999},"last":0.88}]},{"osd":2,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.46000000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":1.042},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.44700000000000001},"max":{"1min":0.84899999999999998,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68100000000000005,"15min":0.67200000000000004},"min":{"1min":0.52800000000000002,"5min":0.45700000000000002,"15min":0.40899999999999997},"max":{"1min":0.873,"5min":0.94499999999999995,"15min":1.137},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":0.92200000000000004,"15min":1.177},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.876,"15min":1.1080000000000001},"last":0.62},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":0.97399999999999998,"15min":1.4399999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.51900000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":0.94799999999999995,"15min":1.22},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54700000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.92900000000000005,"5min":0.97399999999999998,"15min":1.159},"last":0.73499999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.46400000000000002},"max":{"1min":0.94399999999999995,"5min":0.95599999999999996,"15min":1.49},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.60499999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.92900000000000005,"15min":1.2849999999999999},"last":0.76800000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542306,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.38300000000000001,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.98099999999999998,"15min":1.05},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.61799999999999999},"min":{"1min":0.50800000000000001,"5min":0.42199999999999999,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":0.90800000000000003,"15min":0.93500000000000005},"last":0.63}]},{"osd":1,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.53100000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.95099999999999996,"15min":0.97899999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.69099999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.97099999999999997,"15min":1.0489999999999999},"last":0.73299999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.625},"min":{"1min":0.51800000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.90100000000000002,"15min":1.0309999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68700000000000006,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.38700000000000001},"max":{"1min":0.85999999999999999,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.504,"5min":0.45300000000000001,"15min":0.40300000000000002},"max":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.95399999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.88600000000000001,"5min":0.89600000000000002,"15min":0.95999999999999996},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.63700000000000001},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.34300000000000003},"max":{"1min":0.94699999999999995,"5min":0.97699999999999998,"15min":1.1060000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.38400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.038},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.66700000000000004},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0820000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.45300000000000001,"15min":0.39700000000000002},"max":{"1min":1.02,"5min":1.022,"15min":1.1339999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.3080000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.71799999999999997},"min":{"1min":0.50700000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.552},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:57:40.188 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T04:44:20.783952+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=57, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:57:40.189 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T04:44:20.783952+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=57, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:57:40.189 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T04:44:20.783952+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=57, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:57:40.189 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T04:44:20.783952+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=57, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:57:40.189 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T04:44:20.783952+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=57, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:57:40.189 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T04:44:20.783952+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=57, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:57:40.189 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T04:58:00.191 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:58:00.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.394+0000 7f6fb57ff700 1 Processor -- start 2023-10-06T04:58:00.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.395+0000 7f6fb57ff700 1 -- start start 2023-10-06T04:58:00.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.396+0000 7f6fb57ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6fb00abb60 0x7f6fb00abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:00.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.396+0000 7f6fb57ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6fb00ccd30 0x7f6fb0098f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:00.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.396+0000 7f6fb57ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb00acc40 con 0x7f6fb00690b0 2023-10-06T04:58:00.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.396+0000 7f6fb57ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb00ad0d0 con 0x7f6fb00abb60 2023-10-06T04:58:00.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.396+0000 7f6fb57ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb006ae30 con 0x7f6fb00ccd30 2023-10-06T04:58:00.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.396+0000 7f6faf7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6fb00690b0 0x7f6fb0099440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:60578/0 (socket says 172.21.15.124:60578) 2023-10-06T04:58:00.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.396+0000 7f6faeffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6fb00abb60 0x7f6fb00abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:00.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.396+0000 7f6faf7fe700 1 -- 172.21.15.124:0/2116218090 learned_addr learned my addr 172.21.15.124:0/2116218090 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:58:00.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.396+0000 7f6fae7fc700 1 --2- 172.21.15.124:0/2116218090 >> v2:172.21.15.158:3300/0 conn(0x7f6fb00ccd30 0x7f6fb0098f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:00.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.396+0000 7f6fadffb700 1 -- 172.21.15.124:0/2116218090 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088474140 0 0) 0x7f6fb00acc40 con 0x7f6fb00690b0 2023-10-06T04:58:00.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.397+0000 7f6fadffb700 1 -- 172.21.15.124:0/2116218090 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f98003570 con 0x7f6fb00690b0 2023-10-06T04:58:00.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.397+0000 7f6faeffd700 1 -- 172.21.15.124:0/2116218090 >> v2:172.21.15.158:3300/0 conn(0x7f6fb00ccd30 msgr2=0x7f6fb0098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:58:00.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.397+0000 7f6faeffd700 1 --2- 172.21.15.124:0/2116218090 >> v2:172.21.15.158:3300/0 conn(0x7f6fb00ccd30 0x7f6fb0098f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:00.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.397+0000 7f6faeffd700 1 -- 172.21.15.124:0/2116218090 >> v1:172.21.15.124:6789/0 conn(0x7f6fb00690b0 legacy=0x7f6fb0099440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:00.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.397+0000 7f6faeffd700 1 -- 172.21.15.124:0/2116218090 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb00ac5f0 con 0x7f6fb00abb60 2023-10-06T04:58:00.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.397+0000 7f6faeffd700 1 --2- 172.21.15.124:0/2116218090 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00abb60 0x7f6fb00abf30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0099f90 tx=0x7f6fa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c450492954a87ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:00.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.397+0000 7f6fadffb700 1 -- 172.21.15.124:0/2116218090 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0011630 con 0x7f6fb00abb60 2023-10-06T04:58:00.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.397+0000 7f6fadffb700 1 -- 172.21.15.124:0/2116218090 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa0011790 con 0x7f6fb00abb60 2023-10-06T04:58:00.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.397+0000 7f6fadffb700 1 -- 172.21.15.124:0/2116218090 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0011b30 con 0x7f6fb00abb60 2023-10-06T04:58:00.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.398+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2116218090 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00abb60 msgr2=0x7f6fb00abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:00.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.398+0000 7f6fb57ff700 1 --2- 172.21.15.124:0/2116218090 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00abb60 0x7f6fb00abf30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0099f90 tx=0x7f6fa00091a0 comp rx=0 tx=0).stop 2023-10-06T04:58:00.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.398+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2116218090 shutdown_connections 2023-10-06T04:58:00.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.398+0000 7f6fb57ff700 1 --2- 172.21.15.124:0/2116218090 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00abb60 0x7f6fb00abf30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:00.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.398+0000 7f6fb57ff700 1 --2- 172.21.15.124:0/2116218090 >> v2:172.21.15.158:3300/0 conn(0x7f6fb00ccd30 0x7f6fb0098f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:00.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.398+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2116218090 >> 172.21.15.124:0/2116218090 conn(0x7f6fb00cc050 msgr2=0x7f6fb00cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:58:00.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.398+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2116218090 shutdown_connections 2023-10-06T04:58:00.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.398+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2116218090 wait complete. 2023-10-06T04:58:00.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.399+0000 7f6fb57ff700 1 Processor -- start 2023-10-06T04:58:00.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.399+0000 7f6fb57ff700 1 -- start start 2023-10-06T04:58:00.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.400+0000 7f6fb57ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fb00690b0 0x7f6fb00a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:00.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.400+0000 7f6fb57ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fb00abb60 0x7f6fb01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:00.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.400+0000 7f6fb57ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00ccd30 0x7f6fb00a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:00.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.400+0000 7f6fb57ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00a8660 con 0x7f6fb00ccd30 2023-10-06T04:58:00.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.400+0000 7f6fb57ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0159a10 con 0x7f6fb00690b0 2023-10-06T04:58:00.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.400+0000 7f6fb57ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00a7a50 con 0x7f6fb00abb60 2023-10-06T04:58:00.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.400+0000 7f6faf7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00ccd30 0x7f6fb00a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:00.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.400+0000 7f6faf7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00ccd30 0x7f6fb00a7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44344/0 (socket says 172.21.15.124:44344) 2023-10-06T04:58:00.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.400+0000 7f6faf7fe700 1 -- 172.21.15.124:0/2996444044 learned_addr learned my addr 172.21.15.124:0/2996444044 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:58:00.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6faeffd700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fb00690b0 0x7f6fb00a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:00.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6fae7fc700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fb00abb60 0x7f6fb01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:00.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6faf7fe700 1 -- 172.21.15.124:0/2996444044 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fb00abb60 msgr2=0x7f6fb01594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:00.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6faf7fe700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fb00abb60 0x7f6fb01594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:00.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6faf7fe700 1 -- 172.21.15.124:0/2996444044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fb00690b0 msgr2=0x7f6fb00a8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:00.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6faf7fe700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fb00690b0 0x7f6fb00a8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:00.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6faf7fe700 1 -- 172.21.15.124:0/2996444044 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0009420 con 0x7f6fb00ccd30 2023-10-06T04:58:00.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6fae7fc700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fb00abb60 0x7f6fb01594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:58:00.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6faf7fe700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00ccd30 0x7f6fb00a7090 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8001460 tx=0x7f6fa8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:00.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6f96ffd700 1 -- 172.21.15.124:0/2996444044 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800a8a0 con 0x7f6fb00ccd30 2023-10-06T04:58:00.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6f96ffd700 1 -- 172.21.15.124:0/2996444044 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa800aa00 con 0x7f6fb00ccd30 2023-10-06T04:58:00.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2996444044 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb00a7d30 con 0x7f6fb00ccd30 2023-10-06T04:58:00.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6f96ffd700 1 -- 172.21.15.124:0/2996444044 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800ad80 con 0x7f6fb00ccd30 2023-10-06T04:58:00.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.401+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2996444044 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb00a82f0 con 0x7f6fb00ccd30 2023-10-06T04:58:00.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.402+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2996444044 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb00a8810 con 0x7f6fb00ccd30 2023-10-06T04:58:00.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.403+0000 7f6f96ffd700 1 -- 172.21.15.124:0/2996444044 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fa8007300 con 0x7f6fb00ccd30 2023-10-06T04:58:00.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.404+0000 7f6f96ffd700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6f9c066f30 0x7f6f9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:00.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.404+0000 7f6f96ffd700 1 -- 172.21.15.124:0/2996444044 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6fa80847d0 con 0x7f6fb00ccd30 2023-10-06T04:58:00.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.404+0000 7f6faeffd700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6f9c066f30 0x7f6f9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:00.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.405+0000 7f6faeffd700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6f9c066f30 0x7f6f9c0693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00093f0 tx=0x7f6fa0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:00.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.409+0000 7f6f96ffd700 1 -- 172.21.15.124:0/2996444044 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fa8051b30 con 0x7f6fb00ccd30 2023-10-06T04:58:00.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.593+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2996444044 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fb00717a0 con 0x7f6f9c066f30 2023-10-06T04:58:00.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.596+0000 7f6f96ffd700 1 -- 172.21.15.124:0/2996444044 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73032 (secure 0 0 0) 0x7f6fb00717a0 con 0x7f6f9c066f30 2023-10-06T04:58:00.599 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:58:00.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2996444044 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6f9c066f30 msgr2=0x7f6f9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:00.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6f9c066f30 0x7f6f9c0693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00093f0 tx=0x7f6fa0017000 comp rx=0 tx=0).stop 2023-10-06T04:58:00.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2996444044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00ccd30 msgr2=0x7f6fb00a7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:00.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00ccd30 0x7f6fb00a7090 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8001460 tx=0x7f6fa8001a40 comp rx=0 tx=0).stop 2023-10-06T04:58:00.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2996444044 shutdown_connections 2023-10-06T04:58:00.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6fb00ccd30 0x7f6fb00a7090 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:00.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fb00690b0 0x7f6fb00a8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:00.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f6f9c066f30 0x7f6f9c0693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:00.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 --2- 172.21.15.124:0/2996444044 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fb00abb60 0x7f6fb01594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:00.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2996444044 >> 172.21.15.124:0/2996444044 conn(0x7f6fb00cc050 msgr2=0x7f6fb00af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:58:00.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2996444044 shutdown_connections 2023-10-06T04:58:00.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:00.599+0000 7f6fb57ff700 1 -- 172.21.15.124:0/2996444044 wait complete. 2023-10-06T04:58:00.603 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:58:00.618 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2023-10-06T04:58:00.087058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384104,"kb_used_data":5800,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590616,"statfs":{"total":773094113280,"available":770652790784,"internally_reserved":0,"allocated":5939200,"data_stored":3203440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002562"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:38.085844+0000","last_change":"2023-10-06T04:57:38.085813+0000","last_active":"2023-10-06T04:57:38.085844+0000","last_peered":"2023-10-06T04:57:38.085844+0000","last_clean":"2023-10-06T04:57:38.085844+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:57:38.085844+0000","last_undegraded":"2023-10-06T04:57:38.085844+0000","last_fullsized":"2023-10-06T04:57:38.085844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:38.085701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:38.085701+0000","last_clean_scrub_stamp":"2023-10-06T04:57:38.085701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:05.067279+0000","scrub_duration":0.001771197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:37.247017+0000","last_change":"2023-10-06T04:57:37.246980+0000","last_active":"2023-10-06T04:57:37.247017+0000","last_peered":"2023-10-06T04:57:37.247017+0000","last_clean":"2023-10-06T04:57:37.247017+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:57:37.247017+0000","last_undegraded":"2023-10-06T04:57:37.247017+0000","last_fullsized":"2023-10-06T04:57:37.247017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:37.246825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:37.246825+0000","last_clean_scrub_stamp":"2023-10-06T04:57:37.246825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:01.074670+0000","scrub_duration":0.0025677930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:37.013695+0000","last_change":"2023-10-06T04:57:37.013668+0000","last_active":"2023-10-06T04:57:37.013695+0000","last_peered":"2023-10-06T04:57:37.013695+0000","last_clean":"2023-10-06T04:57:37.013695+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:57:37.013695+0000","last_undegraded":"2023-10-06T04:57:37.013695+0000","last_fullsized":"2023-10-06T04:57:37.013695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:37.013592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:37.013592+0000","last_clean_scrub_stamp":"2023-10-06T04:57:37.013592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.763905+0000","scrub_duration":0.0023837559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":189,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:29.511255+0000","last_change":"2023-10-06T04:44:21.805603+0000","last_active":"2023-10-06T04:57:29.511255+0000","last_peered":"2023-10-06T04:57:29.511255+0000","last_clean":"2023-10-06T04:57:29.511255+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:57:29.511255+0000","last_undegraded":"2023-10-06T04:57:29.511255+0000","last_fullsized":"2023-10-06T04:57:29.511255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":39,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:29.512445+0000","last_change":"2023-10-06T04:44:22.078154+0000","last_active":"2023-10-06T04:57:29.512445+0000","last_peered":"2023-10-06T04:57:29.512445+0000","last_clean":"2023-10-06T04:57:29.512445+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:57:29.512445+0000","last_undegraded":"2023-10-06T04:57:29.512445+0000","last_fullsized":"2023-10-06T04:57:29.512445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:20.783952+0000","last_clean_scrub_stamp":"2023-10-06T04:44:20.783952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:41.895009+0000","last_change":"2023-10-06T04:57:41.894978+0000","last_active":"2023-10-06T04:57:41.895009+0000","last_peered":"2023-10-06T04:57:41.895009+0000","last_clean":"2023-10-06T04:57:41.895009+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:57:41.895009+0000","last_undegraded":"2023-10-06T04:57:41.895009+0000","last_fullsized":"2023-10-06T04:57:41.895009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:41.894877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:41.894877+0000","last_clean_scrub_stamp":"2023-10-06T04:57:41.894877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:14.519679+0000","scrub_duration":0.0020320799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":51,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:41.698609+0000","last_change":"2023-10-06T04:57:41.698544+0000","last_active":"2023-10-06T04:57:41.698609+0000","last_peered":"2023-10-06T04:57:41.698609+0000","last_clean":"2023-10-06T04:57:41.698609+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:57:41.698609+0000","last_undegraded":"2023-10-06T04:57:41.698609+0000","last_fullsized":"2023-10-06T04:57:41.698609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:41.698440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:41.698440+0000","last_clean_scrub_stamp":"2023-10-06T04:57:41.698440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:05.526285+0000","scrub_duration":0.0025730950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:39.993558+0000","last_change":"2023-10-06T04:57:39.993514+0000","last_active":"2023-10-06T04:57:39.993558+0000","last_peered":"2023-10-06T04:57:39.993558+0000","last_clean":"2023-10-06T04:57:39.993558+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:57:39.993558+0000","last_undegraded":"2023-10-06T04:57:39.993558+0000","last_fullsized":"2023-10-06T04:57:39.993558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:39.993414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:39.993414+0000","last_clean_scrub_stamp":"2023-10-06T04:57:39.993414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:14.090771+0000","scrub_duration":0.00191665,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:43.065520+0000","last_change":"2023-10-06T04:57:43.065475+0000","last_active":"2023-10-06T04:57:43.065520+0000","last_peered":"2023-10-06T04:57:43.065520+0000","last_clean":"2023-10-06T04:57:43.065520+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:57:43.065520+0000","last_undegraded":"2023-10-06T04:57:43.065520+0000","last_fullsized":"2023-10-06T04:57:43.065520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:43.065371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:43.065371+0000","last_clean_scrub_stamp":"2023-10-06T04:57:43.065371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:50.884213+0000","scrub_duration":0.002417612,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542310,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1187840,"data_stored":843206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.64700000000000002,"15min":0.747},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78100000000000003,"5min":1.044,"15min":8.7720000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.66900000000000004,"15min":0.745},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.81899999999999995,"5min":1.0089999999999999,"15min":8.8339999999999996},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66300000000000003,"15min":0.754},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.40500000000000003},"max":{"1min":0.83999999999999997,"5min":0.997,"15min":9.3070000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.66000000000000003,"15min":0.76000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.877,"15min":9.2129999999999992},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":0.82199999999999995,"5min":0.91300000000000003,"15min":2.6709999999999998},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.439},"max":{"1min":0.93000000000000005,"5min":0.95599999999999996,"15min":8.9179999999999993},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.77900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.44500000000000001},"max":{"1min":0.88700000000000001,"5min":1.087,"15min":9.0850000000000009},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71899999999999997,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.48499999999999999},"max":{"1min":0.83399999999999996,"5min":0.95299999999999996,"15min":9.0969999999999995},"last":0.85399999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.86099999999999999,"5min":1.018,"15min":1.018},"last":0.626},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.371},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.79000000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.47599999999999998,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":0.97199999999999998,"15min":1.0269999999999999},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.57599999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0109999999999999,"5min":1.02,"15min":1.091},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.75,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.44400000000000001},"max":{"1min":0.95499999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.82299999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542311,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.52300000000000002,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":0.86199999999999999,"5min":0.93799999999999994,"15min":0.98999999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78500000000000003,"5min":0.95599999999999996,"15min":1.3779999999999999},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":0.91300000000000003,"5min":0.97399999999999998,"15min":0.997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.95499999999999996,"15min":0.96299999999999997},"last":0.55100000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.40300000000000002},"max":{"1min":0.95199999999999996,"5min":0.98199999999999998,"15min":1.1100000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69999999999999996,"15min":0.71099999999999997},"min":{"1min":0.57999999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88800000000000001,"5min":1.2529999999999999,"15min":1.3580000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.52800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":1.2689999999999999,"15min":1.337},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71699999999999997,"15min":0.72799999999999998},"min":{"1min":0.621,"5min":0.48299999999999998,"15min":0.46100000000000002},"max":{"1min":0.86299999999999999,"5min":1.0049999999999999,"15min":1.1659999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38300000000000001},"max":{"1min":0.86899999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.68600000000000005},"min":{"1min":0.434,"5min":0.42799999999999999,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.995,"15min":1.778},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67600000000000005,"15min":0.70099999999999996},"min":{"1min":0.50800000000000001,"5min":0.442,"15min":0.42299999999999999},"max":{"1min":0.876,"5min":0.91500000000000004,"15min":1.1140000000000001},"last":0.875},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72499999999999998,"15min":0.746},"min":{"1min":0.56000000000000005,"5min":0.47999999999999998,"15min":0.47299999999999998},"max":{"1min":0.90900000000000003,"5min":1.071,"15min":1.071},"last":0.748}]},{"osd":7,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70599999999999996,"15min":0.72599999999999998},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.97299999999999998,"15min":1.8500000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.752,"15min":0.77300000000000002},"min":{"1min":0.5,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91700000000000004,"5min":1.0009999999999999,"15min":1.351},"last":0.92200000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542311,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1187840,"data_stored":843206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39600000000000002,"15min":0.48499999999999999},"min":{"1min":0.27700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":6.508},"last":0.376},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":2.4500000000000002},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.54700000000000004},"min":{"1min":0.29999999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56999999999999995,"5min":0.57599999999999996,"15min":9.2509999999999994},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45500000000000002,"15min":0.56299999999999994},"min":{"1min":0.374,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.625,"5min":0.625,"15min":7.1100000000000003},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49399999999999999,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":0.65800000000000003,"5min":0.66500000000000004,"15min":6.4000000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46000000000000002,"15min":0.49399999999999999},"min":{"1min":0.39800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59199999999999997,"5min":0.63800000000000001,"15min":2.4889999999999999},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70599999999999996,"15min":0.98299999999999998},"min":{"1min":0.46400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.90200000000000002,"5min":1.1359999999999999,"15min":19.911000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71199999999999997,"15min":0.81000000000000005},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97799999999999998,"5min":1.1599999999999999,"15min":6.4450000000000003},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71099999999999997,"15min":0.754},"min":{"1min":0.54700000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88100000000000001,"5min":1.21,"15min":2.552},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":1},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94499999999999995,"5min":1.181,"15min":19.992999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72999999999999998,"15min":0.82299999999999995},"min":{"1min":0.53600000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91500000000000004,"5min":1.095,"15min":6.476},"last":0.752},{"interface":"front","average":{"1min":0.749,"5min":0.748,"15min":0.84199999999999997},"min":{"1min":0.53300000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.252,"15min":6.9050000000000002},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75,"15min":0.78900000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.99099999999999999,"5min":1.1499999999999999,"15min":2.5230000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":1.0249999999999999},"min":{"1min":0.53600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94599999999999995,"5min":1.1739999999999999,"15min":19.960999999999999},"last":0.76300000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542313,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39800000000000002,"15min":0.40699999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.50800000000000001,"5min":0.57599999999999996,"15min":0.69499999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.435},"min":{"1min":0.311,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.67800000000000005},"last":0.72099999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.441,"15min":0.45700000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.623,"5min":0.66100000000000003,"15min":0.67400000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.36699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.81000000000000005},"last":0.77300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61199999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48799999999999999,"15min":0.501},"min":{"1min":0.34999999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.67400000000000004,"15min":0.78500000000000003},"last":0.75}]},{"osd":4,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.45900000000000002},"max":{"1min":0.96999999999999997,"5min":1.1779999999999999,"15min":1.254},"last":1.028},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.57499999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81999999999999995,"5min":1.0289999999999999,"15min":1.3600000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84299999999999997,"5min":1.139,"15min":1.139},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72099999999999997},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.502},"max":{"1min":0.872,"5min":1.0660000000000001,"15min":1.2749999999999999},"last":0.94799999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.501,"15min":0.48599999999999999},"max":{"1min":0.90700000000000003,"5min":1.139,"15min":1.139},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.66200000000000003,"5min":0.56999999999999995,"15min":0.51400000000000001},"max":{"1min":0.93799999999999994,"5min":1.0429999999999999,"15min":1.2929999999999999},"last":1.0680000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48399999999999999},"max":{"1min":0.88200000000000001,"5min":1.089,"15min":1.169},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.52300000000000002},"max":{"1min":0.91000000000000003,"5min":1.181,"15min":1.4019999999999999},"last":0.97999999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542310,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":0.51100000000000001,"5min":0.55400000000000005,"15min":1.139},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.441,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":11.241},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.30499999999999999,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":0.62,"5min":0.62,"15min":1.028},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":11.273},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":0.65500000000000003,"5min":0.72599999999999998,"15min":0.995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.5,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.66300000000000003,"5min":0.67500000000000004,"15min":1.1699999999999999},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":1.169,"15min":1.2889999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.84199999999999997},"min":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.432},"max":{"1min":1.006,"5min":1.1990000000000001,"15min":11.125999999999999},"last":1.0649999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73599999999999999,"15min":0.85199999999999998},"min":{"1min":0.56299999999999994,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.077,"5min":1.077,"15min":11.208},"last":1.014},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.55900000000000005,"5min":0.5,"15min":0.44},"max":{"1min":0.91400000000000003,"5min":1.3140000000000001,"15min":1.5089999999999999},"last":0.878}]},{"osd":6,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78000000000000003,"15min":0.77800000000000002},"min":{"1min":0.64900000000000002,"5min":0.53500000000000003,"15min":0.46000000000000002},"max":{"1min":1.1659999999999999,"5min":1.23,"15min":1.466},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.79700000000000004,"15min":0.82499999999999996},"min":{"1min":0.65300000000000002,"5min":0.57999999999999996,"15min":0.51700000000000002},"max":{"1min":1.147,"5min":1.2589999999999999,"15min":5.327},"last":1.0029999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73199999999999998,"15min":0.85799999999999998},"min":{"1min":0.55400000000000005,"5min":0.51200000000000001,"15min":0.496},"max":{"1min":0.98299999999999998,"5min":1.121,"15min":11.173},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.54100000000000004,"15min":0.52100000000000002},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.3180000000000001},"last":1.034}]}]},{"osd":3,"up_from":14,"seq":60129542311,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40200000000000002,"15min":0.39500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.58399999999999996,"5min":0.875,"15min":0.875},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.433,"15min":0.437},"min":{"1min":0.33500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.52200000000000002,"5min":0.60199999999999998,"15min":0.80700000000000005},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.30099999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.48699999999999999,"5min":0.57699999999999996,"15min":0.60999999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64800000000000002,"5min":0.93500000000000005,"15min":0.95699999999999996},"last":0.52300000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.46400000000000002},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.79300000000000004},"last":0.496},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.504},"min":{"1min":0.372,"5min":0.372,"15min":0.35499999999999998},"max":{"1min":0.69299999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.42999999999999999},"max":{"1min":0.873,"5min":1.3640000000000001,"15min":1.389},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.54600000000000004,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":0.96499999999999997,"5min":1.0389999999999999,"15min":1.202},"last":0.85499999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.41499999999999998},"max":{"1min":1.008,"5min":1.2430000000000001,"15min":1.3160000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73699999999999999,"15min":0.746},"min":{"1min":0.52200000000000002,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":0.94799999999999995,"5min":1.109,"15min":1.5},"last":0.65900000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53300000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.98599999999999999,"5min":1.1970000000000001,"15min":1.341},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77900000000000003,"15min":0.78500000000000003},"min":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":1.0389999999999999,"5min":1.2629999999999999,"15min":1.552},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.52100000000000002,"15min":0.49099999999999999},"max":{"1min":0.96199999999999997,"5min":1.407,"15min":1.752},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.82499999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542310,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.84899999999999998,"5min":0.94799999999999995,"15min":1.1299999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70599999999999996,"15min":0.70299999999999996},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.40200000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.079},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66700000000000004,"15min":0.66200000000000003},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":1.1819999999999999},"last":0.88600000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.68200000000000005},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.44700000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.96699999999999997},"last":0.90300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.40899999999999997},"max":{"1min":0.751,"5min":0.94499999999999995,"15min":1.137},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.45400000000000001},"max":{"1min":0.80500000000000005,"5min":0.92200000000000004,"15min":1.177},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.44500000000000001,"5min":0.42599999999999999,"15min":0.38400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.1080000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.94799999999999995,"5min":0.97399999999999998,"15min":1.4399999999999999},"last":0.745}]},{"osd":6,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.22},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.76400000000000001},"min":{"1min":0.58099999999999996,"5min":0.442,"15min":0.442},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.159},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.876,"5min":0.95599999999999996,"15min":1.49},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69499999999999995,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":1.2849999999999999},"last":0.86399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542310,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.61599999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65100000000000002,"15min":0.623},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.38},"max":{"1min":0.82699999999999996,"5min":0.90800000000000003,"15min":0.93500000000000005},"last":0.91400000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69499999999999995,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.88},{"interface":"front","average":{"1min":0.755,"5min":0.72499999999999998,"15min":0.69599999999999995},"min":{"1min":0.61399999999999999,"5min":0.52400000000000002,"15min":0.39200000000000002},"max":{"1min":0.94499999999999995,"5min":0.97099999999999997,"15min":1.0489999999999999},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.63},"min":{"1min":0.51000000000000001,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.0309999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68600000000000005,"15min":0.66500000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.38700000000000001},"max":{"1min":0.91000000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.68700000000000006},"min":{"1min":0.49399999999999999,"5min":0.45300000000000001,"15min":0.40300000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.71799999999999997,"15min":0.69499999999999995},"min":{"1min":0.53800000000000003,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.621,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.34300000000000003},"max":{"1min":0.94499999999999995,"5min":0.95699999999999996,"15min":1.1060000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.46700000000000003,"5min":0.39900000000000002,"15min":0.38400000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.038},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.36599999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.0820000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72899999999999998,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.39700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.1339999999999999},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96299999999999997,"5min":1.034,"15min":1.3080000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69399999999999995,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.552},"last":0.83199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:58:00.621 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T04:44:20.783952+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=57, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:58:00.621 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T04:44:20.783952+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=57, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:58:00.621 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T04:58:02.473 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:58:02.478 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:58:20.622 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:58:20.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.818+0000 7f500f1ff700 1 Processor -- start 2023-10-06T04:58:20.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.818+0000 7f500f1ff700 1 -- start start 2023-10-06T04:58:20.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.819+0000 7f500f1ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f500806ddc0 0x7f50080b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:20.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.819+0000 7f500f1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5008068bb0 0x7f500806e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.819+0000 7f500f1ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080cc040 con 0x7f5008159040 2023-10-06T04:58:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.819+0000 7f500f1ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500806e6d0 con 0x7f500806ddc0 2023-10-06T04:58:20.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.819+0000 7f500f1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500806e990 con 0x7f5008068bb0 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f500d79c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f5008159040 0x7f50081594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43778/0 (socket says 172.21.15.124:43778) 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f500d79c700 1 -- 172.21.15.124:0/2755291311 learned_addr learned my addr 172.21.15.124:0/2755291311 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f500cf9b700 1 --2- 172.21.15.124:0/2755291311 >> v2:172.21.15.124:3300/0 conn(0x7f500806ddc0 0x7f50080b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f5007fff700 1 --2- 172.21.15.124:0/2755291311 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5008068bb0 0x7f500806e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f500cf9b700 1 -- 172.21.15.124:0/2755291311 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5008068bb0 msgr2=0x7f500806e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f500cf9b700 1 --2- 172.21.15.124:0/2755291311 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5008068bb0 0x7f500806e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f500cf9b700 1 -- 172.21.15.124:0/2755291311 >> v1:172.21.15.124:6789/0 conn(0x7f5008159040 legacy=0x7f50081594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f500cf9b700 1 -- 172.21.15.124:0/2755291311 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080cb9f0 con 0x7f500806ddc0 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f50077fe700 1 -- 172.21.15.124:0/2755291311 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340077052 0 0) 0x7f50080cc040 con 0x7f5008159040 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f500cf9b700 1 --2- 172.21.15.124:0/2755291311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f500806ddc0 0x7f50080b1f50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0098e0 tx=0x7f4ffc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcf7452f280e6d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:20.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.820+0000 7f50077fe700 1 -- 172.21.15.124:0/2755291311 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc009e80 con 0x7f500806ddc0 2023-10-06T04:58:20.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.821+0000 7f50077fe700 1 -- 172.21.15.124:0/2755291311 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc00b860 con 0x7f500806ddc0 2023-10-06T04:58:20.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.821+0000 7f50077fe700 1 -- 172.21.15.124:0/2755291311 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00bbe0 con 0x7f500806ddc0 2023-10-06T04:58:20.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.821+0000 7f500f1ff700 1 -- 172.21.15.124:0/2755291311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f500806ddc0 msgr2=0x7f50080b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:20.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.821+0000 7f500f1ff700 1 --2- 172.21.15.124:0/2755291311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f500806ddc0 0x7f50080b1f50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0098e0 tx=0x7f4ffc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:58:20.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.821+0000 7f500f1ff700 1 -- 172.21.15.124:0/2755291311 shutdown_connections 2023-10-06T04:58:20.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.821+0000 7f500f1ff700 1 --2- 172.21.15.124:0/2755291311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f500806ddc0 0x7f50080b1f50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:20.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.821+0000 7f500f1ff700 1 --2- 172.21.15.124:0/2755291311 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5008068bb0 0x7f500806e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:20.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.821+0000 7f500f1ff700 1 -- 172.21.15.124:0/2755291311 >> 172.21.15.124:0/2755291311 conn(0x7f50080cd390 msgr2=0x7f50080b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:58:20.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.821+0000 7f500f1ff700 1 -- 172.21.15.124:0/2755291311 shutdown_connections 2023-10-06T04:58:20.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.821+0000 7f500f1ff700 1 -- 172.21.15.124:0/2755291311 wait complete. 2023-10-06T04:58:20.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.823+0000 7f500f1ff700 1 Processor -- start 2023-10-06T04:58:20.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.823+0000 7f500f1ff700 1 -- start start 2023-10-06T04:58:20.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500f1ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5008068bb0 0x7f5008151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:20.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500f1ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f500806ddc0 0x7f5008154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:20.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500f1ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5008159040 0x7f500815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:20.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500f1ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008151ed0 con 0x7f5008159040 2023-10-06T04:58:20.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500f1ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080c5b60 con 0x7f5008068bb0 2023-10-06T04:58:20.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500f1ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080c5e40 con 0x7f500806ddc0 2023-10-06T04:58:20.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500d79c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5008159040 0x7f500815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500d79c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5008159040 0x7f500815e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60702/0 (socket says 172.21.15.124:60702) 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500d79c700 1 -- 172.21.15.124:0/1073942074 learned_addr learned my addr 172.21.15.124:0/1073942074 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500cf9b700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5008068bb0 0x7f5008151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f5007fff700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f500806ddc0 0x7f5008154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500d79c700 1 -- 172.21.15.124:0/1073942074 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f500806ddc0 msgr2=0x7f5008154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500d79c700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f500806ddc0 0x7f5008154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500d79c700 1 -- 172.21.15.124:0/1073942074 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5008068bb0 msgr2=0x7f5008151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500d79c700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5008068bb0 0x7f5008151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f500d79c700 1 -- 172.21.15.124:0/1073942074 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc009420 con 0x7f5008159040 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.824+0000 7f5007fff700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f500806ddc0 0x7f5008154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.825+0000 7f500d79c700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5008159040 0x7f500815e0b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f500000cbf0 tx=0x7f50000019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:20.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.825+0000 7f5004ff9700 1 -- 172.21.15.124:0/1073942074 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000a9c0 con 0x7f5008159040 2023-10-06T04:58:20.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.825+0000 7f5004ff9700 1 -- 172.21.15.124:0/1073942074 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500000ab20 con 0x7f5008159040 2023-10-06T04:58:20.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.825+0000 7f500f1ff700 1 -- 172.21.15.124:0/1073942074 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50080c6120 con 0x7f5008159040 2023-10-06T04:58:20.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.825+0000 7f5004ff9700 1 -- 172.21.15.124:0/1073942074 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50000070f0 con 0x7f5008159040 2023-10-06T04:58:20.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.825+0000 7f500f1ff700 1 -- 172.21.15.124:0/1073942074 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50080c66e0 con 0x7f5008159040 2023-10-06T04:58:20.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.826+0000 7f500f1ff700 1 -- 172.21.15.124:0/1073942074 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50080c6900 con 0x7f5008159040 2023-10-06T04:58:20.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.827+0000 7f5004ff9700 1 -- 172.21.15.124:0/1073942074 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5000007520 con 0x7f5008159040 2023-10-06T04:58:20.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.828+0000 7f5004ff9700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fec066f30 0x7f4fec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:20.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.828+0000 7f5004ff9700 1 -- 172.21.15.124:0/1073942074 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5000084810 con 0x7f5008159040 2023-10-06T04:58:20.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.828+0000 7f500cf9b700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fec066f30 0x7f4fec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:20.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.828+0000 7f500cf9b700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fec066f30 0x7f4fec0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0091e0 tx=0x7f4ffc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:20.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:20.832+0000 7f5004ff9700 1 -- 172.21.15.124:0/1073942074 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5000051c00 con 0x7f5008159040 2023-10-06T04:58:21.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.019+0000 7f500f1ff700 1 -- 172.21.15.124:0/1073942074 --> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50080717a0 con 0x7f4fec066f30 2023-10-06T04:58:21.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.022+0000 7f5004ff9700 1 -- 172.21.15.124:0/1073942074 <== mgr.4110 v2:172.21.15.124:6832/114528 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73168 (secure 0 0 0) 0x7f50080717a0 con 0x7f4fec066f30 2023-10-06T04:58:21.025 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:58:21.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 -- 172.21.15.124:0/1073942074 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fec066f30 msgr2=0x7f4fec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fec066f30 0x7f4fec0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0091e0 tx=0x7f4ffc017000 comp rx=0 tx=0).stop 2023-10-06T04:58:21.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 -- 172.21.15.124:0/1073942074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5008159040 msgr2=0x7f500815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5008159040 0x7f500815e0b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f500000cbf0 tx=0x7f50000019b0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 -- 172.21.15.124:0/1073942074 shutdown_connections 2023-10-06T04:58:21.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5008159040 0x7f500815e0b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5008068bb0 0x7f5008151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f4fec066f30 0x7f4fec0693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 --2- 172.21.15.124:0/1073942074 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f500806ddc0 0x7f5008154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 -- 172.21.15.124:0/1073942074 >> 172.21.15.124:0/1073942074 conn(0x7f50080cd390 msgr2=0x7f500815c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:58:21.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.024+0000 7f500f1ff700 1 -- 172.21.15.124:0/1073942074 shutdown_connections 2023-10-06T04:58:21.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.025+0000 7f500f1ff700 1 -- 172.21.15.124:0/1073942074 wait complete. 2023-10-06T04:58:21.031 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-06T04:58:21.046 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2023-10-06T04:58:20.091379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384104,"kb_used_data":5800,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590616,"statfs":{"total":773094113280,"available":770652790784,"internally_reserved":0,"allocated":5939200,"data_stored":3203440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002706"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:38.085844+0000","last_change":"2023-10-06T04:57:38.085813+0000","last_active":"2023-10-06T04:57:38.085844+0000","last_peered":"2023-10-06T04:57:38.085844+0000","last_clean":"2023-10-06T04:57:38.085844+0000","last_became_active":"2023-10-06T04:44:21.802376+0000","last_became_peered":"2023-10-06T04:44:21.802376+0000","last_unstale":"2023-10-06T04:57:38.085844+0000","last_undegraded":"2023-10-06T04:57:38.085844+0000","last_fullsized":"2023-10-06T04:57:38.085844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:38.085701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:38.085701+0000","last_clean_scrub_stamp":"2023-10-06T04:57:38.085701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:05.067279+0000","scrub_duration":0.001771197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:37.247017+0000","last_change":"2023-10-06T04:57:37.246980+0000","last_active":"2023-10-06T04:57:37.247017+0000","last_peered":"2023-10-06T04:57:37.247017+0000","last_clean":"2023-10-06T04:57:37.247017+0000","last_became_active":"2023-10-06T04:44:21.802217+0000","last_became_peered":"2023-10-06T04:44:21.802217+0000","last_unstale":"2023-10-06T04:57:37.247017+0000","last_undegraded":"2023-10-06T04:57:37.247017+0000","last_fullsized":"2023-10-06T04:57:37.247017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:37.246825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:37.246825+0000","last_clean_scrub_stamp":"2023-10-06T04:57:37.246825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:01.074670+0000","scrub_duration":0.0025677930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:37.013695+0000","last_change":"2023-10-06T04:57:37.013668+0000","last_active":"2023-10-06T04:57:37.013695+0000","last_peered":"2023-10-06T04:57:37.013695+0000","last_clean":"2023-10-06T04:57:37.013695+0000","last_became_active":"2023-10-06T04:44:21.801864+0000","last_became_peered":"2023-10-06T04:44:21.801864+0000","last_unstale":"2023-10-06T04:57:37.013695+0000","last_undegraded":"2023-10-06T04:57:37.013695+0000","last_fullsized":"2023-10-06T04:57:37.013695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:37.013592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:37.013592+0000","last_clean_scrub_stamp":"2023-10-06T04:57:37.013592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.763905+0000","scrub_duration":0.0023837559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"50'119","reported_seq":201,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:58:03.734985+0000","last_change":"2023-10-06T04:58:03.734949+0000","last_active":"2023-10-06T04:58:03.734985+0000","last_peered":"2023-10-06T04:58:03.734985+0000","last_clean":"2023-10-06T04:58:03.734985+0000","last_became_active":"2023-10-06T04:44:21.804358+0000","last_became_peered":"2023-10-06T04:44:21.804358+0000","last_unstale":"2023-10-06T04:58:03.734985+0000","last_undegraded":"2023-10-06T04:58:03.734985+0000","last_fullsized":"2023-10-06T04:58:03.734985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'119","last_scrub_stamp":"2023-10-06T04:58:03.734848+0000","last_deep_scrub":"50'119","last_deep_scrub_stamp":"2023-10-06T04:58:03.734848+0000","last_clean_scrub_stamp":"2023-10-06T04:58:03.734848+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:37.929852+0000","scrub_duration":0.0060523820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:58:00.763791+0000","last_change":"2023-10-06T04:58:00.763748+0000","last_active":"2023-10-06T04:58:00.763791+0000","last_peered":"2023-10-06T04:58:00.763791+0000","last_clean":"2023-10-06T04:58:00.763791+0000","last_became_active":"2023-10-06T04:44:22.077827+0000","last_became_peered":"2023-10-06T04:44:22.077827+0000","last_unstale":"2023-10-06T04:58:00.763791+0000","last_undegraded":"2023-10-06T04:58:00.763791+0000","last_fullsized":"2023-10-06T04:58:00.763791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:58:00.763641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:58:00.763641+0000","last_clean_scrub_stamp":"2023-10-06T04:58:00.763641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:24.591486+0000","scrub_duration":0.0020165550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:41.895009+0000","last_change":"2023-10-06T04:57:41.894978+0000","last_active":"2023-10-06T04:57:41.895009+0000","last_peered":"2023-10-06T04:57:41.895009+0000","last_clean":"2023-10-06T04:57:41.895009+0000","last_became_active":"2023-10-06T04:44:22.075468+0000","last_became_peered":"2023-10-06T04:44:22.075468+0000","last_unstale":"2023-10-06T04:57:41.895009+0000","last_undegraded":"2023-10-06T04:57:41.895009+0000","last_fullsized":"2023-10-06T04:57:41.895009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:41.894877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:41.894877+0000","last_clean_scrub_stamp":"2023-10-06T04:57:41.894877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:14.519679+0000","scrub_duration":0.0020320799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":51,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:41.698609+0000","last_change":"2023-10-06T04:57:41.698544+0000","last_active":"2023-10-06T04:57:41.698609+0000","last_peered":"2023-10-06T04:57:41.698609+0000","last_clean":"2023-10-06T04:57:41.698609+0000","last_became_active":"2023-10-06T04:44:22.075481+0000","last_became_peered":"2023-10-06T04:44:22.075481+0000","last_unstale":"2023-10-06T04:57:41.698609+0000","last_undegraded":"2023-10-06T04:57:41.698609+0000","last_fullsized":"2023-10-06T04:57:41.698609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:41.698440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:41.698440+0000","last_clean_scrub_stamp":"2023-10-06T04:57:41.698440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:05.526285+0000","scrub_duration":0.0025730950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:39.993558+0000","last_change":"2023-10-06T04:57:39.993514+0000","last_active":"2023-10-06T04:57:39.993558+0000","last_peered":"2023-10-06T04:57:39.993558+0000","last_clean":"2023-10-06T04:57:39.993558+0000","last_became_active":"2023-10-06T04:44:22.077930+0000","last_became_peered":"2023-10-06T04:44:22.077930+0000","last_unstale":"2023-10-06T04:57:39.993558+0000","last_undegraded":"2023-10-06T04:57:39.993558+0000","last_fullsized":"2023-10-06T04:57:39.993558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:39.993414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:39.993414+0000","last_clean_scrub_stamp":"2023-10-06T04:57:39.993414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:14.090771+0000","scrub_duration":0.00191665,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:57:43.065520+0000","last_change":"2023-10-06T04:57:43.065475+0000","last_active":"2023-10-06T04:57:43.065520+0000","last_peered":"2023-10-06T04:57:43.065520+0000","last_clean":"2023-10-06T04:57:43.065520+0000","last_became_active":"2023-10-06T04:44:21.803180+0000","last_became_peered":"2023-10-06T04:44:21.803180+0000","last_unstale":"2023-10-06T04:57:43.065520+0000","last_undegraded":"2023-10-06T04:57:43.065520+0000","last_fullsized":"2023-10-06T04:57:43.065520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:57:43.065371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:57:43.065371+0000","last_clean_scrub_stamp":"2023-10-06T04:57:43.065371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:50.884213+0000","scrub_duration":0.002417612,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542314,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1187840,"data_stored":843206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.64700000000000002,"15min":0.747},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78100000000000003,"5min":1.044,"15min":8.7720000000000002},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.66900000000000004,"15min":0.745},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.81899999999999995,"5min":1.0089999999999999,"15min":8.8339999999999996},"last":0.751}]},{"osd":1,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66300000000000003,"15min":0.754},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.40500000000000003},"max":{"1min":0.83999999999999997,"5min":0.997,"15min":9.3070000000000004},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.66000000000000003,"15min":0.76000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.877,"15min":9.2129999999999992},"last":0.63}]},{"osd":2,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":0.82199999999999995,"5min":0.91300000000000003,"15min":2.6709999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.439},"max":{"1min":0.93000000000000005,"5min":0.95599999999999996,"15min":8.9179999999999993},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.77900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.44500000000000001},"max":{"1min":0.88700000000000001,"5min":1.087,"15min":9.0850000000000009},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71899999999999997,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.48499999999999999},"max":{"1min":0.83399999999999996,"5min":0.95299999999999996,"15min":9.0969999999999995},"last":0.80400000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.86099999999999999,"5min":1.018,"15min":1.018},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.371},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.79000000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.47599999999999998,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":0.97199999999999998,"15min":1.0269999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.57599999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0109999999999999,"5min":1.02,"15min":1.091},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.75,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.44400000000000001},"max":{"1min":0.95499999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.86299999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542315,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.52300000000000002,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":0.86199999999999999,"5min":0.93799999999999994,"15min":0.98999999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78500000000000003,"5min":0.95599999999999996,"15min":1.3779999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":0.91300000000000003,"5min":0.97399999999999998,"15min":0.997},"last":0.627},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.95499999999999996,"15min":0.96299999999999997},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.40300000000000002},"max":{"1min":0.95199999999999996,"5min":0.98199999999999998,"15min":1.1100000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69999999999999996,"15min":0.71099999999999997},"min":{"1min":0.57999999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88800000000000001,"5min":1.2529999999999999,"15min":1.3580000000000001},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.52800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":1.2689999999999999,"15min":1.337},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71699999999999997,"15min":0.72799999999999998},"min":{"1min":0.621,"5min":0.48299999999999998,"15min":0.46100000000000002},"max":{"1min":0.86299999999999999,"5min":1.0049999999999999,"15min":1.1659999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38300000000000001},"max":{"1min":0.86899999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.68600000000000005},"min":{"1min":0.434,"5min":0.42799999999999999,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.995,"15min":1.778},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67600000000000005,"15min":0.70099999999999996},"min":{"1min":0.50800000000000001,"5min":0.442,"15min":0.42299999999999999},"max":{"1min":0.876,"5min":0.91500000000000004,"15min":1.1140000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72499999999999998,"15min":0.746},"min":{"1min":0.56000000000000005,"5min":0.47999999999999998,"15min":0.47299999999999998},"max":{"1min":0.90900000000000003,"5min":1.071,"15min":1.071},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70599999999999996,"15min":0.72599999999999998},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.97299999999999998,"15min":1.8500000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.752,"15min":0.77300000000000002},"min":{"1min":0.5,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91700000000000004,"5min":1.0009999999999999,"15min":1.351},"last":0.67500000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542315,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1187840,"data_stored":843206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39600000000000002,"15min":0.48499999999999999},"min":{"1min":0.27700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":6.508},"last":0.312},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":2.4500000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.54700000000000004},"min":{"1min":0.29999999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56999999999999995,"5min":0.57599999999999996,"15min":9.2509999999999994},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45500000000000002,"15min":0.56299999999999994},"min":{"1min":0.374,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.625,"5min":0.625,"15min":7.1100000000000003},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49399999999999999,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":0.65800000000000003,"5min":0.66500000000000004,"15min":6.4000000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46000000000000002,"15min":0.49399999999999999},"min":{"1min":0.39800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59199999999999997,"5min":0.63800000000000001,"15min":2.4889999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70599999999999996,"15min":0.98299999999999998},"min":{"1min":0.46400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.90200000000000002,"5min":1.1359999999999999,"15min":19.911000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71199999999999997,"15min":0.81000000000000005},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97799999999999998,"5min":1.1599999999999999,"15min":6.4450000000000003},"last":1.05}]},{"osd":5,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71099999999999997,"15min":0.754},"min":{"1min":0.54700000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88100000000000001,"5min":1.21,"15min":2.552},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":1},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94499999999999995,"5min":1.181,"15min":19.992999999999999},"last":1.091}]},{"osd":6,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72999999999999998,"15min":0.82299999999999995},"min":{"1min":0.53600000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91500000000000004,"5min":1.095,"15min":6.476},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.748,"15min":0.84199999999999997},"min":{"1min":0.53300000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.252,"15min":6.9050000000000002},"last":1.012}]},{"osd":7,"last update":"Fri Oct 6 04:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75,"15min":0.78900000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.99099999999999999,"5min":1.1499999999999999,"15min":2.5230000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":1.0249999999999999},"min":{"1min":0.53600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94599999999999995,"5min":1.1739999999999999,"15min":19.960999999999999},"last":1.1719999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542317,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39800000000000002,"15min":0.40699999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.50800000000000001,"5min":0.57599999999999996,"15min":0.69499999999999995},"last":0.442},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.435},"min":{"1min":0.311,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.67800000000000005},"last":0.55200000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.441,"15min":0.45700000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.623,"5min":0.66100000000000003,"15min":0.67400000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.36699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.81000000000000005},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61199999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48799999999999999,"15min":0.501},"min":{"1min":0.34999999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.67400000000000004,"15min":0.78500000000000003},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.45900000000000002},"max":{"1min":0.96999999999999997,"5min":1.1779999999999999,"15min":1.254},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.57499999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81999999999999995,"5min":1.0289999999999999,"15min":1.3600000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84299999999999997,"5min":1.139,"15min":1.139},"last":0.62},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72099999999999997},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.502},"max":{"1min":0.872,"5min":1.0660000000000001,"15min":1.2749999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.501,"15min":0.48599999999999999},"max":{"1min":0.90700000000000003,"5min":1.139,"15min":1.139},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.66200000000000003,"5min":0.56999999999999995,"15min":0.51400000000000001},"max":{"1min":0.93799999999999994,"5min":1.0429999999999999,"15min":1.2929999999999999},"last":0.68899999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48399999999999999},"max":{"1min":0.88200000000000001,"5min":1.089,"15min":1.169},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.52300000000000002},"max":{"1min":0.91000000000000003,"5min":1.181,"15min":1.4019999999999999},"last":0.65400000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542314,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":0.51100000000000001,"5min":0.55400000000000005,"15min":1.139},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.441,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":11.241},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.30499999999999999,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":0.62,"5min":0.62,"15min":1.028},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":11.273},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":0.65500000000000003,"5min":0.72599999999999998,"15min":0.995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.66300000000000003,"5min":0.67500000000000004,"15min":1.1699999999999999},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":1.169,"15min":1.2889999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.84199999999999997},"min":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.432},"max":{"1min":1.006,"5min":1.1990000000000001,"15min":11.125999999999999},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73599999999999999,"15min":0.85199999999999998},"min":{"1min":0.56299999999999994,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.077,"5min":1.077,"15min":11.208},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.55900000000000005,"5min":0.5,"15min":0.44},"max":{"1min":0.91400000000000003,"5min":1.3140000000000001,"15min":1.5089999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78000000000000003,"15min":0.77800000000000002},"min":{"1min":0.64900000000000002,"5min":0.53500000000000003,"15min":0.46000000000000002},"max":{"1min":1.1659999999999999,"5min":1.23,"15min":1.466},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.79700000000000004,"15min":0.82499999999999996},"min":{"1min":0.65300000000000002,"5min":0.57999999999999996,"15min":0.51700000000000002},"max":{"1min":1.147,"5min":1.2589999999999999,"15min":5.327},"last":0.879}]},{"osd":7,"last update":"Fri Oct 6 04:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73199999999999998,"15min":0.85799999999999998},"min":{"1min":0.55400000000000005,"5min":0.51200000000000001,"15min":0.496},"max":{"1min":0.98299999999999998,"5min":1.121,"15min":11.173},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.54100000000000004,"15min":0.52100000000000002},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.3180000000000001},"last":0.70599999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542315,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40200000000000002,"15min":0.39500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.58399999999999996,"5min":0.875,"15min":0.875},"last":0.31},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.433,"15min":0.437},"min":{"1min":0.33500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.52200000000000002,"5min":0.60199999999999998,"15min":0.80700000000000005},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.30099999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.48699999999999999,"5min":0.57699999999999996,"15min":0.60999999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64800000000000002,"5min":0.93500000000000005,"15min":0.95699999999999996},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.46400000000000002},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.79300000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.504},"min":{"1min":0.372,"5min":0.372,"15min":0.35499999999999998},"max":{"1min":0.69299999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.42999999999999999},"max":{"1min":0.873,"5min":1.3640000000000001,"15min":1.389},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.54600000000000004,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":0.96499999999999997,"5min":1.0389999999999999,"15min":1.202},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.41499999999999998},"max":{"1min":1.008,"5min":1.2430000000000001,"15min":1.3160000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73699999999999999,"15min":0.746},"min":{"1min":0.52200000000000002,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":0.94799999999999995,"5min":1.109,"15min":1.5},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53300000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.98599999999999999,"5min":1.1970000000000001,"15min":1.341},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77900000000000003,"15min":0.78500000000000003},"min":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":1.0389999999999999,"5min":1.2629999999999999,"15min":1.552},"last":0.753}]},{"osd":7,"last update":"Fri Oct 6 04:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.52100000000000002,"15min":0.49099999999999999},"max":{"1min":0.96199999999999997,"5min":1.407,"15min":1.752},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80000000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542314,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.84899999999999998,"5min":0.94799999999999995,"15min":1.1299999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70599999999999996,"15min":0.70299999999999996},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.40200000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.079},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66700000000000004,"15min":0.66200000000000003},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.753},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":1.1819999999999999},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.68200000000000005},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.44700000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.96699999999999997},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.40899999999999997},"max":{"1min":0.751,"5min":0.94499999999999995,"15min":1.137},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.45400000000000001},"max":{"1min":0.80500000000000005,"5min":0.92200000000000004,"15min":1.177},"last":0.63100000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.44500000000000001,"5min":0.42599999999999999,"15min":0.38400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.1080000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.94799999999999995,"5min":0.97399999999999998,"15min":1.4399999999999999},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.22},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.76400000000000001},"min":{"1min":0.58099999999999996,"5min":0.442,"15min":0.442},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.159},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:57:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.876,"5min":0.95599999999999996,"15min":1.49},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69499999999999995,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":1.2849999999999999},"last":0.52700000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542314,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":252838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.61599999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65100000000000002,"15min":0.623},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.38},"max":{"1min":0.82699999999999996,"5min":0.90800000000000003,"15min":0.93500000000000005},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69499999999999995,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.72499999999999998,"15min":0.69599999999999995},"min":{"1min":0.61399999999999999,"5min":0.52400000000000002,"15min":0.39200000000000002},"max":{"1min":0.94499999999999995,"5min":0.97099999999999997,"15min":1.0489999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.63},"min":{"1min":0.51000000000000001,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.0309999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68600000000000005,"15min":0.66500000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.38700000000000001},"max":{"1min":0.91000000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.68700000000000006},"min":{"1min":0.49399999999999999,"5min":0.45300000000000001,"15min":0.40300000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.71799999999999997,"15min":0.69499999999999995},"min":{"1min":0.53800000000000003,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77800000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.621,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.34300000000000003},"max":{"1min":0.94499999999999995,"5min":0.95699999999999996,"15min":1.1060000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.46700000000000003,"5min":0.39900000000000002,"15min":0.38400000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.038},"last":0.83899999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.36599999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.0820000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72899999999999998,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.39700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.1339999999999999},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96299999999999997,"5min":1.034,"15min":1.3080000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69399999999999995,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.552},"last":0.85399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:58:21.054 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T04:58:21.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.236+0000 7f24af7ff700 1 Processor -- start 2023-10-06T04:58:21.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.237+0000 7f24af7ff700 1 -- start start 2023-10-06T04:58:21.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.238+0000 7f24af7ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f24a81592b0 0x7f24a80b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.238+0000 7f24af7ff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f24a8159680 0x7f24a80cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.238+0000 7f24af7ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a815d620 con 0x7f24a815dab0 2023-10-06T04:58:21.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.238+0000 7f24af7ff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a815d0d0 con 0x7f24a8159680 2023-10-06T04:58:21.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.238+0000 7f24af7ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80b2ed0 con 0x7f24a81592b0 2023-10-06T04:58:21.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.238+0000 7f24add9c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f24a815dab0 0x7f24a80ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43782/0 (socket says 172.21.15.124:43782) 2023-10-06T04:58:21.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.238+0000 7f24add9c700 1 -- 172.21.15.124:0/2193282458 learned_addr learned my addr 172.21.15.124:0/2193282458 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:58:21.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.238+0000 7f24acd9a700 1 --2- 172.21.15.124:0/2193282458 >> v2:172.21.15.158:3300/0 conn(0x7f24a8159680 0x7f24a80cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.238+0000 7f24ad59b700 1 --2- 172.21.15.124:0/2193282458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f24a81592b0 0x7f24a80b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.238+0000 7f249ffff700 1 -- 172.21.15.124:0/2193282458 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857799929 0 0) 0x7f24a815d620 con 0x7f24a815dab0 2023-10-06T04:58:21.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.239+0000 7f249ffff700 1 -- 172.21.15.124:0/2193282458 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2494003570 con 0x7f24a815dab0 2023-10-06T04:58:21.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.239+0000 7f24acd9a700 1 -- 172.21.15.124:0/2193282458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f24a81592b0 msgr2=0x7f24a80b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:58:21.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.239+0000 7f24acd9a700 1 --2- 172.21.15.124:0/2193282458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f24a81592b0 0x7f24a80b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.239+0000 7f24acd9a700 1 -- 172.21.15.124:0/2193282458 >> v1:172.21.15.124:6789/0 conn(0x7f24a815dab0 legacy=0x7f24a80ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.239+0000 7f24acd9a700 1 -- 172.21.15.124:0/2193282458 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80b0760 con 0x7f24a8159680 2023-10-06T04:58:21.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.239+0000 7f24acd9a700 1 --2- 172.21.15.124:0/2193282458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24a8159680 0x7f24a80cc780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24980098e0 tx=0x7f24980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d8ae8651f137dcc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:21.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.239+0000 7f249ffff700 1 -- 172.21.15.124:0/2193282458 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498011630 con 0x7f24a8159680 2023-10-06T04:58:21.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.239+0000 7f249ffff700 1 -- 172.21.15.124:0/2193282458 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2498011790 con 0x7f24a8159680 2023-10-06T04:58:21.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.239+0000 7f249ffff700 1 -- 172.21.15.124:0/2193282458 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498011b30 con 0x7f24a8159680 2023-10-06T04:58:21.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.240+0000 7f24af7ff700 1 -- 172.21.15.124:0/2193282458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24a8159680 msgr2=0x7f24a80cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.240+0000 7f24af7ff700 1 --2- 172.21.15.124:0/2193282458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24a8159680 0x7f24a80cc780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24980098e0 tx=0x7f24980091a0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.240+0000 7f24af7ff700 1 -- 172.21.15.124:0/2193282458 shutdown_connections 2023-10-06T04:58:21.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.240+0000 7f24af7ff700 1 --2- 172.21.15.124:0/2193282458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f24a81592b0 0x7f24a80b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.240+0000 7f24af7ff700 1 --2- 172.21.15.124:0/2193282458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24a8159680 0x7f24a80cc780 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.240+0000 7f24af7ff700 1 -- 172.21.15.124:0/2193282458 >> 172.21.15.124:0/2193282458 conn(0x7f24a806ed20 msgr2=0x7f24a806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:58:21.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.240+0000 7f24af7ff700 1 -- 172.21.15.124:0/2193282458 shutdown_connections 2023-10-06T04:58:21.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.240+0000 7f24af7ff700 1 -- 172.21.15.124:0/2193282458 wait complete. 2023-10-06T04:58:21.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.241+0000 7f24af7ff700 1 Processor -- start 2023-10-06T04:58:21.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.241+0000 7f24af7ff700 1 -- start start 2023-10-06T04:58:21.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.242+0000 7f24af7ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24a81592b0 0x7f24a8156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.242+0000 7f24af7ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f24a8159680 0x7f24a80c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.242+0000 7f24af7ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24a815dab0 0x7f24a80c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.242+0000 7f24af7ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80ce910 con 0x7f24a815dab0 2023-10-06T04:58:21.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.242+0000 7f24af7ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80cf490 con 0x7f24a81592b0 2023-10-06T04:58:21.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.242+0000 7f24af7ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80c5140 con 0x7f24a8159680 2023-10-06T04:58:21.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24add9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24a815dab0 0x7f24a80c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24add9c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24a815dab0 0x7f24a80c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60714/0 (socket says 172.21.15.124:60714) 2023-10-06T04:58:21.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24add9c700 1 -- 172.21.15.124:0/3786722186 learned_addr learned my addr 172.21.15.124:0/3786722186 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:58:21.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24acd9a700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f24a8159680 0x7f24a80c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24ad59b700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24a81592b0 0x7f24a8156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24add9c700 1 -- 172.21.15.124:0/3786722186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f24a8159680 msgr2=0x7f24a80c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24add9c700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f24a8159680 0x7f24a80c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24add9c700 1 -- 172.21.15.124:0/3786722186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24a81592b0 msgr2=0x7f24a8156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24add9c700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24a81592b0 0x7f24a8156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24add9c700 1 -- 172.21.15.124:0/3786722186 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2498009420 con 0x7f24a815dab0 2023-10-06T04:58:21.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.243+0000 7f24add9c700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24a815dab0 0x7f24a80c62a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f24a0001460 tx=0x7f24a0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:21.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.244+0000 7f249d7fa700 1 -- 172.21.15.124:0/3786722186 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000a870 con 0x7f24a815dab0 2023-10-06T04:58:21.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.244+0000 7f249d7fa700 1 -- 172.21.15.124:0/3786722186 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000a9d0 con 0x7f24a815dab0 2023-10-06T04:58:21.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.244+0000 7f24af7ff700 1 -- 172.21.15.124:0/3786722186 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a8156ff0 con 0x7f24a815dab0 2023-10-06T04:58:21.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.244+0000 7f249d7fa700 1 -- 172.21.15.124:0/3786722186 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000ad50 con 0x7f24a815dab0 2023-10-06T04:58:21.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.244+0000 7f24af7ff700 1 -- 172.21.15.124:0/3786722186 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a80cee40 con 0x7f24a815dab0 2023-10-06T04:58:21.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.245+0000 7f24af7ff700 1 -- 172.21.15.124:0/3786722186 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a80cf600 con 0x7f24a815dab0 2023-10-06T04:58:21.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.246+0000 7f249d7fa700 1 -- 172.21.15.124:0/3786722186 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24a0007300 con 0x7f24a815dab0 2023-10-06T04:58:21.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.246+0000 7f249d7fa700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f248c066f30 0x7f248c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.246+0000 7f249d7fa700 1 -- 172.21.15.124:0/3786722186 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f24a00846d0 con 0x7f24a815dab0 2023-10-06T04:58:21.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.247+0000 7f24ad59b700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f248c066f30 0x7f248c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.247+0000 7f24ad59b700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f248c066f30 0x7f248c0693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f24a815c950 tx=0x7f24a40091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:21.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.251+0000 7f249d7fa700 1 -- 172.21.15.124:0/3786722186 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24a0051ac0 con 0x7f24a815dab0 2023-10-06T04:58:21.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.443+0000 7f24af7ff700 1 -- 172.21.15.124:0/3786722186 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f24a804c380 con 0x7f24a815dab0 2023-10-06T04:58:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.447+0000 7f249d7fa700 1 -- 172.21.15.124:0/3786722186 <== mon.0 v2:172.21.15.124:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f24a0051ac0 con 0x7f24a815dab0 2023-10-06T04:58:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.447+0000 7f249d7fa700 1 -- 172.21.15.124:0/3786722186 <== mon.0 v2:172.21.15.124:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f24a00550e0 con 0x7f24a815dab0 2023-10-06T04:58:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.450+0000 7f24af7ff700 1 -- 172.21.15.124:0/3786722186 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f248c066f30 msgr2=0x7f248c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.450+0000 7f24af7ff700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f248c066f30 0x7f248c0693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f24a815c950 tx=0x7f24a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.450+0000 7f24af7ff700 1 -- 172.21.15.124:0/3786722186 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24a815dab0 msgr2=0x7f24a80c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.450+0000 7f24af7ff700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24a815dab0 0x7f24a80c62a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f24a0001460 tx=0x7f24a0001a40 comp rx=0 tx=0).stop 2023-10-06T04:58:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.450+0000 7f24af7ff700 1 -- 172.21.15.124:0/3786722186 shutdown_connections 2023-10-06T04:58:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.450+0000 7f24af7ff700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24a815dab0 0x7f24a80c62a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.450+0000 7f24af7ff700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24a81592b0 0x7f24a8156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.450+0000 7f24af7ff700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7f248c066f30 0x7f248c0693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.450+0000 7f24af7ff700 1 --2- 172.21.15.124:0/3786722186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f24a8159680 0x7f24a80c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.450+0000 7f24af7ff700 1 -- 172.21.15.124:0/3786722186 >> 172.21.15.124:0/3786722186 conn(0x7f24a806ed20 msgr2=0x7f24a80b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:58:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.451+0000 7f24af7ff700 1 -- 172.21.15.124:0/3786722186 shutdown_connections 2023-10-06T04:58:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.451+0000 7f24af7ff700 1 -- 172.21.15.124:0/3786722186 wait complete. 2023-10-06T04:58:21.471 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:58:21.471 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:58:21.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.660+0000 7fcd62fff700 1 Processor -- start 2023-10-06T04:58:21.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.660+0000 7fcd62fff700 1 -- start start 2023-10-06T04:58:21.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.661+0000 7fcd62fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcd5c0cae80 0x7fcd5c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.662+0000 7fcd62fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c1598e0 0x7fcd5c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.662+0000 7fcd62fff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c0c1d10 con 0x7fcd5c0ccec0 2023-10-06T04:58:21.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.662+0000 7fcd62fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c0cd430 con 0x7fcd5c0cae80 2023-10-06T04:58:21.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.662+0000 7fcd62fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c0688a0 con 0x7fcd5c1598e0 2023-10-06T04:58:21.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.662+0000 7fcd60d9b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcd5c0cae80 0x7fcd5c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.662+0000 7fcd5bfff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fcd5c0ccec0 0x7fcd5c1591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.124:44044/0 (socket says 172.21.15.124:44044) 2023-10-06T04:58:21.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.662+0000 7fcd5bfff700 1 -- 172.21.15.124:0/4088503362 learned_addr learned my addr 172.21.15.124:0/4088503362 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-06T04:58:21.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.662+0000 7fcd6159c700 1 --2- 172.21.15.124:0/4088503362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c1598e0 0x7fcd5c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd5b7fe700 1 -- 172.21.15.124:0/4088503362 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565210506 0 0) 0x7fcd5c0c1d10 con 0x7fcd5c0ccec0 2023-10-06T04:58:21.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd5b7fe700 1 -- 172.21.15.124:0/4088503362 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd4c003570 con 0x7fcd5c0ccec0 2023-10-06T04:58:21.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd6159c700 1 -- 172.21.15.124:0/4088503362 >> v2:172.21.15.158:3300/0 conn(0x7fcd5c0cae80 msgr2=0x7fcd5c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:58:21.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd6159c700 1 --2- 172.21.15.124:0/4088503362 >> v2:172.21.15.158:3300/0 conn(0x7fcd5c0cae80 0x7fcd5c0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd6159c700 1 -- 172.21.15.124:0/4088503362 >> v1:172.21.15.158:6789/0 conn(0x7fcd5c0ccec0 legacy=0x7fcd5c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd6159c700 1 -- 172.21.15.124:0/4088503362 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c068b80 con 0x7fcd5c1598e0 2023-10-06T04:58:21.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd60d9b700 1 --2- 172.21.15.124:0/4088503362 >> v2:172.21.15.158:3300/0 conn(0x7fcd5c0cae80 0x7fcd5c0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:58:21.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd6159c700 1 --2- 172.21.15.124:0/4088503362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c1598e0 0x7fcd5c0afe40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009e60 tx=0x7fcd54009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6a204b31340b373 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:21.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd5b7fe700 1 -- 172.21.15.124:0/4088503362 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400e070 con 0x7fcd5c1598e0 2023-10-06T04:58:21.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd5b7fe700 1 -- 172.21.15.124:0/4088503362 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcd5400bab0 con 0x7fcd5c1598e0 2023-10-06T04:58:21.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.663+0000 7fcd5b7fe700 1 -- 172.21.15.124:0/4088503362 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400be90 con 0x7fcd5c1598e0 2023-10-06T04:58:21.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.664+0000 7fcd62fff700 1 -- 172.21.15.124:0/4088503362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c1598e0 msgr2=0x7fcd5c0afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.664+0000 7fcd62fff700 1 --2- 172.21.15.124:0/4088503362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c1598e0 0x7fcd5c0afe40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009e60 tx=0x7fcd54009780 comp rx=0 tx=0).stop 2023-10-06T04:58:21.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.664+0000 7fcd62fff700 1 -- 172.21.15.124:0/4088503362 shutdown_connections 2023-10-06T04:58:21.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.664+0000 7fcd62fff700 1 --2- 172.21.15.124:0/4088503362 >> v2:172.21.15.158:3300/0 conn(0x7fcd5c0cae80 0x7fcd5c0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.664+0000 7fcd62fff700 1 --2- 172.21.15.124:0/4088503362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c1598e0 0x7fcd5c0afe40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.664+0000 7fcd62fff700 1 -- 172.21.15.124:0/4088503362 >> 172.21.15.124:0/4088503362 conn(0x7fcd5c0974f0 msgr2=0x7fcd5c0639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:58:21.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.664+0000 7fcd62fff700 1 -- 172.21.15.124:0/4088503362 shutdown_connections 2023-10-06T04:58:21.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.664+0000 7fcd62fff700 1 -- 172.21.15.124:0/4088503362 wait complete. 2023-10-06T04:58:21.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.666+0000 7fcd62fff700 1 Processor -- start 2023-10-06T04:58:21.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.666+0000 7fcd62fff700 1 -- start start 2023-10-06T04:58:21.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd62fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c0cae80 0x7fcd5c1694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd62fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd5c0ccec0 0x7fcd5c098310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd62fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd5c1598e0 0x7fcd5c1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd62fff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c169a30 con 0x7fcd5c1598e0 2023-10-06T04:58:21.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd62fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c098850 con 0x7fcd5c0ccec0 2023-10-06T04:58:21.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd62fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c169c30 con 0x7fcd5c0cae80 2023-10-06T04:58:21.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd6159c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd5c1598e0 0x7fcd5c1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd6159c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd5c1598e0 0x7fcd5c1577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60726/0 (socket says 172.21.15.124:60726) 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd6159c700 1 -- 172.21.15.124:0/251395780 learned_addr learned my addr 172.21.15.124:0/251395780 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd60d9b700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c0cae80 0x7fcd5c1694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd5bfff700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd5c0ccec0 0x7fcd5c098310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd6159c700 1 -- 172.21.15.124:0/251395780 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c0cae80 msgr2=0x7fcd5c1694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd6159c700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c0cae80 0x7fcd5c1694f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.667+0000 7fcd6159c700 1 -- 172.21.15.124:0/251395780 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd5c0ccec0 msgr2=0x7fcd5c098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.668+0000 7fcd6159c700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd5c0ccec0 0x7fcd5c098310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.668+0000 7fcd6159c700 1 -- 172.21.15.124:0/251395780 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50009420 con 0x7fcd5c1598e0 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.668+0000 7fcd5bfff700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd5c0ccec0 0x7fcd5c098310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.668+0000 7fcd6159c700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd5c1598e0 0x7fcd5c1577a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400b610 tx=0x7fcd54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.668+0000 7fcd58ff9700 1 -- 172.21.15.124:0/251395780 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54012e60 con 0x7fcd5c1598e0 2023-10-06T04:58:21.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.668+0000 7fcd58ff9700 1 -- 172.21.15.124:0/251395780 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcd54027470 con 0x7fcd5c1598e0 2023-10-06T04:58:21.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.668+0000 7fcd58ff9700 1 -- 172.21.15.124:0/251395780 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54027850 con 0x7fcd5c1598e0 2023-10-06T04:58:21.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.668+0000 7fcd62fff700 1 -- 172.21.15.124:0/251395780 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd54009a20 con 0x7fcd5c1598e0 2023-10-06T04:58:21.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.668+0000 7fcd62fff700 1 -- 172.21.15.124:0/251395780 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c16a4d0 con 0x7fcd5c1598e0 2023-10-06T04:58:21.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.669+0000 7fcd62fff700 1 -- 172.21.15.124:0/251395780 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c16a030 con 0x7fcd5c1598e0 2023-10-06T04:58:21.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.670+0000 7fcd58ff9700 1 -- 172.21.15.124:0/251395780 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd54024070 con 0x7fcd5c1598e0 2023-10-06T04:58:21.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.671+0000 7fcd58ff9700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcd40066f30 0x7fcd400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:58:21.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.671+0000 7fcd58ff9700 1 -- 172.21.15.124:0/251395780 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fcd54086f30 con 0x7fcd5c1598e0 2023-10-06T04:58:21.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.671+0000 7fcd60d9b700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcd40066f30 0x7fcd400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:58:21.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.672+0000 7fcd60d9b700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcd40066f30 0x7fcd400693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c16ca10 tx=0x7fcd500091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:58:21.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.676+0000 7fcd58ff9700 1 -- 172.21.15.124:0/251395780 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd54054320 con 0x7fcd5c1598e0 2023-10-06T04:58:21.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.911+0000 7fcd62fff700 1 -- 172.21.15.124:0/251395780 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd5c068e60 con 0x7fcd5c1598e0 2023-10-06T04:58:21.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.911+0000 7fcd58ff9700 1 -- 172.21.15.124:0/251395780 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fcd5402cde0 con 0x7fcd5c1598e0 2023-10-06T04:58:21.914 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T04:58:21.914 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/267826992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6833","nonce":267826992},{"type":"v1","addr":"172.21.15.158:6835","nonce":267826992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/361532770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":361532770},{"type":"v1","addr":"172.21.15.124:6835","nonce":361532770}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1150240645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6836","nonce":1150240645},{"type":"v1","addr":"172.21.15.124:6837","nonce":1150240645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6834/1973804826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1973804826},{"type":"v1","addr":"172.21.15.158:6834","nonce":1973804826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-10-06T04:58:21.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.913+0000 7fcd62fff700 1 -- 172.21.15.124:0/251395780 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcd40066f30 msgr2=0x7fcd400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.913+0000 7fcd62fff700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcd40066f30 0x7fcd400693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c16ca10 tx=0x7fcd500091a0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.913+0000 7fcd62fff700 1 -- 172.21.15.124:0/251395780 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd5c1598e0 msgr2=0x7fcd5c1577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:58:21.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.913+0000 7fcd62fff700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd5c1598e0 0x7fcd5c1577a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400b610 tx=0x7fcd54009780 comp rx=0 tx=0).stop 2023-10-06T04:58:21.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.914+0000 7fcd62fff700 1 -- 172.21.15.124:0/251395780 shutdown_connections 2023-10-06T04:58:21.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.914+0000 7fcd62fff700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd5c1598e0 0x7fcd5c1577a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.914+0000 7fcd62fff700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.124:6832/114528,v1:172.21.15.124:6833/114528] conn(0x7fcd40066f30 0x7fcd400693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.914+0000 7fcd62fff700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5c0cae80 0x7fcd5c1694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.914+0000 7fcd62fff700 1 --2- 172.21.15.124:0/251395780 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd5c0ccec0 0x7fcd5c098310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:58:21.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.914+0000 7fcd62fff700 1 -- 172.21.15.124:0/251395780 >> 172.21.15.124:0/251395780 conn(0x7fcd5c0974f0 msgr2=0x7fcd5c0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:58:21.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.914+0000 7fcd62fff700 1 -- 172.21.15.124:0/251395780 shutdown_connections 2023-10-06T04:58:21.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06T04:58:21.914+0000 7fcd62fff700 1 -- 172.21.15.124:0/251395780 wait complete. 2023-10-06T04:58:21.917 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 27 2023-10-06T04:58:21.934 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T04:58:21.934 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T04:58:21.934 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:58:21.935 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:21.947 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:58:21.948 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:58:21.948 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.000 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:58:22.001 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:58:22.001 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.017 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:58:22.017 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:58:22.017 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.073 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:58:22.074 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T04:58:22.074 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T04:58:22.074 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.113 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T04:58:22.114 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T04:58:22.114 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.196 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T04:58:22.196 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T04:58:22.196 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.241 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T04:58:22.241 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T04:58:22.241 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.292 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T04:58:22.292 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T04:58:22.292 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.330 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T04:58:22.330 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T04:58:22.330 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.412 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T04:58:22.413 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T04:58:22.413 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.466 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T04:58:22.466 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T04:58:22.466 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.524 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T04:58:22.524 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T04:58:22.524 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T04:58:22.524 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.587 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T04:58:22.587 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T04:58:22.587 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.646 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T04:58:22.646 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T04:58:22.647 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T04:58:22.647 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.666 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T04:58:22.667 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T04:58:22.667 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.685 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T04:58:22.685 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T04:58:22.685 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:58:22.743 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T04:58:22.743 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T04:58:22.743 DEBUG:teuthology.orchestra.run.smithi124:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:58:22.822 INFO:teuthology.orchestra.run.smithi124.stdout:1696567468.1472008 mon.a (mon.0) 141 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:58:22.824 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T04:58:22.824 DEBUG:teuthology.orchestra.run.smithi124:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:58:22.904 DEBUG:teuthology.orchestra.run.smithi124:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:58:22.985 DEBUG:teuthology.orchestra.run.smithi124:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:58:23.064 INFO:teuthology.orchestra.run.smithi124.stdout:1696567468.1472008 mon.a (mon.0) 141 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:58:23.066 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:58:23.066 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T04:58:23.378 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:58:23.379 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T04:58:23.580 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:58:23.580 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T04:58:23.766 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:58:23.766 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T04:58:23.960 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:58:23.960 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T04:58:24.260 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:58:24.260 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T04:58:24.469 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:58:24.469 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T04:58:24.675 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:58:24.675 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T04:58:24.865 INFO:tasks.ceph:Archiving mon data... 2023-10-06T04:58:24.867 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280/data/mon.a.tgz 2023-10-06T04:58:24.867 DEBUG:teuthology.orchestra.run.smithi124:> mktemp 2023-10-06T04:58:24.918 INFO:teuthology.orchestra.run.smithi124.stdout:/tmp/tmp.GouDDKRB3l 2023-10-06T04:58:24.919 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GouDDKRB3l 2023-10-06T04:58:25.060 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0666 /tmp/tmp.GouDDKRB3l 2023-10-06T04:58:25.181 DEBUG:teuthology.orchestra.remote:smithi124:/tmp/tmp.GouDDKRB3l is 244KB 2023-10-06T04:58:25.278 DEBUG:teuthology.orchestra.run.smithi124:> rm -fr /tmp/tmp.GouDDKRB3l 2023-10-06T04:58:25.323 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280/data/mon.b.tgz 2023-10-06T04:58:25.323 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-10-06T04:58:25.370 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.TC5T7sV9Pg 2023-10-06T04:58:25.370 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TC5T7sV9Pg 2023-10-06T04:58:25.547 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.TC5T7sV9Pg 2023-10-06T04:58:25.666 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.TC5T7sV9Pg is 253KB 2023-10-06T04:58:25.764 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.TC5T7sV9Pg 2023-10-06T04:58:25.809 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280/data/mon.c.tgz 2023-10-06T04:58:25.809 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-10-06T04:58:25.893 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.VV6g70mILd 2023-10-06T04:58:25.894 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.VV6g70mILd 2023-10-06T04:58:26.057 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.VV6g70mILd 2023-10-06T04:58:26.176 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.VV6g70mILd is 253KB 2023-10-06T04:58:26.273 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.VV6g70mILd 2023-10-06T04:58:26.318 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T04:58:26.318 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:58:26.323 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:58:26.427 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T04:58:26.428 DEBUG:teuthology.orchestra.run.smithi124:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:58:26.434 DEBUG:teuthology.orchestra.run.smithi158:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:58:26.518 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:58:26.519 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:58:26.536 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T04:58:26.538 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280/remote/smithi124/crash 2023-10-06T04:58:26.541 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:58:26.611 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280/remote/smithi158/crash 2023-10-06T04:58:26.612 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:58:26.680 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T04:58:26.681 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:58:26.686 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:58:26.789 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:58:26.859 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:58:26.929 INFO:tasks.ceph:Compressing logs... 2023-10-06T04:58:26.929 DEBUG:teuthology.orchestra.run.smithi124:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:58:26.934 DEBUG:teuthology.orchestra.run.smithi158:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:58:31.904 INFO:tasks.ceph:Archiving logs... 2023-10-06T04:58:31.904 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280/remote/smithi124/log 2023-10-06T04:58:31.905 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:58:32.480 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280/remote/smithi158/log 2023-10-06T04:58:32.481 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:58:33.060 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T04:58:33.069 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T04:58:33.069 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:58:33.074 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:58:33.202 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T04:58:33.211 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T04:58:33.212 DEBUG:teuthology.orchestra.run.smithi124:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:58:33.216 DEBUG:teuthology.orchestra.run.smithi158:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:58:33.258 INFO:teuthology.orchestra.run.smithi124.stderr:bash: ntpq: command not found 2023-10-06T04:58:33.260 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-10-06T04:58:33.266 INFO:teuthology.orchestra.run.smithi124.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:58:33.266 INFO:teuthology.orchestra.run.smithi124.stdout:=============================================================================== 2023-10-06T04:58:33.266 INFO:teuthology.orchestra.run.smithi124.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 35 +368us[ +368us] +/- 77ms 2023-10-06T04:58:33.266 INFO:teuthology.orchestra.run.smithi124.stdout:^* hv02.front.sepia.ceph.com 3 7 377 99 -359us[ -356us] +/- 49ms 2023-10-06T04:58:33.266 INFO:teuthology.orchestra.run.smithi124.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +173us[ +173us] +/- 76ms 2023-10-06T04:58:33.266 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:58:33.268 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:58:33.268 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-10-06T04:58:33.268 INFO:teuthology.orchestra.run.smithi158.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 33 +385us[ +385us] +/- 78ms 2023-10-06T04:58:33.268 INFO:teuthology.orchestra.run.smithi158.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 -357us[ -347us] +/- 50ms 2023-10-06T04:58:33.268 INFO:teuthology.orchestra.run.smithi158.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +180us[ +180us] +/- 76ms 2023-10-06T04:58:33.268 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:58:33.269 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T04:58:33.279 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T04:58:33.279 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T04:58:33.288 DEBUG:teuthology.orchestra.run.smithi124:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:58:33.486 DEBUG:teuthology.orchestra.run.smithi158:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:58:33.650 DEBUG:teuthology.orchestra.run.smithi124:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:58:33.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:58:33.728 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:58:33.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:58:33.804 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T04:58:33.814 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T04:58:33.823 INFO:teuthology.task.internal:Duration was 1703.617832 seconds 2023-10-06T04:58:33.824 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T04:58:33.832 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T04:58:33.833 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:58:33.837 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:58:33.950 INFO:teuthology.orchestra.run.smithi124.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:58:33.954 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:58:34.293 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T04:58:34.293 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T04:58:34.293 DEBUG:teuthology.orchestra.run.smithi124:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:58:34.354 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T04:58:34.354 DEBUG:teuthology.orchestra.run.smithi158:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:58:34.417 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T04:58:34.417 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:58:34.421 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:58:34.505 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T04:58:34.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:58:34.509 DEBUG:teuthology.orchestra.run.smithi158:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:58:34.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T04:58:34.637 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T04:58:34.638 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:58:34.707 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:58:34.777 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T04:58:34.788 DEBUG:teuthology.orchestra.run.smithi124:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:58:34.792 DEBUG:teuthology.orchestra.run.smithi158:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:58:34.856 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = core 2023-10-06T04:58:34.861 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = core 2023-10-06T04:58:34.895 DEBUG:teuthology.orchestra.run.smithi124:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:58:34.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:58:34.940 DEBUG:teuthology.orchestra.run.smithi158:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:58:34.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:58:34.984 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T04:58:34.994 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T04:58:34.995 DEBUG:teuthology.misc:Transferring archived files from smithi124:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280/remote/smithi124 2023-10-06T04:58:34.995 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:58:35.077 DEBUG:teuthology.misc:Transferring archived files from smithi158:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280/remote/smithi158 2023-10-06T04:58:35.077 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:58:35.156 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T04:58:35.156 DEBUG:teuthology.orchestra.run.smithi124:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:58:35.161 DEBUG:teuthology.orchestra.run.smithi158:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:58:35.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T04:58:35.218 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T04:58:35.219 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T04:58:35.250 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T04:58:35.251 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:58:35.255 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:58:35.296 INFO:teuthology.orchestra.run.smithi124.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:58 /home/ubuntu/cephtest 2023-10-06T04:58:35.301 INFO:teuthology.orchestra.run.smithi158.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:58 /home/ubuntu/cephtest 2023-10-06T04:58:35.305 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T04:58:35.316 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T04:58:35.337 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T04:58:35.360 DEBUG:teuthology.nuke:shortname: smithi124 2023-10-06T04:58:35.360 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:58:35.380 DEBUG:teuthology.nuke:shortname: smithi158 2023-10-06T04:58:35.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:58:35.384 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:18:51.549170', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEAVo48XyyqF8WwhIz1EAN5JDzAT7TEbLY2hV1KnF9lHlHfXSpFsGEapl53q0wLw8jLEsJiEnpAsyZfCuQPoQ5s='} 2023-10-06T04:58:35.402 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:18:51.547670', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN0jY6eeKfnzMjCEO7OuloWVye6yPMWpc20GCQTKM8t6nbYP+PPIKt7THWED9cMoULky5wcnzIUcYy1evP1vkMo='} 2023-10-06T04:58:35.432 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-06T04:58:35.432 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:58:35.448 INFO:teuthology.orchestra.console.smithi158:Power off 2023-10-06T04:58:35.448 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:58:35.456 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-06T04:58:35.457 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:58:35.468 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-10-06T04:58:35.469 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:58:35.478 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-06T04:58:35.491 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-06T04:58:39.480 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:58:39.492 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:58:39.589 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-06T04:58:39.600 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-06T04:58:43.594 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:58:43.602 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:58:43.704 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-06T04:58:43.710 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-06T04:58:43.805 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-06T04:58:43.811 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-10-06T04:58:43.916 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} duration: 1703.6178324222565 failure_reason: '"1696567468.1472008 mon.a (mon.0) 141 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T04:58:43.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:58:43.986 INFO:teuthology.run:FAIL